Senior Data Engineer

Job purpose

The Data Engineer will play a critical role in building, optimizing, and maintaining robust data pipelines and designing meaningful data models within our Data Platform. These efforts will enable analysts to drive key business outcomes as part of our commitment to being a Data-Driven organization.

The ideal candidate will work with our cloud-based Big Data Platform to ingest and process structured and unstructured supply chain data from various microservices. This role involves designing and implementing strategic solutions to leverage business events for the finance module, enabling analytics, reporting, data visualization, and machine learning pipelines. These efforts will help develop data products, optimize supply chain operations, and address broader business needs.

Collaboration is key, as the Data Engineer will work closely with application teams and product managers  to ensure alignment with cross-functional teams and the broader business roadmap.

Duties and responsibilities

• Design and develop software and systems capable of extracting relevant business events from our supply chain applications and organizing it for retrieval in a large column-store oriented data warehouse
• Design and develop software and systems capable of extracting relevant data from the data warehouse into domain specific data marts.
• Develop systems that extract relevant business events from other support systems (Google Workspace, CRM, ecommerce, etc…) and integrate them into the data platform
• Design data model to store and manage all business events in the organization
• Design and develop aggregation datasets optimized for analytics and visualization
• Work closely with Business Intelligence analysts to provide them best-of-breed self-service tools that allow them to extract and transform these business events into business insights
• Coach and develop other engineers to foster the creation of a high performing team

Capabilities

• Bachelor Degree from Computer Engineering, Computer Science or related fields
• 2 years of experience in data engineering or related fields
• Strong knowledge in SQL, relational database design and efficient methods for working with large size of data
• Strong knowledge in Python
• Understanding of fundamental design principles behind data-oriented application
• Experience with PostgreSQL and Amazon Redshift
• Experience with big data ecosystems that allow for the reduction of large data processing time is a plus
• Experience with AWS platform is a plus
• Experience with data modeling allowing effective capture of business events is a plus
• Ability to pay attention to the detail in order to deliver high quality data
• Ability to understand business requirements and be able to express them in computer language
• Ability to communicate in English, both written and oral form