Data Engineer

Data Engineer– Full time – Contract – 9 months

Computer Generated Solutions – Saint John, NB

Corporate Profile:

We provide custom learning solutions, channel partner enablement services and applications development. Since 1984, CGS has been delivering expert, cross-industry solutions across multiple platforms. To learn more about us, visit www.cgsinc.com

Job Description:

We are seeking a skilled and experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines, as well as optimizing data workflows for efficient data migration and management. Your expertise in data migration tools such as Snowflake and DBT will be essential in ensuring the seamless transfer of data across various platforms and systems. Fivetran experience would be considered an asset.

Responsibilities:

• Design, develop, and maintain data pipelines for efficient data ingestion, transformation, and loading (ETL) processes.
• Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs.
• Utilize your expertise in data migration tools, including Starburst, Snowflake, and Informatica, to facilitate smooth data migration across platforms.
• Optimize data workflows to improve performance, reliability, and scalability.
• Ensure data quality and integrity throughout the migration process by implementing robust validation and error-handling mechanisms.
• Develop and maintain documentation for data migration processes, including technical specifications, data mappings, and data lineage.
• Stay updated on emerging technologies and best practices in data engineering and make recommendations for process improvements and tool enhancements.
• Provide technical support and troubleshooting assistance to resolve data migration issues and ensure timely delivery of data deliverables.
• Collaborate with data architects, analysts, and other stakeholders to understand data models and translate business requirements into technical solutions.
• Participate in code reviews, knowledge sharing sessions, and continuous learning activities to foster a culture of collaboration and innovation.

Requirements:

• Bachelor’s degree in computer science, Engineering, or a related field; or equivalent work experience.
• Proven experience in data engineering, with a focus on data migration, ETL processes, and data warehousing.
• Strong proficiency in data migration tools such as Starburst, Snowflake, and Informatica.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Proficiency in programming languages such as Python, SQL, or Java.
• Solid understanding of database technologies, data modeling principles, and data governance best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills, with the ability to work effectively in a team environment.
• Experience with Agile methodologies and DevOps practices is a plus.
• Relevant certifications in data engineering or cloud computing (e.g., AWS Certified Solutions Architect, Snowflake Certified Professional) are preferred but not required.