Lead Data Engineer

Job Title: Lead Data Engineer

Key Skills: DBT, Python, SQL, Snowflake, Databricks

Location: Brazil

Mode: Remote

We at Coforge are hiring Lead Data Engineer with the following skill set.

Key Responsibilities

• Lead and mentor a team of data engineers, setting technical direction, conducting code reviews, and promoting engineering excellence.
• Own the end-to-end architecture and design of the data platform, ensuring scalability, reliability, and alignment with business needs.
• Take full ownership of implementation delivery, from design through deployment, ensuring high-quality, production-ready solutions.
• Define and drive the data migration strategy from Snowflake / SSIS to Azure Databricks and DBT, including architecture decisions and execution oversight.
• Collaborate closely with cross-functional stakeholders (data, product, architecture, and business teams) to translate requirements into robust technical designs.
• Design and oversee the development of scalable data pipelines and data models, ensuring best practices in performance and maintainability.
• Lead the implementation of infrastructure-as-code using Terraform, enforcing consistency and automation across environments.
• Establish and enforce architectural standards, design patterns, and engineering best practices across the data ecosystem.
• Ensure reliable and efficient data integration between Legacy system and Azure environments, with strong focus on data quality and observability.
• Drive CI/CD adoption and oversee release processes for data pipelines and platform components.
• Act as the primary technical owner for troubleshooting complex issues and ensuring long-term stability of the platform.
• Maintain comprehensive documentation of architecture, design decisions, and implementation standards.

 

Required Skills & Qualifications

• Proven experience owning system design and leading implementations of large-scale data platforms.
• Strong hands-on expertise with Snowflake, Azure Databricks, and DBT with strong Python.
• Will have worked on large scale data transformations comprising of thousands of DBT models and data pipelines handling terabytes of data daily
• Deep understanding of data architecture, data modelling, and distributed data systems.
• Extensive experience with Terraform and infrastructure-as-code principles.
• Demonstrated experience leading cloud-to-cloud data migration projects (AWS to Azure preferred).
• Strong experience with CI/CD pipelines and Git-based version control.
• Advanced SQL skills and deep knowledge of ETL/ELT frameworks.
• Strong problem-solving skills with the ability to make architectural trade-offs and decisions.
• Excellent communication skills, with the ability to influence both technical and non-technical stakeholders.
• Ability to thrive in a fast-paced, ownership-driven environment.
• Previous experience in the insurance or financial sector industry, with strong understanding of core domains such as claims, policies, underwriting, and risk.
• Will have manged teams with a level of maturity and able to demonstrate key success outcomes with these teams.
• Will have managed low, mid and top performers within the team to get the best from them via mentoring, development and training needs where needed.

 

Preferred Skills:

• Experience implementing data governance, observability, and quality frameworks.
• Strong knowledge of security and compliance standards in insurance or financial services.
• Experience with real-time and streaming data technologies (Kafka, Event Hubs, Delta Live Tables).
• Familiarity with lakehouse architecture and cost/performance optimization strategies.
• Experience operating in multi-cloud or hybrid cloud environments.

Posted On: 14-07-2026

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.