Lead Data Engineer

Job Title: Lead Data Engineer
Key Skills: Azure Databricks, DBT, Snowflake, Python, Terraform, Data Architecture
Experience: 8+ YOE.
Location: Costa Rica, Peru, Colombia, and Bolivia.
Mode: Remote.

We at Coforge are hiring Lead Data Engineer (#22145) with the following skill set.

Key Responsibilities
· Lead and mentor a team of Data Engineers, driving technical excellence, code quality, and engineering best practices.
· Own the end-to-end architecture and design of the data platform, ensuring scalability, reliability, and alignment with business objectives.
· Take full ownership of solution delivery, from architecture and design to deployment and production support.
· Define and drive data migration strategies from Snowflake and SSIS to Azure Databricks and DBT.
· Design and oversee the implementation of scalable data pipelines, data models, and enterprise data solutions.
· Lead Infrastructure as Code initiatives using Terraform to ensure consistency, automation, and scalability across environments.
· Establish architectural standards, design patterns, and governance practices across the data ecosystem.
· Ensure reliable and efficient integration between legacy platforms and Azure-based environments.
· Drive CI/CD adoption and oversee release management processes for data platforms and pipelines.
· Act as the primary technical escalation point for complex issues and long-term platform stability.
· Collaborate closely with product, architecture, business, and engineering stakeholders to deliver enterprise-grade solutions.
· Maintain architecture documentation, design standards, and implementation guidelines.

Required Skills & Qualifications
· 8+ years of experience in Data Engineering, including 2-3+ years in a Lead or Staff-level role.
· Proven experience leading the design and implementation of large-scale enterprise data platforms.
· Strong hands-on expertise with Azure Databricks, DBT, Snowflake, Python, and SQL.
· Experience delivering large-scale data transformation programs involving thousands of DBT models and data pipelines processing terabytes of data daily.
· Deep understanding of data architecture, data modeling, ETL/ELT frameworks, and distributed data systems.
· Extensive experience with Terraform and Infrastructure as Code (IaC) principles.
· Experience leading cloud migration initiatives, preferably from AWS to Azure.
· Strong experience with Git-based version control and CI/CD pipelines.
· Strong analytical and problem-solving skills with the ability to make architectural decisions and trade-offs.
· Excellent communication and stakeholder management skills.
· Experience working in insurance or financial services environments, including domains such as claims, underwriting, policies, and risk management.
· Experience leading engineering teams and demonstrating measurable delivery success.
· Experience managing and mentoring team members across different performance levels, driving growth, development, and continuous improvement.

Preferred Skills
· Experience implementing data governance, observability, and data quality frameworks.
· Strong understanding of security and compliance standards within insurance or financial services organizations.
· Experience working with real-time and streaming technologies such as Kafka, Event Hubs, or Delta Live Tables.
· Familiarity with Lakehouse architectures and cloud cost/performance optimization strategies.
· Experience operating in hybrid cloud or multi-cloud environments.

Posted On: 14-08-2026

At Coforge, we hire professionals based solely on their skills and qualifications and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.