Lead Data Engineer - Data Management

Company Overview

Accordion is a global financial consulting and technology firm helping CFOs and their teams drive value creation. Rooted in private equity rigor and powered by data, analytics, and AI, we partner with companies across industries to turn insight into impact.

Accordion works at the intersection of Private Equity sponsors and portfolio companies management teams across every stage of the investment lifecycle. We provide hands-on, execution-oriented support, driving value through the office of the CFO by building data and analytics capabilities and identifying and implementing strategic work, rooted in data and analytics and AI.

Accordion is headquartered in New York City with 10 offices worldwide, including the India office based out of Hyderabad. Join us and make your mark on our company.

Data & Analytics (Accordion | Data & Analytics)

Accordion's Data & Analytics (D&A) practice in India delivers cutting-edge, intelligent solutions to a global clientele. We bring together deep domain expertise, advanced technology, and AI-enabled analytics capabilities to solve some of the most complex and high-impact business challenges.

We partner with Private Equity clients and their Portfolio Companies across diverse sectors, including Retail, CPG, Healthcare, Media & Entertainment, Technology, and Logistics helping them unlock value, drive performance, and make smarter, faster decisions powered by data and AI-driven insights.

D&A team members deliver data and analytical solutions designed to streamline reporting capabilities and enhance business insights across vast and complex data sets ranging from Sales, Operations, Marketing, Pricing, Customer Strategies, and more.

Being part of Accordion India means joining a dynamic community of 800+ professionals across analytics, data science, finance, and technology. You’ll thrive in a high-growth, agile, and entrepreneurial environment where curiosity is encouraged, innovation is embraced, and emerging technologies like AI are actively shaping the way we work and deliver impact.

Join us and experience a better way to work!

Location: Hyderabad, Telangana

Role Overview:

The Lead Data Engineer at Accordion is responsible for architecting and maintaining modern, scalable data platforms that power analytics, AI, and decision-making across client organizations. This role demands deep expertise in cloud-native architectures including data lakes, lakehouses, and enterprise data warehouses, to deliver robust, cost-optimized solutions addressing both current and future client needs.

The Lead Data Engineer will take an AI-first approach to every engagement, leveraging AI tools to accelerate delivery, enhance productivity, and build data infrastructure that is architected to be AIready from the ground up. A successful candidate will possess strong business acumen, cloud platform expertise, and the ability to communicate effectively with cross-functional stakeholders to drive end-to-end solution delivery.

What You will do:

• Partner with client stakeholders to understand business challenges and translate them into data architecture requirements and actionable solution roadmaps.
• Lead the design of cloud-native data platform architectures, including data lakes, lakehouses (Delta Lake, Apache Iceberg), and modern data warehouses, recommending the right technology stack per engagement.
• Collaborate with business and technology teams to define KPIs, data models, and metrics frameworks aligned with client goals.
• Partner with Project Managers to develop and execute delivery plans ensuring high-quality output within agreed timelines.
• Evaluate and lead the implementation of modern data integration patterns: streaming pipelines, ELT/ETL orchestration, and real-time data processing.
• Design and lead the implementation of data infrastructure that is AI-ready by design: ensuring proper governance, lineage, and accessibility patterns that enable downstream AI and analytics consumption.
• Responsibly integrate/leverage AI tools (Claude, GitHub Copilot, Cortex, Genie, or similar) to accelerate pipeline development, code reviews, documentation, and solution delivery.
• Design, build and deploy MCP (Model Context Protocol) servers to expose data platform capabilities as tools consumable by AI agents and LLM powered workflows.
• Conduct technical design reviews, architecture assessments, training and knowledge transfer sessions for junior engineers.
• Stay at the forefront of emerging technologies, cloud platforms, AI tooling, and data ecosystem innovations to deliver forward-thinking solutions to clients.

Ideally, you have:

• An undergraduate degree (B.E/B.Tech.) from a tier-1 or tier-2 institution.
• 6–9 years of relevant experience in data engineering, data platform development, or cloud data architecture.
• Strong SQL proficiency is a must — query optimization, complex transformations, and data modeling across relational and columnar databases.
• Hands-on experience with at least two of: Microsoft Fabric, Azure Synapse Analytics, Databricks, Snowflake, Google BigQuery, or AWS Redshift.
• Experience designing data lake and lakehouse architectures using open table formats (Delta Lake, Apache Iceberg) on cloud storage (ADLS, S3, GCS).
• Proficiency in cloud-native orchestration tools: Azure Data Factory, Databricks Workflows, dbt, Apache Airflow, or equivalent.
• Hands-on experience building MCP (Model Context Protocol) servers to expose data assets and platform capabilities to AI agents and tools.
• A strong habit of responsibly integrating/leveraging AI tools (GitHub Copilot, Cursor, or similar) to improve delivery speed and code quality.
• Hands-on experience owning end-to-end DevOps practices, including designing and implementing CI/CD pipelines, to ensure robust, scalable, and repeatable deployment of data solutions across environments.
• Experience with streaming platforms (Apache Kafka, Azure Event Hubs, AWS Kinesis) is a strong plus.
• Working knowledge of BI tools (Power BI, Tableau, Looker) is a strong plus.
• Demonstrated ability to take initiative, drive innovation, and lead technical discussions with senior stakeholders.
• An analytical, AI-first, automation-forward problem-solving mindset.

Explore a Career at Accordion:

A Culture of Impact & Excellence

• A culture of merit & recognition: Thrive in a meritocratic, high-growth environment with semi-annual performance and promotion cycles.
• Multi - dimensional exposure: Navigate complex, high stakes workstreams across diverse industries and domains. At Accordion, you will engage with varied intellectual challenges —leveraging data and AI-enabled tools to uncover insights, solve problems faster, that keep your perspective sharp, and your curiosity fuelled.
• Entrepreneurial environment: Exercise the intellectual freedom to make definitive decisions and the autonomy to own their outcomes. We reward initiative, encouraging you to expand your influence and assume larger responsibilities.
• Collaborative vitality: Experience a non-bureaucratic, high-energy culture alongside high-calibre peers. Our environment is designed to challenge your thinking and accelerate your growth through shared expertise and collective ambition.

Our Commitment to Your Well-being

We believe that our collective success is rooted in the personal well-being and growth of our people. We have curated a suite of benefits designed to support you and your family’s health, celebrate your milestones, and empower your professional journey.

• Comprehensive health & security: We provide fully covered Health and Group Term Life Insurance for you, with health insurance coverage extending to your immediate family.
• Care on your terms: Access expert medical guidance through on-site health camps or our integrated tele-health services. This ecosystem includes free professional consultations alongside discounted healthcare services including dental and vision care.
• Integrated family support: We support working parents with a fully sponsored, premium on-site Day Care facility.
• Empowering leave structures: Our robust leave policy is an intentional commitment to work-life integration, featuring dedicated maternity and parental support designed to help new parents through life’s major transitions.
• A culture of recognition: We believe every breakthrough deserves an audience. Through our dedicated rewards platform, we pause to celebrate both your professional triumphs and your most meaningful personal milestones.
• Architecting your growth: Thrive in a positive & transparent environment designed for the continuous evolution of your craft. We provide the infrastructure - through learning programs and engagement initiatives - to bridge the gap between your personal aspirations and professional mastery.