Lead Engineer - Data

dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First.

Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail – one of the world’s most competitive markets, with a deluge of multi-dimensional data – dunnhumby today enables businesses all over the world, across industries, to be Customer First.

dunnhumby employs nearly 2,500 experts in offices throughout Europe, Asia, Africa, and the Americas working for transformative, iconic brands such as Tesco, Coca-Cola, Meijer, Procter & Gamble and Metro.

Job Responsibilities:

• Lead the design and development of PnP data ingestion product (datahub).
• Assist and mentor team members to perform their activities efficiently.
• Perform requirement understanding, generalize it, and convert it to development plan.
• Champion spark/scala design principles.
• Participate in design discussions, and code reviews.
• Build solutions which are efficient and can scale over huge data volumes in a reasonable timeframe.
• Act as a subject matter expert for focus areas across the technology space.
• Help identifying the dependencies, risks, and bottlenecks in the projects proactively. Work actively with the Engineering Manager to resolve them.

Required Skills:

• 10+ years of experience in distributed computing (spark) and software development.
• 6+ years of experience in spark-scala.
• 10+ years of experience in Data Engineering.
• 8+ years of experience in Python.
• Fluency in working with databases (preferably Postgre).
• Have sound understanding of Object Oriented Programming and development principles.
• Experience working in an Agile Scrum or Kanban development environment.
• Experience working with version control software (preferably Git).
• Experience with CI/CD pipelines.

What you can expect from us

We won’t just meet your expectations. We’ll defy them. So you’ll enjoy the comprehensive rewards package you’d expect from a leading technology company. But also, a degree of personal flexibility you might not expect.  Plus, thoughtful perks, like flexible working hours and your birthday off.

You’ll also benefit from an investment in cutting-edge technology that reflects our global ambition. But with a nimble, small-business feel that gives you the freedom to play, experiment and learn.

And we don’t just talk about diversity and inclusion. We live it every day – with thriving networks including dh Gender Equality Network, dh Proud, dh Family, dh One and dh Thrive as the living proof. Everyone’s invited.

Our approach to Flexible Working

At dunnhumby, we value and respect difference and are committed to building an inclusive culture by creating an environment where you can balance a successful career with your commitments and interests outside of work.

We believe that you will do your best at work if you have a work / life balance. Some roles lend themselves to flexible options more than others, so if this is important to you please raise this with your recruiter, as we are open to discussing agile working opportunities during the hiring process.

For further information about how we collect and use your personal information please see our Privacy Notice which can be found (here)