Back to jobs

Head of Data Engineering

London, Greater London, England, United Kingdom

Pantheon has been at the forefront of private markets investing for more than 40 years, earning a reputation for providing innovative solutions covering the full lifecycle of investments, from primary fund commitments to co-investments and secondary purchases, across private equity, real assets and private credit.

We have partnered with more than 650 clients, including institutional investors of all sizes as well as a growing number of private wealth advisers and investors, with approximately $65bn in discretionary assets under management (as of December 31, 2023).

Leveraging our specialized experience and global team of professionals across Europe, the Americas and Asia, we invest with purpose and lead with expertise to build secure financial futures.

For further details please visit www.pantheon.com

Purpose of Position:

The Head of Data Engineering will lead the development and evolution of the Pantheon Data Platform, establishing it as the core enabler of analytics and insight across the firm. This role focuses on the design, implementation, and optimization of robust, scalable data infrastructure—including data pipelines, data lakes, and integration frameworks—that power the firm’s decision-making capabilities. The successful candidate will ensure the platform delivers high-quality, timely, and accessible data to internal stakeholders, enabling self-service analytics and driving operational and investment excellence.

Key Responsibilities: 

  • Partner with leaders from Technology, Transformation Office, Investment Team & Portfolio Management and Investor Relations groups to refine and execute on the firm’s data engineering strategy.
  • Stay updated on private markets industry trends, regulatory needs, software vendor offerings, and investment team feedback to guide product decisions and maintain Pantheon’s competitive edge.
  • Align our data strategy with firm priorities, establish the data sources, identify the tools needed, and oversee data governance and quality standards.
  • Enhance the existing Pantheon Data Platform, including data lake, data pipelines and reporting infrastructure.
  • Partner with the Change Office to deliver & enhance Pantheon’s data & analytics product (“Prism”) as required by strategic transformation & change initiatives or by projects initiated within the Pantheon Innovation Lab.
  • Champion a user-centric approach to data pipelines and scalable data platforms, focusing on usability, intuitiveness, and overall user satisfaction.
  • Establish relevant KPIs that measure the outcomes and impacts of our various data initiatives. Conduct regular monitoring and usage to validate and improve existing solutions, and deliver outcome-oriented impact analysis to stakeholders and leadership team.
  • Manage the data team, which may include data analysts, data engineers, and related data professionals.
  • Provide leadership, mentorship, and professional development opportunities for team members, fostering a culture of innovation and continuous improvement.
  • Spearhead the deployment and operationalization of Azure Databricks and lakehouse architecture for scalable data processing.
  • Build and nurture a community of data platform users across teams to foster adoption and data-driven decision making.
  • Establish and manage end-to-end data engineering practices for acquiring, processing, and delivering structured and unstructured data.

Knowledge & Experience Required:

  • Bachelor’s degree in Engineering, Technology, Data Science or a related field; an advanced degree is preferred
  • Track record of working with and organizing data within financial services, asset management, private markets
  • Crucial to have experience in deploying, managing and optimising Azure Databricks environments, with metadata management principles, and data governance best practices
  • Strong experience managing work requests using the Scrum framework and utilising Azure DevOps to facilitate that work.
  • Proficient in programming languages, such as Python, R, or SQL; frameworks, such as Teraform, PySpark, Spark and analytics tools such as Azure Synapse, and reporting platforms such as PowerBI & Tableau
  • Proficiency in managing processes involving acquiring, storing, processing and delivering structured and unstructured data for analytical applications
  • Demonstrated expertise in data governance, data quality management, and the implementation of analytics platforms. Ideally utilising the Unity Catalog functionality in Azure Databricks.
  • Strong experience in managing and developing high-performing teams, with the ability to inspire and drive cross-functional collaboration. Experience leading and developing globally distributed internal teams
  • Strong analytical and strategic thinking skills, with a focus on translating data into actionable business insights
  • Strong problem-solving skills, attention to detail, and an ability to navigate complex data processes and organizations
  • Excellent communication and interpersonal skills, with the ability to engage and influence stakeholders at all levels of the organization
  • Experience with change management and leading digital transformation initiatives within an organization
  • Experience in leading cross-functional initiatives, with strong communication skills, project management abilities, and organizational skills
  • Comfort with industry leading private markets software products (e.g. pipeline management, portfolio company monitoring, investment book of record, portfolio construction, planning & reporting etc.). eFront experience is a plus.
  • Experience using industry standard product management tools and technologies, e.g. Aha, Miro & Visio

This job description is not to be construed as an exhaustive statement of duties, responsibilities, or requirements. You may be required to perform other job-related duties as reasonably requested by your manager.

Pantheon is an Equal Opportunities employer, we are committed to building a diverse and inclusive workforce so if you're excited about this role but your past experience doesn't perfectly align we'd still encourage you to apply.

 

 

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Education

Select...
Select...
Select...

Including last and expected bonus, and any other important to mention benefits

Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Pantheon Ventures Careers’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...

Voluntary Self-Identification of Disability

Form CC-305
Page 1 of 1
OMB Control Number 1250-0005
Expires 04/30/2026

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury
Select...

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.