Back to jobs

AI Tech Lead, San Francisco Bay Area

Palo Alto, California, United States

AI Tech Lead, San Francisco Bay Area

About Us

Acryl Data is the company behind DataHub, the leading open-source metadata platform. Originally developed at LinkedIn, DataHub has grown into the largest open-source metadata community with over 12,000 data practitioners and deployments across 3,000+ organizations worldwide.

Through our flagship product DataHub Cloud, we provide enterprise-grade data catalog and observability solutions that enable seamless data discovery, robust data observability, and federated governance across organizations' entire data ecosystem. Our customers range from innovative startups to Fortune 10 companies, all benefiting from our expertise in bringing clarity and control to complex data environments.

Founded by the original creators of LinkedIn DataHub and Airbnb Dataportal, and backed by top-tier venture capital firms, Acryl Data combines deep technical expertise with a proven track record in building industry-leading data platforms.

Role Overview

We're seeking an experienced AI Technical Lead to spearhead our AI initiatives within DataHub, focusing on intelligent metadata management and shaping our AI infrastructure strategy. This role combines hands-on technical leadership in implementing AI-powered features with strategic thinking about how enterprises deploy and manage AI systems at scale. You'll work at the intersection of data catalog systems and modern AI infrastructure, helping organizations navigate the complexities of enterprise AI deployment while ensuring robust governance and efficiency.

 

Key Responsibilities

AI Features & Implementation

 

  • Lead the technical implementation of AI-powered features in DataHub, including automated data classification, PII detection, and sensitive data identification
  • Architect and implement scalable ML pipelines for continuous learning and model updates
  • Design and implement systems for model monitoring, validation, and performance tracking
  • Guide the team in implementing privacy-preserving ML techniques and ensuring compliance with data protection standards

 

AI Infrastructure Strategy

 

  • Shape the metadata framework needed to support enterprise AI systems, including model cards, lineage tracking, and deployment metadata
  • Define standards for capturing and managing AI-related metadata, including training data versioning, model provenance, and deployment configurations
  • Design systems to track and manage AI assets across the development lifecycle
  • Develop best practices for AI observability and governance in enterprise settings

 

Technical Leadership

 

  • Lead architectural decisions for AI systems integration within DataHub
  • Mentor team members on ML engineering best practices and AI system design
  • Collaborate with product management to define AI feature roadmap
  • Work with customers to understand their AI infrastructure needs and challenges

 

Required Qualifications

 

  • 8+ years of software engineering experience, with at least 4 years focused on ML/AI systems
  • Strong experience with modern ML frameworks (PyTorch, TensorFlow) and MLOps tools
  • Deep understanding of LLM deployment, fine-tuning, and operational considerations
  • Experience with AI governance, including model monitoring, bias detection, and fairness metrics
  • Strong background in data privacy and security, particularly in AI contexts
  • Experience with enterprise AI deployment and infrastructure management
  • Proficiency in Python and modern AI development tools
  • Understanding of vector databases, embedding systems, and semantic search
  • Experience with distributed systems and scalable architecture



Preferred Qualifications

 

  • Experience working with DataHub is a huge plus!
  • Experience building AI-powered features in enterprise SaaS products
  • Background in data catalog or metadata management systems
  • Familiarity with AI governance frameworks and standards
  • Experience with AI infrastructure cost optimization
  • Knowledge of regulatory requirements around AI systems
  • Track record of building production ML systems

 

Essential Knowledge Areas

Deep understanding of enterprise AI infrastructure components

  • Model serving platforms
  • Vector databases
  • Training infrastructure
  • Feature stores
  • Model monitoring systems
  • AI governance tools

Familiarity with key considerations for enterprise AI deployment

  • Cost optimization strategies
  • Security requirements
  • Compliance considerations
  • Performance monitoring
  • Resource management
  • Model versioning and rollback strategies

If you're passionate about technology, enjoy working with customers, and want to be part of a fast-growing company changing the industry, we want to hear from you!

How we work

Remote first. We're a fully-distributed company, and our interaction culture is deliberately mixed between meeting culture and written. We're writing heavily because it forces clarity of thought; we have plenty of synchronous time to give space for collaborative ideation.

At Acryl Data, representation matters – for us to build the best, most inclusive, accessible product for our community members, our work and team must reflect the lived experiences, unique perspectives, and communities around us. We are proud to be an equal opportunity workplace.

Benefits

  • Salary Range: $235,000 to $300,000
  • Equity
  • 99% coverage of medical, dental and vision insurance for US Employees
  • Carrot Fertility and Family Planning 
  • Remote friendly
  • Monthly co-working salary
  • One-time home office budget

This is a hybrid role with the expectation the employee will travel to the office a few times a week during the first few months of employment, and will continue to come to the office in Palo Alto on a regular basis.

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf

Education

Select...
Select...
Select...
Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Acryl Data’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...

Voluntary Self-Identification of Disability

Form CC-305
Page 1 of 1
OMB Control Number 1250-0005
Expires 04/30/2026

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury
Select...

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.