Back to jobs

Infrastructure Security Lead

San Francisco

About Together AI

Together AI is a research-driven AI infrastructure company building the go-to platform for developers to run, fine-tune, and build on open models. We believe open and transparent AI systems drive innovation and create the best outcomes for society, and we're on a mission to dramatically lower the cost of modern AI systems. Our team has helped ship foundational open-source research like FlashAttention, FlexGen, and RedPajama — and we're building the next generation of AI infrastructure.

About the Role

We're looking for a hands-on security leader to own infrastructure security.

You'll be the technical owner of how we keep our systems secure, building internal security tooling, deepening our detection and telemetry, and hardening our global infrastructure against threats that range from opportunistic attackers to sophisticated nation-state actors. 

You'll report directly to our SVP of Engineering and help define infrastructure security. Over time, you'll grow the team, set the standards, and increasingly shape how we secure the systems at the heart of modern AI: training clusters, GPU fleets, model artifacts, and inference. 

Responsibilities

  • Own infrastructure security for Together AI's globally distributed systems — hands-on, as the technical leader of the function.
  • Build and lead the infrastructure security team, defining what great looks like and attracting engineers who want to build with you.
  • Partner with engineering and infrastructure teams to harden global systems — shipping security as something that speeds engineering up, not slows it down.
  • Develop and implement internal security tooling that addresses security challenges at scale.
  • Deepen our security telemetry and detection — gathering system telemetry and improving detection of and response to potential security events.
  • Identify and remediate vulnerabilities across our engineering systems, including authenticated vulnerability scanning of distributed systems.
  • Grow into securing the AI-specific surface — training clusters, GPU fleets, model artifacts, and inference endpoints — as the threat landscape evolves.

Requirements

  • Hands-on security leadership — you can lead a team and stay deep in the technical work. You lead by building, not just by delegating.
  • Strong systems and cloud-native software engineering experience, with deep proficiency in Linux configuration, security, and administration.
  • Fluency with automation and infrastructure-as-code (Terraform, Ansible, and/or Salt) to solve security problems at scale.
  • A pragmatic security instinct — you treat security as an enabler, make sound risk calls, and help the team ship safely and fast rather than piling on friction.
  • Experience with security telemetry and detection (e.g. OSQuery, Falco, SIEM) and with finding and fixing vulnerabilities in distributed systems.
  • Curiosity about how AI changes the security landscape — you don't need to be an AI-security expert today, but you're the kind of engineer who becomes one.
  • Bonus: Go or Rust development, cloud-native service experience (AWS, GCP), deep Linux/networking fundamentals, OCP familiarity (OpenBMC, Coreboot, Linuxboot), or a public security-practitioner footprint (talks, OSS, writing).

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200k - 300k+ equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

Create a Job Alert

Interested in building your career at Together AI? Get future opportunities sent straight to your email.

Apply for this job

*

indicates a required field

Resume/CV

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf

Select...

U.S. Standard Demographic Questions

We invite applicants to share their demographic background. If you choose to complete this survey, your responses may be used to identify areas of improvement in our hiring process.
Select...
Select...
Select...
Select...
Select...
Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Together AI’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...