Current openings at Mithril
We're building the omnicloud for AI
Mithril exists to make cloud compute more accessible, efficient, and powerful for AI developers.
Create a Job Alert
Level-up your career by having opportunities at Mithril sent directly to your inbox.
Featured Jobs
Software Engineer - Member of Technical Staff
About Mithril
Mithril is an AI infrastructure platform built to make GPU compute more accessible and affordable for the world’s leading enterprises, AI startups, and the AI research community, including LG AI Research, Saronic, and the Broad Institute (among many others).Founded by a former Google DeepMind research scientist and Stanford CS PhD, Mithril has raised $80M across seed and Series A funding led by Sequoia Capital & Lightspeed Venture Partners. Platform revenue has grown >6x over the past year, and we were recently recognized by Fast Company as the 8th Most Innovative Company in Artificial Intelligence for 2026.
We are at an inflection point: transitioning from bare-metal operations to a cloud-native, multi-provider platform with a differentiated auction and flexibility model. You would be joining at the moment the platform is being built, not inherited.
About the Opportunity
You will work across Mithril's three core engineering areas — Consumption (the developer-facing product, billing, and API surface), Platform (the orchestration and marketplace engine), and Supply (integrations with cloud providers and capacity management). You will own meaningful slices of each, shipping features end-to-end against a product that handles real revenue and business-critical customer workloads.
This is not a single-domain role. You'll move between backend systems, marketplace logic, and customer-facing surfaces — with direct exposure to the architectural decisions shaping how Mithril scales.
What Makes This Role Different
Most early-stage engineering roles at infrastructure companies are either deep in systems (little product surface) or deep in product (little systems exposure). At Mithril, you'll work across both: the orchestration engine that manages GPU capacity across providers, and the developer-facing surfaces that customers use to reserve, bid, and consume that capacity.
The systems you build will handle real money, real workloads, and real market dynamics — spot auctions, reservation pricing, and capacity allocation across a heterogeneous supply base. If you want to understand how GPU infrastructure markets actually work and build the systems that run them, this is that role.
Core Responsibilities
Backend & API
Build and maintain backend Python APIs powering Mithril's reservation, bidding, billing, and usage surfaces — including usage visualization and the billing platform.
Write and maintain database migrations, design relational schemas for complex multi-entity models (orders, allocations, grants, quotas), and optimize queries for performance.
Own features end-to-end: from design doc through backend API, database migration, feature flag rollout, and monitoring.
Platform & Marketplace
Design and implement orchestration primitives for flexible reservations: pause/return credits, reservation extensions, capacity algorithm updates, and the auction model connecting spot and reserved capacity.
Contribute to operational maturity — quota systems, financial controls, fraud prevention, and inventory management automation — so Mithril can scale supply sources without scaling headcount linearly.
Supply Integrations
Contribute to supply-side integrations, bringing GCP, Nebius, and OCI resources under Mithril management through the Mithril API.
Build tooling to give operators visibility into managed capacity and surface supply constraints early.
Consumption & Developer Tooling
Build consumption tooling to help developers make better decisions: reservation calculators, bid modeling, cost dashboards, and CLI extensions.
Work across the client frontend to ship customer-facing features including usage graphs, billing views, and reservation management UIs.
Operations
Participate in on-call rotations, triage production incidents, and contribute to operational runbooks and automation that reduce toil over time.
Requirements
The profile we're hiring for is a generalist with strong backend instincts — someone who has shipped and maintained production systems at real scale, and is comfortable owning features across the full stack when needed.
Strong Python backend skills — you've built and maintained production APIs at real scale, not just prototypes.
Proven experience with distributed systems; comfortable with messaging systems (RabbitMQ, Kafka) and RPC methods (gRPC, protobuf, tRPC).
Fluency with relational databases: schema design, query optimization, and migrations in production environments.
Ability to own a feature end-to-end — from design doc through backend API, database migration, feature flag rollout, and monitoring.
Strong debugging instincts: calm and systematic when triaging production incidents, with a bias toward durable fixes.
Comfortable in small teams where ownership is high and process is lightweight.
Nice to Have
Experience with marketplace and billing systems — especially variable-usage, auction-based, or complex reservation models.
Familiarity with Kubernetes, AWS infrastructure, or cloud provider APIs (GCP, OCI, Nebius).
Familiarity with Linux containers and container orchestration (Docker Swarm, Nomad).
Comfort working across the stack — Python backend and TypeScript/React frontend.
Experience with developer tools or CLIs (bonus: SkyPilot or similar frameworks).
Proficiency with infrastructure-as-code (Terraform, Kustomize) or observability tooling (Grafana, Prometheus).
Background in real-time systems: SSE, WebSockets, or event-driven architectures.
Prior experience at a startup where you wore multiple hats and shipped across domains.
Benefits
Health, dental, and vision coverage for you and your dependents
401k Plan with 4% company match
21 days of PTO & 14 company holidays; including 2 floating holidays
Salary Range Information
In consideration of market analysis and various pertinent factors, the remuneration bracket for this role is set between $170,000 and $230,000. Nevertheless, adjustments beyond this range could be warranted for candidates whose qualifications substantially deviate from those delineated in the job description.
In-Office Requirement
At Mithril, we take our work extremely seriously, though not always ourselves. We recognize that we are striving to achieve something substantial—an all-too-rare and elusive counterfactual contribution. Our work is not easy, so we seek out any lever that can accelerate our progress and increase the likelihood of realizing our full ambitions. Working collaboratively in person is one such lever.
Our headquarters is in Palo Alto (very near the Caltrain station) and we recently opened a second office in the Jackson Square area of San Francisco. We expect team members to primarily work from their local office (Palo Alto or SF), with everyone gathering at HQ a minimum one day a week while our team remains small and cross-collaboration is critical.
This approach is built on trust. We take our mission seriously and are committed to fostering an environment where you can make impactful decisions and drive success. We also understand that life can present challenges, and if extenuating circumstances arise, we’re here to support you.
Ultimately, we believe this guidance helps us be as effective as possible while maintaining the spirit of teamwork and flexibility.
Equal Opportunity Employer
Mithril maintains a strict commitment to Equal Opportunity employment practices. All applicants are evaluated without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law.
We emphasize that candidates need not fulfill every expectation listed to be eligible for this position. Our objective is to cultivate a diverse team encompassing a spectrum of backgrounds, experiences, and skill sets.
Site Reliability Engineer (SRE)
About Mithril
Mithril is an AI infrastructure platform built to make GPU compute more accessible and affordable for the world’s leading enterprises, AI startups, and the AI research community, including LG AI Research, Saronic, and the Broad Institute (among many others).Founded by a former Google DeepMind research scientist and Stanford CS PhD, Mithril has raised $80M across seed and Series A funding led by Sequoia Capital & Lightspeed Venture Partners. Platform revenue has grown >6x over the past year, and we were recently recognized by Fast Company as the 8th Most Innovative Company in Artificial Intelligence for 2026.
Our engineering team is lean and high-impact. This role is a core infrastructure hire that will shape how Mithril scales its platform across a heterogeneous, multi-cloud environment.
About the Opportunity
You will be a core contributor to the stability and performance of Mithril's global GPU orchestration platform. This is not a 'keep the lights on' role — you will build the automation, observability, and tooling that allows Mithril to coordinate advanced compute across multiple cloud providers at scale, ensuring customers have fast, reliable access to the infrastructure they need.
You will work directly with our founding team on high-impact infrastructure decisions — from SLO design to capacity orchestration — with clear visibility into the technical and commercial dynamics of the business.
What Makes This Role Different
Most SRE roles at this stage are primarily reactive — on-call, incident management, keeping services stable. At Mithril, you'll also be building infrastructure that directly shapes how our marketplace operates: how supply is sourced, allocated, and monitored across providers. The systems you build will have a direct line to customer experience and company revenue.
You'll have real ownership, a short feedback loop to leadership, and the opportunity to define how infrastructure engineering operates as the company scales.
Core Responsibilities
Platform reliability and infrastructure automation are the primary focus of this role (~70–75% of time).
Reliability & SLOs
Implement and own SLIs and SLOs across Mithril's API layer and internal orchestration services to ensure customer commitments are met.
Partner with Product and Platform teams to ensure new features are designed for operability, reliability, and performance from the start.
Participate in an on-call rotation; drive root cause analysis (RCA) for production incidents and implement durable fixes to prevent recurrence.
Observability & Monitoring
Build and maintain dashboards, alerts, and distributed tracing within Mithril's monitoring stack to provide high-granularity visibility into our multi-cloud infrastructure.
Own the tooling that surfaces supply-side signal — GPU availability, provider health, reservation fill rates — to both engineering and operations teams.
Infrastructure as Code & Automation
Develop and maintain Terraform/Pulumi modules and Kubernetes configurations to manage Mithril's growing multi-cloud provider footprint.
Write clean, maintainable Python (or Go) to automate repetitive operational tasks — from provider API reconciliation to automated health checks and capacity rebalancing.
Capacity Support
Assist in managing GPU capacity across providers, ensuring the marketplace can dynamically respond to supply fluctuations and customer demand signals.
Surface capacity constraints and failure modes early; contribute to the tooling that enables Mithril to make fast, data-driven supply decisions.
Requirements
The profile we're hiring for combines strong systems instincts with the ability to build and own tooling end-to-end. Candidates should be able to point to infrastructure or automation they've built that is still running in production.
3+ years of experience in SRE, Production Engineering, or Infrastructure roles at a high-growth technology company.
Hands-on Kubernetes experience: comfortable managing clusters, deployments, and troubleshooting production incidents in a multi-tenant environment.
Cloud proficiency in at least one major provider (AWS, GCP, or Azure), including practical understanding of cloud networking fundamentals (VPC, DNS, load balancing, security groups).
Coding ability: proficiency in Python or equivalent (Go, Rust, etc.) — you build tools and services, not just scripts. Willing to pick up new languages as needed.
Linux fundamentals: strong command of Linux systems, TCP/IP networking, and security best practices.
Disciplined troubleshooter: calm under pressure during production incidents, with a rigorous approach to RCA and long-term remediation.
Clear communicator: able to document processes and explain technical trade-offs to engineering and non-engineering teammates.
Nice to Have
Experience with GPU/TPU-accelerated workloads or AI/ML infrastructure.
Exposure to multi-cloud deployments or niche/specialized cloud providers (e.g., CoreWeave, Lambda Labs, Nebius).
Familiarity with distributed systems concepts — service discovery, circuit breakers, consensus protocols.
Production experience with Prometheus, Grafana, or OpenTelemetry.
Prior experience in a high-growth startup environment where infrastructure scope expands faster than headcount.
Benefits
Health, dental, and vision coverage for you and your dependents
401k Plan with 4% company match
21 days of PTO & 14 company holidays; including 2 floating holidays
Salary Range Information
In consideration of market analysis and various pertinent factors, the remuneration bracket for this role is set between $170,000 and $230,000. Nevertheless, adjustments beyond this range could be warranted for candidates whose qualifications substantially deviate from those delineated in the job description.
In-Office Requirement
At Mithril, we take our work extremely seriously, though not always ourselves. We recognize that we are striving to achieve something substantial—an all-too-rare and elusive counterfactual contribution. Our work is not easy, so we seek out any lever that can accelerate our progress and increase the likelihood of realizing our full ambitions. Working collaboratively in person is one such lever.
Our headquarters is in Palo Alto (very near the Caltrain station) and we recently opened a second office in the Jackson Square area of San Francisco. We expect team members to primarily work from their local office (Palo Alto or SF), with everyone gathering at HQ a minimum one day a week while our team remains small and cross-collaboration is critical.
This approach is built on trust. We take our mission seriously and are committed to fostering an environment where you can make impactful decisions and drive success. We also understand that life can present challenges, and if extenuating circumstances arise, we’re here to support you.
Ultimately, we believe this guidance helps us be as effective as possible while maintaining the spirit of teamwork and flexibility.
Equal Opportunity Employer
Mithril maintains a strict commitment to Equal Opportunity employment practices. All applicants are evaluated without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law.
We emphasize that candidates need not fulfill every expectation listed to be eligible for this position. Our objective is to cultivate a diverse team encompassing a spectrum of backgrounds, experiences, and skill sets.
