
Infrastructure Engineer
About Arize
AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize AX unifies build, test, and run in a single workspace—so teams can ship faster with confidence.
We’re a Series C company backed by top-tier investors, with over $135M in funding and a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like Booking.com, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.
The Opportunity
You will focus on designing, building, and scaling the infrastructure that powers Arize’s platform services. You will work directly with our open-source team to ensure Arize Phoenix’s robustness, scalability, and accessibility for developers worldwide. This is a unique opportunity to contribute to foundational infrastructure that will shape the way organizations observe and evaluate AI systems.
About Arize Phoenix
Large Language Models (LLMs) like GPT4 are capable of human and super-human reasoning, but they don’t understand your personal data, are unable to perform complex tasks, remember the actions they performed yesterday, and so on. The core mission of the Arize OSS team is to enable developers to build LLM-powered applications with safety and observability in mind.
We are at the forefront of a new way to build software. Doing this successfully will usher in a new age of knowledge automation and completely redefine the modern tech stack.
Our product offerings consist of an open-source Typescript library as well as an enterprise platform. Arize Phoenix has hundreds of thousands monthly downloads and is used from large enterprises to early-stage startups - it is both easy to get started but robust for production use.
What You’ll Work On
- Collaborate with internal teams and the open-source community to architect and scale infrastructure that supports Arize Phoenix’s growth.
- Enable and enhance Phoenix’s SaaS capabilities by building out features such as central authentication, data retention, and capacity scaling.
- Build out a robust set of infrastructure tools and services that alleviates the operations across the suite of Arize's product offering.
What Will Set You Apart
- 3+ years of experience building scalable infrastructure and developer tools, ideally in an open-source context.
- Strong understanding of the open-source development lifecycle and community dynamics.
- Expertise in Kubernetes, Terraform, and other modern infrastructure tools.
- Familiarity with build tools like Bazel and CI/CD systems.
- A pragmatic approach to solving problems and prioritizing impactful solutions over trends.
- Experience working with AI frameworks, LLM integrations, or observability platforms is a plus.
- Familiarity with Go, Python, and some TypeScript is a plus.
Location:
The estimated annual salary and variable compensation for this role is between $125,000 - $225,000, plus a competitive equity package. Actual compensation is determined based upon a variety of job related factors that may include: transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefit package, including: medical, dental, vision, 401(k) plan, unlimited paid time off, generous parental leave plan, and others for mental and wellness support.
While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.
More About Arize
Arize’s mission is to make the world’s AI work—and work for people.
Our founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge—understanding whether AI is performing and how to improve it at scale.
Learn more about what we're doing here:
https://techcrunch.com/2025/02/20/arize-ai-hopes-it-has-first-mover-advantage-in-ai-observability/
Diversity & Inclusion @ Arize
Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture
- Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI
- Culturally conscious events such as LGBTQ trivia during pride month
- We have an active Lady Arizers subgroup
Create a Job Alert
Interested in building your career at Arize AI? Get future opportunities sent straight to your email.
Apply for this job
*
indicates a required field