Director, AI Infrastructure
Who We Are
Vultr is on a mission to make high-performance cloud infrastructure easy to use, affordable, and locally accessible for enterprises and AI innovators around the world. With 32 global cloud data center locations, Vultr is trusted by hundreds of thousands of active customers across 185 countries for its flexible, scalable, global Cloud Compute, Cloud GPU, Bare Metal, and Cloud Storage solutions. In December 2024 Vultr announced an equity financing at a $3.5 billion valuation. Founded by David Aninowsky and self-funded for over a decade, Vultr has grown to become the world’s largest privately-held cloud infrastructure company.
Vultr Cares
-
100% company-paid insurance premiums for employee medical, dental and vision plans.
-
401(k) plan that matches 100% up to 4%, with immediate vesting
-
Professional Development Reimbursement of $2,500 each year
-
11 Holidays + Paid Time Off Accrual + Rollover Plan
-
Commitment matters to Vultr! Increased PTO at 3 year and 10 year anniversary + 1 month paid sabbatical every 5 years + Anniversary Bonus each year
-
$500 stipend for remote office setup in first year + $400 each following year
-
Internet reimbursement up to $75 per month
-
Gym membership reimbursement up to $50 per month
-
Company paid Wellable subscription
Join Vultr
We are seeking a Director, AI Infrastructure to lead the engineering teams responsible for building, operating, and troubleshooting Vultr’s AI clusters. This role focuses on translating technical strategy into reality by driving execution, ensuring reliability at scale, and partnering with cross-functional teams to deliver high-performance infrastructure.
You will oversee the engineering responsible for our GPU cluster deployments, orchestration frameworks, and overall fleet operations. This is a hands-on leadership role for someone who excels in scaling systems, optimizing performance, and guiding teams through complex technical work — without being the sole owner of company-wide infrastructure strategy. This is your opportunity to join our fast growing team and leave your mark on Vultr and the future of AI Infrastructure.
Key Responsibilities
- Lead engineering team responsible for implementation, scaling, and operation of AI compute clusters.
- Partner with senior leadership to shape infrastructure roadmaps and translate high-level strategy into actionable engineering plans.
- Drive execution of cluster deployments, hardware bring-up, node-level configuration, integration and validation with orchestration systems.
- Oversee engineering efforts related to GPU fleet growth, networking design integration, and storage systems that support ML and high-performance workloads.
- Ensure reliability, performance, and availability of the infrastructure through monitoring, automation, and well-defined operational processes.
- Work with AI/ML teams, SRE, networking, and hardware engineering to align cluster capabilities with training and inference requirements.
- Improve provisioning, configuration management, and lifecycle operations for large bare metal and GPU fleets.
- Contribute to the design of multi-tenant scheduling, workload management, and resource orchestration, in partnership with the cluster architect.
- Manage technical incident response and proactively identify areas for performance improvement or architectural refinement.
- Mentor and grow engineering talent, fostering a high-performance, detail-oriented culture.
- Collaborate closely with Product to clarify requirements, delivery timelines, and customer-facing capabilities.
Qualifications
- Extensive experience (typically 8–12 years) in infrastructure engineering, HPC, large-scale systems, or similar domains.
- Strong understanding of AI compute infrastructure, including GPU/CPU clusters, distributed training workflows, and high-performance networking (InfiniBand/RDMA).
- Experience running production bare metal platforms or hardware fleets at meaningful scale.
- Technical depth in Linux systems, Kubernetes or Slurm, provisioning tools (Terraform, Ansible), observability stacks, and networking fundamentals.
- Hands-on experience with cluster operations, hardware bring-up, distributed systems, or ML workload scaling.
- Demonstrated ability to lead and develop engineering teams while staying close to the technical details.
- Excellent cross-functional communication and ability to partner with architecture, AI/ML, SRE, Networking, and Infrastructure Operations teams.
- Strong execution mindset with the ability to translate strategic goals into measurable engineering deliverables.
Compensation
$160,000 - $185,000
This salary can vary based on location, years of experience, background and skill set.
Inclusion & Privacy
We are an equal opportunity employer and are committed to creating an inclusive environment for all employees. We welcome applications from individuals of all backgrounds and experiences, and we prohibit discrimination based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected status under applicable laws.
We also take your privacy seriously. We handle personal information responsibly and follow applicable laws, including U.S. privacy rules and India’s Digital Personal Data Protection Act, 2023. Your data is used only for legitimate business purposes and is protected with proper security measures.
Where allowed by law, applicants may request details about the data we collect, access or delete their information, withdraw consent for its use, and opt out of nonessential communications. For more details, please see our Privacy Policy.
Create a Job Alert
Interested in building your career at Vultr? Get future opportunities sent straight to your email.
Apply for this job
*
indicates a required field