Back to jobs
New

Director of AI Compute Services

Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA

CoreWeave is the AI Hyperscaler™, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leading AI labs with the most performant, efficient and resilient solutions for accelerated computing. Since 2017, CoreWeave has operated a growing footprint of data centers covering every region of the US and across Europe. CoreWeave was ranked as one of the TIME100 most influential companies of 2024.

As the leader in the industry, we thrive in an environment where adaptability and resilience are key. Our culture offers career-defining opportunities for those who excel amid change and challenge. If you’re someone who thrives in a dynamic environment, enjoys solving complex problems, and is eager to make a significant impact, CoreWeave is the place for you. Join us, and be part of a team solving some of the most exciting challenges in the industry.  

CoreWeave powers the creation and delivery of the intelligence that drives innovation. 

Position Overview

CoreWeave is seeking an experienced and innovative Director of AI Compute Services. In this role you will focus on architecting CoreWeave's compute services like Coreweave Kubernetes Service - powering the AI revolution. You will build and lead a world-class team, tackling the complex challenges of designing, building, and operating world-class compute services for the most demanding AI workloads on the planet. You will be focusing on achieving the highest levels of service quality, scalability and performance. This leadership position requires a strong combination of technical expertise, strategic vision, and business acumen. You will work closely with yours in Engineering, Product and Sales to shape the compute infrastructure roadmap, drive innovation, and ensure the reliability, security, and scalability of the CoreWeave Cloud Platform.

 

Key Responsibilities

Strategic Leadership

  • Define and execute CoreWeave’s AI compute roadmap in alignment with our growth trajectory and customer needs.
  • Collaborate with product, infrastructure, sales, and engineering teams to support GPU-intensive workloads and strategic client deployments.
  • Grow and lead a high-performance team of infrastructure, systems, and AI platform engineers.

Infrastructure & Optimization

  • Design and manage large-scale GPU cluster environments.
  • Help drive architecture decisions around high-throughput networking, low-latency storage, and resource scheduling for AI/ML workloads.
  • Ensure optimal performance and utilization across massive-scale GPU deployments.

Innovation & Technical Execution

  • Evaluate and integrate next-gen hardware and software technologies.
  • Develop scheduling, orchestration, and containerization strategies (e.g., Kubernetes, Slurm) tailored for deep learning workloads.
  • Provide internal and external clients with robust, secure, and performant AI environments.

Operational Excellence

  • Define customer-centric SLAs and Implement effective monitoring systems to ensure infrastructure uptime and efficiency.
  • Optimize for both performance and cost-efficiency across GPU-based compute resources.

Client & Partner Collaboration

  • Support strategic client engagements with technical solutions and infrastructure design.
  • Represent CoreWeave in partner/vendor relationships with hardware and software ecosystem players.
  • Act as a technical voice of the customer in shaping internal product and infrastructure roadmaps.
  • Collaborate effectively with open source communities

Qualifications

  • 10+ years of experience in infrastructure, high-performance compute, or cloud systems
  • 5+ years of experience in engineering leadership roles
  • Proven track record of building and scaling high-performing engineering teams and fostering a positive and productive team culture.
  • Experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture
  • Good understanding of AI/ML model training, inference workflows, and performance tuning
  • Bachelor’s or Master's degree in Computer Science or Compute Architecture, or equivalent practical experience.

Preferred Experience

  • Experience at a cloud provider or hyperscaler.
  • Familiarity with MLOps, workload telemetry, and multi-tenant compute environments.
  • Demonstrated success scaling infrastructure for LLMs or foundation models.
  • Strong business acumen in balancing cost, performance, and reliability at scale.

 

Why CoreWeave?

  • Be a key leader at one of the fastest-growing GPU cloud companies.
  • Work with cutting-edge hardware and real-world AI production workloads.
  • Join a collaborative, mission-driven team solving compute at unprecedented scale.
  • Competitive compensation, equity, and benefits in a high-growth environment.

 

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $230,000-$275,000. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.

What We Offer

The range we’ve posted represents the typical compensation range for this role. To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location.

In addition to a competitive salary, we offer a variety of benefits to support your needs, including:

  • Medical, dental, and vision insurance - 100% paid for by CoreWeave
  • Company-paid Life Insurance 
  • Voluntary supplemental life insurance 
  • Short and long-term disability insurance 
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement 
  • Mental Wellness Benefits through Spring Health 
  • Family-Forming support provided by Carrot
  • Paid Parental Leave 
  • Flexible, full-service childcare support with Kinside
  • 401(k) with a generous employer match
  • Flexible PTO
  • Catered lunch each day in our office and data center locations
  • A casual work environment
  • A work culture focused on innovative disruption

Our Workplace

While we prioritize a hybrid work environment, remote work may be considered for candidates located more than 30 miles from an office, based on role requirements for specialized skill sets. New hires will be invited to attend onboarding at one of our hubs within their first month. Teams also gather quarterly to support collaboration

California Consumer Privacy Act - California applicants only

CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.

As part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: careers@coreweave.com.

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf

Select...
Select...
Select...
Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in CoreWeave’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...

Voluntary Self-Identification of Disability

Form CC-305
Page 1 of 1
OMB Control Number 1250-0005
Expires 04/30/2026

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury
Select...

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.