Back to jobs

Member of Technical Staff - Applied Inference

Palo Alto, CA

About xAI

xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

RESPONSIBILITIES:

  • Architect and implement scalable distributed infrastructure for model serving, such as load balancing, auto scaling, batch scheduling, and global KVcache systems.
  • Ensure the reliability of inference services, targeting 100% uptime, a 0% error rate, and good tail performance, through proactive monitoring, fault-tolerant designs, and rigorous testing.
  • Create custom tools to trace, replay, and fix issues or crashes across the entire stack, from cluster orchestration to GPU kernels.
  • Benchmark and fine-tune inference engines to deliver optimal performance under diverse, production workloads.
  • Develop robust CI/CD infrastructure to enable seamless endpoint deployment, image publishing, feature rollouts, and inference engine updates.

BASIC QUALIFICATIONS:

  • Worked on large-scale, high-concurrent production serving.
  • Worked on GPU inference engines.
  • Worked on testing, benchmarking, and the reliability of inference services.
  • Worked on designing and implementing CI/CD infrastructure.

COMPENSATION AND BENEFITS:

$180,000 - $440,000 USD

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

xAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

Create a Job Alert

Interested in building your career at xAI? Get future opportunities sent straight to your email.

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

If you are currently employed in the field, please tell us the name of your employer.

If you are currently employed in the field, please tell us your role including your seniority level (e.g. Software Engineer II).

If you have a public LinkedIn profile, please provide its URL.

If you have a Google Scholar page, please provide its URL.

Select...

In 100 words or less, tell us about a piece of work you are most proud of.

Select...