On-device AI Frameworks Engineer (Staff)

We are looking for a Staff Engineer to join our growing On-device AI Frameworks team at Argmax! In this role, you will design, implement and optimize software frameworks that expose developer-friendly APIs to run state-of-the-art inference workloads natively on Apple and Android devices. You will collaborate closely with industry-leader engineer and researcher colleagues, advancing the frontiers of on-device inference technology and accelerating its market adoption.

AI Frameworks are at the core of Argmax SDK, our flagship developer toolkit trusted by Enterprises and developers in high-stakes industries such as healthcare. Argmax is a customer-obsessed team and we work very closely with them, sometimes in forward-deployed capacity.

 

Responsibilities

• Productionize research prototypes: The Applied Research team will come to you with a Python prototype that provides the blueprints for a new feature (example) for one of our AI Frameworks. You will collaborate with them in turning this standalone prototype into a production-ready implementation in a test-driven development fashion. This collaboration may include experimentation and benchmarking that leads to top-tier AI research conference submissions (example). 
• Contribute to SDK and Frameworks design: As the number of supported models and workloads grow, you will see around corners and recommend scalable design patterns to absorb the code growth while minimizing technical debt.
• Support Enterprise customers: You will directly work with the engineering teams of Enterprise customers during their onboarding journey. This could range from a Q&A session to customizing an Argmax feature to fit a particular customer requirement.

 

Qualifications

• 3+ years of hands-on experience in SDK or Frameworks development for iOS or macOS
• Fluency in Swift
• Fluency in profiling and optimizing native applications
• Familiarity with at least one of Core ML, MLX Swift, LiteRT, ONNX, WebGPU or ExecuTorch

 

Preferred Qualifications

• 5+ years of hands-on experience in SDK or Frameworks development for iOS or Android
• Track record of significant open-source contributions
• Fluency in Swift, Kotlin and Python
• Direct experience with Core ML, MLX Swift and LiteRT

 

Perks

• Top-of-market equity at a fast-growing early-stage startup with a unique mission
• Performance-based equity refreshers twice a year
• 3 days a week in the office from Palo Alto, CA or Manhattan, NY
• Palo Alto office offers comprehensive on-site amenities, including chef-catered meals
• Remote possible by exception for industry leader exceptional candidates
• Platinum-tier healthcare with 90% employer contribution, including dependents
• 401(k) match
• Quarterly in-person team-building weeks in Palo Alto, CA

 

About Argmax

AI applications are scaling in user adoption at unprecedented rates. The infrastructure is crumbling:
- Spinner wheels are back in fashion
- The most sensitive types of user data are uploaded to the cloud and occasionally leaked
- Spiky demand leads to infrastructure capacity crunch and underutilization at the same time

Argmax is building the critical infrastructure required to bring real-time AI workloads to the edge:
- Autoscaling instantly and infinitely
- Private and compliant by design
- Reliable beyond even the multi-cloud platforms

The hardest part: We are directly migrating cloud workloads to the edge, without compromising accuracy that our customers work so hard to achieve. This is a hard core technology problem and we built the mission-driven team with a long-term vision to make on-device the default way to build AI applications. Join us if this sounds like you and you have 3+ years to stake!