Senior Software Engineer, AI Platform
Who We Are
Humane is a team of proven industry experts who have invented, built, and shipped category-defining hardware and software products to billions of people across the globe. We're known for building the audacious, ambitious, and the impossible, and we're doing it again. Our vision for the next shift between humans and computing requires innovation across multiple emerging technologies in hardware and software, from devices to cloud services.
About The Role
The AI Platform team is building cutting-edge Local Inference solutions that bring the power of AI directly to edge devices while seamlessly integrating with cloud infrastructure. Our goal is to enable low-latency, private, and cost-efficient AI inference across a wide range of connected devices, from wearables to IoT and smart assistants.
As a key member of this team, you will design and optimize distributed AI systems that balance on-device inference with cloud-based processing. You'll integrate third-party AI models and frameworks, optimize machine learning pipelines for edge and cloud environments, and develop scalable, privacy-first AI solutions.
What You Might Do
- Develop and optimize edge inference pipelines to run AI models efficiently on resource-constrained devices while integrating with cloud services.
- Design and implement hybrid cloud-edge AI architectures that balance local inference with cloud scalability.
- Integrate and third-party machine learning APIs, while also training and optimizing open source models for real-time AI applications.
- Build distributed systems and networked AI devices, ensuring seamless connectivity and interoperability between edge and cloud environments.
- Evaluate on-device AI accelerators and emerging hardware solutions to maximize performance, security, and efficiency.
- Drive new features from prototype to production, collaborating closely with AI researchers, infrastructure engineers, and designers.
- Work on privacy-first AI architectures, ensuring data security and compliance in localized AI deployments.
- Develop robust testing and validation pipelines for non-deterministic AI systems, including LLMs and real-time inference models.
Essential Qualifications
- 5+ years of hands-on software development experience, including recent expertise in distributed systems, networked devices, or embedded AI.
- Strong background in machine learning model deployment, including LLMs, computer vision, or speech models.
- Experience integrating AI models on edge devices, IoT platforms, or hybrid cloud-edge systems.
- Ability to quickly adapt to new AI advancements and apply them to scalable real-world applications.
- Fast-paced, iterative approach to AI development and deployment.
- 5+ years of experience with Java or C++.
Preferred Skills
- Expertise in on-device ML optimization techniques (e.g., quantization, pruning, distillation).
- Strong understanding of low-latency computing, edge inference, and privacy-preserving AI.
- Familiarity with AI hardware accelerators (e.g., NPUs, TPUs, GPU-based inference).
- Experience evaluating and integrating third-party inference engines (e.g., TensorFlow Lite, ONNX Runtime, CoreML).
- Knowledge of cloud-edge hybrid architectures, including distributed AI model serving and orchestration.
- Experience developing or working with open-source ML frameworks.
- Prompt engineering and experimentation with AI-powered hardware.
Salary range: $180,000 - $230,000
Compensation & Benefits (Full-Time Employees)
- The salary range for this role is listed above. Final salary offered is based upon multiple factors including individual job-related qualifications, education, experience, knowledge and skills
- At Humane, you'll enjoy benefits that include health & wellness and work/life balance offerings. Our portfolio of benefits include: comprehensive healthcare insurance, disability insurance, life insurance, flexible spending accounts, and a 401K plan
- Humane employees also enjoy generous paid time off and leave programs, commuter benefits, team events, snacks and other perks
Why Humane?
- Develop cutting edge technologies in a creative and innovative environment
- Imagine new opportunities in areas that matter and will impact the world you live in
- Be a part of a high performing team of the world’s best innovators and executors
- Flexible work arrangements to support you in working in the way that you work best
- Our values: trust truth +joy
At Humane, diversity is important to us.
Humane is an equal opportunity employer and makes employment decisions on the basis of merit and business needs. We do not make hiring or employment decisions on the basis of race, color, religion (including, but not necessarily limited to, religious creed, dress, and grooming practices), citizenship, marital status, age, national origin, place of birth, height, weight, ancestry, mental or physical disability, genetic information, medical condition, U.S. (state and federal) military and veteran status, sexual orientation, gender identity, gender expression, sex, gender, pregnancy (including childbirth or related medical condition), or any other characteristics protected under applicable federal, state, or local laws (“protected characteristics” or “protected categories”). Pursuant to the San Francisco Fair Chance Ordinance and other similar state laws and ordinances, we will consider for employment qualified applicants with arrest and conviction records. At Humane, building a healthy and safe workplace is core to our mission. We prohibit harassment of any kind.
Apply for this job
*
indicates a required field