Back to jobs
New

Senior Software Engineer, Applied AI

Remote

Senior Software Engineer, Applied AI

About Syllo 

Syllo is on a mission to transform litigation. Our product is a unified litigation platform that enables lawyers and paralegals to safely harness the power of language models and agentic AI throughout the litigation life cycle. Since going to market, we have gained a diverse group of enterprise customers, including some of the biggest law firms and corporations in the country, and we are quickly expanding. By reducing the expense of litigation industry-wide, we aim to improve access to high-quality representation and promote the alignment of legal outcomes with merit. 

About the Role

We are seeking a skilled and fast-moving Applied AI Engineer to join our team. This role is focused on the practical application of AI, specifically leveraging Large Language Models (LLMs), to build robust, scalable, and impactful user-facing features. This is an engineering-centric role. You will be an expert at building and integrating production systems, not primarily a research scientist.

Responsibilities 

  • Design and build high-performance, production-level AI-powered features and services, with a focus on reliability and scalability.
  • Develop robust engineering solutions to mitigate the inherent unreliability of LLMs. This includes implementing effective guardrails, validation pipelines, error handling, caching, and failover/fallback mechanisms to ensure a high-quality user experience even when the model misbehaves.
  • Design long-running batch processing that is idempotent, resumable, and resilient to individual item failures.
  • Focus on optimizing latency, throughput, and cost efficiency for all AI-powered services.
  • Serve as an engineering expert in integrating models and data feeds with existing business logic and APIs.
  • Define and implement evaluation for AI feature output quality, not only system correctness.
  • Implement rigorous testing strategies, including unit, integration, and performance testing, to ensure the robustness of AI features before and after deployment.
  • Champion and enforce high standards for code quality, architectural design, and system documentation, and participate actively in peer code reviews to maintain a high bar across the team.
  • Take ownership of the full lifecycle of new AI features, from initial design and prototyping through API design, integration with front-end services, persistent data storage, deployment, and comprehensive monitoring and alerting.
  • Quickly onboard onto our existing codebase to understand, maintain, and significantly enhance existing data and feature pipelines, improving their efficiency and robustness.
  • Work closely with product managers and other engineers to scope, estimate, and deliver features on a fast iterative cycle.

 

Qualifications 

  • Deep Engineering Fluency and Quality Focus: Proven ability to build and deploy complex, high-quality software systems with an emphasis on maintainable code, rigorous testing, and engineering best practices.
  • Python Proficiency: Fluent in Python and its ecosystem for backend services and data processing.
  • System Design Expertise: Strong grasp of system design principles, including distributed systems and API design, and demonstrated ability to design scalable distributed systems.
  • AI/ML Feature Experience: Experience directly building, shipping, and maintaining AI-powered products, agents, or intelligent features in a commercial setting.
  • LLM Production Experience: Hands-on experience with the engineering challenges of integrating Large Language Models into a production environment, including prompt engineering, working with vector databases, RAG systems, and managing context windows.
  • Codebase Agility: Excellent ability to read, understand, and navigate an unfamiliar codebase quickly.

Great to Have

  • Experience fine-tuning or distilling smaller task-specific models, and judgment about when that is worth doing.
  • Familiarity with agent frameworks and their failure modes.
  • Familiarity with cloud platforms (AWS, GCP, Azure) and containerization (Docker, Kubernetes) for deploying and managing services.

 

 



 

 

 

United States - Remote Pay Range

$160,000 - $200,000 USD

Create a Job Alert

Interested in building your career at Syllo? Get future opportunities sent straight to your email.

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf

Education

Select...
Select...

Please answer based on your current work authorization status. If you are authorized to work in the U.S. today, select “Yes.”

Select...

This includes current or future employer support for statuses such as H-1B, O-1, or TN.

 
 

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Syllo’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...