Back to jobs
New

Forward Deployed Engineer

Arlington, VA

540 is seeking a Forward Deployed Engineer to support a high-impact Department of War (DoW) initiative focused on testing and evaluating advanced SI capabilities before they reach mission-critical environments. The program is building a secure, repeatable environment to evaluate agentic systems and language models across the DoW.

In this role, you will build, deploy, and operate a test and evaluation (T&E) harness inside a government-hosted environment. This harness will route evaluation traffic to models through a controlled gateway, orchestrate benchmark test runs, and produce auditable, verifiable results that government decision-makers can trust.

You will own the software from code to production and work directly with government and industry testers to evaluate large language models, distilled small language models, and multi-agent workflows. Ultimately, you will serve as the core technical partner who turns testing needs into working evaluations, delivering a robust reference implementation that the government will own and operate over the long term.

Location: Primarily remote (DC metro area preferred), with occasional onsite meetings as needed
Citizenship & Clearance Requirement: per client requirements, candidates must be U.S. Citizens with an active DoW Secret (or higher) clearance
Education Requirement: Bachelor’s Degree
540 Internal Thrive Level: Forward Deployed Engineer III

WHY 540?

540 is a forward-thinking company that the government turns to in order to #getshitdone. We don’t just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.

HOW YOU’LL DRIVE IMPACT

  • Build, extend, and manage the T&E harness in a Microsoft Azure Government environment at Impact Level 5 (IL5) while meeting strict privacy and regulatory requirements
  • Onboard new models, benchmarks, and datasets to support test campaigns for agentic systems, LLMs, and small language model (SLM) distillation
  • Design and deploy secure, containerized microservices and AI-enabled systems using automated CI/CD pipelines, leveraging GenAI tools to accelerate your own development workflow
  • Act as a forward-deployed engineer to gather requirements, design evaluations, troubleshoot runs, and interpret results alongside government stakeholders
  • Coordinate multi-team technical initiatives and manage complex cross-organizational dependencies to ensure shared engineering outcomes
  • Manage defect backlogs, prioritize technical debt, and drive rigorous root-cause analysis to tackle architectural challenges
  • Conduct live demos, translate complex technical concepts for non-technical stakeholders, and transfer knowledge so the government team can eventually run the harness independently

REQUIRED SKILLS & EXPERIENCE

  • Strong programming expertise (e.g., Python, TypeScript, or Go) with a track record of deploying, operating, and maintaining secure and scalable software in production environments
  • Experience developing and deploying containerized microservices and/or serverless applications using automated CI/CD pipelines
  • Experience designing, building, and deploying production-grade LLM applications, retrieval-augmented generation (RAG) pipelines, and/or multi-agent workflows
  • Proficiency building resilient integrations with enterprise platforms, ideally using Model Context Protocol (MCP) or similar tool-calling frameworks for AI models
  • Experience acting in a forward-deployed or solutions engineering capacity, actively leading requirement gathering and adapting solutions to fit specific customer environments
  • Experience with automated testing, ensuring enterprise-grade security and privacy, and implementing comprehensive observability for distributed systems
  • Experience managing defect backlogs, prioritizing technical debt, and driving rigorous root cause analysis to continuously improve product quality
  • Skilled at conducting live demos, delivering presentations, and translating highly technical AI and software concepts for both technical and non-technical audiences
  • Demonstrated skills in at least one specialized domain (Solutions Architecture, Cloud Infrastructure, Platform Engineering, Security, Data Engineering) in addition to Full Stack or QA development

NICE TO HAVE

  • DoD Information Assurance Technical (IAT) Level II qualification
  • Professional-level certification from a commercial CSP (e.g., AWS, Google Cloud, Azure)
  • Experience designing, deploying, and operating secure applications that handle controlled or classified information
  • Background instrumenting services for SLIs/SLOs, participating in on-call incident response, and contributing to postmortems
  • Familiar with ML model architectures (beyond LLMs) and understands their specific data input requirements
  • Working knowledge of LLM evaluation: benchmark harnesses, scoring, prompt and response handling, model API gateways
  • Experience deploying and operating applications on a commercial cloud service
  • Experience with GitOps and either GitLab CI/CD or GitHub Actions

BENEFITS & PERKS

  • Flexible PTO + all Federal holidays off
  • Health, dental and vision insurance plans
  • Flexible Spending Account (FSA)
  • 401k with employer match
  • Company-sponsored life insurance, short- and long-term disability 
  • Professional development (training, certifications, conferences)
  • Paid cloud developer accounts
  • Referral bonuses
  • HQ office perks (parking / metro reimbursement, nitro coffee & lunches) 
  • Annual social events (540 Week, hackathon, charity golf tournament, etc.)
  • Access to 540’s Washington Capitals & Nationals tickets

EQUAL EMPLOYMENT OPPORTUNITY (EEO)

540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Create a Job Alert

Interested in building your career at 540? Get future opportunities sent straight to your email.

Apply for this job

*

indicates a required field

Phone
Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf


Select...
Select...
Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in 540’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...