Back to jobs

Backend Engineer, Collection Platform

Remote

Vannevar builds AI systems for the Department of War's most consequential missions. We have 125 deployments across every branch and combatant command spanning our core platform and five distinct products. An an example of how we work, when major combat operations started with Iran, we fielded a new product supporting 24/7 operations and 9,000+ users in three months.

How we build is our advantage: we deploy forward with the people who own the mission. Our engineers, product team, and CTO deploy forward to the point of friction, including visiting units in Ukraine. We focus on embedding directly with operational units supporting great power competition with China, combat operations with Iran, and counter-narcotics missions.

About the Role

At Vannevar, we build mission software for the national security, defense, and intelligence communities. The Collection Platform team builds the systems that acquire mission-critical data from websites, APIs, feeds, and third-party platforms.

In this role, you’ll own web scrapers, third-party integrations, and data pipelines that produce complete, correct, and timely data despite unreliable upstream systems. You’ll partner with mission teams, product managers, and engineers to define requirements and make tradeoffs among data quality, reliability, scale, and cost.

 

What you’ll do

  • Build and operate production web scrapers, third-party integrations, and data pipelines.
  • Design for schema changes, rate limits, authentication requirements, and partial failures.
  • Build reliable retry, backfill, deduplication, idempotency, and replay mechanisms.
  • Define and monitor data completeness, correctness, freshness, duplication, and provenance.
  • Develop APIs, databases, and shared services for collection workflows.
  • Partner with mission teams, platform teams, and product managers to evaluate sources and support new data requirements.
  • Influence architecture, technology selection, and engineering standards for collection systems.

What we’re looking for

  • You have 4+ years of backend engineering experience, including production web scraping, data ingestion, ETL, or third-party integrations.
  • You write production software in Python and are familiar with relational databases and API design.
  • You know how to maintain data quality across large, changing datasets.
  • You have designed systems that tolerate upstream failures and changing external interfaces.
  • You can make thoughtful tradeoffs among reliability, scalability, performance, maintainability, and cost.
  • You communicate technical decisions clearly and work well across engineering, product, and mission teams.
  • U.S. Person status is required, as this role requires access to U.S.-only data systems and the ability to obtain a security clearance.

Nice to Have

  • Experience with distributed task processing, workflow orchestration, or large-scale data pipelines.
  • Experience monitoring data quality and investigating production regressions.

What we offer

We’re proud to offer competitive benefits that support our employees. Some key highlights of our benefits package include:
  • Health, dental, and vision insurance
  • Remote friendly with WeWork access
  • Unlimited PTO, shared downtime during the federal holiday calendar, and company-wide off time at the end of each year
  • 401(k) match
  • Lifestyle & wellbeing stipends
  • Salary top-up during military reserve duty
  • Fully paid parental leave
  • Child and pet care reimbursement during travel
Vannevar is an equal opportunity employer, and qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status.
 
We encourage candidates from all backgrounds to apply, even if you don't feel like you're a perfect fit. If you're passionate about contributing to our mission, we'd love to hear from you!
 
IMPORTANT NOTICE
We are committed to protecting the privacy of all applicants. Official emails from the company will come from an @vannevarlabs.com domain. Under no circumstances will a legitimate representative from our company contact you to request passwords, financial information, or other sensitive personal data. Please be vigilant of potential scams.

Create a Job Alert

Interested in building your career at Vannevar? Get future opportunities sent straight to your email.

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf

Select...
Select...

To conform to U.S. Government space technology export regulations, including the International Traffic in Arms Regulations (ITAR) you must be a U.S. citizen, lawful permanent resident of the U.S., protected individual as defined by 8 U.S.C. 1324b(a)(3), or eligible to obtain the required authorizations from the U.S. Department of State. Learn more about ITAR here.

Select...

We support remote workers in the US only. Do you currently reside in the US and plan on staying for the next twelve months? 

Select...
Select...

Please tell us how you heard about this opportunity.

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Vannevar’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...