Platform Engineer, Agents
About Hebbia
The user interface for universal knowledge capture. We want every atom of information that our users need to be at their fingertips.
Designed to be generally capable– it can tackle even the most complex tasks, citing answers over any amount of sources. By showing its work, Hebbia empowers users to collaborate with AI on each step and validate responses instead of blindly trusting them. Our mission is to put capable AI in the hands of 1 billion people by 2030.
The Team
Hebbia enables leading finance and legal firms with advanced reasoning, copiloting and retrieval capabilities - unlocking meaningful insights for meaningful use cases. The Agents team builds everything from core document understanding capabilities to co-piloting experiences for matrix and deep, multi-source research. We’ve built our own agentic frameworks powered by distributed systems built for scale.
We don’t build for one-off success. We build steerable, reliable and explainable agentic systems. And we build these systems for the scale of data our customers bring to the table. Our goal is to unlock the unknowable unknown for customers all over the world.
We want to build a product that becomes indisposable to our customers and as delightful as your favorite consumer product. We move fast and build first of their kind systems.
Our team works in person 5 days a week at our SoHo office in NYC.
What we’ve built:
- A custom multi-agent framework powering everything from deep research capabilities to copiloting interfaces paired with distributed systems infrastructure for long running agentic tasks.
- The world’s most powerful and scalable LLM inference engine - a distributed, asynchronous DAG orchestrator capable of incorporating live graph mutations, cooperating in tandem with our LLM throughput management capabilities.
- Elastically scaling data representation and metadata generation → powering the most effective private data retrieval systems.
- Industry leading agents solving problems from buy side company diligence to multi billion dollar M&A.
The Role
Platform engineering at Hebbia is about excellent, scalable enablement. You are responsible for the core distributed systems that power billions of tokens across millions of dollars of AUM. You will be responsible for deploying efficient systems and building software tightly coupled with state of the art infrastructure/system design. Hebbia’s edge is built on operating on the edge of the tokenomics curve and you will serve as a key contributor in this area. We value engineers who think on their feet, innovate and can solve for exponential scale.
Responsibilities
- Own critical system components: Take complex requirements and turn them into robust, scaled solutions that solve real customer needs.
- Unlock O(1) universal indexing: Build and iterate on our high-scale document build system that enables constant time latency for indexing any content in the world, regardless of data volume.
- Drive performance optimization: Architect and implement performance-tuning solutions to ensure our systems operate efficiently at scale, minimizing latency and maximizing throughput across millions of documents.
- Mentor and guide: Provide technical leadership, mentorship, and guidance to junior engineers, fostering a culture of learning and growth.
Who You Are
- Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field. A strong academic background with coursework in data structures, algorithms, and software development is preferred.
- 5+ years software development experience at a venture-backed startup or top technology firm, with a focus on distributed systems and platform engineering.
- Proficiency in building backend and distributed systems using technologies such as Python, Java, or Go.
- Deep understanding of scalable system design, performance optimization, and resilience engineering.
- Extensive experience with cloud platforms (e.g., AWS)
- Working experience with one or more of the following: Kafka, ElasticSearch, PostgreSQL, and/or Redis
- Knowledge of workflow orchestration and execution platforms like Airflow, Temporal or Prefect.
- Proven experience enabling observability patterns.
- Ability to analyze complex problems, propose innovative solutions, and effectively communicate technical concepts to both technical and non-technical stakeholders.
- Proven experience in leading software development projects and collaborating with cross-functional teams. Strong interpersonal and communication skills to foster a collaborative and inclusive work environment.
- Enthusiasm for continuous learning and professional growth. A passion for exploring new technologies, frameworks, and software development methodologies.
- Autonomous and excited about taking ownership over major initiatives
- Bonuses:
- Experience building distributed systems leveraging technologies such as etcd or Apache Zookeeper.
- Frequent user of AI products, especially during the development lifecycle (i.e. Cursor, Claude Code, etc).
Compensation
The salary range for this role is $160,000 to $300,000, covering levels from junior to principal. Final leveling is determined through our assessment process, and exceptions to this range may be made for candidates with qualifications that fall outside our standard framework.
Life @ Hebbia
PTO: Unlimited
Insurance: Medical + Dental + Vision + 401K
Eats: Catered lunch daily + doordash dinner credit
Parental leave policy: 3 months non-birthing parent, 4 months for birthing parent
Fertility benefits: $15k lifetime benefit
New hire equity grant: competitive equity package with unmatched upside potential
#LI-Onsite
Apply for this job
*
indicates a required field