Staff Software Engineer, ML Data
About Stack:
Stack is developing revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations. Stack's autonomous technology incorporates cutting-edge advancements in artificial intelligence, robotics, machine learning, and cloud technologies, empowering us to create innovative solutions that address the needs and challenges of the dynamic trucking transportation industry. With decades of experience creating and deploying real world systems for demanding environments, the Stack team is dedicated to developing an autonomous solution ecosystem tailored to the trucking industry's unique demands.
About the Role:
In the ML Data team, our mission is to provide trusted and useful data to efficiently power all of Stack's ML applications end-to-end from labeling to training to safety evaluation. We work hand in hand with AV autonomy teams to provide cutting edge solutions to all their data needs, working across data engineering, ML modeling, and ML infrastructure. In particular, we provide services to find (semantic search, data mining), curate (datasets), annotate (data labeling), and serve (high throughput data access) data for all ML needs.
- Semantic Search for Data Mining: We are building the infrastructure of a highly scalable semantic search service for video/camera data to find interesting events quickly and flexibly. As part of this mission, you would be setting the direction for and helping us build an inference service using LLMs and vector db.
- Dataset management for training: We are building state of the art infrastructure to support machine learning training and inference workloads using OSS components such as Ray, Spark, and Iceberg.
- Labeling: You would set the direction and build towards auto-labeling. You would be the owner driving labeling needs of the entire company.
Responsibilities:
- Develop e2e solution for real-time semantic search services (text/images/videos) and vector DBs
- Explore state-of-art multimodal semantic search models and performance benchmarks
- Discover and identify key issues in existing ML infra and proactively improve system performance
- Drive technical discussions across multiple orgs and deliver solutions on a timely basis
- Architect and tune ETL pipelines to maximize GPU/CPU/Ram utilization
- Write readable and high-performance Python/C++ c
Qualifications:
- 6+ years of experience with:
- Multimodal data indexing and inference pipelines.
- Building semantic search service, embedding generation for video/images and vector DB
- Large scale data processing pipelines (Airflow/Flyte) and model optimization.
- Experience building ML infrastructure for a large number of customer teams and collaborating effectively with multi-functional teams.
- Proven track record of building scalable, reliable infrastructure in a fast-paced environment.
- Deep understanding of design trade-offs with the ability to articulate those trade-offs and achieve alignment with others.
- Autonomous vehicles (AV) experience is a bonus.
#LI-AW1
We are proud to be an equal opportunity workplace. We believe that diverse teams produce the best ideas and outcomes. We are committed to building a culture of inclusion, entrepreneurship, and innovation across gender, race, age, sexual orientation, religion, disability, and identity.
Check out our Privacy Policy.
Please Note: Pursuant to its business activities and use of technology, Stack AV complies with all applicable U.S. national security laws, regulations, and administrative requirements, which can restrict Stack AV’s ability to employ certain persons in certain positions pursuant to a range of national security-related requirements. As such, this position may be contingent upon Stack AV verifying a candidate’s residence, U.S. person status, and/or citizenship status. This position may also involve working with software and technologies subject to U.S. export control regulations. Under these regulations, it may be necessary for Stack AV to obtain a U.S. government export license prior to releasing its technologies to certain persons. If Stack AV determines that a candidate’s residence, U.S. person status, and/or citizenship status will require a license, prohibit the candidate from working in this position, or otherwise be subject to national security-related restrictions, Stack AV expressly reserves the right to either consider the candidate for a different position that is not subject to such restrictions, on whatever terms and conditions Stack AV shall establish in its sole discretion, or, in the alternative, decline to move forward with the candidate’s application.
Create a Job Alert
Interested in building your career at Stack AV? Get future opportunities sent straight to your email.
Apply for this job
*
indicates a required field