Software Engineer - Full Stack Data Engineer
Company Introduction
At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life for communities around the globe. With the agility of a start-up and the wisdom of seasoned experts, Bot Auto boasts a team that has achieved numerous world-firsts and unparalleled innovations. United by a shared vision, we create miracles and propel the future of transportation. Join us and transform your dreams into reality.
We are looking for a skilled and versatile Full Stack Data Engineer to join our team. This unique role is ideal for candidates who bring a strong foundation in both full stack development and data engineering. As a Full Stack Data Engineer, you’ll play a key role in advancing our autonomous driving data workflows, building high-performance internal tools, and developing our hybrid-Cloud data platform. Your work will span from developing web-based interfaces and dashboards to architecting robust data storage, extraction, and transformation pipelines.
Key Responsibilities
- Full Stack Data Platform: Design and develop full-stack solutions, including web applications and dashboards, to support data monitoring, visualization, and flow management across autonomous driving data workflows.
- Collaborate with the infrastructure team to deploy and manage the data platform across hybrid-cloud solutions, utilizing both cloud-native compute services and on-premises data centers.
- Architect systems with high availability and elasticity by applying principles of stateful and stateless microservices, event queuing, caching strategies, load balancing, and API gateways.
- Data Engineering: Build and maintain high-performance data collection pipelines that facilitate seamless data transfer from autonomous systems to both cloud and on-premises environments.
- Develop robust data ingestion pipelines that pull from CoreDB, external APIs, autonomous driving datasets, and streaming sources, integrating data efficiently into our Data Lake.
- Architect and optimize large-scale data storage solutions, ensuring efficient, scalable data management within our hybrid-cloud infrastructure.
- Analytical Solutions: Create intuitive, user-friendly dashboards and analytics tools that empower executives, algorithm teams, and operations to access actionable insights and data-driven decision-making.
- Construct and maintain the Data Lakehouse and data visualization dashboards, supporting real-time analytics for strategic decision-making.
- Cross-functional Collaboration: Work closely with cross-functional teams to deploy and integrate solutions that enhance the efficiency and effectiveness of data processes across the autonomous driving platform.
- Support the development of scalable ETL processes and transformation pipelines to provide timely analytics, reporting, and insights across teams.
Qualifications
Required:
- Bachelor's degree in Computer Science, Engineering, or related field.
- Proven experience in software engineering with a focus on modern web technologies.
- Strong proficiency in React, Typescript, and CSS. Solid understanding of software architecture, data modeling, and database management.
- Strong with databases such as MySQL and Postgres, with experience in designing and managing them for data-driven applications.
- Experience with cloud platforms (AWS, GCP, or Azure) and hybrid-Cloud solutions.
- Experience with ETL processes, data transformation, and handling large datasets efficiently with distributed data processing engine such as Spark, Presto, Glue
- Knowledge of DevOps practices, CI/CD pipelines
- Experience working closely with Design and Product teams to deliver high-quality user experiences.
- Excellent problem-solving skills and a strong attention to detail.
- Strong communication and collaboration abilities.
Preferred:
- Experience with Large Scale Data/ML System Design
- Experience with Python and C++.
- Experience with the Autonomous Driving Industry.
Apply for this job
*
indicates a required field