Data Architect Engineer
Luminar Technologies, Inc. (Nasdaq: LAZR) is transforming automotive safety and autonomy by delivering the only lidar and associated software that meets the industry’s stringent performance, safety, and economic requirements. Luminar has rapidly gained over 50 industry partners, including a majority of the top global automotive OEMs. In 2020, Luminar signed the industry’s first production deal for autonomous consumer vehicles with Volvo Cars, which now expects to make Luminar’s technology part of the standard safety package on their next generation electric SUV. Additional customer wins include SAIC, Daimler Truck AG, Intel’s Mobileye, Pony.ai and Airbus UpNext. Founded in 2012, Luminar employs approximately 400 with offices in Palo Alto, Orlando, Colorado Springs, Detroit, and Munich.
For more information, please visit www.luminartech.com.
Team Overview
We are seeking an experienced and technical Data Engineering/Architect to lead our enterprise-level initiative in building reliable and scalable Data Pipelines at Luminar Technologies. The successful candidate will have in-depth experience with Databricks and AWS. Be responsible for driving the design, implementation, and management of data pipelines. Work closely with stakeholders across the organization including business leaders, IT leadership and external partners.
Responsibilities
- Build data pipelines using Delta Live Table Framework such as Autoloader, Delta Tables (View, Materialized View, Streaming View), Expectation, Workflows, Change Data Capture, SCD, Data Asset Bundle, Python, and Spark
- Manage internal/external tables & volumes, access control, tagging, comments, and credentials on Unity Catalog
- Implement DevOps processes on the Databricks platform, harmonize and curate pipelines across all programs
- Programming and debugging in Python and SQL.
- Manage Databricks on AWS
- Help reduce consumption and improve performance issues. Can help build monitoring tools
- Build and develop RAGs and AI functions in Databricks
- Define data requirements that determine the different types of data structure needed for a project, such as raw, conform, and consumption data layers. Demonstrating the structure model types such as 3rd Normal Form, denormalized, and dimensionalized structures.
Minimum Qualifications
- 5+ years of experience in data engineering, data science, technical architecture, or similar roles
- Bachelor’s or master’s degree in computer science, Information Systems, or a related field.
- On-Hands experiences with Databricks, Python, SQL, Spark
- Knowledgeable of security, privacy, and compliance requirements
- Excellent communication and interpersonal skills to effectively collaborate with cross-functional teams.
Preferred Qualifications
- Databricks Certification
- 10+ years of experience in data engineering, data science, technical architecture, or similar role
Luminar is an equal opportunity employer. All applicants will be considered for employment without regard to race, color, ancestry, national origin, sex, gender, sexual orientation, marital status, religion, age, disability, gender identity, results of genetic testing, service in the military, or any other characteristic protected by applicable federal, state or local laws. We will make a reasonable accommodation for any qualified applicant with a disability, provided that the individual is otherwise qualified to safely perform the essential functions of the job with or without accommodation and that the accommodation would not impose an undue hardship on the operation of our business. Please let us know if you believe you require reasonable accommodation, or if you would like assistance to complete an application or to participate in an interview at the company.
Apply for this job
*
indicates a required field