Data Engineer

About the Role

Rocket Lawyer is seeking a passionate data engineer for Rocket Data Platform. In this role, you will build a highly reliable, trustworthy data lakehouse that is leveraged across the organization to derive insights and make real-time decisions. You will be bringing your skills to drive new data projects, build reliable data pipelines, set up strong monitoring and alerting systems, and build data solutions to support a diverse set of use cases.

We value a fun, collaborative, team-oriented work environment, where we celebrate our accomplishments.

Responsibilities

• Design and develop data pipelines using tools like Apache Airflow or by leveraging Snowflake's external tables functionality.

• Translate HiveQL queries to Snowflake SQL, ensuring compatibility and efficient data processing.

• Utilize dbt to model and transform data within Snowflake, adhering to best practices for data governance and maintainability.

• Configure and manage data pipelines in GCP to orchestrate data movement and processing tasks.

• Collaborate with data analysts and stakeholders to understand data requirements and ensure a successful migration outcome.

• Monitor and optimize data pipelines for performance and scalability.

• Develop and implement automated testing procedures to validate data quality and integrity after migration.

• Document the migration process and provide ongoing support for the migrated data warehouse on Snowflake.

Requirements

• Minimum 5+ years of experience as a Data Engineer with a proven track record of successful data warehouse/data lake implementation and management.
• Deep understanding of leveraging Snowflake to build highly performant and resilient datawarehouse (or experience with similar platforms).
• Strong expertise in HiveQL, SQL, and experience with data warehousing/lake house concepts (dimensional modeling, data quality, etc.).
• Strong programming knowledge in python.
• Experience with Apache Spark for large-scale data processing (a plus).
• Proficiency in dbt for data modeling and transformation in Snowflake preferred.
• Experience working with Google Cloud Platform (GCP) and its data storage services (GCS, BigQuery - a plus) - or experience with similar platforms.
• Excellent written and verbal communication skills with the ability to collaborate effectively with cross-functional teams.
• Strong problem-solving skills and a passion for building efficient and scalable data solutions.

Preferred Qualifications:

• Strong understanding of data architectures and patterns.
• Experience in DataOps implementation and support.
• Experience in MLOps implementation and support.
• Experience in building and supporting AI/ML platform.

Benefits & Perks

By applying for this position, your data will be processed as per Rocket Lawyer Privacy Policy.