New

Staff Data Engineer

New York, New York

Unite USA Inc. dba Unite Us

Staff Data Engineer

Location: New York, New York

Job Description

The Staff Data Engineer will lead enterprise-wide data architecture strategy and long-term data
platform design. Evaluate and approve major technical designs, including establishing
engineering best practices. Serve as technical advisor to leadership and influence product/data
roadmap. Champion data governance, democratization, and scalable data standards. Work with
cross functional teams including the Solutions Delivery, Business Intelligence; Predictive
Analytics, and Enterprise Services teams to assist with and support any data-related technical
issues and/or needs. Analyze, manipulate, and process large sets of data using statistical
software. Develop ETL (Extract, Transform, Load) and data pipeline solutions using Airflow,
DBT, Python, and Snowflake to load a data warehouse. Design and manage ETL workflows to
support large-scale ingestion, transformation, and loading of data. Build and scale CI/CD
pipelines and enterprise-wide data quality frameworks. Test internal data pipelines for reliability
and performance. Test, validate, and reformulate models to ensure accuracy. Complete and
improve monitoring and validation processes to maintain pipeline reliability and data accuracy.
Write new functions or applications in programming languages to conduct analysis. Build
streaming pipelines with Confluent Kafka for event-driven processing. Build dashboards and
monitors for pipeline health, freshness, uptime, and SLA compliance. Apply data modeling to
extract and analyze information from large structured and unstructured datasets. Telecommuting
available anywhere in the United States. Annual salary between $175,000 - $200,000.


Job Requirements

Requires at least a Master’s degree or foreign equivalent in Data Science, Applied Computer
Science, Computer Science or a related field. Must possess 4 years (48 months) of experience
with all of the following: (a) developing and optimizing scalable pipelines using Apache Airflow
and Python; (b) building streaming pipelines using Kafka; (c) tuning big data systems using
Kafka and Hive; (d) using Spark to create jobs for batch and streaming analytics; (e) writing and
using complex SQL queries to retrieve data from data warehouses for analysis and reporting (f)
using AWS for data processing and large-volume workloads; (g) automating deployment of code
and processes using Python; (h) working with cloud-based infrastructure; (i) building Datadog
dashboards to monitor pipelines and system performance; (j) using Docker and Kubernetes to
improve and validate containerization and automation reliability; (k) implementing Continuous
Integration/Continuous Deployment (CI/CD) using Jenkins; and (l) utilizing all of the following:
GitHub as a code repository, Windows and Linux operating systems. Experience may be gained
concurrently. Telecommuting available anywhere in the United States.
Benefits: Paid Parental Leave; 401K Match; Flexible Vacation Time; Medical, Dental and
Vision Coverage; Commuter Benefits.

Create a Job Alert

Interested in building your career at Unite Us? Get future opportunities sent straight to your email.

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf

Select...
Select...
Select...
Select...
Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Unite Us’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...