Senior Data Engineer
Unite USA Inc.
Job Title: Senior Data Engineer
Location: New York, NY
Job Description
The Senior Data Engineer will hold in-depth knowledge of data operational efficiency and effective management of data environments – platforms, and tools that will inspire data engineering teams to build solutions to drive data quality and security and effectively manage and monitor the data ecosystem of analytics, data lakes, warehouses, and MDM platforms and tools. Additional responsibilities include: creating a strong partnership with Product Strategy, Data Engineering, IT, and leadership for Data Management technologies for “well managed” and effective data platform and tools operations; leading their team in building data management solutions that span all data platforms – MDM, data lake (relational, NoSQL), data warehouse, and data tools (Data Catalog, Schema Management, Data Discovery, and Data Lineage); leading the adoption of state of the art data management tools like Apache Avro and Apache Atlas for federated data discovery and lineage; building-out new or transforming existing Data Management tools or processes including data quality and governance, central monitoring, data cataloging, and reference data or MDM functions; developing best practices that support an agile workflow while maintaining a closely controlled production environment so that the source code and data can be audited and traced; partnering closely across the enterprise to ensure data management and quality are built-in upfront; and be an evangelist across the organization for data quality, security, stable, reliable systems, and engineering excellence. Telecommuting available anywhere in U.S.
Annual salary: $151,154.00 – 181,177.50. Benefits Medical; Dental; Vision; Parental Leave; Flexible Vacation Time; 401K Match.
Job Requirements
Requires a Master’s degree (or foreign equivalent) in Computer Information Technology, Mathematics, Statistics, or a related field plus three (3) years of experience as a Data Engineer, Data Developer or related. Must possess Three (3) years of experience with: (a) designing and developing data pipelines in AWS S3 bucket; (b) building Enterprise Data Lakes; (c) improving performance and optimization using Spark; implementing ETL processes in Python and Java; (d) conducting version control in GitHub; (e) developing and automating Docker containers; (f) performing data modeling and connecting to relational databases like Snowflake, Redshift and Postgres from Spark; (g) redeveloping infrastructure with Terraform; (h) Design CI/CD pipelines using Jenkins; (i) building reusable models with DBT; (j) orchestrating and scheduling data workflows using Apache Airflow. Telecommuting available anywhere in U.S.
Our Mission:
Unite Us’ mission is to unlock the potential of every community. Our co-founders started Unite Us in 2013 to serve the people they served with.
They witnessed firsthand the barriers and inefficiencies in trying to navigate health and social services, and set out to improve that experience for
veterans and their families. Unite Us quickly expanded to serving all people who need connections to care across our country. Through Unite Us’
national network and software, community-based organizations, government agencies, and healthcare organizations are all connected to better
collaborate to meet the needs of the individuals in their communities. We drive the collaboration to predict, deliver, and pay for services that impact
whole-person health. If you want to do well and do good, join Unite Us.
Create a Job Alert
Interested in building your career at Unite Us? Get future opportunities sent straight to your email.
Apply for this job
*
indicates a required field