Data Engineer
About the Team
The Enterprise Data Management (EDM) team at RA Capital is dedicated to delivering high-quality, reliable data across the organization. With a strong emphasis on data integrity, accessibility, and compliance, EDM supports strategic business objectives by optimizing data assets and ensuring their effective use. The team oversees the entire data lifecycle, collaborates with internal stakeholders and external vendors, and builds scalable data infrastructure to empower data-driven decision-making at RA Capital.
About the Role
As a Data Engineer on the EDM team, you will play a critical role in designing and maintaining robust data pipelines and integrations. You’ll be responsible for ensuring the accuracy, quality, and seamless flow of data from external vendors into internal systems, while contributing to the scalability and performance of our data platform.
Responsibilities
-
Design, build, and optimize end-to-end data pipelines for vendor data ingestion, quality assurance, and system integration.
-
Develop and maintain data integration processes between the data warehouse and downstream applications to support business operations.
-
Write production-level code to match, standardize, and reconcile data from multiple vendors, applying NLP and machine learning techniques where applicable.
-
Design and maintain efficient data models in Snowflake to ensure scalable, high-performance analytics and reporting.
-
Build and maintain scalable, maintainable code for managing data flows, developing APIs, and integrating systems, following best practices in software development (e.g., Git, CI/CD).
-
Implement and monitor data quality controls to ensure data integrity, accuracy, and compliance.
-
Collaborate with vendors to define data formats, transformations, and delivery timelines for timely, high-quality data integration.
-
Partner with IT and business teams to ensure data solutions align with strategic goals and proactively address issues.
-
Create thorough documentation of data pipelines, architectures, and processes, and translate technical concepts for non-technical stakeholders.
-
Provide Tier 1 monitoring and support for the data platform, including pipelines and integrations.
-
Ensure adherence to best practices in data governance, security, and compliance.
Key Skills
-
Data Engineering & Integration: Expertise in designing and managing data pipelines and ETL processes.
-
Software Development: Strong programming background, including OOP, modular design, and API development. Proficient with version control (Git) and CI/CD.
-
Data Matching & Standardization: Ability to design algorithms and tools to match and reconcile data across vendor sources.
-
Data Quality Management: Experience implementing quality controls and validation checks to ensure data accuracy.
-
Technical Proficiency: Advanced skills in SQL, Python, and Spark; hands-on experience with Databricks and/or Snowflake. Familiarity with cloud-based data solutions is a plus.
-
Vendor Management: Proven ability to coordinate with external data providers and resolve data-related issues efficiently.
-
Communication: Excellent verbal and written communication skills; able to explain technical concepts to non-technical audiences and align technical work with business needs.
Preferred Qualifications
-
Experience working with both structured and unstructured data.
-
Familiarity with AWS technologies such as S3, EC2, and EBS.
-
Experience developing and maintaining pipelines in Snowflake and Databricks.
-
Exposure to preparing data for AI/ML applications.
Key Requirements
-
Authorization to work in the United States.
-
Bachelor’s degree or higher in Computer Science, Data Science, Information Technology, Software Engineering, or a related field. Masters Degree preferred.
-
1-3+ years of experience in SQL, Python, Java, and Spark, with hands-on experience in Databricks and/or Snowflake.
-
1-3+ years of experience in software development, data integration, vendor data management, and production-grade code for data reconciliation.
-
Strong documentation and communication skills.
-
Flexibility to work off-hours as needed.
-
Must be based in Massachusetts; no relocation provided
Apply for this job
*
indicates a required field