Back to jobs

Senior Data Engineer

New York, New York, United States

About 21Shares

21Shares makes investing in digital assets as easy as buying shares using your conventional broker or bank. Investors can purchase our crypto ETPs easily, safely and securely in a regulated framework on the SIX Swiss Exchange in USD, Euros and GBP, on BX Swiss in CHF, on Boerse Stuttgart in Euros, on DB Xetra as well as Wiener Boerse ( Vienna Exchange) in Euros. We offer the most expansive suite of crypto ETPs available on regulated European exchanges.

Founded in 2018, 21Shares is led by a team of talented entrepreneurs and experienced professionals from the asset management and banking industry. Headquartered in Zurich, the company has launched several exchange-traded products such as NEAR and ONDO in the last twelve months.

About the Role

We are seeking a highly motivated and skilled Senior Data Engineer with strong team leadership skills to join our growing team of analytics experts in our New York office. As a highly experienced Data Engineer, you will be responsible for designing, expanding, and optimizing our data infrastructure and pipeline architecture, while simultaneously mentoring and leading a team of data engineers. You will work on cutting-edge technologies, playing a key role in ensuring efficient data flow and collection across cross-functional teams, helping to establish best practices and drive technical excellence. The ideal candidate is a hands-on builder and leader, experienced in developing scalable data systems, building robust data pipelines, managing complex datasets, and fostering a high-performing team environment. 

Our culture values diversity, communication, collaboration, and a shared passion for leveraging data to drive insights, innovation, and business outcomes.

Responsibilities and Scope

  • Design, build, and maintain robust and scalable data pipeline architectures.
  • Assemble large, complex datasets that meet both functional and non-functional business requirements.
  • Identify, design, and implement internal process improvements — including automation of manual workflows, optimization of data delivery, and re-architecting infrastructure for greater scalability and reliability.
  • Design, build, and optimize ETL infrastructure to enable scalable, high-quality data workflows across diverse sources, leveraging SQL and modern data processing frameworks.
  • Build analytics tools that utilize the data pipeline to deliver actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
  • Collaborate with stakeholders across Executive, Product, Data, and Design teams to resolve data-related technical issues and ensure their data infrastructure needs are met.
  • Ensure data integrity, separation, and security across multiple data centers and AWS regions.
  • Create data tools and frameworks to empower analytics and data science teams in building and optimizing products that drive innovation and establish market leadership.
  • Lead and mentor a small team of data engineers, fostering a culture of technical excellence, collaboration, and continuous improvement.
  • Provide technical guidance, set coding standards, conduct code reviews, and support career development for team members.
  • Work closely with data and analytics experts to continually enhance the functionality, reliability, and scalability of our data systems.

What You Will Need To Be Great In This Role

  • 6+ years of experience in a Data Engineering role, designing, building, and managing scalable and reliable data systems.
  • Proficient with big data and stream-processing technologies such as Spark and Kafka.
  • Hands-on experience with cloud platforms, particularly AWS services like EC2 and RDS.
  • Skilled in building and orchestrating data pipelines using tools like Airflow.
  • Experience with Databricks for scalable data processing and advanced analytics.
  • Strong knowledge of SQLMesh for modern data workflow management.
  • Extensive experience integrating and working with external data sources via REST APIs, GraphQL endpoints, and SFTP servers.
  • Strong communication skills and leadership capabilities are required.

Databases and Data Management:

  • Expertise with relational and NoSQL databases, including Postgres and MongoDB. ●
  • Solid understanding of data modeling, data governance, and data security best practices.

Programming and Development:

  • Proficient in Python for data engineering, automation, and workflow scripting.
  • Familiarity with software engineering best practices, including version control, testing, and CI/CD pipelines for data workflows.
  • Experience with JavaScript and TypeScript is a plus.

Analytics, Visualization, and BI:

  • Skilled in implementing and supporting self-service BI tools to enable business teams with accessible, actionable insights.
  • Experience with Streamlit for building interactive data visualizations is a plus.

Blockchain and Financial Data Expertise:

  • Knowledge of blockchain technology and the cryptocurrency ecosystem is a nice-to-have, with a strong interest in staying up to date with emerging trends.
  • Experience working with financial datasets and financial engineering concepts is considered a strong advantage.

Our Stack

We work with a modern and evolving technology stack, including but not limited to:

  • Cloud Infrastructure: AWS for cloud services and infrastructure management
  • Databases: PostgreSQL for relational data, MongoDB for non-relational (NoSQL) data, and Redis for caching and real-time data management
  • Backend: NestJS (Node.js, TypeScript) and Python for building scalable backend services
  • Frontend: React for web applications, Streamlit for building interactive data visualizations
  • Data Engineering: Airflow and SQLMesh for data pipeline orchestration and modern workflow management
  • Big Data & Processing: Databricks and Kafka for scalable data processing, analytics, and streaming
  • Integrations & APIs: Extensive use of REST APIs, GraphQL, SFTP, and Slack integrations to enable seamless data exchange and operational workflows
  • Messaging & Event Streaming: Kafka for real-time data pipelines and event-driven architectures

We are continuously exploring and integrating new technologies to meet business needs and drive innovation.

 

This role is based in New York City and will be expected to work from our New York office Monday - Wednesday.

Compensation (NYC Only)

Pursuant to Section 8-102 of Title 8 of the New York City administrative code, the base salary range for this role is $170,000.00 - $220,000.00. Total compensation packages are based on various factors unique to each candidate, including but not limited to skill set, years and depth of experience, certifications, and specific office location.

Create a Job Alert

Interested in building your career at 21Shares? Get future opportunities sent straight to your email.

Apply for this job

*

indicates a required field

Resume/CV

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf

Select...
Select...
Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in 21Shares’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...

Voluntary Self-Identification of Disability

Form CC-305
Page 1 of 1
OMB Control Number 1250-0005
Expires 04/30/2026

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury
Select...

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.