Back to jobs

Data Engineer (Gen AI)

New York, NY

Company Overview

Interactive Brokers Group, Inc. (Nasdaq: IBKR) is a global financial services company headquartered in Greenwich, CT, USA, with offices in over 15 countries. We have been at the forefront of financial innovation for over four decades, known for our cutting-edge technology and client commitment.

IBKR affiliates provide global electronic brokerage services around the clock on stocks, options, futures, currencies, bonds, and funds to clients in over 200 countries and territories. We serve individual investors and institutions, including financial advisors, hedge funds and introducing brokers. Our advanced technology, competitive pricing, and global market help our clients to make the most of their investments.

Barron's has recognized Interactive Brokers as the #1 online broker for six consecutive years. Join our dynamic, multi-national team and be a part of a company that simplifies and enhances financial opportunities using state-of-the-art technology.

This is Hybrid role (3 days in office /2 days remote)

About your Team:

The Enterprise Architecture organization is looking for a Data Engineer to join the team and help build the next generation of data infrastructure and AI-enabled workflows. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines, data lake platforms, and analytics solutions that support enterprise-wide AI initiatives and advanced analytics capabilities. You will partner closely with internal development teams and IT leadership to architect data solutions that meet diverse use-cases across the organization. This role offers the opportunity to work with cutting-edge data technologies, AI knowledge bases, and cloud-native data platforms as we scale our data operations. Your work will focus on delivering robust, well-documented data solutions and establishing best practices for data engineering across the enterprise.

 What will be your responsibilities within IBKR: 

 

· Design, build, and maintain scalable data crawlers and ETL/ELT pipelines to ingest data from various sources including enterprise collaboration tools, web applications, and internal databases

· Develop and manage data lake platform infrastructure including S3-based storage, Iceberg tables, AWS Glue data catalog, and cloud data warehouse solutions for analytics workloads

· Build and optimize real-time streaming data pipelines using Kafka for event-driven analytics and data processing

· Create and maintain data transformation pipelines to clean, curate, and prepare data for analytics and AI/ML applications, supporting multiple data formats including structured, semi-structured, and unstructured data (text, images, audio, video)

· Develop Python-based applications for data ingestion, processing, and integration supporting Gen AI RAG workflows and knowledge base systems

· Collaborate with internal development teams, data scientists, and stakeholders to understand requirements, architect appropriate data solutions, and create comprehensive technical documentation

· Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and data quality

· Write clean, maintainable, well-tested code following software engineering and data engineering best practices

· Create comprehensive technical documentation for data pipelines, architectures, and platform capabilities

 

 

 What required skill’s you need:

· 6+ years of hands-on data engineering experience with modern data stack technologies

· Strong experience with AWS cloud services, particularly: S3, AWS Glue, Athena, EMR, Lambda

· Proficiency in Python for data processing, ETL, and application development

· Experience with PySpark on EMR for large-scale data processing

· Strong SQL skills for data analysis and transformation

· Experience building and maintaining ETL/ELT pipelines at scale

· Experience with Kafka for streaming data pipelines and real-time data processing

· Knowledge of data lake architectures and modern table formats (e.g., Iceberg)

· Experience with CI/CD practices using Git, version control systems, and containerization (Docker)

· Understanding of data modeling, data warehousing concepts, and analytics best practices

· Exceptional problem-solving and analytical skills

· Excellent collaboration and communication (verbal and written) skills

· Self-motivated with ability to work independently and manage multiple priorities

· Willingness and enthusiasm to learn AI/ML technologies, stay current with emerging data engineering trends

 

 To be successful in this position, you will have the following:

  • Self-motivated and able to handle tasks with minimal supervision.
  • Superb analytical and problem-solving skills.
  • Excellent collaboration and communication (Verbal and written) skills.
  • Outstanding organizational and time management skills.

Company Benefits & Perks

  • Competitive salary, annual performance-based bonus and stock grant
  • Retirement plan 401(k) with competitive company match
  • Excellent health and wellness benefits, including medical, dental, and vision benefits. Company paid medical healthcare premium.
  • Wellness screenings and assessments, health coaches and counseling services through an Employee Assistance Program (EAP)
  • Paid time off and a generous parental leave policy
  • Daily company lunch allowance provided and a fully stocked kitchen with healthy options for breakfast and snack
  • Corporate events including team outings, dinners, volunteer activities and company sports teams
  • Education reimbursement and learning opportunities
  • Modern offices with multi-monitor setups

 

The anticipated base salary range for this role is $150,000 to $200,000 per year, based on skills, experience, and location. The offered salary is just part of the total compensation package. In addition to a competitive salary, the company offers both a discretionary cash bonus and a stock award, as well as a wide range of benefits, including healthcare, tuition reimbursement, and more.

 

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf

Education

Select...
Select...
Privacy Disclosure *

Interactive Brokers (“IBKR”) is committed to protecting the privacy of its users. 1. Aggregate Information about Visitors. We collect information on a general and aggregate basis, such as IP addresses, in order to analyze the performance of our sites. This data is used completely anonymously in order to determine the number of people who visit our sites and the most frequently used sections of our sites. This enables us to continually update and refine our sites to ensure it provides you with a successful experience. 2. Information about Users. When registering you are requested to enter certain information about yourself. This information forms the basis for any job application. 3. Your online resume and job application. The details of your job application, covering letter, resume and academic results and any other information will not be viewed by anyone except IBKR and any third party service providers used by IBKR for its hiring processes. 4. Information Management. You can edit any information entered at any time before your job application is submitted. This includes contact details, email address, job application information and password. However, once a job application has been sent, that specific job application cannot be altered. You have certain rights to see and correct data held about you. Please refer to the IBKR Group Privacy Policy on our website. 5. Security. The security of our system is very important to us and we work hard on it. However, please note that no data transmission over the Internet is 100% secure.

Select...
Select...
Select...

For fresh graduates please mention 'NA'. 

Select...
Select...
Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Interactive Brokers’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...

Voluntary Self-Identification of Disability

Form CC-305
Page 1 of 1
OMB Control Number 1250-0005
Expires 04/30/2026

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury
Select...

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.