Main responsibilities:

1. Develop data pipelines and internal analytical data products – contribute to architectural decisions, ideation, idea evaluation, provide guidance to team members, and communicate with stakeholders.
2. Build and maintain these data pipelines using Redshift, Redshift, Dynamo, Athena, Glue, EMR, Kinesis, SQS, Firehose, Redis, CDK, Step Functions, etc. These pipelines will process terabytes of information in batch and real-time, and will:
1. Be re-used by various upstream data producers to land their data in the company’s analytical database or customer data center
2. Be used in various of downstream business dashboards and machine learning models for improving batch or real-time decisions or customer experience
3. Calculate real-time business-critical metrics that are used by executives and engineers to make prioritization decisions
3. Initiate & improve backend batch and stream data processing software.
4. Identify opportunities to simplify workflows, automate tasks, and build components that are reusable across multiple use-cases and teams.

What we are looking for:

• Experience:
• 2+ years experience in Data Engineering or back-end Software Engineering
• 2+ years experience working high performance engineering team with Agile framework
• 1+ years experience in building batch and real-time data pipelines that extract, transform, and load the data into analytical data warehouses or data lake
• Creative, resourceful, and enthusiastic about seeking new solutions to problems and opportunities
• Skills and attitudes:
• Expert in SQL, git, and a programming language (ie Python, Java, etc)
• Strong proficiency in Python
• Familiarity with technologies like AWS Serverless, S3, Lambda, Redshift, Dynamo, Athena, Glue, EMR, Kinesis, SQS, Firehose, Redis, CDK, Step Functions
• Experience with CI/CD (Continuous Integration, Continuous Delivery), Automated Testing, Automated Delivery
• Business-proficiency in English
• Bonus Points:
• Experience in building customer data center or large scale real-time/batch customer feature data pipelines/microservices
• Experience in developing real-time data pipeline for fintech companies
• Experience with DBT and airflow