Data Engineer
The Swift Group is seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have a strong background in building and managing data pipelines, collaborating with development teams, and working with various data processing and cloud technologies. You will play a key role in designing, implementing, and maintaining scalable data solutions.
Required Qualifications:
- 4+ years of data engineering experience, and solid educational training in data engineering
- Experience in building and managing data pipelines
- Experience working on a highly collaborative development team
- Experience with python
- Experience with cloud computing using AWS services
- Experience processing data using spark
- Experience with an RDBMS (Postgres, Oracle, MySQL) and writing SQL queries
- Experience with Linux and shell scripting
- Experience analyzing data in different file formats like csv, xml, json, avro, parquest, etc.
- Experience writing unit tests
- BA/BS Degree in relevant field (5 years of relevant experience in lieu of a degree)
- US citizenship with an active TS/SCI with Polygraph security clearance required
Desired Qualifications:
- Experience in NiFi, Apache AirFlow, or an equivalent solution or tool for orchestrating data pipelines
- Experience with java or scala
- Experience administering an EMR/Spark cluster
- Experience conducting performance tuning of a spark job
- Experience supporting Hive, Iceberg, or another technology providing SQL access to data
- Experience developing cloud-based security solutions
- Experience following a configuration management process to review and deploy code as part of releases
- MA/MS Degree
The Swift Groups and Subsidiary's are an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status, or any other protected class.
Pay ranges are a general guideline and not intended as a guaranteed and/or implied final compensation or salary for this job opening. Determination of official compensation or salary relies on several different factors including, but not limited to: level of position, complexity of job responsibilities, geographic location, work experience, education, certifications, Federal Government contract labor categories, and contract wage rates.
At Swift Groups and Subsidiary's you will receive comprehensive benefits including but not limited to: healthcare, wellness, financial, retirement, education, and time off benefits.
Apply for this job
*
indicates a required field