Data Engineer
Join Accenture Federal Services, a technology company and part of global Accenture, to do work that matters in a collaborative and caring community, where you feel like you belong and are empowered to grow, learn and thrive through hands-on experience, certifications, industry training and more.
Join us to drive positive, lasting change that moves missions and the government forward!
Job Description
Accenture Federal Services is searching for a Data Engineer to design, develop and maintain data solutions for data generation, collection, and processing. This role will help to create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Responsibilities:
Data Pipeline Development & Management
- Design and implement data pipelines utilizing AWS S3, Apache NiFi, and ELK Stack
- Create automated data ingestion workflows with API integration
- Implement NLP-based data transformation and conditioning processes
- Ensure pipeline monitoring, maintenance, and optimization
Data Architecture & Storage
- Design and implement databases based on documented data models
- Lead data storage solutions and architecture decisions
- Establish data cleansing and normalization protocols
- Integrate multiple data sources into consistent, machine-readable formats
Data Quality & Governance
- Implement methodologies for improving data reliability and quality
- Manage data categorization, labeling, and retention policies
- Enforce data governance standards across projects
- Develop and maintain data quality monitoring systems
Visualization & Analytics
- Lead dashboard development and customized visualization initiatives
- Create and maintain reporting solutions
- Provide technical guidance for program study areas
Technical Infrastructure & Tools
- Proficiency in version control and CI/CD practices for data pipelines
- Knowledge of stream processing frameworks (Apache Kafka, Kinesis)
- Experience with data warehousing solutions (Snowflake, Redshift)
Programming & Development
- Strong Python programming skills for data pipeline development
- Advanced SQL knowledge for complex data transformations
- Familiarity with containerization (Docker, Kubernetes)
Data Testing & Monitoring
- Set up monitoring and alerting for pipeline failures
- Create data validation checks and reconciliation processes
- Develop automated testing for data transformations
Performance Optimization
- Experience optimizing large-scale data processing jobs
- Knowledge of query optimization techniques
- Ability to troubleshoot performance bottlenecks
Security & Compliance
- Implement data security best practices
- Understanding of security protocols for sensitive data
Basic Qualifications:
- 3 years of experience with creating data pipelines, ensure data quality, and implementing ETL (extract, transform and load) processes to migrate and deploy data across systems
- Experience with any of the following technology:
- Python programming
- AWS cloud
- Apache NiFi
- ELK Stack
- Docker or Kubernetes
Preferred experience:
- Bachelor’s degree
- Must obtain IAT Level II certification within 90 days of starting
- Experience with AWS cloud services, particularly S3
- Proficiency in Apache NiFi and ELK Stack
- Experience with API integration and data extraction
- Knowledge of NLP and data transformation techniques
- Understanding of data governance principles
- Experience with Apache NiFi / Kafka
- Experience in relational databases
- Experience in NoSQL solutions
- Proficiency in Python
- Proficiency in Java
- Experience with ETL pipeline development and maintenance
- Experience with Elasticsearch, Logstash and Kibana
As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of California, Colorado, Hawaii, Illinois, Maryland, Minnesota, New Jersey, New York, Washington, Vermont, and the District of Columbia. The base pay range for this position in these locations is shown below. Compensation for roles at Accenture Federal Services varies depending on a wide array of factors, including but not limited to office location, role, skill set and level of experience. Accenture Federal Services offers a wide variety of benefits. You can find more information on benefits here. We accept applications on an on-going basis and there is no fixed deadline to apply.
The pay range for the states of California, Colorado, Hawaii, Illinois, Maryland, Minnesota, New Jersey, New York, Washington, Vermont, and the District of Columbia is:
$110,400 - $160,300 USD
Apply for this job
*
indicates a required field