Back to jobs

Senior Data Engineer

Remote - United States

Overview: ComplexCare Solutions is a leading technology company that combines advanced cloud-based data analytics and data-driven intervention platforms to achieve meaningful insight. Platform require to ingest large amount of variety of data from various clients. Timely and accurately ingestion of business data is utmost critical for the success of the platform. You have the opportunity to create configurable and robust data ingestion platform and work on truly cutting-edge cloud and big data technologies.

 

Duties and Responsibilities:

  • Work with the agile team to participate in agile ceremonies like grooming, planning, standup, retrospective, demos
  • Actively contribute to grooming, and standup, create & update tasks estimate and status
  • Design and develop modern data ingestion pipeline utilizing tools like ADF (Azure Data Factory), Databricks, MS-SQL
  • Extensively work on Azure Cloud Platform
  • Write complex queries, stored procedures, functions, for various job execution, manipulating data
  • Create highly configurable design to apply various business rules, filters, mapping based on various clients
  • Work with data architects and business analysts to create a logical data model and create DDL scripts for physical model creation
  • Read data files (flat, excel, csv, json etc) from sftp servers, validate the data utilizing various business rules and configurations
  • Design and code various data architecture component like data validation, cleansing, de-duping, Symantec layer
  • Work on large data to ensure configurable ingestion of data, dynamic rule & validation of data, cleansing, transforming and loading into the data warehouse
  • Design and implement data validation and quality checks to ensure the accuracy and completeness of the data in the data warehouse
  • Perform performance of queries and data processing, identify and resolve any issues looking at query plans, create appropriate indexes, resolve dead locks and create table hints
  • Understand data partition, performance, multi-threading/processing of high volume data
  • Participate in design discussions, data analysis, data model creation etc
  • Product quality design diagrams (using MS-Visio, Draw.io etc) and documentations (MS-Work, Excel etc)
  • Maintain compliance with ComplexCare Solutions policies, procedures and mission statement;
  • Adhere to all confidentiality and HIPAA requirements as outlined within ComplexCare Solutions Operating Policies and Procedures in all ways and at all times with respect to any aspect of the data handled or services rendered in the undertaking of the position; and
  • Fulfill those responsibilities and/or duties that may be reasonably provided by ComplexCare Solutions for the purpose of achieving operational and financial success of the Company.

 

Job Requirements:

  • Minimum of 10 years industry experience working in data & reporting area, knowledge of healthcare data will be a plus
  • 10+ years working on data process/pipeline, ETL, Data Workflow, Query Plans & Optimization
  • 10+ experience in MS SQL, T-SQL, ETL Jobs
  • 5+ years working on databricks, PySpark/SparkSQL, data frames, unity catalog
  • 5+ years’ experience in writing query plans, indexes etc
  • 5+ years’ experience working on Azure Cloud is preferred utilizing ADF (Azure Data Factory), Azure Delta Lake, Azure SQL Server, Data Sync, Log Insights and Analytics
  • Experience working with Role based security at database, ETL jobs, data exports level
  • Experience with HIPPA and PHI will be a plus
  • Ability to effectively communicate with internal and external customers
  • Excellent verbal and written communication skills
  • Excellent computer proficiency (MS Office – Word, Excel and Outlook)
  • Must be able to work under pressure and meet deadlines; and
  • Ability to work independently and to carry out tasks to completion following standard accepted practices

 

Education:

  • BS degree in Computer Science or Computer Engineering, Business, or equivalent experience.

 

Physical Demands and Work Environment:

  • Sedentary work (i.e., sitting for long periods of time);
  • Exerting up to 10 pounds of force occasionally and/or negligible amount of force;
  • Frequently or constantly to lift, carry push, pull or otherwise move objects and repetitive motions;
  • Subject to inside environmental conditions; and
  • Some travel (less than 10%) may be required for this position, primarily for training and collaboration purposes.

 

 

Studies have shown that women and people of color are less likely to apply for jobs unless they believe they meet every one of the qualifications listed in a job description. If you don’t meet every qualification listed but are excited about our mission and the work described, we encourage you to apply regardless.  ComplexCare Solutions is most interested in finding the best candidate for the job and you may be just the right person for this or other roles.

By embracing diversity, equity and inclusion we enhance our work environment and drive business success. ComplexCare Solutions strives to reflect the diversity of the communities where we operate and of our clients and everyone whom we serve. We endeavor to create a culture of inclusion in which our associates feel empowered to bring their full, authentic selves to work and pursue their professional goals in an equitable setting. We understand that by fostering this type of culture, and welcoming different perspectives, we generate innovation and growth.

ComplexCare Solutions is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirement.

The Company maintains a drug free work environment for all of its associates, which includes employees, contractors and vendors. It is unlawful for associates to manufacture, sell, distribute, dispense, possess or use any controlled substance or marijuana in the workplace and doing so will result in disciplinary action, up to and including termination of employment or the contracted relationship.

To review the legal requirements, including all labor law posters, please visit this link

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf

Select...
Select...
Select...
Select...

You must be able to select "yes" in order to proceed.

Select...
Select...

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in CCS, LLC’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...

Voluntary Self-Identification of Disability

Form CC-305
Page 1 of 1
OMB Control Number 1250-0005
Expires 04/30/2026

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury
Select...

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.