DataOps Lead

DataOps Lead

Job Title: DataOps Lead

Location: Bangalore

Job Type: Full-Time

Experience Level: 7-10 Yrs

Job Summary:

We are looking for a skilled DataOps Engineer with Java expertise and experience in IT infrastructure risk management. You will play a pivotal role in developing and maintaining scalable data pipelines while auditing and identifying potential risks across IT systems. Your work will ensure seamless data operations, help clients understand the risks and vulnerabilities in their infrastructure, and assist them in mitigating those risks to enhance security and compliance.

Key Responsibilities:

• Audit clients’ IT infrastructure, identifying assets, analyzing vulnerabilities, and assessing associated impacts and threats.
• Provide risk-based recommendations for addressing identified vulnerabilities based on criticality and potential impact to the business.
• Implement data security and governance strategies across infrastructure components, ensuring compliance with industry standards and regulations.
• Create and maintain continuous integration (CI) and continuous deployment (CD) pipelines for data processes and infrastructure.
• Monitor data infrastructure performance, identify bottlenecks, and ensure high availability and resilience.
• Ensure that all data systems comply with information security standards, conducting regular vulnerability assessments.
• Collaborate with clients and stakeholders, delivering clear communication about identified vulnerabilities, threats, and recommended risk mitigation strategies.
• Work on mitigating technical risks by prioritizing and addressing high-impact vulnerabilities and implementing security patches, configuration changes, or design modifications.
• Conduct IT infrastructure audits to identify assets, associated vulnerabilities, and potential threats.
• Analyze the impact and severity of each vulnerability, prioritizing risks based on potential business impact and criticality.
• Develop risk mitigation strategies and provide clients with actionable recommendations to address high-priority risks.
• Implement and maintain security controls within the data pipeline and IT systems to minimize exposure to threats.
• Conduct regular vulnerability assessments and create reports to track risk management efforts and progress.
• Advise clients on best practices for securing their infrastructure and data, ensuring compliance with security regulations (GDPR, HIPAA, etc.).

Required Skills:

• Experience managing data pipelines using Java with tools like Apache Kafka, Apache Spark, or similar technologies.
• Familiarity with Java with a fair understanding of object-oriented programming (OOP) and system architecture.
• Familiarity with databases (SQL, NoSQL), data lakes, and distributed data systems.
• Hands-on experience with DevOps practices like CI/CD, infrastructure as code, and automation tools.
• Experience with containerization (Docker) and orchestration platforms such as Kubernetes.
• Familiarity with cloud platforms (AWS, Azure, GCP) and their security and risk management tools (e.g., AWS Inspector, Azure Security Center).
• Strong knowledge of vulnerability management frameworks and tools (e.g., Nessus, Qualys, OWASP).
• Experience with security patch management, configuration auditing, and IT asset management systems.
• Familiarity with threat modeling, risk assessment methodologies, and mitigation strategies based on criticality.
• Strong understanding of IT risk management, including the ability to identify threats, assess impact, and recommend appropriate mitigation strategies.

Nice to Have:

• Experience with data security frameworks and regulatory compliance (GDPR, CCPA).
• Understanding of DataOps frameworks and principles, including observability and monitoring of data pipelines.
• Exposure to message brokers like RabbitMQ, ActiveMQ, or similar technologies.
• Experience in automation frameworks for testing data flows and pipelines.
• Prior experience with big data technologies (Hadoop, HDFS) would be an added advantage.
• Hands-on experience with security tools like Nessus, Splunk, or Qualys.
• Knowledge of incident management, disaster recovery, and business continuity planning.
• Experience in developing automated scripts to track and remediate vulnerabilities.

Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or related field.
• years of experience in Java development and data-related projects.
• Strong problem-solving skills and ability to work independently as well as in a team.