Senior QA Automation Engineer (Azure, Python, SQL) for Sora Union

🌍 Talent is everywhere, opportunity is not. 🌍 Sora Union changes that.

Sora Union is a professional services company specializing in Engineering, Design, and QA projects for businesses, organizations, and governments. The Sora Union team is globally distributed and made up of diverse and talented professionals impacted by or at risk of displacement due to conflict or climate change.

We are seeking a Senior QA Automation Engineer with expertise in data quality assurance, test automation, and cloud-based data platforms. This role involves designing, implementing, and maintaining automated testing frameworks for Azure-based data solutions, ensuring the integrity and accuracy of complex ETL/ELT pipelines, data warehouses, and BI reports. The ideal candidate will have strong Python, SQL, and Azure experience, along with a passion for data validation and automation.

As a  Senior QA Automation Engineer – Data Quality collaborating with our clients, you will engage with a variety of products and companies, both large and small. Your main responsibility will be to ensure they provide the best possible experience for their users. You will work closely with software developers, product managers, designers, and customer service teams to enhance confidence in our clients’ releases. This includes testing applications, investigating issues, and reporting findings.

Success in this role comes from your enthusiasm for becoming a top expert on a product and its delivery to consumers. You should be an adept communicator, able to share information in a straightforward manner with both technical and non-technical stakeholders.

Key Responsibilities:

• Plan, design and execute testing activities for new features being implemented as well as for the changes to existing systems
• Be hands-on in the creation of test cases and test execution.
• Be a strong advocate for test automation with extensive experience in delivering working solutions.
• Create manual and automated test cases to verify functional and non-functional requirements of solutions in various stages of the development life cycle.
• Find critical bugs and verify reported issues, identifying their underlying cause and seeing them through to resolution and liaising with other teams where appropriate.
• Producing descriptive and concise bug reports that evidence the functionality of a solution.
• Communicating status information and issues to a variety of stakeholders, adapting
• appropriately depending on the audience.

Ideally, you’ll have:

• Data Quality & Validation in Azure
• Verify Data Pipelines in Azure Data Factory (ADF) and Databricks to ensure data accuracy.
• Test ETL/ELT Processes: Validate transformations, data ingestion, and data movement.
• Schema Validation: Ensure table structures and constraints match expectations in SQL Server. 
• Data Completeness and Consistency checks between source and destination databases.
• Data Profiling: Detect anomalies, missing values, or duplicate records.
• Automated Testing Framework using Python.
• Develop automated data validation tests using PyTest, PySpark and Pandas
• Implement Integration Tests for SQL queries and transformations.
• Build reusable test scripts for data pipeline validation in Azure Data Factory and Databricks.
• Test Data Lineage and Auditing using logging and monitoring tools.
• SQL and Database Testing
• Write complex SQL queries to validate transformations and business rules.
• Compare source and target tables for data accuracy after transformations.
• Verify indexes, constraints, and stored procedures in SQL Server.
• Validate Performance and Query Optimization for large datasets.
• CI/CD for Data Testing
• Integrate Automated Tests in CI/CD pipelines using Azure DevOps or GitHub Actions.
• Schedule Data Quality Checks in Databricks Workflows or ADF Pipelines.
• Automate Deployment Testing for data models, ETL pipelines, and transformations.
• Extensive experience in testing software, systems, and data solutions (for example Data Warehouses) with a focus on Test automation.
• Ability to think creatively, problem-solve and innovate.
• Extensive experience in testing BI reports, dashboards, datasets, and data models.
• Experience in agile software development methodologies.
• Solid understanding of the testing pyramid and experience in implementing it at various levels
• Experience building an Automation Framework from scratch and creating and maintaining automated tests.
• Experience in mentoring QAs on automation tools, and frameworks and performing code reviews.
• Experience working closely with BA and Developer to derive the Acceptance criteria and participating in 3 amigos sessions.

Essential skills:

• Cloud: Azure Data Factory, Azure Databricks, Azure SQL Server
• Database/Storage: SQL Server, Azure Synapse, Delta Lake
• Programming: Python (PySpark, Pandas), SQL, C#, REST APIs
• Monitoring: Azure Monitor, Log Analytics, Databricks
• CI/CD: Azure DevOps, GitHub Actions
• Automation/Frameworks: PyTest, DataDiffPy, GreatExpectation, POSTMAN
• Advanced SQL

Desired Experience: 

The ideal candidate will have financial services experience in the private equity, infrastructure & real assets, or private debt space. However, this is not a stringent requirement.

Desired skills:

• Experience working on and Testing Traditional ETL tools (SAP Business Objects Data Services, INFORMATICA, SSIS, etc.)
• Experience testing Business Objects & Crystal Reports Selenium
• Use of BDD and/or TDD framework
• Testing Power BI dashboards, reports, and datasets.

This role is distributed and can be based in any location.

Sora Union is committed to creating and fostering a diverse team. We encourage people from underrepresented backgrounds and all walks of life to apply. We are committed to providing reasonable accommodations to all applicants throughout the application process