Back to jobs
New

QA Automation Engineer

Colombia

About the Role

Join Alvys, an early-stage company ambitiously transforming the $800B US freight industry. As a Senior QA Engineer, you will be the quality infrastructure authority for your domain. You will design test architecture, own the CI/CD quality pipeline, and build the frameworks and tooling that let the whole engineering organization ship with confidence. You will also run AI agents as part of your testing practice, with the specifications, evals and controls that make their output trustworthy.

In this role, you will collaborate closely with engineering, product, and customer success teams to ensure our software remains reliable, performant, and capable of meeting complex customer needs within the transportation logistics sector.

About Alvys

Alvys is on a mission to revolutionize transportation logistics. Combining hands-on industry expertise with a world-class technical vision, we're building a multi-tenant SaaS platform that's becoming indispensable for transportation companies.

Our Principles

  • Engineering Excellence: We embrace a balanced approach of practical and theoretical techniques to deliver superior code quality and architecture.
  • End-to-End Ownership: If you build it, you own it—teams are fully responsible for their code and its performance.
  • Blameless Culture: We learn from mistakes collaboratively, focusing on growth rather than finger-pointing.
  • Core Values: Trust, transparency, and fairness underlie everything we do, shaping the solutions we build for an often fragmented industry.

Tech Stack

We leverage a combination of modern testing tools and frameworks, including Playwright for end-to-end automation, with contract, performance and synthetic tests running in our CI/CD pipelines. Engineers in this role also use AI coding agents, skills and evals to build, run and verify tests. The ability to scale and optimize our test automation infrastructure is a key part of the role.

Minimum Qualifications

  • 4 to 7 years of industry experience in software or test engineering.
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Strong track record designing and building Playwright-based test automation frameworks that other engineers adopt.
  • Experience owning a CI/CD quality pipeline, including parallelization, flake management and post-deploy monitoring.
  • Experience defining test strategy for complex software systems, with risk-based prioritization and measurable quality metrics.
  • AI proficiency, at minimum, you write specifications with acceptance checks before delegating to an agent, review results against evidence, and keep task state outside the context window.
  • Strong analytical and problem-solving skills with a dedication to delivering high-quality software.

Preferred Qualifications:

  • AI proficiency with running parallel agent loops in a harness, with evals in CI and reusable checks built from past failures.
  • Experience building eval and regression frameworks for AI-powered features or non-deterministic system outputs.
  • Experience with contract testing, synthetic monitoring or chaos engineering.
  • Proficiency in performance and load testing tools.
  • Experience mentoring test engineers and driving quality practices across multiple teams.
  • Knowledge of industry-standard tools for bug tracking and test management, such as Jira, Azure DevOps, or TestRail.

Responsibilities

  • Quality infrastructure: Architect the automation and quality infrastructure strategy for your product area, including Playwright-based frameworks that every engineer, not only QAs, can use.
  • CI/CD quality pipeline: Own the pipeline end to end: sharding, parallelization, flake SLOs, artifact collection and post-deploy monitors. Build dashboards for test health, flakiness, coverage trends and mean time to detection.
  • Advanced testing: Apply contract testing, performance testing, synthetic monitoring and chaos engineering where the risk justifies them.
  • Test architecture: Define the test strategy and standards for your domain, including test pyramid balance, coverage targets and risk-based prioritization. Design test data and environment isolation so tests stay deterministic at scale.
  • AI-driven testing: Run agent-based test development and triage loops with software-enforced limits, and build eval and regression frameworks for AI-powered features. See AI Literacy below.
  • Process: Improve release processes and quality gates. Lead post-incident quality reviews and make sure systemic fixes are automated and monitored.
  • Influence: Represent quality in architecture and product decisions. Work with Product, Platform and Customer Success, and use escape rate, MTTD and flakiness rate to guide quality investment.

Equal Employment Opportunity

Alvys is an equal opportunity employer and as such, we do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other characteristic protected by applicable laws.

We are dedicated to growing a diverse team of highly talented people. We’re dedicated to building a workplace where we give each other the strategies, support, and space we each need to thrive—believing in and bringing out the best of everyone.

If you require any accommodations during the recruitment process, whether it be alternate forms of material, accessible meeting rooms, etc., please let us know and we will work with you to meet your needs.

For information about Alvys's privacy practices, see our Privacy Policy.

#LI-Remote

Create a Job Alert

Interested in building your career at Alvys? Get future opportunities sent straight to your email.

Apply for this job

*

indicates a required field

Phone
Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf


Select...