Senior QA Automation Engineer

About Zencoder

Join us at Zencoder, where our mission is to advance human knowledge through innovative AI solutions. We're transforming the landscape of software development by empowering developers with AI coding agents embedded into their workflow that help create high-quality software and accelerate product delivery. By empowering developers to code smarter, faster, and with greater impact we bridge the gap between imagination and implementation, helping organizations ship impactful software products faster.

Our product is an extension for JetBrains and VSCode that assists developers not only in generating code but also in iterative refining and repairing it through embedded AI agents. This approach goes beyond the basic code snippet suggestions. By deeply analyzing developers’ repositories and employing robust software engineering principles, Zencoder's agents enhance code quality and project alignment, freeing developers to concentrate more on innovation and creative problem-solving.

The Opportunity

We're seeking a Senior QA Automation Engineer to empower our QA team and together impact how QA is done in the whole industry integrating with AI technologies. You'll take on the challenge of evaluating and improving LLM quality while working with various programming languages and frameworks. We offer the rare advantage of building from the ground up with no legacy code to hold you back. Design and execute robust automated testing strategies for API, UI and desktop to ensure the highest quality of our software product.

This is a unique opportunity to join an early-stage company led by the founder of a unicorn startup, Andrey Filev, and help scale it into a thriving, innovative business. You’ll be a part of the team that ships AI products, shaping the future of software development and unlocking the creative potential of brilliant minds.

Key Responsibilities

• Develop robust automated tests for APIs, UIs, and desktop applications using TypeScript for VSCode plug-ins (current) and Java/Kotlin for JetBrains plug-ins (near future). Optionally, leverage Python for additional automation and testing tasks.
• Gain in-depth knowledge of IDEs and programming languages to thoroughly test and evaluate product functionality and performance.
• Build an automated testing infrastructure, setting up and integrating automated tests with CI/CD pipelines from the ground up.
• Identify, track, and manage bugs while writing clear technical documentation to support issue resolution and knowledge sharing.
• Conduct code reviews and provide feedback to ensure test code quality.
• Contribute to the design and improvement of our testing strategies and frameworks.
• Evaluate the performance of LLMs.
• Work closely with developers, product managers, and other stakeholders to thoroughly understand requirements, offer constructive feedback, and ensure alignment on quality standards.
• Collaborate closely with developers and users to collect feedback, identify areas for improvement, and investigate issues, ensuring the product meets user needs. Engage with our user community, fostering a supportive environment and leveraging user insights to improve the product.
• Leverage AI tools to increase efficiency and effectiveness within the QA processes.
• Stay updated with the latest trends in QA practices and AI advancements to drive innovation and maintain competitiveness.

Essential Qualifications

• 6+ years of hands-on experience in both manual and automated QA.
• 4+ years of automation experience using one or some of the languages like TypeScript, Kotlin, Java, Python, or C#, with the willingness and ability to quickly adapt to new languages and frameworks.
• Software engineering background with proficiency in Java/Kotlin.
• Ability to design and build test automation infrastructure for UI, API, and desktop applications from the ground up.
• Experience in DevOps practices and configuration management to streamline the QA process.
• Familiarity with desktop GUI automation tools.
• Skilled in maintaining and updating detailed test documentation for clarity and accessibility.
• Proficient in advanced Git techniques, including rebasing and history modification, to manage version control efficiently.
• Exceptional problem-solving skills combined with a proactive and ownership-driven mindset.
• Strong communication skills, with the ability to clearly articulate complex concepts and collaborate effectively with cross-functional teams.
• Proficiency in Python for automation purposes is an advantage. 
• Knowledge of AI technologies, particularly hands-on experience with LLMs and prompt engineering, and understanding of how to evaluate the quality of AI models is a plus.

Why Join Zencoder?

• Impact: Gen AI will change how companies develop software in the next two years. Be at the frontier of that AI work, building a category-leading product in a huge market. You will have an everyday opportunity to innovate.
• Growth potential: Thrive in a high-growth AI startup combining personal and career growth.
• High Talent Density: Collaborate daily with our team of top-notch engineers and founder, Andrew Filev.
• Equity: Align your success with ours by participating in our equity plan.
• Flexibility: We hire globally, prioritizing talent over location. Work where you’re most productive and comfortable.

Zencoder is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.