Senior Manager, Generative AI Test Engineering
Lab Summary:
We focus on developing speech recognition, advanced speech personalization, and state-of-the-art natural language understanding technology. We are dedicated to creating an advanced AI platform that handles seamless conversations across a variety of devices, as well as democratizing AI by allowing developers and IoT manufacturers to add new capabilities to Bixby.
Position Summary:
We’re seeking a Senior Manager for our Generative AI Test Engineering team–which will join our Quality Insights team. You will be responsible for managing a small team and for designing and implementing testing strategies and frameworks to evaluate the performance, accuracy, robustness, and safety of AI models and systems. You will collaborate closely with research teams to understand new model capabilities and translate them into robust testing plans and scenario. You will drive development and maintenance of automated testing frameworks and tools for efficient AI validation and system-level testing.
Position Responsibilities:
- Lead of small team of Data Scientists and QA Engineers
- Act as a player/coach and utilize test results data to guide product development, identify opportunities, predict challenges, and inform strategic decisions
- Measure product success through metrics, identifying areas for improvement, and effectively communicating insights to stakeholders
- Work closely with other functions, such as engineering, product, design, and others
Required Skills:
- Bachelor’s degree in Computer Science, Computer Engineering, or equivalent combination of education, training, and experience
- 12+ years of professional software development testing experience, including test automation frameworks and tools building
- 2+ years of people management experience
- Experience with LLMOps, model monitoring, or ML observability platforms
- Proficiency in Python, SQL, and data visualization tools for model analytics
- Strong knowledge of QA methodologies, test automation, and CI/CD integration
- Experience as a mentor, tech lead or leading an engineering team
Special Attributes:
- Hands-on experience with LangChain, OpenAI API, Hugging Face models, or RAG pipelines
- Knowledge of cloud platforms (AWS/GCP/Azure) for data workflows and ML deployment
- Familiarity with human-in-the-loop QA or AI-assisted testing workflows
Base Pay Range
$197,800 - $296,600 USD
Additional Information
Disclosure of Trade Secrets
Samsung has a strict policy on trade secrets. In applying to Samsung and progressing through the recruitment process, you must not disclose any trade secrets of a current or previous employer.
Essential Job Functions
This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, and frequently operate standard office equipment, such as telephones and computers.
Samsung Research America is committed to complying with all Federal, State and local laws related to the employment of qualified individuals with disabilities. If you are an individual with a disability and would like to request a reasonable accommodation as part of the employment selection process, please contact the recruiter or email sratalent@samsung.com.
Equal Employment Opportunity
At Samsung, we believe that innovation and growth are driven by an inclusive culture and a diverse workforce. We aim to create a global team where everyone belongs and has equal opportunities, inspiring our talent to be their true selves. Together, we are building a better tomorrow for our customers, partners, and communities.
Samsung Research America is committed to employing a diverse workforce, and provide Equal Employment Opportunity for all individuals regardless of race, color, religion, gender, age, national origin, marital status, sexual orientation, gender identity, status as a protected veteran, genetic information, status as a qualified individual with a disability, or any other characteristic protected by law.
For more information regarding protection from discrimination under Federal law for applicants and employees, please refer to this link: Pay Transparency
Apply for this job
*
indicates a required field