AI Evaluator

About the Job:

As an AI Evaluator you will work to help state-of-the-art generative AI models perform better. 

In this role, you will ensure the high quality of AI-generated writing and create original content that enhances the AI’s capabilities. Your insights into client needs and best practices will be instrumental in driving our success and shaping the future of AI-driven content.

Key Responsibilities: 

• Write detailed top-tier original content that demonstrates great creativity and an excellent grasp of English grammar and comprehension.
• Evaluate, edit, and improve the quality of AI-generated writing as well as that from humans-in-the-loop.
• Rate the quality of AI-generated content on rubrics such as grammar, brevity, and correctness.
• Be a thought partner to Delivery managers, input into the project delivery strategies, and share quality best practices to aid in achieving the project goals.
• Deliver just-in-time coaching/mentorship support to production teams on new or changing project instructions as well as “refreshers” on existing instructions on an as-needed basis.
• Manage investigations of escalations to understand the root cause(s), work through the remediation actions, and champion the recovery process.
• Manage the performance and quality of your team through coaching and mentoring to improve writing quality.
• Be a master of the Sama platform.

Minimum Qualifications:

• Have completed a Bachelor's degree or higher in English or Literature.
• Fluency in English at C1/C2 level. Excellent English grammar and comprehension.
• A critical eye and the ability to clearly explain the strengths and weaknesses of a given piece of text.
• Excellent sense of writing style.

Preferred Qualifications:

• At least 2 years of experience in a creative writing role.
• Experience in GenAI is an added advantage.
• Strong critical thinking, reasoning, and exceptional problem-solving skills.
• Excellent written and oral communication skills.
• Demonstrable ability to perform well in a rapidly changing and extremely global team.
• Excellent attention to details.
• Passion for our mission of ensuring a world-class support experience for our community and customers.
• Experience as an editor is an added advantage.

About Sama 

Sama provides high-quality training data that powers AI technology for Fortune 2000 companies such as Google, Walmart, Ford, Microsoft, and Marriott. We’re experts in data curation and data annotation for 2D and 3D image, video, and sensor data for machine learning algorithms. Sama offers the highest quality SLAs in the industry, along with cutting-edge ML-assisted annotation tools, QA processes, and security and compliance standards. 

Founded in 2008 on the belief that “talent is equally distributed, but opportunity is not”, Sama is driven by the mission to expand opportunities for those who are underprivileged. As a certified B-corp, Sama has provided worker training programs to increase economic opportunity for more than 13,000 people from underserved communities. By connecting our customers with amazing talent in East Africa, we've impacted more than 59,000 workers and their dependents.

Today, our vision is to provide data scientists, ML engineers, and data operations teams with an indispensable, integrated platform for AI data preparation, labeling, and collection. 

For more information, visit www.sama.com.

More information can be found at:

• Featured in Forbes: How Ethical Is Your AI?
• Sama Honored on Inc. Magazine’s Annual List of America’s Fastest-Growing Private Companies — the Inc. 5000
• Reversing Poverty - Ted Talk by our founder Leila Janah

Our Culture:

Sama is quite unique. We are a technology company with a social mission. People that thrive in a high-growth environment, love working on the bleeding edge of technology, and really care about having a positive impact on the world are a great fit for the Sama culture. Our core values are One Team, One Goal - Deliver. Period. - Trust & Transparency - Customer First - Humanity.

Our Benefits:

Sama is proud to offer competitive compensation corresponding to market data & level of experience. Sama also offers benefits packages based on country of employment, including but not limited to medical, dental, vision, and life insurance, holiday and vacation policies, professional development stipends and a paid sabbatical program. Our Talent Acquisition team would be happy to discuss our benefits packages with you in more detail during the interview process.

At Sama, we pride ourselves in being a diverse and equal opportunity employer.