Content Strategist III

Summary:

We are looking for an experienced and detail-oriented Content Strategist III to join our team. In this role, you will develop comprehensive content evaluation guidelines that empower content reviewers to assess quality, consistency, and policy alignment at scale. As part of the Product Data Operations team, you will play a pivotal role in bridging product strategy with human annotation workflows, driving the high-quality data that powers AI products and experiences.

The ideal candidate possesses a strong background in content strategy, a proven ability to create human labeling guidelines, and a deep understanding of content evaluation methodologies. Experience working with UX Research teams to design, test, and refine survey questions is highly preferred. If you’re passionate about building scalable systems to improve content quality and excel at transforming ambiguous policies into actionable frameworks, we encourage you to apply.

Job Responsibilities

Develop Content Evaluation Guidelines:

• Translate product strategies, content policies, and research insights into structured, actionable content labeling guidelines for human annotators.
• Collaborate with Product, UX Research, and Product Data Operations (PDO) teams to identify content quality challenges and define labeling requirements.
• Create clear and comprehensive guidelines to ensure consistent content evaluation across large-scale annotation pipelines.

Define Evaluation Criteria:

• Establish objective, measurable evaluation criteria aligned with product goals, brand voice, and quality standards.
• Design decision tree questions that are concise, comprehensive, and unbiased, enabling reviewers to annotate data accurately and efficiently.
• Continuously refine evaluation frameworks based on reviewer feedback, performance data, and stakeholder input.

Stakeholder Collaboration:

• Work closely with content reviewers, product teams, and PDO teams to ensure guidelines meet their needs.
• Provide training and support to content reviewers to ensure effective implementation of evaluation guidelines.
• Gather feedback from stakeholders to iterate on and enhance guidelines.

Data Analysis & Reporting:

• Develop metrics to monitor and measure content quality and consistency.
• Analyze evaluation data to identify trends, bottlenecks, and opportunities for improvement.
• Create reporting frameworks to share performance insights and guideline effectiveness with stakeholders.

Continuous Improvement:

• Stay updated on emerging trends in content moderation, AI advancements, and UX research best practices.
• Design research studies to evaluate how guideline updates impact reviewer accuracy and content quality outcomes.
• Advocate for inclusive and culturally sensitive evaluation criteria across global content pipelines.

Required Skills:

• 3+ years of experience in content strategy, content operations, or a related field.
• Proven track record of developing and implementing content evaluation guidelines.
• Excellent communication, collaboration, and project management skills.
• Strong analytical and problem-solving abilities, with proficiency in Excel.
• Ability to thrive in fast-paced environments and adapt to shifting priorities.
• Experience with content management systems (CMS).
• Bachelor’s degree in English, Communications, Journalism, or a related field.

Preferred Skills:

• Experience with generative AI tools and applications.
• Knowledge of SEO principles and their impact on content evaluation.
• Certification in content strategy or a related field.
• Experience working with global teams and tailoring guidelines for diverse regions and cultures.

Pursuant to the California Fair Chance Act, Los Angeles County Fair Chance Ordinance for Employers, Los Angeles Fair Chance Initiative for Hiring Ordinance, and San Francisco Fair Chance Ordinance, qualified applicants will be considered for assignment with arrest and conviction records. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness, meet client expectations, standards, and accompanying requirements, and safeguard business operations and company reputation.

Location: United States (Remote, West Coast preferred)

Role type: Contract 3 Month Position 

Expected hours: 40 per week 

Benefits:

• Dental insurance
• Health insurance
• Health savings account
• Life insurance
• Paid time off
• Retirement plan
• Vision insurance

Schedule:

• 8 hour shift
• Monday to Friday (Extended schedule as needed Saturday-Sunday)

Application Question(s):

• Do you or will you in the future require any sponsorship to work in the US?

Language:

• English  (Required)