Expert Contributor - Reasoning and STEM Domains (Contract)

We’re on a mission to democratize AI by building the definitive AI data development platform. The AI landscape has gone through incredible change between 2016, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high performance, and production-ready systems. We work with some of the world’s largest organizations to empower scientists, engineers, financial experts, product creators, journalists, and more to build custom AI with their data faster than ever before. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!

Location: Remote
Hours: Expert Contributors are expected to commit to a predictable daily schedule with an average of 20-30 hours per week, Monday through Friday.
Pay:

• Weekly Base Pay: Guaranteed at $1,000 minimum, based on the contributor's available commitment and adherence to task guidelines.
• Milestone-Based Incentives: Additional compensation tied to achieving project milestones as part of a team effort.

Company Overview

Snorkel is at the forefront of AI development, building high-quality datasets that leverage the strengths of Large Language Models (LLMs) in language understanding and data processing. While LLMs have excelled in tasks like language generation and pattern recognition, advancing their reasoning capabilities is the next frontier. Our goal is to push the boundaries of AI by designing and scaling datasets that will shape new AI technologies focused on complex reasoning tasks across domains such as Math, Physics, Economics, and Biology.

This is an opportunity to contribute directly to the advancement of AI by developing challenging reasoning tasks and datasets that will transform LLMs into more sophisticated reasoning systems.

Role Overview

As an Expert Contributor (EC), you will play a pivotal role in creating, curating, and reviewing reasoning tasks for a groundbreaking AI benchmark. You'll help bridge the gap between what LLMs excel at now and the advanced reasoning capabilities we aim to achieve. Contributors will collaborate within a cohort environment, engaging in live learning sessions and leveraging shared incentives tied to achieving project milestones.

This role is ideal for individuals with expertise in STEM or reasoning-based fields who are detail-oriented, self-motivated, and eager to shape the future of AI reasoning.

Key Responsibilities

Tasks will include, but are not limited to:

• Reasoning Dataset Development:
• Generate challenging questions in domains such as Math, Physics, Chemistry, Economics, and Common Sense Reasoning.
• Design datasets that test reasoning skills like deductive reasoning, causal reasoning, and pattern recognition.
• Collaboration in Cohort Environment:
• Participate in live learning sessions and peer discussions to enhance dataset quality and resolve challenges.
• Contribute to group efforts to meet project milestones and achieve shared rewards.

Compensation Structure

This project combines weekly base pay with milestone-based incentives, structured to provide consistent earnings and additional rewards for achieving project goals:

1. Base Pay:
• Weekly pay of $1,000 minimum for consistent participation and contributions based on a predictable schedule.
2. Milestone-Based Incentives:
• Additional pay for achieving shared project milestones, such as completing key batches of data, meeting biweekly targets, or ensuring quality standards.

Preferred Qualifications

• Advanced degrees or strong experience in STEM fields such as Math, Physics, Chemistry, Economics, or Computer Science.
• Strong analytical and reasoning skills, with the ability to create or solve complex reasoning tasks.
• Previous experience in data annotation, question generation, or educational content creation is a plus.
• Ability to adhere to a predictable daily schedule and collaborate effectively within a cohort environment.

Commitment Expectations for ECs

• Commitment: Contributors must adhere to a consistent daily schedule, with 20-30 hours per week over the duration of the project. Tasks require focus, consistency, and the ability to build on prior work.
• Collaboration: Active participation in the cohort environment, including live learning sessions and group discussions, to collectively achieve milestones.
• Accountability: Maintain clear communication through designated channels and contribute to a professional and supportive team environment.

Why Join Us?

By joining this project, you will:

• Contribute to a groundbreaking open-source benchmark that will advance frontier AI.
• Earn competitive pay with opportunities for additional compensation tied to achieving project milestones.
• Work on challenging and rewarding tasks in a structured and collaborative environment.
• Gain recognition for your contributions to the future of AI reasoning.

If you’re passionate about advancing AI and eager to collaborate on cutting-edge datasets, apply now to become a part of this transformative project!