MasterClass

AI Project Reviewer (TEMP)

United States

Not SpecifiedCompensation
Junior (1 to 2 years)Experience Level
Full TimeJob Type
UnknownVisa
Education, E-LearningIndustries

Position Overview

  • Location Type: Remote
  • Employment Type: Contract
  • Salary: Not specified
  • Estimated Hours: ~20 hours/week
  • Description: As an AI Project Reviewer, you will be responsible for evaluating learner submissions against detailed rubrics for a new product. You will apply consistent judgment to determine pass/fail outcomes and provide clear, constructive feedback to help learners improve. Working alongside our product and learning design teams, you’ll help calibrate and validate assessment approaches to ensure fair, accurate, and valuable feedback for our members. This is a contract role with flexible engagement based on project needs.

Who We Are:

MasterClass is the streaming platform where the world's best come together so anyone, anywhere, can access and be inspired by their knowledge and stories. We put you in the room with the creators, thinkers, makers and leaders who have changed the world, so that you can change yours. Members get unprecedented access to 200+ instructors and classes across a wide variety of fields, including Arts & Entertainment, Business, Design & Style, Sports & Gaming, Writing and more. Step into Nas' recording studio and Gordon Ramsay's kitchen, and go behind the big screen with James Cameron. Design your career with Elaine Welteroth, get ready to win with Lewis Hamilton, perfect your pitch with Shonda Rhimes and discover your inner negotiator with Chris Voss. If you want to help make an impact on our members' lives – we want to hear from you! We are looking for more than what a resume can show. If you don't have the exact experience or skills, but think you'd be a great addition to MasterClass, please apply for the role.

Requirements

  • 5+ years of experience in assessment, evaluation, or educational feedback roles.
  • Proven ability to consistently apply detailed rubrics across multiple submissions.
  • Strong written communication skills with the ability to articulate reasoning clearly.
  • Experience providing constructive feedback to support learner growth.
  • Ability to work independently while maintaining high standards.
  • Willingness to refrain from using AI during evaluations and written rationales.

Responsibilities

  • Review and evaluate projects against detailed rubrics, providing consistent pass/fail judgments.
  • Write clear, actionable feedback that helps learners understand areas for improvement.
  • Collaborate with the learning design and product team to refine rubrics and assessment criteria.
  • Compare human and AI assessment outcomes to identify areas for calibration.
  • Document reasoning behind evaluation decisions to support assessment consistency.

You’re a Great Fit If You:

  • Are passionate about education and committed to helping learners succeed.
  • Have a keen eye for detail and take pride in maintaining high standards in evaluation.
  • Enjoy providing feedback and supporting learner growth.

Skills

Assessment
Evaluation
Educational Feedback
Rubrics Application
Written Communication

MasterClass

Subscription-based platform for expert-led classes

About MasterClass

MasterClass offers a subscription-based streaming platform that allows users to access a variety of classes taught by experts in different fields, including Arts & Entertainment, Business, Design & Style, Sports & Gaming, and Writing. Each class consists of around 20 video lessons, each lasting about 10 minutes, enabling users to learn at their own pace. The platform enhances the learning experience with high-quality visuals and practical demonstrations, along with downloadable workbooks to support the lessons. Unlike many other educational platforms, MasterClass focuses on providing insights from renowned professionals, making it appealing to those who want to learn from the best. The goal of MasterClass is to cater to lifelong learners and enthusiasts around the world, offering them the opportunity to gain knowledge and skills from top experts.

San Francisco, CaliforniaHeadquarters
2015Year Founded
$448.8MTotal Funding
SERIES_FCompany Stage
Education, Consumer GoodsIndustries
501-1,000Employees

Benefits

Health Insurance
Dental Insurance
Vision Insurance
Flexible Work Hours
Company Equity

Risks

Free educational content on platforms like YouTube increases competition for MasterClass.
Economic downturns may lead to reduced subscription renewals for MasterClass.
AI-generated content could diminish the perceived value of human-taught classes.

Differentiation

MasterClass offers celebrity-led courses, enhancing its appeal with renowned experts.
The platform provides cinematic visuals and hands-on demonstrations for an immersive experience.
MasterClass's diverse subjects cater to a global market of lifelong learners.

Upsides

Increased demand for online learning boosts MasterClass's potential user base.
The rise of smart TV usage expands MasterClass's reach through TV apps.
Growing interest in skill-based learning aligns with MasterClass's offerings.

Land your dream remote job 3x faster with AI