[Remote] Psychometrician at Khan Academy

Mountain View, California, United States

Khan Academy Logo
Not SpecifiedCompensation
Mid-level (3 to 4 years)Experience Level
Full TimeJob Type
UnknownVisa
Education, EdTechIndustries

Requirements

  • Motivated by the Khan Academy mission “to provide a free world-class education for anyone, anywhere.”
  • Total of 3+ years education, training, and experience in statistics and/or psychometrics, ideally in the K-12 assessment or education technology space
  • 3+ years of statistical programming experience in languages such as Python, Go, or R
  • Experience working with databases and SQL
  • Proven cross-cultural competency skills demonstrating self-awareness, awareness of others, and the ability to adopt inclusive perspectives, attitudes, and behaviors to drive inclusion and belonging
  • Ability to balance the rigor of assessment with the possibility of innovation and new ways of doing things
  • A positive growth mindset that is curious and energized to innovate and create something new
  • A bias to action

Responsibilities

  • Extract and transform assessment data
  • Perform psychometric and other statistical analyses (e.g., item analysis, test analysis, survey analysis)
  • Track and report on assessment metrics, including reporting via technical documentation
  • Support senior and principal psychometricians with assessment projects, including automated scoring and computer adaptive testing (CAT)
  • Assist with and conduct standard setting meetings with subject-matter experts
  • Contribute to research efforts exploring the intersection of ML, generative AI, and psychometrics

Skills

Key technologies and capabilities for this role

PsychometricsStatisticsItem AnalysisTest AnalysisSurvey AnalysisAutomated ScoringComputer Adaptive TestingData ExtractionData TransformationAssessment MetricsTechnical Documentation

Questions & Answers

Common questions about this position

What experience is required for the Psychometrician role?

Candidates need 3+ years of education, training, and experience in statistics and/or psychometrics, ideally in K-12 assessment or edtech, plus 3+ years of statistical programming in Python, Go, or R, and experience with databases and SQL.

What does the Psychometrician do on a daily basis?

You'll extract and transform assessment data, perform psychometric and statistical analyses like item and test analysis, track and report metrics, support senior psychometricians on projects including automated scoring and CAT, assist with standard setting, and contribute to research on ML, AI, and psychometrics.

What is the company culture like at Khan Academy?

Khan Academy values diversity, equity, inclusion, and belonging, hires from diverse backgrounds including academia, edtech, and tech, and commits to investing in professional development with a focus on a positive growth mindset and innovation.

Is the Psychometrician position remote?

This information is not specified in the job description.

What makes a strong candidate for this Psychometrician role?

A strong candidate is motivated by Khan Academy's mission, has the required 3+ years in statistics/psychometrics and programming, demonstrates cross-cultural competency, and balances assessment rigor with innovation and a growth mindset.

Khan Academy

Provides free online educational resources

About Khan Academy

Khan Academy offers free online educational resources and courses for students of all ages. The platform provides instructional videos, practice exercises, and a personalized learning dashboard that allows users to learn at their own pace. Students can access a wide range of subjects, including math, science, history, and more, making it a comprehensive learning tool. Unlike many other educational platforms, Khan Academy focuses on providing all its resources for free, ensuring that anyone with internet access can benefit from high-quality education. The goal of Khan Academy is to democratize education and make learning accessible to everyone, regardless of their background or location.

Palo Alto, CaliforniaHeadquarters
2006Year Founded
$15.8MTotal Funding
GRANTCompany Stage
Social Impact, EducationIndustries
1,001-5,000Employees

Benefits

Competitive salaries
Health and wellness benefits
Flexible time off
401(k) + matching
Affinity groups
Paid parental leave
Fun virtual events

Risks

Reliance on AI tools raises concerns about data privacy and security.
Partnership with Microsoft may limit flexibility in technology choices.
Resistance from educators towards AI tools in humanities subjects could hinder adoption.

Differentiation

Khan Academy offers a mastery-based learning system for personalized student progress.
The platform provides free SAT, LSAT, and Praxis prep in collaboration with major organizations.
Khan Academy's AI tool, Khanmigo, enhances learning with GPT-4 technology.

Upsides

Khan Academy's partnerships expand its reach and resources, enhancing educational offerings.
Growing demand for personalized learning tools boosts Khan Academy's relevance and adoption.
Increased philanthropic funding supports Khan Academy's mission to democratize education.

Land your dream remote job 3x faster with AI