[Remote] Staff AI Research Scientist - Evaluation, Handshake AI at Handshake

San Francisco, California, United States

Handshake Logo
$350,000 – $420,000Compensation
Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Artificial IntelligenceIndustries

Requirements

  • PhD or equivalent research experience in machine learning, computer science, cognitive science, or related fields with focus on AI evaluation, interpretability, or model understanding
  • 6+ years of academic or industry experience post-doc in a research-first environment
  • Strong background in LLM research, evaluation methodologies, and/or foundational AI assessment techniques
  • Proven ability to independently design, lead, and execute evaluation research programs with novel data types end-to-end
  • Deep proficiency in Python and PyTorch for large-scale model analysis, benchmarking, and evaluation
  • Experience building or leading novel benchmark development, systematic model assessment, or interpretability studies
  • Strong publication record in post-training, evaluation, or interpretability that demonstrates field-defining contributions
  • Ability to clearly communicate complex insights and influence both technical and non-technical stakeholders

Responsibilities

  • Lead teams of researchers to produce original research in LLM evaluation methodologies, interpretability, and human-AI knowledge alignment
  • Develop novel frameworks and assessment techniques that reveal deep insights into model capabilities, limitations, and emergent behaviors
  • Collaborate with engineers to translate research breakthroughs into scalable benchmarks, evaluation systems, and standards
  • Pioneer new approaches to measuring reasoning, alignment, and trustworthiness in frontier AI systems
  • Author high-quality code to enable large-scale experimentation, reproducible evaluation, and knowledge assessment workflows
  • Publish in top-tier conferences and journals, establishing new directions in the science of AI evaluation
  • Work cross-functionally with leadership, engineers, and external partners to set industry standards for responsible AI evaluation and alignment

Skills

LLM Evaluation
LLM Interpretability
Human-AI Knowledge Alignment
Research
Framework Development
Assessment Techniques

Handshake

Connects students with job opportunities

About Handshake

Handshake connects college students with job and internship opportunities through its platform. It serves over 15 million students, 1,500 universities, and 900,000 employers, focusing on early career recruitment. The platform allows universities to provide students access to job listings, career fairs, and recruitment events, while employers can post job openings and manage recruitment processes. Handshake's user-friendly interface helps students organize their job search and offers insights like company reviews. The company prioritizes data privacy and security, ensuring compliance with regulations like FERPA. Handshake aims to bridge the gap between students and employers, facilitating early career opportunities.

San Francisco, CaliforniaHeadquarters
2014Year Founded
$422.2MTotal Funding
SERIES_FCompany Stage
Cybersecurity, EducationIndustries
501-1,000Employees

Benefits

💰Equity and ownership in a fast-growing company.
🍼16 Weeks of paid parental leave
💝Comprehensive medical, dental, and vision
💻Handshake offers $500/£360 home office stipend
📚Generous learning & development opportunities and an annual $2,000/£1,500/2k€ stipend
🏦401k Match: Handshake offers a dollar-for-dollar match on 1% of deferred salary, up to a maximum of $1,200 per year.
🏝PTO

Risks

Emerging competitors like Fizz target Handshake's demographic with financial products.
Intuit's collaboration may draw students away from Handshake.
AI-driven skills demand may reduce engagement with Handshake.

Differentiation

Handshake connects over 15 million students with 900,000 employers.
The platform offers a user-friendly interface for job and internship applications.
Handshake ensures data privacy, complying with regulations like FERPA.

Upsides

Handshake's new social media-like interface boosts user engagement.
Growing student loan repayment benefits attract more employers to Handshake.
Demand for skills-based workforce aligns with Handshake's mission.

Land your dream remote job 3x faster with AI