Sr. Data Scientist - AI (Remote)
Rula$190,800 - $213,300/year
Full Time
Senior (5 to 8 years), Expert & Leadership (9+ years)
Not SpecifiedCompensation
N/AExperience Level
N/AJob Type
Not SpecifiedVisa
N/AIndustries
Requirements
- PhD or equivalent experience in machine learning, NLP, or data-centric AI, with a track record of leadership in LLM post-training or data quality research
- 5 years of academic or industry experience post-doc
- Deep expertise in RLHF, preference data pipelines, reward modeling, or evaluation systems
- Demonstrated experience designing and scaling data quality infrastructure — from labeling frameworks and validation metrics to automated filtering and dataset optimization
- Strong engineering proficiency in Python, PyTorch, and ecosystem tools for large-scale training and evaluation
- A proven ability to define, lead, and execute complex research initiatives with clear business and technical impact
- Strong communication and collaboration skills, with experience driving strategy across research, engineering, and product teams
Responsibilities
- Lead high-impact research on data quality frameworks for post-training LLMs — including techniques for preference consistency, label reliability, annotator calibration, and dataset auditing
- Design and implement systems for identifying noisy, low-value, or adversarial data points in human feedback and synthetic comparison datasets
- Drive strategy for aligning data collection, curation, and filtering with post-training objectives such as helpfulness, harmlessness, and faithfulness
- Collaborate cross-functionally with engineers, alignment researchers, and product leaders to translate research into production-ready pipelines for RLHF and DPO
- Mentor and influence junior researchers and engineers working on data-centric evaluation, reward modeling, and benchmark creation
- Author foundational tools and metrics that connect supervision data characteristics to downstream LLM behavior and evaluation performance
- Publish and present research that advances the field of data quality in LLM post-training, contributing to academic and industry best practices
Skills
Handshake
Connects students with job opportunities
About Handshake
Handshake connects college students with job and internship opportunities through its platform. It serves over 15 million students, 1,500 universities, and 900,000 employers, focusing on early career recruitment. The platform allows universities to provide students access to job listings, career fairs, and recruitment events, while employers can post job openings and manage recruitment processes. Handshake's user-friendly interface helps students organize their job search and offers insights like company reviews. The company prioritizes data privacy and security, ensuring compliance with regulations like FERPA. Handshake aims to bridge the gap between students and employers, facilitating early career opportunities.
San Francisco, CaliforniaHeadquarters
2014Year Founded
$422.2MTotal Funding
SERIES_FCompany Stage
Cybersecurity, EducationIndustries
501-1,000Employees
Benefits
💰Equity and ownership in a fast-growing company.
🍼16 Weeks of paid parental leave
💝Comprehensive medical, dental, and vision
💻Handshake offers $500/£360 home office stipend
📚Generous learning & development opportunities and an annual $2,000/£1,500/2k€ stipend
🏦401k Match: Handshake offers a dollar-for-dollar match on 1% of deferred salary, up to a maximum of $1,200 per year.
🏝PTO
Risks
Emerging competitors like Fizz target Handshake's demographic with financial products.
Intuit's collaboration may draw students away from Handshake.
AI-driven skills demand may reduce engagement with Handshake.
Differentiation
Handshake connects over 15 million students with 900,000 employers.
The platform offers a user-friendly interface for job and internship applications.
Handshake ensures data privacy, complying with regulations like FERPA.
Upsides
Handshake's new social media-like interface boosts user engagement.
Growing student loan repayment benefits attract more employers to Handshake.
Demand for skills-based workforce aligns with Handshake's mission.
Related Jobs
RemoteRemoteMachine Learning Researcher
ElevenLabsSalary not specified
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
RemoteQuality Engineer
Owens & Minor$60,000 - $90,000/year
- Full Time
- Junior (1 to 2 years), Mid-level (3 to 4 years)
RemoteResearch Staff, LLMs
Deepgram$150,000 - $220,000/year
- Full Time
- Expert & Leadership (9+ years)
RemoteProduct Owner (Machine Learning)
SweedSalary not specified
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteResearch Data Scientist
iSpot.tvSalary not specified
- Full Time
- Junior (1 to 2 years), Mid-level (3 to 4 years)
RemoteApplied Scientist
KoBold MetalsSalary not specified
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteHuman Data Research Analyst
Keywords Studios$35,000 - $40,000/year
- Full Time
- Junior (1 to 2 years)