Responsibilities

The LLM Data Researcher will define and implement strategies to assess the return on investment (ROI) of data across training and fine-tuning pipelines, build and maintain benchmarks that measure performance across key client and internal objectives, collaborate with data operations, research, and delivery teams to align on quality standards and data priorities, develop systems and tooling for continuous data evaluation, drive human-in-the-loop quality processes including pre-delivery validation and annotation feedback loops, identify data gaps and lead targeted acquisitions or refinements based on performance metrics, and define or leverage comprehensive task taxonomy frameworks to structure data annotation efforts and improve training signal quality. Furthermore, they will translate research insights and data evaluations into client-facing value through better delivery and prioritization.