Research Engineer / Scientist, Alignment Science
Anthropic- Full Time
- Junior (1 to 2 years)
Candidates should possess a PhD or equivalent experience in computer science, computational science, data science, cognitive science, or similar fields. Strong engineering skills, particularly in designing and optimizing large-scale machine learning systems, especially with frameworks like PyTorch, are essential. A deep understanding of alignment algorithms and techniques is required, along with the ability to develop data visualization or data collection interfaces using TypeScript or Python. Candidates should thrive in fast-paced, collaborative research environments and have a commitment to developing trustworthy and reliable AI models for high-stakes scenarios.
The Research Engineer / Research Scientist will develop and evaluate alignment capabilities that are subjective and context-dependent. They will design evaluations to measure risks and alignment with human intent, build tools to study model robustness, and conduct experiments to understand how alignment scales with various factors. Additionally, they will design and evaluate new Human-AI interaction paradigms and scalable oversight methods, train models to be calibrated on correctness and risk, and create novel approaches for using AI in alignment research.
Develops safe and beneficial AI technologies
OpenAI develops and deploys artificial intelligence technologies aimed at benefiting humanity. The company creates advanced AI models capable of performing various tasks, such as automating processes and enhancing creativity. OpenAI's products, like Sora, allow users to generate videos from text descriptions, showcasing the versatility of its AI applications. Unlike many competitors, OpenAI operates under a capped profit model, which limits the profits it can make and ensures that excess earnings are redistributed to maximize the social benefits of AI. This commitment to safety and ethical considerations is central to its mission of ensuring that artificial general intelligence (AGI) serves all of humanity.