Senior Research Engineer, OLMo at The Allen Institute for AI

Seattle, Washington, United States

The Allen Institute for AI Logo
$170,000 – $220,000Compensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Artificial IntelligenceIndustries

Requirements

  • Proficiency in Python programming
  • Strong understanding of infrastructure concepts and technologies
  • Experience with modern deep learning techniques
  • Solid understanding of NLP principles and practices
  • In-depth knowledge of language models and the transformer architecture
  • Ability to work independently and collaboratively within a team
  • Strong analytical and problem-solving abilities
  • Ability to translate complex technical issues into clear explanations

Responsibilities

  • Build and maintain scalable machine learning pipelines for OLMo training
  • Contribute to the design and architecture of systems used to train large language models
  • Participate in all stages of OLMo training – pre-training, mid-training, post-training, and emerging paradigms
  • Explore and implement novel methodologies for advancing AI capabilities
  • Work closely with other research and machine learning engineers
  • Present research findings and technical details effectively

Skills

Python
Deep Learning
NLP
Transformers
Language Models
Machine Learning Pipelines
System Architecture

The Allen Institute for AI

Advances AI through research and engineering

About The Allen Institute for AI

The Allen Institute for Artificial Intelligence (AI2) focuses on advancing artificial intelligence through research and engineering. It develops technologies that improve machine reasoning, common sense for AI, and language modeling. AI2 works on various projects, such as AllenNLP for natural language processing and EarthRanger for environmental monitoring. Unlike for-profit companies, AI2 operates as a non-profit, relying on grants and donations to fund its initiatives. This allows them to provide their research and tools to the public for free, promoting collaboration in the AI field. The goal of AI2 is to tackle significant scientific and engineering challenges to benefit society.

Seattle, WashingtonHeadquarters
2014Year Founded
N/ACompany Stage
AI & Machine LearningIndustries
201-500Employees

Benefits

Medical
401(k)
Visa Sponsorship
Time off
Catered meals & free snacks
Training & development
Tuition reimbursement
Remote & hybrid work options

Risks

Competition from OpenAI's QwQ-32B model may reduce AI2's market influence.
AI2's reliance on grants poses financial risks during economic downturns.
Open-source models may face intellectual property risks and misuse.

Differentiation

AI2 focuses on open-source models, promoting transparency and collaboration in AI development.
AI2's projects like AllenNLP and Semantic Scholar address diverse scientific and societal challenges.
AI2 operates as a non-profit, relying on grants and donations for funding.

Upsides

AI2's open-source models attract researchers, enhancing collaboration and innovation.
Tülu3 and OLMo-2 models position AI2 as leaders in open-source AI.
AI2's multimodal models meet the demand for integrated data processing in various fields.

Land your dream remote job 3x faster with AI