Arize AI

Open Source Infrastructure Engineer

Remote

Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Artificial Intelligence, Software DevelopmentIndustries

Job Description: Infrastructure Engineer

Position Overview

AI is rapidly transforming the world, and Arize AI is at the forefront with its leading AI observability and evaluation platform. We are seeking an Infrastructure Engineer to join our mission of building world-class software that helps make AI applications work better. This role will focus on designing, building, and scaling the infrastructure that powers Arize’s platform services, with a direct impact on the robustness, scalability, and accessibility of Arize Phoenix for developers worldwide.

About Arize Phoenix

The Arize OSS team is dedicated to enabling developers to build LLM-powered applications with safety and observability in mind. Arize Phoenix, our open-source Typescript libraries and enterprise platform, has hundreds of thousands of monthly downloads and is used by a wide range of organizations. We are backed by prominent venture capital firms including TCV, Foundation Capital, Swift Ventures, and Battery Ventures.

The Role

As an Infrastructure Engineer, you will architect and scale the infrastructure supporting Arize Phoenix's growth. You will collaborate closely with our open-source team and focus on enhancing Phoenix’s SaaS capabilities by building features such as central authentication, data retention, and capacity scaling. You will also develop robust infrastructure tools and services to streamline operations across Arize's product offerings. This is a unique opportunity to contribute to foundational infrastructure that will shape the future of AI system observation and evaluation.

Responsibilities

  • Collaborate with internal teams and the open-source community to architect and scale infrastructure that supports Arize Phoenix’s growth.
  • Enable and enhance Phoenix’s SaaS capabilities by building out features such as central authentication, data retention, and capacity scaling.
  • Build out a robust set of infrastructure tools and services that alleviates the operations across the suite of Arize's product offering.

Requirements

  • 3+ years of experience building scalable infrastructure and developer tools, ideally in an open-source context.
  • Strong understanding of the open-source development lifecycle and community dynamics.
  • Expertise in Kubernetes, Terraform, and other modern infrastructure tools.
  • Familiarity with build tools like Bazel and CI/CD systems.
  • A pragmatic approach to solving problems and prioritizing impactful solutions over trends.
  • Experience working with AI frameworks, LLM integrations, or observability platforms is a plus.
  • Familiarity with Go, Python, and some TypeScript is a plus.

Compensation & Benefits

  • Estimated Annual Salary: $125,000 - $225,000
  • Variable Compensation: Competitive equity package.
  • Comprehensive Benefits Package:
    • Medical, dental, and vision insurance
    • 401(k) plan
    • Unlimited paid time off
    • Generous parental leave plan
    • Mental and wellness support

Location

  • Employment Type: [Not specified]
  • Location Type: Remote-first. Offices are available in New York City and the San Francisco Bay Area for those who wish to work in-person. A WFH monthly stipend is provided for co-working spaces for all other employees.

About Arize

Arize’s mission is to make the world’s AI work and work for the people. Our founders came together through a common frustration: investments in AI are growing rapidly across businesses.

Skills

Infrastructure
Scalability
Open Source
Typescript
LLM

Arize AI

AI observability and model evaluation platform

About Arize AI

Arize AI provides a platform focused on AI observability and evaluating language models. The platform allows companies to monitor, troubleshoot, and assess the performance of various machine learning models, including those used for natural language processing, computer vision, and recommendations. Users can access analytics and workflows that help identify and resolve issues within their AI systems, ensuring optimal performance. Key features include task-based evaluations for aspects like hallucination and relevance, as well as tools for visualizing query and knowledge base embeddings to enhance retrieval accuracy. Unlike many competitors, Arize AI specifically targets the needs of top AI companies, offering tailored solutions for continuous improvement of their models. The goal of Arize AI is to empower these companies to enhance their AI capabilities through effective monitoring and evaluation.

Berkeley, CaliforniaHeadquarters
2020Year Founded
$59.3MTotal Funding
SERIES_BCompany Stage
Data & Analytics, AI & Machine LearningIndustries
51-200Employees

Benefits

Health Insurance
Dental Insurance
Vision Insurance
401(k) Retirement Plan
Unlimited Paid Time Off
Parental Leave
Mental Health Support
Flexible Work Hours

Risks

Competition from tech giants like Microsoft may overshadow Arize's offerings.
Rapid tech advancements could render Arize's features obsolete if not updated.
Data privacy compliance in the EU poses challenges for Arize AI.

Differentiation

Arize AI offers industry-first AI Copilot for troubleshooting AI systems.
The platform provides unique prompt engineering and retrieval tracing workflows.
Arize AI supports EU data residency, addressing regional data privacy concerns.

Upsides

Increased demand for AI observability tools boosts Arize AI's market potential.
Collaboration with Microsoft enhances Arize AI's enterprise deployment capabilities.
Prompt variable monitoring highlights Arize AI's commitment to LLM performance enhancement.

Land your dream remote job 3x faster with AI