Arize AI

Infrastructure Software Engineer, On Prem Deployments

Remote

Not SpecifiedCompensation
Junior (1 to 2 years)Experience Level
Full TimeJob Type
UnknownVisa
Artificial Intelligence, Software Development, Enterprise InfrastructureIndustries

On-Premises Infrastructure Engineer

Position Overview

AI is rapidly transforming the world, and Arize is at the forefront as the leading AI observability and Evaluation platform. We help AI teams discover issues, diagnose problems, and improve the results of their AI Applications. We are building world-class software to make AI applications work better.

As our On-Premises Infrastructure Engineer, reporting to the Head of AI Infrastructure, you will be instrumental in designing and implementing deployment architectures and software that bring Arize's powerful capabilities directly into our customers' environments. This is a unique opportunity to bridge the gap between cutting-edge AI observability and enterprise infrastructure requirements.

The Role

We are seeking an exceptional Infrastructure Engineer with a proven track record of building scalable on-premises solutions and the ability to navigate complex enterprise environments. You will be a key player in our engineering organization, working directly with the CTO and customers to architect and implement solutions that enable seamless deployment of our platform across diverse customer environments.

What You’ll Work On

  • Design and implement robust deployment architectures that enable Arize to run efficiently in diverse customer environments, from air-gapped systems to hybrid cloud setups.
  • Collaborate with customers to understand their infrastructure requirements and create tailored deployment solutions that meet their security, compliance, and performance needs.
  • Develop and maintain automation tools and frameworks that streamline the deployment, upgrade, and maintenance processes for on-premises installations.
  • Partner with the product team to ensure new features are compatible with on-premises deployments and create efficient release mechanisms.
  • Create comprehensive monitoring and observability solutions that enable customers to maintain and troubleshoot their Arize installations effectively.

Requirements

  • 5+ years of experience in infrastructure engineering, with significant exposure to enterprise on-premises deployments.
  • Deep expertise in container orchestration platforms (especially Kubernetes) and infrastructure-as-code tools like Terraform.
  • Strong background in enterprise networking, security requirements, and compliance considerations.
  • Experience working with multiple cloud providers (AWS, GCP, Azure) and understanding how to adapt cloud-native architectures for on-premises environments.
  • Track record of building and maintaining automation tools that improve deployment reliability and reduce operational overhead.
  • Excellent communication skills and ability to work directly with customers to understand and address their infrastructure needs.
  • Experience with Python, Golang, and JavaScript is highly desirable.

Compensation & Benefits

  • Estimated Annual Salary: $160,000 - $210,000
  • Variable Compensation: Competitive equity package.
  • Total Compensation: Includes a comprehensive benefit package:
    • Medical, dental, and vision insurance.
    • 401(k) plan.
    • Unlimited paid time off.
    • Generous parental leave plan.
    • Mental and wellness support.

Note: Actual compensation is determined based upon a variety of job-related factors, including transferable work experience, skill sets, and qualifications.

Company Information

  • Company Mission: To make the world’s AI work and work for the people.
  • Company Structure: Fully remote company with optional offices in New York City and the San Francisco Bay Area for those who prefer in-person work. Employees outside these areas receive a WFH monthly stipend for co-working spaces.

Application Instructions

  • [Application instructions not provided in the original text.]

Employment Type

  • [Employment type not provided in the original text.]

Location Type

  • [Location type not provided in the original text.]

Skills

Deployment architectures
Enterprise infrastructure
Automation tools
On-premises solutions
Security
Compliance
Performance optimization

Arize AI

AI observability and model evaluation platform

About Arize AI

Arize AI provides a platform focused on AI observability and evaluating language models. The platform allows companies to monitor, troubleshoot, and assess the performance of various machine learning models, including those used for natural language processing, computer vision, and recommendations. Users can access analytics and workflows that help identify and resolve issues within their AI systems, ensuring optimal performance. Key features include task-based evaluations for aspects like hallucination and relevance, as well as tools for visualizing query and knowledge base embeddings to enhance retrieval accuracy. Unlike many competitors, Arize AI specifically targets the needs of top AI companies, offering tailored solutions for continuous improvement of their models. The goal of Arize AI is to empower these companies to enhance their AI capabilities through effective monitoring and evaluation.

Berkeley, CaliforniaHeadquarters
2020Year Founded
$59.3MTotal Funding
SERIES_BCompany Stage
Data & Analytics, AI & Machine LearningIndustries
51-200Employees

Benefits

Health Insurance
Dental Insurance
Vision Insurance
401(k) Retirement Plan
Unlimited Paid Time Off
Parental Leave
Mental Health Support
Flexible Work Hours

Risks

Competition from tech giants like Microsoft may overshadow Arize's offerings.
Rapid tech advancements could render Arize's features obsolete if not updated.
Data privacy compliance in the EU poses challenges for Arize AI.

Differentiation

Arize AI offers industry-first AI Copilot for troubleshooting AI systems.
The platform provides unique prompt engineering and retrieval tracing workflows.
Arize AI supports EU data residency, addressing regional data privacy concerns.

Upsides

Increased demand for AI observability tools boosts Arize AI's market potential.
Collaboration with Microsoft enhances Arize AI's enterprise deployment capabilities.
Prompt variable monitoring highlights Arize AI's commitment to LLM performance enhancement.

Land your dream remote job 3x faster with AI