Staff Software Engineer, LLM Products
Qualified.comFull Time
Expert & Leadership (9+ years)
Candidates should possess 5+ years of experience working with high-performance backend systems, strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages, enthusiasm and interest in the AI and LLM ecosystem, and previous work building and operating highly complex SaaS platforms/systems. Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc. is also required.
The Senior AI Product Engineer, Backend will write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, build high-volume and highly available analytics systems, design and build APIs specific to customers’ Machine Learning and LLM workflows, prototype, optimize, and maintain scalable backend services, extend and contribute back to open source OLAP databases and distributed message queue frameworks, develop and integrate collection tools for robust monitoring of ML and LLM pipelines, research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment, and collaborate with product, design, and customer engineering teams to enhance and expand product offerings. They will also contribute to the build our own in-house AI Agents.
AI observability and model evaluation platform
Arize AI provides a platform focused on AI observability and evaluating language models. The platform allows companies to monitor, troubleshoot, and assess the performance of various machine learning models, including those used for natural language processing, computer vision, and recommendations. Users can access analytics and workflows that help identify and resolve issues within their AI systems, ensuring optimal performance. Key features include task-based evaluations for aspects like hallucination and relevance, as well as tools for visualizing query and knowledge base embeddings to enhance retrieval accuracy. Unlike many competitors, Arize AI specifically targets the needs of top AI companies, offering tailored solutions for continuous improvement of their models. The goal of Arize AI is to empower these companies to enhance their AI capabilities through effective monitoring and evaluation.