Software Engineer

Position Overview

• Location Type: Not Specified
• Job Type: Full-time
• Salary: Not Specified (Equity offered)

Vectara provides a scalable platform to deploy Enterprise AI Agents and AI Assistants with Accuracy, Security, and Explainability. Our enterprise RAG Platform leverages strong models for retrieval, embedding, reranking, an optimized LLM, and advanced Hallucination Mitigation. We are the developers of the Hughes Hallucination Evaluation Model and Correction model, ensuring accuracy, quality, and responsible AI. Our platform has over 100 Enterprise clients, including large US military organizations, Financial services, Healthcare, and Manufacturing.

Our founding team includes industry veterans and experts in neural information retrieval and distributed systems from Google. Join us as we pursue our mission to help the world find meaning. People at Vectara are passionate about ensuring customers take advantage of breakthroughs in applied Artificial Intelligence (AI) to solve real-world technology and business problems. Our team comprises all-stars in computer science and business from Google, Cloudera, Splunk, MongoDB, Elastic, and more.

Role Overview

Vectara is seeking a Senior Platform Software Engineer with strong experience in backend development and modern DevOps practices. In this role, you’ll work on building and scaling the core infrastructure that powers our retrieval-augmented generation platform. You’ll help design robust services and scalable systems, with a focus on automation, observability, reliability, and performance.

Key Responsibilities

• Proficiency in AI-assisted coding; able to do multiple tasks at once and manage AI agents to quickly execute.
• Design, implement, and maintain scalable and secure backend services and platform components.
• Drive infrastructure automation, CI/CD, and monitoring/alerting pipelines.
• Collaborate with product engineering and research teams to deploy, scale, and optimize ML/NLP workloads.
• Lead initiatives to improve system reliability, scalability, and developer experience.
• Contribute to architecture and infrastructure decisions as we scale our platform.
• Champion best practices in code quality, testing, and DevOps culture across the team.

Qualifications

• 5+ years of experience as a software engineer with a focus on backend systems and platform engineering.
• Proficiency in languages like Go, Python, or Java; experience with infrastructure-as-code (Terraform, Pulumi, etc.).
• Deep experience with all computing environments (GCP, AWS, Onprem, or Azure).
• Strong understanding of containerization and orchestration (Docker, Kubernetes).
• Experience with observability tools (Prometheus, Grafana, ELK/EFK, etc.).
• Experience working on ML platforms or supporting ML workloads in production.
• Familiarity with data infrastructure (e.g., Kafka, Spark, Airflow).

Compensation

Salary is just one component of Vectara’s employee compensation. Our full-time employees are also equity owners in the company, which can have positive impacts on long-term total compensation. We focus on engaging many of our employees in being economic co-owners of the business.

Company Culture & Values

Vectara welcomes all. We value the collective wisdom of people from different backgrounds, experiences, abilities, and perspectives. We never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. Vectara has a positive and supportive culture—we look for people who are... [content truncated]