Anyscale

Technical Services Engineer

Bengaluru, Karnataka, India

Not SpecifiedCompensation
Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Artificial Intelligence, AI & Machine Learning, Cloud Computing, Software DevelopmentIndustries

Requirements

Candidates should have over 5 years of experience in a customer-facing technical role, with at least 2 years in a startup environment. Proficiency in container orchestration platforms like Kubernetes and infrastructure as code tools such as Terraform is required, along with hands-on experience with major cloud platforms (AWS, GCP, or Azure) and knowledge of observability tools like Grafana. Excellent communication, interpersonal skills, strong ownership, self-motivation, and a willingness to learn and mentor are also essential. Experience with Ray, MLOps platforms, and LLMs is a bonus.

Responsibilities

The Technical Services Engineer will act as a technical advisor and champion for Anyscale customers, guiding them through onboarding, adoption, and growth on the Anyscale platform. This role involves owning customer issues end-to-end, including troubleshooting, triaging, escalations, and resolution, while participating in a follow-the-sun support model. Responsibilities include tracking customer bugs and feature requests, managing customer workload states to drive account expansion, and contributing to the improvement of internal tools and documentation. The engineer will also provide feedback and collaborate with product and engineering teams to enhance the customer product experience and build strong relationships with technical stakeholders at customer accounts.

Skills

Distributed Computing
Machine Learning
AI
LLM
vLLM
Troubleshooting
Customer Support
Technical Advising
Onboarding
Platform Adoption
Debugging
Ray

Anyscale

Platform for scaling AI workloads

About Anyscale

Anyscale provides a platform designed to scale and productionize artificial intelligence (AI) and machine learning (ML) workloads. Its main product, Ray, is an open-source framework that helps developers manage and scale AI applications across various fields, including Generative AI, Large Language Models (LLMs), and computer vision. Ray allows companies to enhance the performance, fault tolerance, and scalability of their AI systems, with some users reporting over 90% improvements in efficiency, latency, and cost-effectiveness. Anyscale primarily serves clients in the AI and ML sectors, including major companies like OpenAI and Ant Group, who rely on Ray for training large models. The company operates on a software-as-a-service (SaaS) model, charging clients a subscription fee for access to the Ray platform. Anyscale's goal is to empower organizations to effectively scale their AI workloads and optimize their operations.

San Francisco, CaliforniaHeadquarters
2019Year Founded
$252.5MTotal Funding
SERIES_CCompany Stage
Enterprise Software, AI & Machine LearningIndustries
201-500Employees

Benefits

Medical, Dental, and Vision insurance
401K retirement savings
Flexible time off
FSA and Commuter benefits
Parental and family leave
Office & phone plan reimbursement

Risks

ShadowRay vulnerability in Ray framework poses significant security risk with no patch.
OctoML's OctoAI service increases competition in AI infrastructure market.
Dependency on Nvidia's technology could be risky if Nvidia faces issues.

Differentiation

Anyscale's Ray framework scales AI applications from laptops to cloud seamlessly.
Ray is widely used in Generative AI, LLMs, and computer vision fields.
Anyscale's SaaS model provides recurring revenue through subscription fees for Ray platform.

Upsides

Anyscale's $100M Series C funding indicates strong investor confidence and growth potential.
Partnership with Nvidia enhances performance and cost-efficiency for AI deployments.
Anyscale Endpoints offers 10X cost-efficiency for popular open-source LLMs.

Land your dream remote job 3x faster with AI