Customer Support Engineer at Anyscale

Bengaluru, Karnataka, India

Anyscale Logo
Not SpecifiedCompensation
Mid-level (3 to 4 years)Experience Level
Full TimeJob Type
UnknownVisa
Technology, AI, Machine LearningIndustries

Requirements

  • 5+ years of experience in a customer-facing technical role with 2+ years in a dynamic, fast-paced, startup-like environment
  • Strong organizational skills and ability to manage multiple customer needs simultaneously
  • Experience as a machine learning engineer
  • Experience in training, fine-tuning and inference/serving of LLMs
  • Knowledge in one or more of the major cloud platforms (AWS, GCP or Azure)
  • Excellent communication and interpersonal skills
  • Strong sense of ownership, self-motivation and eagerness to acquire new skills and do new things
  • Willingness to uplevel the knowledge and skills of your peers through mentorship, trainings and shadowing

Responsibilities

  • Resolve customer issues and help in their successful adoption of Anyscale platform
  • Be a technical advisor, and internal champion for our key customers
  • Own customer issues end-to-end, from troubleshooting, triaging, escalations and eventual resolution
  • Participate in our follow-the-sun customer support model to ensure continuity in resolving high priority tickets
  • Keep track of open customer bugs and feature requests to influence prioritization and provide timely customer updates upon resolution
  • Contribute towards improvement of internal tools and documentation of playbooks, guides and best practices etc. based on observed patterns
  • Habitually provide feedback and collaborate cross-functionally with product and engineering teams to address customer issues with a focus on improving the product experience
  • Build and maintain strong relationships with technical stakeholders within customer accounts

Skills

Ray
Machine Learning
AI
LLM
vLLM
Distributed Systems
Troubleshooting
Debugging
Customer Support

Anyscale

Platform for scaling AI workloads

About Anyscale

Anyscale provides a platform designed to scale and productionize artificial intelligence (AI) and machine learning (ML) workloads. Its main product, Ray, is an open-source framework that helps developers manage and scale AI applications across various fields, including Generative AI, Large Language Models (LLMs), and computer vision. Ray allows companies to enhance the performance, fault tolerance, and scalability of their AI systems, with some users reporting over 90% improvements in efficiency, latency, and cost-effectiveness. Anyscale primarily serves clients in the AI and ML sectors, including major companies like OpenAI and Ant Group, who rely on Ray for training large models. The company operates on a software-as-a-service (SaaS) model, charging clients a subscription fee for access to the Ray platform. Anyscale's goal is to empower organizations to effectively scale their AI workloads and optimize their operations.

San Francisco, CaliforniaHeadquarters
2019Year Founded
$252.5MTotal Funding
SERIES_CCompany Stage
Enterprise Software, AI & Machine LearningIndustries
201-500Employees

Benefits

Medical, Dental, and Vision insurance
401K retirement savings
Flexible time off
FSA and Commuter benefits
Parental and family leave
Office & phone plan reimbursement

Risks

ShadowRay vulnerability in Ray framework poses significant security risk with no patch.
OctoML's OctoAI service increases competition in AI infrastructure market.
Dependency on Nvidia's technology could be risky if Nvidia faces issues.

Differentiation

Anyscale's Ray framework scales AI applications from laptops to cloud seamlessly.
Ray is widely used in Generative AI, LLMs, and computer vision fields.
Anyscale's SaaS model provides recurring revenue through subscription fees for Ray platform.

Upsides

Anyscale's $100M Series C funding indicates strong investor confidence and growth potential.
Partnership with Nvidia enhances performance and cost-efficiency for AI deployments.
Anyscale Endpoints offers 10X cost-efficiency for popular open-source LLMs.

Land your dream remote job 3x faster with AI