Anyscale

Software Engineer - Reinforcement Learning

Remote

Not SpecifiedCompensation
Senior (5 to 8 years), Mid-level (3 to 4 years)Experience Level
Full TimeJob Type
UnknownVisa
AI & Machine Learning, Artificial Intelligence, Software Development, Open Source SoftwareIndustries

About Anyscale

At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

About the Role

RLlib is an open-source library for reinforcement learning that offers both high scalability and a unified API for a variety of applications. It is used by many high profile gaming and finance companies to build cutting-edge RL based systems. We're looking for software engineers with existing machine learning experience that are interested in continuing to enhance RLlib. We are looking for senior hires as well as less experienced but motivated individuals.

We'd love to hear from you if you have:

  • Relevant experience using RLlib or developing RL algorithms
  • Strong proficiency in Python and PyTorch or Tensorflow.
  • Are excited about working with customers who are applying RL to their own use cases
  • Are excited about working on open source and broadcasting new features to the community

As part of this role you will:

  • Develop high quality open source software to simplify reinforcement learning (RLlib)
  • Identify, implement, and evaluate promising new RL algorithms from the literature
  • Improve the testing process for RLlib to make releases as smooth as possible
  • Communicate your work to a broader audience through talks, tutorials, and blog posts

Equal Opportunity Employer

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish.

Skills

Reinforcement Learning
RLlib
Python
PyTorch
TensorFlow
Machine Learning
Distributed Computing
Open Source

Anyscale

Platform for scaling AI workloads

About Anyscale

Anyscale provides a platform designed to scale and productionize artificial intelligence (AI) and machine learning (ML) workloads. Its main product, Ray, is an open-source framework that helps developers manage and scale AI applications across various fields, including Generative AI, Large Language Models (LLMs), and computer vision. Ray allows companies to enhance the performance, fault tolerance, and scalability of their AI systems, with some users reporting over 90% improvements in efficiency, latency, and cost-effectiveness. Anyscale primarily serves clients in the AI and ML sectors, including major companies like OpenAI and Ant Group, who rely on Ray for training large models. The company operates on a software-as-a-service (SaaS) model, charging clients a subscription fee for access to the Ray platform. Anyscale's goal is to empower organizations to effectively scale their AI workloads and optimize their operations.

San Francisco, CaliforniaHeadquarters
2019Year Founded
$252.5MTotal Funding
SERIES_CCompany Stage
Enterprise Software, AI & Machine LearningIndustries
201-500Employees

Benefits

Medical, Dental, and Vision insurance
401K retirement savings
Flexible time off
FSA and Commuter benefits
Parental and family leave
Office & phone plan reimbursement

Risks

ShadowRay vulnerability in Ray framework poses significant security risk with no patch.
OctoML's OctoAI service increases competition in AI infrastructure market.
Dependency on Nvidia's technology could be risky if Nvidia faces issues.

Differentiation

Anyscale's Ray framework scales AI applications from laptops to cloud seamlessly.
Ray is widely used in Generative AI, LLMs, and computer vision fields.
Anyscale's SaaS model provides recurring revenue through subscription fees for Ray platform.

Upsides

Anyscale's $100M Series C funding indicates strong investor confidence and growth potential.
Partnership with Nvidia enhances performance and cost-efficiency for AI deployments.
Anyscale Endpoints offers 10X cost-efficiency for popular open-source LLMs.

Land your dream remote job 3x faster with AI