Reinforcement Learning Engineer, Helix at Figure

San Jose, California, United States

Figure Logo
$150,000 – $400,000Compensation
Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
AI Robotics, Humanoid RoboticsIndustries

Requirements

  • Confident writing production quality code in PyTorch
  • Familiar with online and offline reinforcement learning algorithms: PPO, SAC, etc
  • Experience tuning hyperparameters and cost functions for these RL algorithms
  • Familiarity with common RL techniques such as: domain randomization, curriculum learning, reward shaping, etc
  • Familiarity with general ML evaluation tools such as TensorBoard, Weights & Biases, etc

Responsibilities

  • Develop, train, and deploy reinforcement learning algorithms for locomotion and manipulation tasks
  • Build simulation infrastructure to support the training of locomotion and manipulation policies for a general purpose humanoid robot at a large scale
  • Collaborate with the controls team to integrate policies into the existing control stack
  • Define, test, and evaluate performance metrics for learned policies

Skills

Key technologies and capabilities for this role

PyTorchPPOSACreinforcement learningdomain randomizationcurriculum learningreward shapingTensorBoardWeights & Biasessimulation infrastructurelocomotion policiesmanipulation policies

Questions & Answers

Common questions about this position

What is the salary range for the Reinforcement Learning Engineer position?

The US base salary range for this full-time position is between $150,000 - $400,000 annually, and may vary based on job-related knowledge, skills, and experience.

Is this a remote position or does it require in-office work?

The role requires 5 days/week in-office collaboration and is based in San Jose, CA.

What skills are required for the Reinforcement Learning Engineer role?

Required skills include confident writing production quality code in PyTorch, familiarity with online and offline RL algorithms like PPO and SAC, experience tuning hyperparameters and cost functions, familiarity with RL techniques such as domain randomization and curriculum learning, and familiarity with ML evaluation tools like TensorBoard and Weights & Biases.

What are the bonus qualifications for this position?

Bonus qualifications include experience transferring policies learned in simulation to robot hardware and experience training locomotion policies for quadrupedal or bipedal robots.

What makes a strong candidate for this Reinforcement Learning Engineer role?

A strong candidate will have hands-on experience developing, training, and deploying RL algorithms for robotics tasks like locomotion and manipulation, proficiency in PyTorch for production code, and expertise in tuning RL algorithms with techniques like domain randomization.

Figure

Blockchain-based home equity lending solutions

About Figure

Figure is a financial technology company that uses blockchain technology to improve financial transactions, specifically in the home equity lending market. It offers products like Home Equity Lines of Credit (HELOCs) and mortgage refinancing, allowing homeowners to access their home equity quickly and efficiently. The application process is fully online, enabling homeowners to receive funds in as little as five days, which is much faster than traditional banks that can take weeks or months. Figure ensures secure and cost-effective transactions through blockchain, and it generates revenue from origination fees and interest on loans, with competitive rates starting at 3.49% APR. Targeting homeowners across various U.S. states, Figure aims to meet the demand for quick access to home equity for purposes like home improvements or debt consolidation.

San Francisco, CaliforniaHeadquarters
2018Year Founded
$406.6MTotal Funding
SERIES_DCompany Stage
Fintech, Crypto & Web3Industries
201-500Employees

Benefits

Health & wellness - Figure pays 100% of premium costs for employees and dependents for medical, dental, and vision insurance (with the exception of costs associated with the buy-up medical plan.)
Continuing education - Figure will reimburse eligible employees for approved continuing education that either offers growth in an area related to his or her current position or that may lead to promotional opportunities.
Flexible time off - We offer 10 company-wide holidays plus one personal holiday, generous Flexible Time Away (FTA), Paid Time Off (PTO), and Paid Parental Leave.
Bonus & stock options - Figure’s Bonus Plan recognizes and rewards eligible employees’ efforts and contributions. Eligible employees are also granted an option to purchase a set number of shares of Figure’s common stock.

Risks

Recent layoffs may indicate financial instability or restructuring challenges.
New piggyback loan product could increase financial risk amid housing affordability issues.
Volatile crypto market could impact Figure's blockchain initiatives.

Differentiation

Figure uses blockchain to offer fast, secure home equity access in five days.
The company provides a fully online application process, unlike traditional banks.
Figure's competitive interest rates start as low as 3.49% APR.

Upsides

Increased blockchain adoption boosts Figure's secure transaction offerings.
Figure Connect taps into the demand for liquid private capital markets.
Michael Tannenbaum's appointment as CEO suggests potential for growth.

Land your dream remote job 3x faster with AI