AI Inference Engineer - San Francisco at Perplexity AI

San Francisco, California, United States

Perplexity AI Logo
$190,000 – $250,000Compensation
Junior (1 to 2 years)Experience Level
Full TimeJob Type
UnknownVisa
Artificial Intelligence, SoftwareIndustries

Requirements

Candidates should have experience with ML systems and deep learning frameworks such as PyTorch, TensorFlow, or ONNX, familiarity with common LLM architectures and inference optimization techniques, and an understanding of GPU architectures or experience with GPU kernel programming using CUDA.

Responsibilities

The AI Inference Engineer will develop APIs for AI inference to be used by internal and external customers, benchmark and address bottlenecks throughout the inference stack, improve the reliability and observability of systems and respond to system outages, and explore novel research and implement LLM inference optimizations.

Skills

Python
TensorFlow
PyTorch
ONNX
CUDA
GPU architectures
LLM inference optimization
Kubernetes
C++

Perplexity AI

Advanced answer engine providing reliable information

About Perplexity AI

Perplexity AI provides an advanced answer engine that delivers accurate and reliable responses to user queries. The platform uses current sources to ensure the information is both precise and relevant. It caters to a wide audience, including individuals looking for quick answers and businesses needing detailed information. Unlike many competitors, Perplexity AI emphasizes high-quality, source-backed answers, making it a valuable resource for users seeking trustworthy data. The company's goal is to meet the increasing demand for immediate access to reliable information, generating revenue through subscription fees, advertising, and partnerships.

San Francisco, CaliforniaHeadquarters
2022Year Founded
$890MTotal Funding
LATE_VCCompany Stage
Data & Analytics, Consumer SoftwareIndustries
201-500Employees

Benefits

Health Insurance
Dental Insurance
Vision Insurance
401(k) Retirement Plan
Company Equity

Risks

Pending copyright infringement class action poses legal and financial challenges.
Competition from Google's AI Mode could impact user retention and market share.
Otterly.AI's brand visibility tool may pressure Perplexity to maintain high performance.

Differentiation

Perplexity AI integrates large language models with search engines for precise responses.
The platform offers an open-source environment, enhancing public access to AI tools.
Perplexity's strategic acquisition of Carbon boosts its data connectivity capabilities.

Upsides

Partnership with Tripadvisor enhances travel planning with personalized recommendations.
$500M funding round increases valuation to $9 billion, supporting growth and innovation.
Integration with FactSet attracts financial clients with enhanced data accessibility.

Land your dream remote job 3x faster with AI