Sr. ML Engineer, AI Cloud at Tenstorrent

Austin, Texas, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

AI, Cloud ComputingIndustries

Requirements

Fluent in Python; experience with Pytorch and HuggingFace models
Have used and developed APIs for AI/ML applications
Experienced with AI serving frameworks such as vllm, llm-d, LlamaIndex, torchserve, etc
Experienced in performance benchmarking, profiling, and real-time system optimization
Experienced with Containers, Docker, Git, CI/CD, Agile
Eligible to access U.S. export-controlled technology (contingent upon citizenship/permanent residency status or ability to obtain prior license approval)

Responsibilities

Hands-on design, development, and support of realistic demonstrations of AI applications running on Tenstorrent hardware in our cloud
Anticipating, clarifying, and de-risking technological requirements for such demonstrations
Encouraging development and design choices in sustainable directions that will allow capabilities to compound
Supporting enabling customer access to trying our latest hardware and software

Skills

Python

PyTorch

HuggingFace

vLLM

LlamaIndex

TorchServe

Docker

Kubernetes

Git

CI/CD

Tenstorrent

Builds advanced computers for AI applications

About Tenstorrent

Tenstorrent builds advanced computers specifically designed for artificial intelligence applications. Their products include high-performance computing systems that utilize specialized hardware and software solutions, leveraging technologies like ASIC design and RISC-V architecture. Unlike many competitors, Tenstorrent focuses on integrating neural network compilers into their systems, enhancing the efficiency of AI computations. The company's goal is to advance the capabilities of AI computing, serving clients in the AI and computing sectors while generating revenue through the sale of their specialized systems and services.

Toronto, CanadaHeadquarters

2016Year Founded

$1,297.7MTotal Funding

SERIES_DCompany Stage

Hardware, AI & Machine LearningIndustries

501-1,000Employees

Benefits

Hybrid Work Options

Risks

Competition from established AI hardware companies like Nvidia could impact market share.

Reliance on open-source software may delay product development timelines.

Geopolitical tensions in South Korea and Japan could disrupt Tenstorrent's supply chains.

Differentiation

Tenstorrent leverages RISC-V technology for flexible, open-source AI hardware solutions.

The company partners with BOS Semiconductors to develop next-gen automotive AI chips.

Tenstorrent's global presence includes offices in key tech hubs like Silicon Valley and Tokyo.

Upsides

RISC-V architecture's growth aligns with Tenstorrent's open-source AI software focus.

Automotive AI chip market growth offers lucrative opportunities for Tenstorrent's BOS partnership.

Increasing demand for HPC systems could expand Tenstorrent's reach beyond tech industries.

Land your dream remote job 3x faster with AI

Try Jobo Free