Sr. ML Engineer, AI Cloud at Tenstorrent

Austin, Texas, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

AI, Cloud ComputingIndustries

Requirements

Fluent in Python; experience with Pytorch and HuggingFace models
Have used and developed APIs for AI/ML applications
Experienced with AI serving frameworks such as vllm, llm-d, LlamaIndex, torchserve, etc
Experienced in performance benchmarking, profiling, and real-time system optimization
Experienced with Containers, Docker, Git, CI/CD, Agile
Eligible to access U.S. export-controlled technology (contingent upon citizenship/permanent residency status or ability to obtain prior license approval)

Responsibilities

Hands-on design, development, and support of realistic demonstrations of AI applications running on Tenstorrent hardware in our cloud
Anticipating, clarifying, and de-risking technological requirements for such demonstrations
Encouraging development and design choices in sustainable directions that will allow capabilities to compound
Supporting enabling customer access to trying our latest hardware and software

Skills

Key technologies and capabilities for this role

PythonPyTorchHuggingFacevLLMLlamaIndexTorchServeDockerKubernetesGitCI/CD

Questions & Answers

Common questions about this position

What is the compensation range for this Senior ML Engineer role?

Compensation for all engineers at Tenstorrent ranges from $100k - $500k including base and variable compensation targets, with the actual offer impacted by experience, skills, education, background, and location.

Is this role remote or hybrid, and where is it based?

This role is hybrid OR remote, based out of Santa Clara, CA, Austin, TX, Toronto, ON.

What key skills are required for this Senior ML Engineer position?

Candidates need to be fluent in Python with experience in Pytorch and HuggingFace models, have used and developed APIs for AI/ML applications, be experienced with AI serving frameworks like vllm, llm-d, LlamaIndex, torchserve, and have expertise in performance benchmarking, profiling, real-time optimization, Containers, Docker, Git, CI/CD, and Agile.

What is the company culture like at Tenstorrent?

Tenstorrent values collaboration, curiosity, and a commitment to solving hard problems, with a diverse team of technologists passionate about AI and building the best AI platform.

What makes a strong candidate for this role?

Strong candidates have hands-on experience with AI/ML applications, APIs, serving frameworks, performance optimization, and container technologies, plus the ability to design sustainable demos on Tenstorrent hardware; candidates at various experience levels are welcome and will be assessed during interviews.

Tenstorrent

Builds advanced computers for AI applications

About Tenstorrent

Tenstorrent builds advanced computers specifically designed for artificial intelligence applications. Their products include high-performance computing systems that utilize specialized hardware and software solutions, leveraging technologies like ASIC design and RISC-V architecture. Unlike many competitors, Tenstorrent focuses on integrating neural network compilers into their systems, enhancing the efficiency of AI computations. The company's goal is to advance the capabilities of AI computing, serving clients in the AI and computing sectors while generating revenue through the sale of their specialized systems and services.

Toronto, CanadaHeadquarters

2016Year Founded

$1,297.7MTotal Funding

SERIES_DCompany Stage

Hardware, AI & Machine LearningIndustries

501-1,000Employees

Benefits

Hybrid Work Options

Risks

Competition from established AI hardware companies like Nvidia could impact market share.

Reliance on open-source software may delay product development timelines.

Geopolitical tensions in South Korea and Japan could disrupt Tenstorrent's supply chains.

Differentiation

Tenstorrent leverages RISC-V technology for flexible, open-source AI hardware solutions.

The company partners with BOS Semiconductors to develop next-gen automotive AI chips.

Tenstorrent's global presence includes offices in key tech hubs like Silicon Valley and Tokyo.

Upsides

RISC-V architecture's growth aligns with Tenstorrent's open-source AI software focus.

Automotive AI chip market growth offers lucrative opportunities for Tenstorrent's BOS partnership.

Increasing demand for HPC systems could expand Tenstorrent's reach beyond tech industries.

Land your dream remote job 3x faster with AI

Try Jobo Free