Inference Runtime Systems - Software Engineer, Staff at d-Matrix

Santa Clara, California, United States

d-Matrix Logo
$142,500 – $230,000Compensation
Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
AI & Machine Learning, HardwareIndustries

Skills

Key technologies and capabilities for this role

C++PythonCMakePytestGPU ProgrammingDistributed SystemsHPCPyTorchSoftware Design PatternsParallel ProgrammingConcurrent Programming

Questions & Answers

Common questions about this position

What is the salary range for this position?

The salary range is $142.5K - $230K.

Is this role remote or hybrid, and what are the location requirements?

This is a hybrid role requiring onsite presence at the Santa Clara, CA headquarters 3 days per week.

What are the key technical skills required for this role?

Strong proficiency in modern C++ (C++11 and above) and Python is required, along with experience in parallel and concurrent programming, software design patterns, CMake, Pytest, and familiarity with PyTorch internals or similar frameworks.

What is the company culture like at d-Matrix?

The culture is one of respect and collaboration, valuing humility and direct communication.

What experience makes a strong candidate for this position?

Candidates with a Bachelor’s degree and 6+ years or Master’s with 3+ years in C++ software development, experience architecting complex systems, distributed systems or HPC, and GPU programming knowledge stand out.

d-Matrix

AI compute platform for datacenters

About d-Matrix

d-Matrix focuses on improving the efficiency of AI computing for large datacenter customers. Its main product is the digital in-memory compute (DIMC) engine, which combines computing capabilities directly within programmable memory. This design helps reduce power consumption and enhances data processing speed while ensuring accuracy. d-Matrix differentiates itself from competitors by offering a modular and scalable approach, utilizing low-power chiplets that can be tailored for different applications. The company's goal is to provide high-performance, energy-efficient AI inference solutions to large-scale datacenter operators.

Santa Clara, CaliforniaHeadquarters
2019Year Founded
$149.8MTotal Funding
SERIES_BCompany Stage
Enterprise Software, AI & Machine LearningIndustries
201-500Employees

Benefits

Hybrid Work Options

Risks

Competition from Nvidia, AMD, and Intel may pressure d-Matrix's market share.
Complex AI chip design could lead to delays or increased production costs.
Rapid AI innovation may render d-Matrix's technology obsolete if not updated.

Differentiation

d-Matrix's DIMC engine integrates compute into memory, enhancing efficiency and accuracy.
The company offers scalable AI solutions through modular, low-power chiplets.
d-Matrix focuses on brain-inspired AI compute engines for diverse inferencing workloads.

Upsides

Growing demand for energy-efficient AI solutions boosts d-Matrix's low-power chiplets appeal.
Partnerships with companies like Microsoft could lead to strategic alliances.
Increasing adoption of modular AI hardware in data centers benefits d-Matrix's offerings.

Land your dream remote job 3x faster with AI