Software Engineer, Senior Staff- AI/ML Kernels at d-Matrix

Santa Clara, California, United States

Apply Now

$180,000 – $300,000Compensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

AI, TechnologyIndustries

Requirements

MS in computer engineering, math, physics, or related degree with 7+ years of industry experience or PhD in same fields with 1+ years of industry experience
Strong grasp of computer architecture, data structures, system software, and machine learning fundamentals
Proficient in C/C++ and Python development in Linux environments using standard development tools
Experience implementing algorithms in high-level languages such as C/C++ and Python
Experience implementing algorithms for specialized hardware such as FPGAs, DSPs, GPUs, and AI accelerators using libraries such as CUDA
Experience implementing operators commonly used in ML workloads (e.g., GEMMs, Convolutions, BLAS, SIMD operators for softmax, layer normalization, pooling)
Experience with development for embedded SIMD vector processors such as Tensilica
Self-motivated team player with strong sense of ownership and leadership
Experience building software kernels for HW architectures
Very strong understanding of various hardware architectures and how to map algorithms to the architecture
Understanding of mapping computational graphs from AI frameworks to underlying architecture
Past experience working across all aspects of full-stack toolchain, optimizing and trading off hardware-software co-design
Ability to build and scale software deliverables in tight development windows

Responsibilities

Develop, enhance, and maintain software kernels for next-generation AI hardware
Work as part of the team to productize the SW stack for the AI compute engine
Work with a team of compiler experts to build out compiler infrastructure
Collaborate closely with other software (ML, systems) and hardware (mixed signal, DSP, CPU) experts

Skills

Key technologies and capabilities for this role

Software KernelsAI HardwareHardware ArchitecturesComputational GraphsAI FrameworksCompiler InfrastructureHardware-Software Co-DesignDSPCPUMixed Signal

Questions & Answers

Common questions about this position

What is the salary range for this position?

The salary range is $180K - $300K.

Is this role remote or hybrid, and what are the location requirements?

This is a hybrid role requiring onsite work at the Santa Clara, CA headquarters 3 days per week.

What are the key skills required for this Senior Staff Software Engineer role?

Key skills include a strong grasp of computer architecture, data structures, system software, and machine learning fundamentals; proficiency in C/C++ and Python in Linux environments; and experience implementing ML operators like GEMMs and convolutions for specialized hardware such as GPUs and AI accelerators.

What is the company culture like at d-Matrix?

The culture emphasizes respect, collaboration, humility, direct communication, inclusivity, and diverse perspectives for better solutions, while seeking passionate individuals driven by execution.

What makes a strong candidate for this role?

Strong candidates have an MS or PhD in computer engineering, math, physics or related field with relevant industry experience, deep expertise in hardware-software co-design for AI, proficiency in C/C++, Python, and ML operators, plus self-motivation, ownership, and leadership as a team player; startup experience and ML frameworks like PyTorch are preferred.

d-Matrix

AI compute platform for datacenters

About d-Matrix

d-Matrix focuses on improving the efficiency of AI computing for large datacenter customers. Its main product is the digital in-memory compute (DIMC) engine, which combines computing capabilities directly within programmable memory. This design helps reduce power consumption and enhances data processing speed while ensuring accuracy. d-Matrix differentiates itself from competitors by offering a modular and scalable approach, utilizing low-power chiplets that can be tailored for different applications. The company's goal is to provide high-performance, energy-efficient AI inference solutions to large-scale datacenter operators.

Santa Clara, CaliforniaHeadquarters

2019Year Founded

$149.8MTotal Funding

SERIES_BCompany Stage

Enterprise Software, AI & Machine LearningIndustries

201-500Employees