Groq

Sr. Director of Hardware Systems Engineering

Palo Alto, California, United States

Not SpecifiedCompensation
Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Artificial Intelligence, Semiconductors, HardwareIndustries

Sr. Director of Hardware Systems Engineering

Position Overview

Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses and developers the speed and scale they need. Headquartered in Silicon Valley, we are on a mission to make high performance AI compute more accessible and affordable. When real-time AI is within reach, anything is possible. Build fast.

Mission

Lead the Hardware Systems Engineering team; to include responsibility for product roadmap, vendor selection, manufacturing and design houses; ensuring quality and delivery of all technologies on schedule.

Responsibilities & Opportunities

  • Strategic Leadership: Define and own the hardware systems engineering roadmap, strategy, and execution for our AI inference platform, with a deep focus on SoC integration and system-level performance.
  • System & SoC Architecture: Lead the architectural definition and trade-off analysis for complex hardware systems, with a strong emphasis on the interaction and integration of our custom SoC within board-level designs, server integration, and rack-scale deployments. Optimize for performance, power, cost, and reliability.
  • Team Building & Management: Recruit, mentor, and lead a high-performing team of hardware systems engineers specializing in SoC integration, board design, and system validation, fostering a culture of innovation, technical excellence, and collaboration.
  • Cross-Functional Collaboration: Partner closely with silicon design (front-end and back-end), SoC, firmware, software, product management, operations, and supply chain teams to ensure holistic system design, seamless SoC integration, and successful product delivery.
  • Design & Development Oversight: Provide technical leadership and oversight for all phases of hardware system development, including requirements definition, architectural design, component selection, schematic capture, PCB layout guidance, DFM/DFT, and validation, with a critical eye on SoC-centric challenges.
  • High-Speed Design: Lead the design and validation of high-speed interfaces, power delivery networks, and signal integrity considerations for the SoC within the board and system context (e.g., DDR, PCIe, custom interconnects).
  • Reliability & Qualification: Establish and implement robust reliability and qualification processes for all hardware components and systems, with particular attention to the SoC and its surrounding support circuitry.
  • Vendor & Supplier Management: Manage relationships with key hardware component suppliers and manufacturing partners, ensuring quality, cost-effectiveness, and on-time delivery, especially for SoC-related components.
  • Risk Management: Identify and mitigate technical risks throughout the hardware development lifecycle, with a focus on SoC integration challenges.
  • Industry Trends: Stay abreast of the latest advancements in AI hardware, SoC architectures, interconnect technologies, and relevant industry standards, incorporating best practices into our designs.

Ideal Candidate Profile

  • 12-15+ years of progressive experience across hardware systems engineering, with a proven track record of successfully bringing complex hardware systems to market.
  • BS/MS/PhD in Electrical Engineering, Computer Engineering, or a related field.
  • Deep expertise in several of the following areas, with strong understanding across all:
    • Custom Silicon/ASIC/SoC design and integration: Expert understanding of chip-level interfaces, packaging, power delivery to SoC, thermal management for SoC, and integration challenges.
    • High-speed digital design: Experience with DDR, PCIe, Ethernet, SerDes, and other high-speed interfaces critical for SoC connectivity.
    • Board-level design: Strong understanding of PCB design principles, power integrity, signal integrity, EMI/EMC, specifically as it relates to robust SoC operation.
    • Hardware/software co-design and debug: Proven ability.

Company Information

Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses and developers the speed and scale they need. Headquartered in Silicon Valley, we are on a mission to make high performance AI compute more accessible and affordable. When real-time AI is within reach, anything is possible.

Employment Type

  • [Employment Type Not Specified]

Location Type

  • [Location Type Not Specified]

Salary

  • [Salary Not Specified]

Skills

Hardware Systems Engineering
AI inference
SoC integration
System-level performance
System architecture
Board design
Server integration
Rack-scale deployments
Hardware design
Component selection
Schematic capture
PCB layout
Team leadership
Mentoring
Cross-functional collaboration
Product roadmap
Vendor selection
Manufacturing
Design houses
Quality assurance
Product delivery
Firmware
Software
Product management
Operations
Supply chain

Groq

AI inference technology for scalable solutions

About Groq

Groq specializes in AI inference technology, providing the Groq LPU™, which is known for its high compute speed, quality, and energy efficiency. The Groq LPU™ is designed to handle AI processing tasks quickly and effectively, making it suitable for both cloud and on-premises applications. Unlike many competitors, Groq's products are designed, fabricated, and assembled in North America, which helps maintain high standards of quality and performance. The company targets a variety of clients across different industries that require fast and efficient AI processing capabilities. Groq's goal is to deliver scalable AI inference solutions that meet the growing demands for rapid data processing in the AI and machine learning market.

Mountain View, CaliforniaHeadquarters
2016Year Founded
$1,266.5MTotal Funding
SERIES_DCompany Stage
AI & Machine LearningIndustries
201-500Employees

Benefits

Remote Work Options
Company Equity

Risks

Increased competition from SambaNova Systems and Gradio in high-speed AI inference.
Geopolitical risks in the MENA region may affect the Saudi Arabia data center project.
Rapid expansion could strain Groq's operational capabilities and supply chain.

Differentiation

Groq's LPU offers exceptional compute speed and energy efficiency for AI inference.
The company's products are designed and assembled in North America, ensuring high quality.
Groq emphasizes deterministic performance, providing predictable outcomes in AI computations.

Upsides

Groq secured $640M in Series D funding, boosting its expansion capabilities.
Partnership with Aramco Digital aims to build the world's largest inferencing data center.
Integration with Touchcast's Cognitive Caching enhances Groq's hardware for hyper-speed inference.

Land your dream remote job 3x faster with AI