Groq

Principal Systems Architect

San Jose, California, United States

Not SpecifiedCompensation
Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Semiconductors, Hardware & InfrastructureIndustries

Principal Systems Architect

Position Overview

Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses and developers the speed and scale they need. Headquartered in Silicon Valley, we are on a mission to make high performance AI compute more accessible and affordable. When real-time AI is within reach, anything is possible. Build fast.

The Principal Systems Architect is responsible for Groq’s next-gen hardware platforms to enable state-of-the-art AI/ML workloads and guide future hardware systems development of the most advanced AI accelerator on the market. This role solves complex technical problems and leads multi-disciplined team projects focused on the delivery of rack-scale accelerator solutions.

Responsibilities & Opportunities

  • Technical Lead:
    • Serve as technical lead for hardware systems design projects, guiding design and architecture decisions that align with organizational objectives.
    • Work directly with the project manager to coordinate all team activities, milestone attainment, functional coordination, and alignment.
    • Collaborate closely with cross-functional teams including Silicon Engineering, Data Center Operations, Cloud Infrastructure, Product Management, and Manufacturing Operations to ensure seamless delivery of products, features, and enhancements.
    • Maintain defect/bug tracking throughout the project duration and drive issue resolution.
  • Interconnect Solution Definition and Selection:
    • Define electro-optical solutions: backplanes, bulk power distribution, optical, internal and external system interconnects.
    • Define thermo-mechanical solutions: macro-system cooling solution, integration, and interconnect.
    • Coordinate design teams to achieve common leveraged results.
  • Full Stack System Understanding, Troubleshooting, and Issue Resolution:
    • Possess a deep understanding of design expectations and comprehensive validation methods for results, from POC to final product.
    • Assist teams in narrowing problems to the subsystem level and guide the whole team to resolution as necessary.
    • Be proficient in electrical & power issues, mechanical & thermal issues, low-level firmware, application layer software, operating systems, performance testing, and tuning for optimizations.

Requirements

  • Experience:
    • At minimum: 15+ years of industry experience.
    • At minimum: 6+ years of experience leading platform teams to delivery success.
  • Education:
    • Bachelors or Masters degree in Electrical Engineering, Mechanical Engineering, or a related field.

Compensation

  • Base Salary Range: $270,000 to $315,000, determined by your skills, qualifications, experience, and internal benchmarks.
  • Package: Includes equity and benefits.

Location

  • Some roles may require being located near or on our primary sites, as indicated in the job description.

About Groq & Company Culture

  • Mission: To make high performance AI compute more accessible and affordable.
  • Attributes of a Groqster:
    • Humility: Egos are checked at the door.
    • Collaborative & Team Savvy: We make up the smartest person in the room, together.
    • Growth & Giver Mindset: Learn it all versus know it all; we share knowledge generously.
    • Curious & Innovative: Take a creative approach to projects, problems, and design.
    • Passion, Grit, & Boldness: No limit thinking, fueling informed risk-taking.

Application Instructions

If this sounds like you, we’d love to hear from you!

Equal Opportunity Employer

Groq is an Equal Opportunity Employer that is committed to inclusion and diversity. Qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, gender, sexual orientation, gender identity, and other protected characteristics. Our goal is to hire and promote an exceptional workforce as diverse as the global populations we serve. Groq values and celebrates diversity in thought, beliefs, talent, expression, and backgrounds. We know that our individual differences make us better.

Skills

Hardware systems design
AI/ML workloads
System architecture
Interconnect solutions
Electro-optical systems
Thermo-mechanical cooling
System troubleshooting
Validation methods
Cross-functional collaboration

Groq

AI inference technology for scalable solutions

About Groq

Groq specializes in AI inference technology, providing the Groq LPU™, which is known for its high compute speed, quality, and energy efficiency. The Groq LPU™ is designed to handle AI processing tasks quickly and effectively, making it suitable for both cloud and on-premises applications. Unlike many competitors, Groq's products are designed, fabricated, and assembled in North America, which helps maintain high standards of quality and performance. The company targets a variety of clients across different industries that require fast and efficient AI processing capabilities. Groq's goal is to deliver scalable AI inference solutions that meet the growing demands for rapid data processing in the AI and machine learning market.

Mountain View, CaliforniaHeadquarters
2016Year Founded
$1,266.5MTotal Funding
SERIES_DCompany Stage
AI & Machine LearningIndustries
201-500Employees

Benefits

Remote Work Options
Company Equity

Risks

Increased competition from SambaNova Systems and Gradio in high-speed AI inference.
Geopolitical risks in the MENA region may affect the Saudi Arabia data center project.
Rapid expansion could strain Groq's operational capabilities and supply chain.

Differentiation

Groq's LPU offers exceptional compute speed and energy efficiency for AI inference.
The company's products are designed and assembled in North America, ensuring high quality.
Groq emphasizes deterministic performance, providing predictable outcomes in AI computations.

Upsides

Groq secured $640M in Series D funding, boosting its expansion capabilities.
Partnership with Aramco Digital aims to build the world's largest inferencing data center.
Integration with Touchcast's Cognitive Caching enhances Groq's hardware for hyper-speed inference.

Land your dream remote job 3x faster with AI