AI/HPC Network Development Engineer - Networking at xAI

Memphis, Tennessee, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

AI, HPCIndustries

Requirements

Minimum of 10 years designing and operating large scale networks with 5 years in the ethernet AI/HPC space
Deep understanding of congestion control on ethernet with Infiniband an added bonus
Deep understanding of AI training and inference workloads and how they operate on the network
Ability to use and debug NCCL and potentially commit to the library
Expertise in creating a portfolio of metrics for performance and operations to optimize the fleet for training and inference traffic
Experience with Python to automate away repetitive tasks and facilitate working with and analyzing large sets of data
Strong communication skills to concisely and accurately share knowledge with teammates
Willingness to travel significantly to Memphis for data center buildouts and to Palo Alto for team collaboration
Availability for team on-call rotation and helping with scaling and maintenance efforts

Responsibilities

Develop at hyper scale while optimizing network performance and availability with deep experience in RoCEv2
Analyze and understand current network performance and availability to optimize for training models and customer inference queries
Spend time deep inside NCCL, building metric dashboards, and tweaking configurations to maximize performance
Help design the next iteration of backend and front-end networks for seamless build-out of new GPU infrastructure with minimal engineering assistance
Participate in significant travel to Memphis for building capacity
Engage in team on-call rotation and assist with scaling and maintenance efforts
Contribute to deployment and operations frameworks to eliminate repetitive tasks

Skills

Key technologies and capabilities for this role

RoCEv2NCCLHPCNetworkingGPU ClustersEthernetPerformance OptimizationMetric DashboardsScalingDeployment

Questions & Answers

Common questions about this position

What is the location for this role and is it remote?

There are two openings: one based in Palo Alto, California and the other in Dublin, Ireland, with significant travel expected to Memphis, Tennessee for data center buildouts and to the head office in Palo Alto for team collaboration. Remote work is not mentioned.

What experience is required for this position?

Candidates need a minimum of 10 years designing and operating large scale networks with 5 years in the ethernet AI/HPC space, deep understanding of congestion control on ethernet (Infiniband a bonus), AI training and inference workloads including NCCL, expertise in performance metrics, and experience with Python for automation.

What is the company culture like at xAI?

xAI has a small, highly motivated team focused on engineering excellence, with a flat organizational structure where all employees are hands-on, leadership is earned through initiative and excellence, and strong work ethic, prioritization, and communication skills are valued.

What travel or on-call requirements are there?

There will be significant travel to Memphis for building capacity, participation in a team on-call rotation, and helping with scaling and maintenance efforts.

What makes a strong candidate for this role?

Ideal candidates have 10+ years in large-scale networks including 5 years in ethernet AI/HPC, deep expertise in RoCEv2, congestion control, NCCL, AI workloads, performance metrics, and Python automation, and thrive in a hands-on environment with travel and on-call duties.

xAI

AI tools for research and information retrieval

About xAI

x.ai develops AI tools aimed at enhancing research and information retrieval. Their main product, Grok, is designed to answer a variety of questions, including unconventional ones that other AI systems might not handle. Grok provides real-time knowledge, making it a useful resource for researchers, academics, and professionals who need quick access to relevant information. Unlike competitors, Grok stands out for its ability to suggest questions and provide nuanced answers, catering to a diverse range of inquiries. The goal of x.ai is to empower users by streamlining their research processes and fostering innovation through reliable information access.

Burlingame, CaliforniaHeadquarters

2023Year Founded

$11,803.1MTotal Funding

SERIES_CCompany Stage

Data & Analytics, AI & Machine LearningIndustries

1,001-5,000Employees

Benefits

Health Insurance

Remote Work Options

Risks

Increased competition from Anthropic could challenge xAI's market position.

Legal battles involving Elon Musk may divert resources from xAI's operations.

Reliance on Nvidia GPUs poses risks if supply chain issues arise.

Differentiation

Grok answers unconventional questions, unlike many AI systems.

xAI's Grok provides real-time knowledge, enhancing research efficiency.

Grok's ability to generate striking images sets it apart in visual data processing.

Upsides

xAI secured $6 billion funding, boosting AI infrastructure and R&D.

Grok's iOS app launch expands user accessibility and engagement.

AI-driven research tools are increasingly integrated with cloud platforms, aiding xAI's growth.

Land your dream remote job 3x faster with AI

Try Jobo Free