Software Engineer - Model Performance
Baseten- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
Candidates should have strong experience with training frameworks like PyTorch and experience with GPU-accelerated inference using TensorRT or similar frameworks. Proficiency in Python and C++ is required, along with experience using profiling tools for identifying model training and serving bottlenecks and knowledge of model compression techniques. A total of 10+ years of experience is preferred, including 4+ years focused on large-scale model training or inference platforms, along with excellent leadership skills to lead high-performing engineering teams.
The Senior/Staff Software Engineer will develop and execute a strategic vision for the ML Performance Optimization team, lead the design and operation of cutting-edge ML training and inference performance optimization techniques, and collaborate closely with cross-functional teams to define requirements and align on architectural decisions. Additionally, they will provide technical guidance and mentorship to enable team members to grow their careers.
Develops autonomous electric ride-hailing vehicles
Zoox focuses on creating a fully integrated autonomous ride-hailing service designed specifically for urban transportation. Unlike other companies that modify existing vehicles for self-driving capabilities, Zoox has engineered its own vehicle from the ground up, optimizing it for safety, efficiency, and passenger comfort. The vehicle features advanced sensors, cameras, and AI systems that allow it to navigate complex city environments. It can carry up to four passengers in a spacious interior, ensuring a pleasant ride experience. Safety is paramount, with rigorous testing and collaboration with regulatory bodies to meet high standards. Additionally, Zoox's vehicles are fully electric, promoting sustainability by reducing emissions. The company also develops a user-friendly ride-hailing platform that uses data analytics to improve routing and reduce wait times. Zoox aims to enhance urban mobility while prioritizing safety and environmental responsibility.