Software Engineer, LLM & Automation
BasisPart Time
Mid-level (3 to 4 years)
Candidates should possess a Bachelor’s degree in Computer Science, Engineering, or a related field, along with at least three years of experience in Machine Learning Engineering, specifically focusing on model training and fine-tuning. Experience with advanced fine-tuning frameworks like Axolotl, Unsloth, Transformers, TRL, and familiarity with parameter-efficient techniques such as LoRA and QLoRA is required.
The Machine Learning Engineer - Fine Tuning will design comprehensive fine-tuning strategies to translate customer requirements into effective technical approaches, developing scalable pipelines for large language models and other AI modalities. They will work directly with customers to understand their needs, guide technical implementation, and serve as the technical point of contact throughout the fine-tuning journey. Additionally, this role involves researching and applying cutting-edge techniques in instruction tuning and model customization, creating frameworks for efficient data preparation, evaluation, and deployment, and implementing best-in-class distributed training techniques.
Platform for deploying and managing ML models
Baseten provides a platform for deploying and managing machine learning (ML) models, aimed at simplifying the process for businesses. Users can select from a library of open-source foundation models and deploy them with just two clicks, making it easier to implement ML solutions. The platform features autoscaling, which adjusts resources based on demand, and comprehensive monitoring tools for tracking performance and troubleshooting. A key differentiator is Baseten's open-source model packaging framework, Truss, which allows users to package and deploy custom models easily. The company operates on a usage-based pricing model, where clients pay only for the time their models are actively deployed, helping them manage costs effectively.