Senior Software Engineer, Vision Language Models
MotionalSalary not specified
- Full Time
- Junior (1 to 2 years)
$190,000 – $320,000Compensation
Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
AI & Machine Learning, Consumer SoftwareIndustries
Requirements
Candidates must possess a Bachelor’s, Master’s, or Ph.D. in Computer Science, Artificial Intelligence, Machine Learning, or a related field. Proven experience in developing vision-language models and multimodal machine-learning systems is required. Strong proficiency in deep learning frameworks such as PyTorch or Jax is necessary, along with experience with transformer-based architectures, contrastive learning, and generative models. Familiarity with large-scale dataset handling, knowledge of retrieval-augmented generation, and experience in deploying multimodal models in production environments are also essential. Strong analytical and problem-solving skills, along with excellent communication abilities, are required.
Responsibilities
The Machine Learning Vision Engineer will design, train, and deploy models that integrate vision and language, including contrastive learning and image/video understanding. They will develop algorithms for deep fusion of textual and visual data, optimize training strategies, and fine-tune large-scale pre-trained vision-language models for various applications. Collaboration with researchers, software engineers, and product teams is crucial for integrating visual-language AI capabilities into real-world applications. The engineer will also stay updated on advancements in vision-language modeling, construct large-scale multimodal datasets, and maintain comprehensive documentation of models and training procedures.
Skills
PyTorch
Jax
Deep Learning
Transformer-based architectures
Contrastive Learning
Generative Models
LLaVA
Flamingo
GPT-4V
CLIP
BLIP
Vision Transformers (ViTs)
Retrieval-augmented generation (RAG)
Vision-language alignment
Model Interpretability
Multimodal Datasets
Data Pipelines
Large-scale dataset handling
Sesame
Telehealth platform connecting patients with doctors
About Sesame
Sesame Care connects patients with doctors and specialists through a telehealth platform, primarily serving clients in various states across the U.S. The platform allows patients to book online appointments for services like urgent care, prescription refills, dermatology, mental health, and general doctor visits. By enabling independent clinicians to use its platform, Sesame Care reduces overhead costs and offers competitive pricing, often lower than traditional healthcare providers. Additionally, Sesame partners with Quest Diagnostics to provide affordable lab services, creating a comprehensive healthcare solution. The company operates on a direct-pay model, where patients pay for services upfront, ensuring transparency and prompt payments for healthcare providers. Sesame Care's goal is to make healthcare more affordable and accessible, simplifying the process for patients to receive quality care.
Key Metrics
New York City, New YorkHeadquarters
2018Year Founded
$74MTotal Funding
SERIES_BCompany Stage
HealthcareIndustries
51-200Employees