GenAI & Databricks- R01556764 at Brillio

Bengaluru, Karnataka, India

Brillio Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
TechnologyIndustries

Requirements

  • 5-8+ years of experience in Data Science, Machine Learning, NLP, LLMs, Generative AI, and Databricks
  • Strong background in Machine Learning, NLP, and LLMs (Transformers, RAG, embedding models)
  • Proven experience fine-tuning or implementing models using Hugging Face, LangChain, LlamaIndex, or OpenAI API
  • Knowledge of retrieval-augmented generation, multi-agent orchestration, and context management
  • Expertise in Databricks (Delta Lake, MLflow, Unity Catalog, Feature Store, Vector Search)
  • Familiarity with Azure Databricks, Azure OpenAI, or Snowflake Cortex AI
  • Experience integrating external APIs and cloud-native microservices (FastAPI, REST, or gRPC)
  • Strong proficiency in Python, SQL, PySpark, and Databricks Notebooks
  • Experience building modular codebases, deploying APIs, and working with CI/CD pipelines (GitHub Actions, Azure DevOps)
  • Hands-on experience with Streamlit, Gradio, or other UI frameworks for AI app development
  • Hands-on with MLflow tracking, model registry, and experiment management
  • Experience in AI validation, faithfulness scoring, drift detection, and integrity match metrics
  • Working knowledge of Docker, Kubernetes, and inference scaling techniques

Responsibilities

  • Design and implement end-to-end Generative AI solutions on Databricks, leveraging Unity Catalog, MLflow, Delta Lake, and Vector Search
  • Architect LLM-based multi-agent frameworks for intelligent automation, chatbot systems, and document reasoning tasks
  • Integrate Cortex AI, OpenAI, or Anthropic APIs for retrieval-augmented generation (RAG), conversational reasoning, and workflow orchestration
  • Fine-tune and evaluate LLMs and domain-specific NLP models (NER, Risk Assessment, Question Answering)
  • Develop pipelines for prompt engineering, context management, model evaluation, and hallucination detection
  • Optimize inference performance, latency, and cost across multi-cloud and Databricks environments
  • Collaborate with data engineering teams to ensure clean, well-governed, and vectorized data pipelines
  • Build and maintain feature stores and embeddings stores using Databricks or Snowflake
  • Implement data validation, lineage, and monitoring using Delta Live Tables and Unity Catalog
  • Build reusable ML pipelines using Databricks Repos, MLflow, and Feature Store
  • Automate deployment, monitoring, and retraining workflows for continuous model improvement
  • Partner with product managers, data scientists, and business stakeholders to translate ideas into production-ready AI systems
  • Review code, mentor junior engineers, and enforce best practices in scalable AI/ML development
  • Contribute to internal knowledge bases, documentation, and reusable component libraries

Skills

Databricks
Generative AI
Machine Learning
NLP
LLMs
MLflow
Delta Lake
Unity Catalog
Vector Search
RAG
MLOps
OpenAI
Anthropic
Snowflake
Azure

Brillio

Technology consulting for digital transformation

About Brillio

Brillio helps businesses with their digital transformation by providing technology consulting services. The company focuses on creating customized digital solutions that utilize artificial intelligence and cloud technologies to meet the specific needs of each client. This includes improving operational efficiency and enhancing user experiences through real-time responses and better workflows. Brillio serves a variety of clients, including large Fortune 500 companies, with a strong emphasis on the healthcare sector. Unlike many competitors, Brillio's approach is centered on developing bespoke solutions that give clients a competitive advantage, aiming to help them evolve into 'generative enterprises.' The company's goal is to drive significant improvements in business operations and outcomes through its consulting services and technology implementations.

Edison, New JerseyHeadquarters
2014Year Founded
LATE_VCCompany Stage
Consulting, AI & Machine Learning, HealthcareIndustries
1,001-5,000Employees

Benefits

Remote Work Options

Risks

High competition in tech may impact Brillio's talent acquisition and service scaling.
Over-reliance on healthcare exposes Brillio to sector-specific regulatory and funding risks.
Expansion into new markets may stretch resources, leading to potential operational inefficiencies.

Differentiation

Brillio specializes in bespoke digital solutions for diverse industries, focusing on AI and cloud.
The company is recognized as an Enterprise Innovator in healthcare payer services.
Brillio's Cloud and AI Studio aims to modernize enterprise IT systems and optimize workflows.

Upsides

Increased demand for AI-driven healthcare solutions boosts Brillio's market potential.
Expansion in India enhances service delivery and innovation through a growing tech talent pool.
Recognition in Open Banking IT Services highlights Brillio's role in financial digital transformation.

Land your dream remote job 3x faster with AI