Sr Data Scientist – NLP, LLM and GenAI

Employment Type: Full time

Position Overview:

S&P is a leader in risk management solutions leveraging automation and AI/ML. This role is a unique opportunity for hands-on ML scientists and NLP/Gen AI/ LLM scientists to grow into the next step in their career journey and apply their technical expertise in NLP, deep learning, GenAI, and LLMs to drive business value for multiple stakeholders while conducting cutting-edge applied research around LLMs, Gen AI, and related areas.

Grade Level (for internal use): 10

Responsibilities:

ML, Gen AI, NLP, LLM Model Development:

• Design and develop custom ML, Gen AI, NLP, LLM Models for batch and stream processing-based AI ML pipelines.
• Model components will include data ingestion, preprocessing, search and retrieval, Retrieval Augmented Generation (RAG), NLP/LLM model development, fine-tuning and prompt engineering.
• Ensure the solution meets all technical and business requirements.
• Work closely with other members of data science, MLOps, and technology teams in the design, development, and implementation of the ML model solutions.

ML, NLP, LLM Model Evaluation:

• Work closely with other data science team members to develop, validate, and maintain robust evaluation solutions and tools to evaluate model performance, accuracy, consistency, and reliability during development and UAT.
• Implement model optimizations to improve system efficiency.

NLP, LLM, Gen AI Model Deployment:

• Work closely with the MLOps team for the deployment of machine learning models into production environments, ensuring reliability and scalability.

Internal Collaboration:

• Collaborate closely with product teams, business stakeholders, MLOps, machine learning engineers, and software engineers to ensure smooth integration of machine learning models into production systems.

Documentation:

• Write and maintain comprehensive documentation of ML modeling processes and procedures for reference and knowledge sharing.

Develop Models Based on Standards and Best Practices:

• Ensure that the models are designed and developed while adhering to specified standards, governance, and best practices in ML model development as specified by senior Data Science and MLOps leads.

Assist in Problem Solving:

• Troubleshoot complex issues related to machine learning model development and data pipelines and develop innovative solutions.

What We’re Looking For:

• Bachelor's / Master’s in Computer Science, Mathematics or Statistics, Computational Linguistics, Engineering, or a related field.
• 1+ years of professional hands-on experience leveraging large sets of structured and unstructured data to develop data-driven tactical and strategic analytics and insights using ML, NLP, computer vision solutions.
• Demonstrated 1+ years hands-on experience with Python, Hugging Face, TensorFlow, Keras, PyTorch, Spark or similar statistical tools. Expert in Python programming.
• 1+ years hands-on experience developing natural language processing (NLP) models, ideally with transformer architectures.
• 1+ years of experience with implementing information search and retrieval at scale, using a range of solutions from keyword search to semantic search using embeddings.
• Knowledge of developing or tuning Large Language Models (LLM) and Generative AI (GAI).
• Knowledge of NLP, LLMs (extractive and generative), fine-tuning, and LLM model development.
• Familiar with higher-level trends in LLMs and open-source platforms.

Nice to have:

• Experience with contributing to GitHub and open-source initiatives or in research projects and/or participation in Kaggle competitions.

About S&P Global Ratings:

At S&P Global Ratings, our analyst-driven credit ratings, research, and sustainable finance opinions provide critical insights that are essential to translating complexity into clarity so market participants can uncover opportunities and make decisions with conviction. By bringing transparency to the market through...