Lead AI Engineer (FM Hosting, LLM Inference) at Capital One

New York, New York, United States

Capital One Logo
Not SpecifiedCompensation
Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Banking, Financial ServicesIndustries

Requirements

  • Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies, or Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 2 years of experience developing AI and ML algorithms or technologies
  • At least 4 years of experience (noted in basic qualifications, appears truncated)
  • Passion for staying abreast of the latest research and ability to intuitively understand scientific publications and judiciously apply novel techniques in production
  • Ability to adapt quickly and thrive on bringing clarity to big, undefined problems, with a love for asking questions and digging deep to uncover root causes, articulating findings concisely
  • Courage to share new ideas even when unproven
  • Deeply technical with strong foundation in engineering and mathematics; expertise in hardware, software, and AI to identify and exploit optimization opportunities
  • Resilient trailblazer who can forge new paths to achieve business goals in unknown territories

Responsibilities

  • Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how associates work and customers interact with Capital One
  • Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
  • Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more
  • Invent and introduce state-of-the-art LLM optimization techniques to improve performance (scalability, cost, latency, throughput) of large-scale production AI systems
  • Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One

Skills

Key technologies and capabilities for this role

AI EngineeringMachine LearningLLM InferenceFoundation Model HostingAI InfrastructureSoftware DeploymentCross-functional Collaboration

Questions & Answers

Common questions about this position

What kind of work arrangement does this role offer?

This information is not specified in the job description.

What is the salary or compensation for this position?

This information is not specified in the job description.

What key skills and technologies are required for this Lead AI Engineer role?

The role requires partnering with cross-functional teams to deliver AI products, designing and deploying AI software components like foundation model training and LLM inference, leveraging technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch, and inventing LLM optimization techniques.

What is the team culture like at Capital One for this role?

The Intelligent Foundations and Experiences (IFX) team works hand-in-hand with partners across the company to advance AI engineering, build proprietary solutions for business value, and empower teams with responsible, scalable AI, while emphasizing quality work and doing the right thing.

What makes an ideal candidate for this Lead AI Engineer position?

The ideal candidate loves building systems with pride in quality, shares passion for changing banking for good, stays abreast of latest research, intuitively understands scientific publications, applies novel techniques in production, and adapts quickly.

Capital One

Offers diverse financial products and services

About Capital One

Capital One provides a variety of financial services aimed at making banking accessible and easy for everyone. The company offers products such as credit cards, savings accounts, car loans, and business checking accounts, catering to both individual consumers and small businesses primarily in the United States. Capital One's approach includes user-friendly banking solutions with no fees or minimums for checking accounts, allowing customers to manage their finances more effectively. They generate revenue through interest on loans, credit card fees, and investment banking services. What sets Capital One apart from its competitors is its strong commitment to financial inclusion and literacy, demonstrated through community partnerships and educational initiatives, such as collaborations with Khan Academy. The company's goal is to create a more inclusive financial system and empower customers with the knowledge and tools they need to make informed financial decisions.

McLean, VirginiaHeadquarters
2014Year Founded
$15.9MTotal Funding
IPOCompany Stage
Fintech, Financial ServicesIndustries
10,001+Employees

Benefits

Medical, Dental, & Vision coverage
Onsite Health Centers
Prescription saving with network of local pharmacies
Stock Purchase Plan
Education Assistance
401(k)
Flexible Spending Accounts
Life and Disability insurance
Generous paid time off + corporate & floating holidays
Registered dieticians on site, cooking classes and free virtual fitness classes
Employee Assistance Program

Risks

Increased competition in subscription management tools may dilute Capital One's advantage.
Over-reliance on partnerships could expose Capital One to technological risks.
Departure of key personnel like Joe Rodriguez may affect risk management continuity.

Differentiation

Capital One offers user-friendly banking with no fees or minimums for checking accounts.
The company partners with Khan Academy to provide financial literacy education.
Capital One is the first major U.S. bank to offer subscription management tools.

Upsides

Capital One's mobile app is a model for secure, user-friendly digital banking.
Data sharing with Worldpay enhances payment security and fraud prevention.
Partnerships with fintechs like Minna Technologies improve customer experience.

Land your dream remote job 3x faster with AI