Staff Engineer - Maverick AI

Employment Type: Full-Time Location Type: Remote Salary: Not Specified

Position Overview

Madhive is seeking an experienced Staff Engineer to join our Maverick AI team. This role is pivotal in shaping our technical strategy and execution for our AI product, where data is the core capability. You will be responsible for building dynamic, very low-latency data pipelines and innovating architectural improvements for stability and operational efficiency in our increasingly complex data and database systems. Collaboration with the product team and other technology leaders will be central to your responsibilities.

Responsibilities

• Drive design and architecture discussions for data infrastructure supporting multiple autonomous AI agents, building alignment on complex decisions around feature serving, dynamic data access patterns, and real-time ML feature serving.
• Design, code, test, and release high-quality software for ML feature pipelines and real-time serving infrastructure, ensuring our AI agents can access features with sub-millisecond latency across 100+ models.
• Run and measure live experiments to optimize data delivery for unpredictable agent behavior patterns, testing hypotheses about caching strategies, pre-fetching, and adaptive pipeline architectures.
• Collaborate with cross-functional teams including AI researchers and ML engineers to understand how different agents generate research requests and design data solutions that scale with their evolving needs.
• Apply engineering expertise to solve challenges unique to serving large volumes of data to agentic systems, such as handling sudden request spikes when multiple agents converge on similar research areas or managing feature freshness for real-time model inference.
• Support on-call assignments for critical AI serving infrastructure, ensuring feature pipelines maintain reliability even under unpredictable agent-generated loads.
• Mentor junior engineers on the unique challenges of AI infrastructure, from feature engineering best practices to debugging data issues in multi-model serving environments, supporting hiring and evaluation of candidates.
• Write technical documents to influence architectural decisions around our feature store design, agent data access patterns, and strategies for scaling to thousands of models.

Requirements

• 7+ years of experience working with big data systems capable of processing and transforming data at petabyte scale.
• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
• Experience working in a brisk-paced, high-ambiguity, high-innovation delivery environment.
• Familiarity with messaging systems, batch processing, serverless, and streaming technologies.
• Understanding of both OLTP and OLAP database systems.
• Proven ability to deliver results with consistent accuracy and latency, regardless of dataset size (from 1 GB to 10 PB).
• Experience implementing multiple retrieval-augmented generation (RAG) systems and intimate familiarity with the trade-offs between different types of low-latency data retrieval systems.
• Experience handling database design and considerations for data at scale for transaction management, reporting, and analytics.
• Enjoyment in designing and implementing critical parts of complex systems.

Company Information

Madhive is the leading independent and fully customizable operating system built to help local media professionals build profitable, differentiated, and efficient businesses. Madhive empowers sales teams to extend their reach into streaming and connects local advertisers with the communities they serve. Madhive’s platform provides the unique ability to reach local audiences at national scale, with premium supply partnerships and end-to-end tools for planning, targeting, and measuring full-funnel campaign outcomes. Powering campaigns for over 30,000 small and medium businesses per day, Madhive is driving the evolution of local media.