Senior Engineering Manager - Accelerated Compute Memory Systems at Pryon

Boston, Massachusetts, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

AI, High-Performance Computing, Enterprise SoftwareIndustries

Requirements

10+ years in software engineering, 5+ years in management roles with large-scale AI/ML systems and infrastructure
Expert-level proficiency in Python and Golang, with 5+ years building production distributed systems
Experience with orchestration frameworks (Kubernetes, Ray, Dask)
Proficiency with vector databases (Pinecone, Weaviate, Qdrant, or similar)
Experience with message queuing systems (Kafka, Pulsar, RabbitMQ)
In-depth knowledge and hands-on experience building scalable distributed architectures and high-performance compute systems
Proven experience in multimodal ingestion pipelines within RAG platforms
Direct experience in designing, fine-tuning, and optimizing LLMs for ingestion and retrieval workloads
Previous success managing engineering teams delivering production-grade, HPC-scale RAG systems
Deep understanding of infra domains: compute, storage, networking, observability, security, disaster recovery, and cost management
Familiarity with HPC cluster management software such as Slurm
Familiarity with cloud platforms (AWS, Azure, GCP) and/or on-prem datacenter operations

Responsibilities

Build and lead a team delivering the ingestion, retrieval, and inference layers that will power mission-critical deployments for commercial and federal entities with millions of public users
Architect and deliver horizontally scalable, fault-tolerant systems capable of handling billions of documents and burst loads of 30K+ concurrent users
Guide implementation of multimodal ingestion pipelines (e.g., PDF, HTML, DOCX, JSON, XML, PPTX, TIFF)
Oversee design and optimization of LLM-driven data ingestion and retrieval workflows
Own optimization and tuning of high-throughput, low-latency production environments via async orchestration frameworks
Establish performance benchmarking, compliance frameworks, and automated testing for scale
Balance technical leadership with people leadership, guiding architecture decisions, while also scaling and mentoring a high-performing team
Collaborate cross-functionally with Product, Executive Leadership, and Customer Success

Skills

Key technologies and capabilities for this role

HPCLLMRAGRetrieval-Augmented GenerationMultimodal IngestionAsync OrchestrationScalable SystemsFault-Tolerant SystemsPerformance BenchmarkingAutomated TestingNatural Language ProcessingSoftware EngineeringTeam Leadership

Questions & Answers

Common questions about this position

What experience level is required for this Senior Engineering Manager role?

Candidates need 10+ years in software engineering and 5+ years in management roles with large-scale AI/ML systems and infrastructure.

What programming languages and technical skills are essential for this position?

Expert-level proficiency in Python and Golang is required, along with 5+ years building production distributed systems, experience with orchestration frameworks like Kubernetes, Ray, Dask, vector databases such as Pinecone, Weaviate, Qdrant, and message queuing systems like Kafka, Pulsar, RabbitMQ.

What is the salary or compensation for this role?

This information is not specified in the job description.

Is this position remote or does it require office work?

This information is not specified in the job description.

What kind of team will I be leading in this role?

You will build and lead a technical team delivering the ingestion, retrieval, and inference layers for mission-critical deployments, balancing technical and people leadership while scaling and mentoring a high-performing team.

Pryon

AI platform for enhancing information access

About Pryon

Pryon provides an AI-powered platform that helps organizations reduce "knowledge friction," which is the time employees waste searching for information across various formats and locations. The platform uses technologies like Computer Vision, Optical Character Recognition, and Large Language Models to read and understand content, creating a "Knowledge Fabric" that serves as a reliable source of information. This allows employees to quickly access the data they need, improving productivity and operational efficiency. Pryon operates on a subscription-based model, charging clients based on the number of users and data processed, which ensures a steady revenue stream. The goal of Pryon is to streamline information access within organizations, enabling employees to focus on problem-solving rather than searching for information.

Raleigh, North CarolinaHeadquarters

2017Year Founded

$132.8MTotal Funding

SERIES_BCompany Stage

Enterprise Software, AI & Machine LearningIndustries

51-200Employees

Benefits

Health Insurance

Dental Insurance

Vision Insurance

Life Insurance

Disability Insurance

401(k) Retirement Plan

401(k) Company Match

Unlimited Paid Time Off

Risks

Rapid AI advancements could render Pryon's technology outdated without continuous innovation.

Reliance on Oracle Cloud Infrastructure poses risks if service agreements change.

Complex enterprise content challenges the accuracy of Pryon's Retrieval-Augmented Generation solutions.

Differentiation

Pryon transforms unstructured data into machine-readable formats with its Ingestion Engine.

The company offers a no-code AI platform, minimizing operational disruptions for clients.

Pryon's Retrieval Engine provides secure, scalable RAG solutions for complex enterprise content.

Upsides

Pryon's partnership with Carahsoft opens new revenue streams in the public sector.

Inclusion in the 2024 CB Insights AI 100 list boosts Pryon's visibility and investor appeal.

Oracle Cloud Infrastructure selection is expected to double Pryon's AI research productivity.

Land your dream remote job 3x faster with AI

Try Jobo Free