Senior Engineering Manager - Accelerated Compute Memory Systems at Pryon

Boston, Massachusetts, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

AI, High-Performance Computing, Enterprise SoftwareIndustries

Requirements

10+ years in software engineering, 5+ years in management roles with large-scale AI/ML systems and infrastructure
Expert-level proficiency in Python and Golang, with 5+ years building production distributed systems
Experience with orchestration frameworks (Kubernetes, Ray, Dask)
Proficiency with vector databases (Pinecone, Weaviate, Qdrant, or similar)
Experience with message queuing systems (Kafka, Pulsar, RabbitMQ)
In-depth knowledge and hands-on experience building scalable distributed architectures and high-performance compute systems
Proven experience in multimodal ingestion pipelines within RAG platforms
Direct experience in designing, fine-tuning, and optimizing LLMs for ingestion and retrieval workloads
Previous success managing engineering teams delivering production-grade, HPC-scale RAG systems
Deep understanding of infra domains: compute, storage, networking, observability, security, disaster recovery, and cost management
Familiarity with HPC cluster management software such as Slurm
Familiarity with cloud platforms (AWS, Azure, GCP) and/or on-prem datacenter operations

Responsibilities

Build and lead a team delivering the ingestion, retrieval, and inference layers that will power mission-critical deployments for commercial and federal entities with millions of public users
Architect and deliver horizontally scalable, fault-tolerant systems capable of handling billions of documents and burst loads of 30K+ concurrent users
Guide implementation of multimodal ingestion pipelines (e.g., PDF, HTML, DOCX, JSON, XML, PPTX, TIFF)
Oversee design and optimization of LLM-driven data ingestion and retrieval workflows
Own optimization and tuning of high-throughput, low-latency production environments via async orchestration frameworks
Establish performance benchmarking, compliance frameworks, and automated testing for scale
Balance technical leadership with people leadership, guiding architecture decisions, while also scaling and mentoring a high-performing team
Collaborate cross-functionally with Product, Executive Leadership, and Customer Success

Skills

HPC

LLM

RAG

Retrieval-Augmented Generation

Multimodal Ingestion

Async Orchestration

Scalable Systems

Fault-Tolerant Systems

Performance Benchmarking

Automated Testing

Natural Language Processing

Software Engineering

Team Leadership

Pryon

AI platform for enhancing information access

About Pryon

Pryon provides an AI-powered platform that helps organizations reduce "knowledge friction," which is the time employees waste searching for information across various formats and locations. The platform uses technologies like Computer Vision, Optical Character Recognition, and Large Language Models to read and understand content, creating a "Knowledge Fabric" that serves as a reliable source of information. This allows employees to quickly access the data they need, improving productivity and operational efficiency. Pryon operates on a subscription-based model, charging clients based on the number of users and data processed, which ensures a steady revenue stream. The goal of Pryon is to streamline information access within organizations, enabling employees to focus on problem-solving rather than searching for information.

Raleigh, North CarolinaHeadquarters

2017Year Founded

$132.8MTotal Funding

SERIES_BCompany Stage

Enterprise Software, AI & Machine LearningIndustries

51-200Employees

Benefits

Health Insurance

Dental Insurance

Vision Insurance

Life Insurance

Disability Insurance

401(k) Retirement Plan

401(k) Company Match

Unlimited Paid Time Off

Risks

Rapid AI advancements could render Pryon's technology outdated without continuous innovation.

Reliance on Oracle Cloud Infrastructure poses risks if service agreements change.

Complex enterprise content challenges the accuracy of Pryon's Retrieval-Augmented Generation solutions.

Differentiation

Pryon transforms unstructured data into machine-readable formats with its Ingestion Engine.

The company offers a no-code AI platform, minimizing operational disruptions for clients.

Pryon's Retrieval Engine provides secure, scalable RAG solutions for complex enterprise content.

Upsides

Pryon's partnership with Carahsoft opens new revenue streams in the public sector.

Inclusion in the 2024 CB Insights AI 100 list boosts Pryon's visibility and investor appeal.

Oracle Cloud Infrastructure selection is expected to double Pryon's AI research productivity.

Land your dream remote job 3x faster with AI

Try Jobo Free