Software Engineer (Backend), Enterprise at Scale AI

Budapest, Hungary

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Artificial Intelligence, Enterprise Software, TechnologyIndustries

Requirements

4+ years of experience developing large-scale backend or infrastructure systems, with a strong emphasis on distributed services, reliability, and scalability
Proficiency in Python or TypeScript, with experience designing high-performance APIs and backend architectures using frameworks such as FastAPI, Flask, Express, or NestJS
Deep familiarity with cloud infrastructure (AWS and Azure preferred), including container orchestration (Kubernetes, Docker) and Infrastructure-as-Code tools like Terraform
Experience managing data systems such as relational and NoSQL databases (PostgreSQL, DynamoDB, etc.) and building pipelines for data-intensive applications
Hands-on experience with GenAI applications, model integration, or AI agent systems—understanding how to deploy, evaluate, and scale AI workloads in production
Strong understanding of observability, CI/CD, and security best practices for running services in enterprise or multi-tenant environments
Ability to balance rapid iteration with production-grade quality, shipping reliable backend systems in fast-paced environments
Collaborative mindset, working closely with ML, infra, and product teams to bring complex GenAI systems into production at enterprise scale

Responsibilities

Design, build, and scale backend systems that power enterprise GenAI products, focusing on reliability, performance, and deployment across both Scale’s and customers’ infrastructure
Develop core services and APIs that integrate AI models and enterprise data sources securely and efficiently, enabling production-scale AI adoption
Architect scalable distributed systems for data processing, inference, and orchestration of large-scale GenAI workloads
Optimize backend performance for latency, throughput, and cost—ensuring AI applications can operate at enterprise scale across hybrid and multi-cloud environments
Manage and evolve cloud infrastructure (AWS, Azure, or GCP), driving automation, observability, and security for large-scale AI deployments
Collaborate with ML and product teams to bring cutting-edge GenAI models into production through efficient APIs, model serving systems, and evaluation frameworks
Continuously improve reliability and scalability, applying strong engineering practices to make AI systems robust, maintainable, and enterprise-ready

Skills

Key technologies and capabilities for this role

Backend EngineeringAPIsDistributed SystemsData ProcessingInferenceOrchestrationScalabilityReliabilityPerformance OptimizationGenAIInfrastructureDeployment PipelinesMicroservicesPythonGo

Questions & Answers

Common questions about this position

What experience level is required for this Backend Engineer role?

The role requires 4+ years of experience developing large-scale backend or infrastructure systems, with a strong emphasis on distributed services, reliability, and scalability.

What programming languages and frameworks are needed for this position?

Proficiency in Python or TypeScript is required, along with experience designing high-performance APIs and backend architectures using frameworks such as FastAPI, Flask, Express, or NestJS.

What cloud platforms should candidates be familiar with?

Deep familiarity with cloud infrastructure is needed, with AWS and Azure preferred.

Is this a remote position or does it require office work?

This information is not specified in the job description.

What is the salary or compensation for this role?

This information is not specified in the job description.

Scale AI

AI platform for data and models

About Scale AI

Scale AI provides a platform that helps businesses develop AI applications by utilizing their enterprise data to customize generative models. The platform includes tools for collecting, curating, and annotating data, as well as features for evaluating and optimizing models. Scale works with a variety of clients, including major tech companies like Microsoft and Meta, government agencies such as the U.S. Army and Airforce, and startups like Brex and OpenSea. What sets Scale apart from its competitors is its comprehensive suite of tools and services that focus on safely unlocking the value of AI. The company's goal is to enhance the performance of advanced language models and generative models, making AI more accessible and effective for its clients.

San Francisco, CaliforniaHeadquarters

2016Year Founded

$1,558.9MTotal Funding

SERIES_FCompany Stage

Data & Analytics, AI & Machine LearningIndustries

1,001-5,000Employees

Benefits

Health, Dental & Vision Coverage - Our health plans give you the flexibility to select the right coverage for you and eligible family members through a variety of plan options.

Easy to use 401(K) - Plan and invest for the future with a 401(k) via Guideline. Scale’s 401(k) plan provides you an opportunity to defer compensation for your long-term savings.

Wellness Fund - We care about the physical, mental, and emotional wellbeing of all Scaliens. Our $100/month wellness stipend can be used for gym memberships, acupuncture, meditation apps, and so much more.

Virtual Social Activities - Being remote has not stopped us from hosting fun virtual events. From trivia night to candle making, we ensure employees are fostering connections & building strong relationships.

Learning & Development - We know how important career growth is for Scaliens, so we offer a $500/year L&D stipend to help support continued development throughout your journey.

Flexible hours allow you to work when you are most productive. You can work with your manager to best plan your daily work schedule.

Generous Paid Time Off - Enjoy time to travel or plan a staycation. We encourage employees to take time off to recharge and prevent burnout. We have a flexible PTO policy where each employee is afforded the flexibility to take planned time-off as needed.

Commuter Benefits - Set aside pre-tax dollars to use on qualified transportation expenses to help ease your commute.

Parental Leave - Balancing work and family is essential, and Scale understands the importance of having adequate leave policies in place to promote a healthy home and work life.

Risks

Legal issues over labor practices could harm Scale AI's reputation and financial standing.

Controversial stance on DEI may deter potential talent and partnerships, affecting growth.

Expansion in San Francisco could increase operational costs amid uncertain economic conditions.

Differentiation

Scale AI offers comprehensive data annotation for AI, unlike competitors focusing on single modalities.

The platform supports diverse clients, from tech giants to government agencies, enhancing its versatility.

Scale AI's commitment to AI safety initiatives sets it apart in responsible AI development.

Upsides

Growing demand for AI data annotation boosts Scale AI's market potential and client base.

Expansion into defense applications opens new revenue streams and strategic partnerships.

Partnerships with AI safety organizations enhance Scale AI's reputation as a responsible AI leader.

Land your dream remote job 3x faster with AI

Try Jobo Free