Senior Data Engineer at Adobe

San Jose, California, United States

Adobe Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Technology, Software, AIIndustries

Requirements

  • 4+ years of software development experience with 1+ year in data engineering, search relevance, or large-scale systems for conversational experiences
  • Expertise in building reliable and innovative ETL pipelines for heterogeneous data
  • Experience with distributed data frameworks (Spark, Flink) and streaming platforms (Kafka)
  • Proficiency in Python (preferred) or Java/Scala, with strong CS fundamentals
  • Experience with cloud platforms (Azure, AWS, or GCP) and containerization/orchestration (Docker, Kubernetes)
  • Familiarity with modern search systems (Elastic, Vespa) and graph databases (Neo4j, TigerGraph)
  • Understanding of ML data pipelines and MLOps standards for monitoring and continuous improvement
  • Self-starter who thrives in zero-to-one environments and can make informed tradeoffs
  • Preferred Qualifications
  • Background in information retrieval, NLP, or cognitive computing
  • Experience developing, optimizing, and deploying data processing with Apache Spark/Dask/Ray
  • Experience with ontologies, knowledge graphs, or semantic enrichment pipelines
  • Degree in Computer Science, Information Systems, or related field

Responsibilities

  • Build scalable ingestion pipelines for brand information and creative assets, ensuring freshness, reliability, and versioning
  • Integrate and leverage systems and models from our machine learning and data science partner teams
  • Design and maintain brand-aware data models, ontologies, and multi-modal graphs to support context linking and rich retrievals
  • Implement hybrid storage and retrieval strategies across vector databases, graph databases, and search engines, optimizing for precision and latency
  • Develop metadata enrichment pipelines to enhance semantic search, personalization, and optimization for RAG-based conversational systems
  • Ensure data quality and observability by monitoring metrics for accuracy, coverage, and timeliness; build monitoring systems to track ingestion and retrieval health
  • Collaborate with product, ML, and information retrieval teams to align data infrastructure with creative workflows
  • Optimize pipelines using distributed/streaming systems for scale and speed

Skills

Key technologies and capabilities for this role

Data EngineeringData PipelinesMachine LearningVector DatabasesGraph DatabasesSearch EnginesData IngestionData ModelingOntologiesScalable SystemsETLMultimodal Data

Questions & Answers

Common questions about this position

What experience level is required for this Senior Data Engineer role?

Candidates need 4+ years of software development experience with 1+ year in data engineering, search relevance, or large-scale systems for conversational experiences.

What technical skills are essential for this position?

Expertise in building reliable ETL pipelines for heterogeneous data, experience with distributed data frameworks like Spark and Flink, streaming platforms like Kafka, and proficiency in Python (preferred) or Java/Scala with strong CS fundamentals are required.

What is the salary or compensation for this role?

This information is not specified in the job description.

Is this a remote position or does it require office work?

This information is not specified in the job description.

What does Adobe's company culture emphasize?

Adobe is committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity, hiring the very best, and fostering an environment where new ideas can come from everywhere.

Adobe

Software solutions for content creation and marketing

About Adobe

Adobe provides a range of software solutions focused on digital experiences, catering to creative professionals, businesses, and educational institutions. Its main offerings include Adobe Creative Cloud, which contains tools for photography, graphic design, video editing, illustration, UI/UX design, 3D and augmented reality, and social media content creation. Adobe also offers marketing solutions through Adobe Experience Cloud and document management services via Adobe Document Cloud. The company operates on a subscription-based model, allowing users to access its software through monthly or annual plans, with special pricing available for students, teachers, and businesses. Adobe differentiates itself from competitors by providing a comprehensive suite of tools that cover various aspects of content creation and marketing, all integrated into one platform. The goal of Adobe is to empower users to create, manage, and optimize their digital content effectively.

San Jose, CaliforniaHeadquarters
1994Year Founded
$668.9MTotal Funding
IPOCompany Stage
Consumer Software, Enterprise Software, DesignIndustries
10,001+Employees

Benefits

Company Equity
401(k) Company Match

Risks

Emerging AI-driven design tools offer similar functionalities at lower costs.
Open-source alternatives may attract users away from Adobe's subscription model.
Data privacy concerns could affect trust in Adobe's cloud services.

Differentiation

Adobe offers a comprehensive suite for content creation, marketing, and document management.
Adobe's subscription model includes special pricing for students, teachers, and businesses.
Adobe integrates advanced analytics with Experience Cloud for data-driven marketing.

Upsides

Generative AI tools enhance Adobe's content creation and editing efficiency.
Remote work boosts demand for Adobe's cloud-based document management solutions.
AR's popularity in marketing benefits Adobe's 3D and AR tools.

Land your dream remote job 3x faster with AI