Senior Data Engineer at eBay

Dublin, County Dublin, Ireland

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Ecommerce, TechnologyIndustries

Requirements

Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies
Proficiency in Hadoop ecosystems such as Hive, Iceberg, Spark SQL
Good understanding of Apache Airflow for orchestrating complex computational workflows and data processing pipelines
Proven ability to design and implement automated data pipelines and materialized views
Proficiency in Python, Unix or similar languages
Good understanding of SQL (Oracle, SQL Server or similar)
Java + Spring Boot: Build and maintain microservices
Ops & CI/CD: Monitoring (Prometheus/Grafana), logging, pipelines (Jenkins/GitHub Actions)
Core Engineering: Data structures/algorithms, testing (JUnit/pytest), Git, clean code
Cloud Native: Docker, Kubernetes (deploy, network, scale, troubleshoot)
6+ years of directly applicable experience
BS in Computer Science, Engineering, or equivalent experience

Responsibilities

Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance
Implement data ETL processes for batch and streaming analytics requirements
Optimize and troubleshoot distributed systems for ingestion, storage, and processing
Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs
Ensure data security, integrity, and compliance throughout the infrastructure
Maintain documentation and contribute to architecture reviews
Participate in incident response and operational excellence initiatives for the data warehouse
Continuously learn and apply new Hadoop ecosystem tools and data technologies

Skills

Key technologies and capabilities for this role

HadoopApache KafkaApache FlinkETLData PipelinesBig DataStreaming AnalyticsBatch ProcessingDistributed Systems

Questions & Answers

Common questions about this position

What skills and experience are required for the Senior Data Engineer role?

The role requires extensive experience with Apache Kafka, Apache Flink, and streaming technologies; proficiency in Hadoop ecosystems like Hive, Iceberg, Spark SQL; good understanding of Apache Airflow; proficiency in Python, Unix, SQL, Java + Spring Boot; plus skills in Ops & CI/CD, core engineering, and cloud native technologies like Docker and Kubernetes, along with 6+ years of experience.

Is this Senior Data Engineer position remote or office-based?

This information is not specified in the job description.

What is the salary or compensation for this role?

This information is not specified in the job description.

What is the team like for this Data Engineer position?

You'll join the Cloud Data Technologies (CDT) team in Dublin, working on the Hadoop-based data warehouse with passionate thinkers, innovators, and dreamers, collaborating with data engineers, analysts, and platform engineers.

What makes a strong candidate for this Senior Data Engineer role?

A strong candidate will have 6+ years of directly applicable experience, a BS in Computer Science, Engineering, or equivalent, and hands-on expertise in building scalable data pipelines with tools like Kafka, Flink, Hadoop, Spark, Airflow, Python, Java, and cloud native technologies.

eBay

Global online marketplace for buying and selling

About eBay

eBay is an online marketplace where individuals and businesses can buy and sell a wide range of products, including electronics, fashion, and collectibles. Users can list items for auction or use the 'Buy It Now' option for immediate purchases. eBay stands out from competitors with its vast selection, user-friendly interface, and strong buyer and seller protections, including free shipping on many items. The company's goal is to facilitate seamless transactions while generating revenue through transaction fees, advertising, and subscription services.

San Jose, CaliforniaHeadquarters

1995Year Founded

$6.5MTotal Funding

IPOCompany Stage

Consumer Software, Consumer GoodsIndustries

10,001+Employees