Senior Data Engineer at eBay

Dublin, County Dublin, Ireland

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Ecommerce, TechnologyIndustries

Requirements

Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies
Proficiency in Hadoop ecosystems such as Hive, Iceberg, Spark SQL
Good understanding of Apache Airflow for orchestrating complex computational workflows and data processing pipelines
Proven ability to design and implement automated data pipelines and materialized views
Proficiency in Python, Unix or similar languages
Good understanding of SQL (Oracle, SQL Server or similar)
Java + Spring Boot: Build and maintain microservices
Ops & CI/CD: Monitoring (Prometheus/Grafana), logging, pipelines (Jenkins/GitHub Actions)
Core Engineering: Data structures/algorithms, testing (JUnit/pytest), Git, clean code
Cloud Native: Docker, Kubernetes (deploy, network, scale, troubleshoot)
6+ years of directly applicable experience
BS in Computer Science, Engineering, or equivalent experience

Responsibilities

Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance
Implement data ETL processes for batch and streaming analytics requirements
Optimize and troubleshoot distributed systems for ingestion, storage, and processing
Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs
Ensure data security, integrity, and compliance throughout the infrastructure
Maintain documentation and contribute to architecture reviews
Participate in incident response and operational excellence initiatives for the data warehouse
Continuously learn and apply new Hadoop ecosystem tools and data technologies

Skills

Hadoop

Apache Kafka

Apache Flink

ETL

Data Pipelines

Big Data

Streaming Analytics

Batch Processing

Distributed Systems

eBay

Global online marketplace for buying and selling

About eBay

eBay is an online marketplace where individuals and businesses can buy and sell a wide range of products, including electronics, fashion, and collectibles. Users can list items for auction or use the 'Buy It Now' option for immediate purchases. eBay stands out from competitors with its vast selection, user-friendly interface, and strong buyer and seller protections, including free shipping on many items. The company's goal is to facilitate seamless transactions while generating revenue through transaction fees, advertising, and subscription services.

San Jose, CaliforniaHeadquarters

1995Year Founded

$6.5MTotal Funding

IPOCompany Stage

Consumer Software, Consumer GoodsIndustries

10,001+Employees