Job Description

Position Overview

PayPay is seeking a highly experienced Kafka Engineer to join our expanding Streaming Platform team. This role is crucial for strengthening our event-driven architecture, enhancing performance and resilience, and leading the next stage of our Kafka infrastructure. You will be instrumental in migrating our self-hosted Kafka clusters to KRaft mode and managing Kafka both in self-managed and AWS MSK environments. This is a senior, hands-on role with the opportunity to build and modernize the streaming infrastructure powering payments for over 69 million users.

About PayPay

PayPay is a leading FinTech company, boasting over 69 million users (as of May 2025) since its 2018 launch. Our team is incredibly diverse, with members hailing from over 50 countries.

OUR VISION IS UNLIMITED_ We believe in creating a future beyond imagination by constantly taking risks and challenging ourselves. PayPay remains true to its roots, realizing visions no one else can conceive. This mindset offers daily new and exciting opportunities for growth into unimagined dimensions. We seek individuals who embrace challenges, refresh products at breakneck speed, and promote PayPay with professionalism and passion.

Please note: You cannot apply or be selected in parallel with PayPay Corporation, PayPay Card Corporation, and PayPay Securities Corporation.

Main Responsibilities

• Tech Leadership & Operations: Provide tech leadership, architecture, development, and operations for Apache Kafka, including self-hosted clusters and AWS MSK.
• Infrastructure Management: Ensure deployment, management, and smooth operation of highly available Kafka infrastructure.
• Monitoring & Alerting: Implement and maintain monitoring and alerting for Kafka to ensure reliability, throughput, and latency.
• Performance Tuning: Conduct performance tuning and instrumentation of Kafka clusters and pipelines.
• Collaboration: Partner with application teams to guide Kafka topic design, schema management, and best practices.
• Pipeline Development: Contribute to the development of scalable, secure, and observable data pipelines.
• Automation: Automate infrastructure and operations workflows using infrastructure-as-code tools.

Tech Stack

• Languages: Java, Python, Go
• Streaming & Data: Kafka, Elasticsearch/Opensearch, AWS MSK, Athena, Glue
• Containerization & Orchestration: Docker, Kubernetes, ArgoCD, Argo rollouts, Argo workflows
• Infrastructure & CI/CD: Artifactory, AWS, GCP, GitHub, GitHub Actions, Jenkins, Terraform, Ansible, Microservices, GitOps
• Monitoring & Logging: Logstash, Fluent-bit, Vector, Victoria Metrics, Grafana, Prometheus
• Collaboration Tools: Slack, Zoom, Confluence, JIRA

Qualifications

• Kafka Experience: Minimum of 3 years of engineering experience with Apache Kafka in production environments.
• Cloud & DevOps Experience: Minimum of 3 years of experience in AWS, Terraform, Ansible, and Linux Administration.
• Kafka Operations: Strong hands-on experience with Kafka cluster operations, including setup, tuning, and maintenance.
• Kafka Security: Experience with Kafka authentication and authorization operations.
• AWS Familiarity: Familiarity with the AWS cloud platform, especially Amazon MSK (Managed Streaming for Kafka).
  • Note: Candidates without previous AWS experience must be prepared to quickly onboard.
• Programming Proficiency: Proficiency in one or more general-purpose programming languages (e.g., Python, Java, Go).
• Automation Tools: Experience with infrastructure automation and configuration management tools, such as Terraform or Ansible.
• System Design: Understanding of modern system design using microservice architecture.
• Version Control & CI/CD: Working knowledge of Git and CI/CD tools.

Preferred Qualifications

• (Information not provided in the original text)

Salary

• (Information not provided in the original text)

Location Type

• (Information not provided in the original text)

Employment Type

• (Information not provided in the original text)