Senior Data Platform Engineer
Apollo.ioFull Time
Senior (5 to 8 years)
Candidates must have 5+ years of software engineering experience, focusing on large-scale distributed systems or data infrastructure. Expertise in building scalable data platforms, including ingestion, stream, and batch processing systems, is required. Proficiency in programming languages like Python, Java, or Rust, along with experience in open-source data projects, is essential. Hands-on experience with modern data technologies such as Kafka, Spark, Flink, or Airflow/Dagster, and a deep understanding of database systems (SQL, NoSQL, columnar storage) and data modeling principles are necessary. Strong knowledge of cloud infrastructure (AWS, GCP, Azure), containerization tools (Docker, Kubernetes), and microservices architecture is expected. Excellent communication and collaboration skills are also required, along with the ability to thrive in a fast-paced environment. Bonus points for a passion for Discord and gaming, and open-source contributions to data-related projects. Candidates must reside in or be willing to relocate to the San Francisco Bay Area.
The Senior Software Engineer will define and execute the technical vision for Discord's data platform, enabling scalable, reliable, and performant data systems. They will design, implement, and optimize data infrastructure for processing petabytes of data, and develop innovative data architectures for analytics, machine learning, and operational insights. Responsibilities include building monitoring, logging, and alerting systems, partnering with data scientists, engineers, and product managers to align technical solutions with business goals, and promoting best practices in data governance, security, and compliance. The role also involves providing technical leadership, mentoring junior engineers, and staying current with industry trends in data platforms.
Voice, video, and text communication platform
Discord is a communication platform that allows users to connect through voice, video, and text. It serves as a space for friends and communities to gather and share their interests, catering to a wide range of groups such as artists, activists, study groups, and hobbyists. Users can join various communities, known as servers, which host discussions and activities related to their interests. Unlike many other platforms, Discord does not rely on advertising or selling user data; instead, it offers a premium subscription service called Nitro, which provides additional features like enhanced streaming quality and customization options. The goal of Discord is to create a welcoming environment where people can build connections and foster a sense of belonging.