Staff Cloud Platform Engineer- Core Infra

Position Overview

• Location Type: Remote
• Job Type: FullTime
• Salary: $164.2K - $222.2K

The Core Platform team maintains and optimizes the data, infrastructure, messaging, and services platform that powers Sift’s online systems. We ensure these systems are always available, reliable, and performing at their best to meet customer needs. In the event of an outage or failure, we follow well-practiced recovery plans to restore services swiftly. Managing such complex, large-scale systems requires continuous monitoring and proactive maintenance to uphold these standards.

Requirements

• Experience: 8+ years of experience as a Software Engineer focused on infrastructure/platform services or in a Site Reliability Engineering (SRE) role.
• Programming Skills: Strong programming skills in languages such as Java, Scala, or Python.
• Distributed Systems: Experience designing and implementing distributed systems.
• Cloud Infrastructure: Experience building and managing cloud infrastructure on AWS or GCP.
• Infrastructure as Code: Expertise in building infrastructure as code and automating provisioning processes using tools like CloudFormation or Terraform.
• Monitoring & Alerting: Proficiency in setting up and managing monitoring and alerting systems.

Responsibilities

• System Availability & Performance: Own the availability, performance, and scalability of Sift’s primary online storage systems and infrastructure.
• Immutable Infrastructure: Design and build immutable infrastructure and fault-tolerant, multi-AZ/multi-region systems that are resilient and self-healing.
• Multi-Region Deployments: Design and Implement multi-region deployments, such as BigTable clusters spanning multiple regions, with strategies to ensure specific customers are routed to designated regions (e.g., sticky sessions at the regional level).
• Problem Solving: Solve complex problems that arise from our unique data volume and request rate which may involve digging deep into data store and messaging internals.
• Optimization: Optimize local development and testing workflows to be fast, efficient, and seamless.
• Service & Library Development: Design and implement services and libraries for components to interact with data stores, messaging layer and services platform.
• Tools Development: Develop tools for monitoring, detecting faults, and automatically repairing distributed systems.
• Design Support: Provide design support to internal engineering teams for optimal usage of data stores, data growth planning, production workload optimization, messaging, caching and service platform.
• On-Call & Incident Response: Participate in on-call support and incident response activities, providing 12/7 coverage for one calendar week approximately once every 3-4 weeks.

Technical Stack

• Cloud Providers: GCP, AWS
• Automation Tools: Airflow, Terraform, Jenkins
• Containerization: Kubernetes
• Secrets Management: Vault
• Messaging Systems: Kafka
• Data Warehousing & Processing: Snowflake, Spark
• Programming Languages: Java 11, Python 3, Ruby 2.7, Ruby on Rails