Data Reliability Engineer II at Zeta

Basking Ridge, New Jersey, United States

Zeta Logo
Not SpecifiedCompensation
Mid-level (3 to 4 years)Experience Level
Full TimeJob Type
UnknownVisa
Fintech, Banking, TechnologyIndustries

Requirements

  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • 3-5 years of experience in database administration, with a focus on PostgreSQL
  • 1-2 years of hands-on experience with PostgreSQL RDS
  • Familiarity with data pipeline concepts and technologies like Debezium, Kafka Connect, Apache Nifi
  • Basic understanding of Amazon Redshift and S3
  • Exposure to Apache Spark for data processing
  • Basic understanding of Apache Airflow for workflow orchestration
  • Strong SQL scripting skills for querying and basic data manipulation
  • Familiarity with scripting languages (e.g., Python, Bash) is a plus
  • Knowledge of database security best practices, including access controls, encryption, and compliance with regulatory requirements (e.g., GDPR, HIPAA)
  • AWS Certified Database - Specialty certification is a plus

Responsibilities

  • Proactively monitor PostgreSQL RDS instances for performance, availability, and resource utilization (CPU, memory, storage, connections) using established monitoring tools (e.g., CloudWatch, Prometheus)
  • Assist in identifying performance bottlenecks in PostgreSQL RDS. Apply basic performance tuning techniques like reviewing query execution plans, adding missing indexes, and recommending parameter adjustments
  • Monitor the health and performance of Debezium and Kafka Connect connectors, identifying and troubleshooting basic issues related to data capture and delivery
  • Monitor Apache Nifi data flows for errors, backpressure, and performance issues. Assist in troubleshooting and resolving common Nifi flow failures
  • Provide support for data related issues and participate in root cause analysis
  • Monitor the execution of Apache Airflow DAGs, identify failed tasks, and troubleshooting and re-runs
  • Develop and maintain automation scripts and infrastructure as code (IAC) templates (e.g., using Crossplane, Terraform) to automate routine database tasks, deployments, and updates
  • Participate in on-call rotations to respond to database-related incidents and perform troubleshooting and root cause analysis
  • Assist in implementing and maintaining security best practices for cloud databases, including access controls, encryption, and compliance with regulatory requirements
  • Regularly audit and assess database security configurations
  • Configure and manage database backup and recovery strategies to ensure data integrity and availability in case of failures or data loss
  • Analyse database query performance and collaborate with developers to optimize SQL queries and schemas
  • Participate in continuous improvement initiatives to enhance the reliability, scalability, and performance of cloud databases
  • Assist in the design and optimization of database schemas for cloud environments

Skills

Key technologies and capabilities for this role

PostgreSQLRDSCloudWatchPrometheusDebeziumKafka ConnectApache NiFiApache Airflowquery optimizationindexingperformance tuning

Questions & Answers

Common questions about this position

What are the main responsibilities of this Data Reliability Engineer II role?

Responsibilities include proactively monitoring PostgreSQL RDS instances for performance and availability, troubleshooting Debezium, Kafka Connect, Apache Nifi, and Airflow DAGs, developing automation scripts with Terraform and Crossplane, participating in on-call rotations, and ensuring database security and backups.

What technical skills and tools are required for this position?

Key skills include monitoring and tuning PostgreSQL RDS, working with Debezium, Kafka Connect, Apache Nifi, Apache Airflow, CloudWatch, Prometheus, Terraform, and Crossplane, plus experience in performance optimization, automation, security, and backups.

Is this a remote position or does it require office work?

This information is not specified in the job description.

What is the salary or compensation for this role?

This information is not specified in the job description.

What experience makes a strong candidate for this Data Reliability Engineer II role?

Strong candidates will have hands-on experience with PostgreSQL RDS performance tuning, monitoring distributed systems like Kafka, Nifi, and Airflow, scripting for automation with tools like Terraform and Crossplane, and participating in on-call incident response.

Zeta

Cloud-native payment card processing platform

About Zeta

Zeta provides a platform for payment card processing that is designed for banks, financial institutions, and fintech companies. Their main product, the Omni Stack, allows clients to easily create and manage digital credit, debit, and prepaid card programs. This platform works by integrating with existing systems through APIs, which helps streamline the payment processing experience. Zeta stands out from its competitors by focusing on cloud-native solutions and ensuring compliance with important regulations, which helps build trust with their clients. The company's goal is to make payments seamless and less noticeable in everyday transactions, moving towards a future where payments are 'invisible'.

San Francisco, CaliforniaHeadquarters
2015Year Founded
$369.6MTotal Funding
LATE_VCCompany Stage
Fintech, Financial ServicesIndustries
1,001-5,000Employees

Risks

Competition from fintech startups may erode Zeta's market share.
Data privacy concerns could arise as Zeta expands globally.
Dependence on key partnerships like Sparrow poses risks if disrupted.

Differentiation

Zeta's Tachyon platform powers Sparrow's top-rated credit card for underserved markets.
Zeta's Omni Stack enables rapid launch of digital card programs for financial institutions.
Zeta is recognized for compliance with ISO IEC 27001, PCI DSS 4.0, and SOC 2 Type 2.

Upsides

Zeta's partnership with Sparrow opens new revenue streams in underserved markets.
Zeta's technology receives high ratings, enhancing brand reputation and customer trust.
Recognition by Celent boosts Zeta's market positioning for US banks and credit unions.

Land your dream remote job 3x faster with AI