Big Data Engineer

United States

Apply with AI Apply

Not SpecifiedCompensation

Junior (1 to 2 years), Mid-level (3 to 4 years)Experience Level

Full TimeJob Type

UnknownVisa

Biotechnology, Software Development, Cloud ComputingIndustries

Requirements

Candidates should possess a Bachelor's degree in Computer Science, Data Engineering, or a related field, or 1-3 years of relevant professional experience. Expertise in ETL design, data warehousing concepts, SQL query writing and optimization, Python programming (with object-oriented principles), distributed data processing frameworks (like Apache Spark and Apache Flink), AWS or other major cloud platforms, Linux/Unix shell scripting, and the big data ecosystem (including Hive, Presto, Hadoop, HDFS, Parquet, and ORC) is required.

Responsibilities

The Big Data Engineer will build, optimize, and maintain data pipelines using technologies such as Apache Spark and Kafka to handle high-volume data for AI features. Responsibilities include designing, developing, and maintaining ETL processes, optimizing data warehouses and analytical data models, writing and tuning complex SQL queries, collaborating with stakeholders to translate business needs into data workflows, implementing distributed data processing solutions with Scala or Python, building streaming and messaging solutions with Kafka, optimizing solutions within the big data ecosystem, deploying and managing workloads using Kubernetes in cloud or hybrid environments, and developing automation scripts in Linux/Unix shell.

Skills

Apache Spark

Kafka

ETL

Data Warehousing

SQL

Python

Apache Flink

AWS

Linux/Unix shell scripting

Kubernetes

HDFS

Parquet

ORC

Hive

Presto

Scala

Zoom

Video conferencing and online meeting solutions

About Zoom

Zoom provides video conferencing and online meeting solutions that allow users to conduct virtual meetings, webinars, and collaborative sessions. Its main product is video conferencing software, which enables high-quality video and audio communication, along with features like screen sharing, group messaging, and virtual backgrounds. Zoom also offers specialized products for larger events, such as Zoom Webinars and Zoom Events. The company operates on a freemium model, providing basic services for free while charging for advanced features through subscription plans tailored for various users, including businesses, educational institutions, and healthcare providers. Zoom stands out from competitors due to its user-friendly interface, reliable performance, and scalability for different needs, making it a vital tool for remote work, online education, telehealth, and social interactions.

San Jose, CaliforniaHeadquarters

2013Year Founded

$144.5MTotal Funding

IPOCompany Stage

Enterprise Software, Education, HealthcareIndustries

10,001+Employees

Benefits

Health Insurance

Dental Insurance

Vision Insurance

Life Insurance

Disability Insurance

Hybrid Work Options

Flexible Work Hours

Stock Options

Company Equity

Paid Vacation

Paid Sick Leave

Risks

Increased competition from Microsoft Teams and Google Meet threatens Zoom's market share.

Privacy concerns and regulatory scrutiny could impact Zoom's operations and reputation.

Hybrid work models may reduce demand for virtual meetings, affecting Zoom's growth.

Differentiation

Zoom offers a user-friendly interface with reliable performance for virtual meetings.

The platform supports diverse needs, including remote work, education, and telehealth.

Zoom's freemium model attracts a wide range of users with scalable subscription options.

Upsides

Zoom integrates AI tools to enhance virtual meeting effectiveness and productivity.

The expansion of 5G networks improves Zoom's video conferencing quality and accessibility.

Zoom's secure, HIPAA-compliant solutions drive demand in the telehealth sector.

Land your dream remote job 3x faster with AI

Try Jobo Free