Staff Big Data Engineer
H1Salary not specified
- Full Time
- Expert & Leadership (9+ years)
$130,000 – $180,000Compensation
Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level
InternshipJob Type
UnknownVisa
Biotechnology, Data ScienceIndustries
Requirements
Candidates should possess a Bachelor's or Master's degree in Computer Science or a related field, along with 8+ years of experience in developing big data technologies and data pipelines. They must have proficiency in managing and manipulating large datasets, specifically terabytes, and expertise in big data frameworks such as Hadoop, Apache Spark, and Apache Hive, with preference for cloud platforms like GCP, AWS, or Azure. Strong coding skills in Scala and Python are required, alongside expertise in SQL for data analysis and optimization, particularly in BigQuery or Spark SQL. Experience with messaging platforms like Kafka is preferred, and solid data modeling skills are necessary for designing effective schemas.
Responsibilities
The Staff, Data Engineer will be responsible for designing, building, and enhancing high-performance, reusable frameworks for data pipelines, deploying cutting-edge solutions at scale impacting millions of customers worldwide. They will support International Supply Chain data applications by ensuring data quality and governance standards, interacting with Walmart engineering teams across geographies, and translating business requirements into data strategies and projects. Additionally, they will identify suitable data sources, build data integration infrastructure, automate data preparation tasks, provide guidance to stakeholders, and collaborate with team members to solve business problems effectively.
Skills
Scala
Python
SQL
BigQuery
Spark SQL
Hadoop
Apache Spark
Apache Hive
Kafka
Data Modeling
Data Pipelines
Data Integration
Walmart
Global retail chain offering affordable products
About Walmart
Walmart operates a chain of hypermarkets, discount department stores, and grocery stores, providing a wide variety of products at low prices to everyday consumers, families, and communities. The company combines physical retail locations with an e-commerce platform, allowing customers to shop for groceries, apparel, electronics, and household items both in-store and online. Walmart's efficient supply chain management and large-scale purchasing enable it to maintain affordability, setting it apart from competitors. The company also offers financial services and health and wellness services, including pharmacies and vision centers. Walmart's goal is to save people money and support communities, as demonstrated by its efforts during the COVID-19 pandemic and its commitment to social responsibility, including programs for veterans and military families.
Key Metrics
Bentonville, ArkansasHeadquarters
1962Year Founded
$5,515MTotal Funding
IPOCompany Stage
Financial Services, Consumer GoodsIndustries
10,001+Employees