Senior Data Engineer
Built TechnologiesSalary not specified
- Full Time
- Senior (5 to 8 years)
$60,000 – $90,000Compensation
Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level
InternshipJob Type
UnknownVisa
Biotechnology, Data Science, EngineeringIndustries
Requirements
Candidates should possess a Bachelor's or Master's degree in Computer Science or a related field, along with a minimum of 5 years of experience in the development of big data technologies and data pipelines. They must have proficiency in managing and manipulating large datasets, typically in the terabyte range, and demonstrate expertise in big data frameworks such as Hadoop, Apache Spark, and Apache Hive, preferably on cloud platforms like GCP or Azure. Strong programming skills in Scala and Python are required, alongside proficiency in SQL for data analysis and optimization, particularly in BigQuery or Spark SQL. Experience with messaging platforms like Kafka is preferred, as well as strong data modeling skills for designing adaptable schemas.
Responsibilities
The Senior Data Engineer will be responsible for designing, building, and enhancing high-performance, reusable frameworks for data pipelines, deploying cutting-edge solutions at scale impacting millions of customers worldwide, and ensuring data quality and governance standards for International Supply Chain data applications. They will support data use-cases, interact with Walmart engineering teams across geographies, analyze business requirements and translate them into data strategies, and identify suitable data sources. Furthermore, they will build the infrastructure for data transformation and integration, automate data preparation tasks, and collaborate with team members to solve business problems effectively.
Skills
Scala
Python
SQL
BigQuery
Spark SQL
Hadoop
Apache Spark
Apache Hive
Kafka
Data Modeling
Data Warehousing
Data Pipelines
Walmart
Global retail chain offering affordable products
About Walmart
Walmart operates a chain of hypermarkets, discount department stores, and grocery stores, providing a wide variety of products at low prices to everyday consumers, families, and communities. The company combines physical retail locations with an e-commerce platform, allowing customers to shop for groceries, apparel, electronics, and household items both in-store and online. Walmart's efficient supply chain management and large-scale purchasing enable it to maintain affordability, setting it apart from competitors. The company also offers financial services and health and wellness services, including pharmacies and vision centers. Walmart's goal is to save people money and support communities, as demonstrated by its efforts during the COVID-19 pandemic and its commitment to social responsibility, including programs for veterans and military families.
Key Metrics
Bentonville, ArkansasHeadquarters
1962Year Founded
$5,515MTotal Funding
IPOCompany Stage
Financial Services, Consumer GoodsIndustries
10,001+Employees