Senior Data Engineer
BiorenderSalary not specified
Full Time
Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Retail, TechnologyIndustries
Requirements
- Master’s degree or the equivalent in Computer Science, Engineering or related field; OR Bachelor’s degree or the equivalent in Computer Science, Engineering or related field and 2 years of experience in software engineering or related field
- Experience with Data Modeling, data integration and ETL (extract transform load) processes to load data into data lakes and warehouses
- Experience with SQL, Hive and NoSQL database systems to retrieve structured data efficiently
- Experience with data modeling techniques, creating data pipelines, and designing scalable data architectures to transform raw data into actionable insights and maintaining data warehouse solutions
- Experience with big data tools and frameworks including Hadoop, Scala and experience with Spark for analyzing and managing massive datasets to derive insights and enable real time analytics
- Experience with Google Cloud Platform (GCP) services including BigQuery, GCS, Dataproc, Pub/Sub to manage data storage, processing and deliver efficient business solutions
- Experience programming languages including Python, Java and modeling used in data processing
- Experience with integration tools including atomic, airflow for automating, scheduling and orchestrating workflows enabling efficient data pipeline management
- Experience with CI/CD pipeline creation, integration and automation to streamline the software development lifecycle and faster deployment
- Experience writing and executing Unit Tests, Functional Tests to validate code functionality and data quality to ensure software
Responsibilities
- Identifies possible options to address the business problems within one's discipline through analytics, big data analytics, and automation
- Supports the development of business cases and recommendations
- Owns delivery of project activity and tasks assigned by others
- Supports process updates and changes
- Solves business issues
- Supports the documentation of data governance processes
- Supports the implementation of data governance practices
- Understands, articulates, and applies principles of the defined strategy to routine business problems that involve a single function
- Extracts data from identified databases
- Creates data pipelines and transform data to a structure that is relevant to the problem by selecting appropriate techniques
- Develops knowledge of current data science and analytics trends
- Supports the understanding of the priority order of requirements and service level agreements
- Helps identify the most suitable source for data that is fit for purpose
- Performs initial data quality checks on extracted data
- Analyzes complex data elements, systems, data flows, dependencies, and relationships to contribute to conceptual, physical, and logical data models
- Develops the Logical Data Model and Physical Data Models including data warehouse and data mart designs
- Defines relational tables, primary and foreign keys, and stored procedures to create a data model structure
- Evaluates existing data models and physical databases for variances and discrepancies
- Develops efficient data flows
- Analyzes data-related system integration challenges and proposes appropriate solutions
- Creates training documentation and trains end-users on data modeling
- Oversees the tasks of less experienced programmers and stipulates system troubleshooting supports
- Writes code to develop the required solution and application features by determining the appropriate programming language and leveraging business, technical, and data requirements
- Creates test cases to review and validate the proposed solution design
- Creates proofs of concept
- Tests the code using the appropriate testing approach
- Deploys software to production servers
- Contributes code documentation, maintains playbooks, and provides timely progress updates
Skills
Key technologies and capabilities for this role
Questions & Answers
Common questions about this position
What is the location for this Data Engineer III position?
The job is located at 1375 Crossman Avenue, Sunnyvale, CA 94089.
What education and experience are required for this role?
A Master’s degree or equivalent in Computer Science, Engineering, or related field is required, or a Bachelor’s degree or equivalent with 2 years of experience in software engineering or related field.
What key skills are needed for the Data Engineer III position?
Required skills include experience with Data Modeling, data integration and ETL processes to load data into data lakes and warehouses, SQL, Hive and NoSQL database systems, data modeling techniques, creating data pipelines, and designing.
What is the salary or compensation for this position?
This information is not specified in the job description.
What makes a strong candidate for this Data Engineer III role?
Strong candidates will have a Master’s or Bachelor’s in Computer Science or Engineering with relevant experience, plus hands-on expertise in data modeling, ETL processes, SQL, Hive, NoSQL, data pipelines, and data warehouse design.
Walmart
Global retail chain offering affordable products
About Walmart
Walmart operates a chain of hypermarkets, discount department stores, and grocery stores, providing a wide variety of products at low prices to everyday consumers, families, and communities. The company combines physical retail locations with an e-commerce platform, allowing customers to shop for groceries, apparel, electronics, and household items both in-store and online. Walmart's efficient supply chain management and large-scale purchasing enable it to maintain affordability, setting it apart from competitors. The company also offers financial services and health and wellness services, including pharmacies and vision centers. Walmart's goal is to save people money and support communities, as demonstrated by its efforts during the COVID-19 pandemic and its commitment to social responsibility, including programs for veterans and military families.
Bentonville, ArkansasHeadquarters
1962Year Founded
$5,515MTotal Funding
IPOCompany Stage
Financial Services, Consumer GoodsIndustries
10,001+Employees
Benefits
PTO: Paid vacation, sick time, personal time and holiday time
10% discount on regularly priced general merchandise and fresh fruits and vegetables
6% 401(k) match to all employees, including hourly workers, after one year
Roth IRA available
Associate Stock Purchase Plan
maximum and eligible preventive care covered at 100%
Health reimbursement plans
Risks
Rising U.S. labor costs could pressure profit margins.
Amazon's grocery delivery expansion threatens Walmart's market share.
Fintech investments expose Walmart to financial regulatory risks.
Differentiation
Walmart's omnichannel strategy integrates physical and online retail seamlessly.
The company offers a wide range of products at consistently low prices.
Walmart's commitment to community support enhances its brand reputation.
Upsides
Walmart's investment in fintech expands its financial services offerings.
Robotics integration in distribution centers boosts operational efficiency.
Culturally themed product lines attract diverse customer segments.
Related Jobs
RemoteRemoteSenior Data Engineer (Pipeline)
Demandbase$190,000 - $284,000/year
- Full Time
- Senior (5 to 8 years)
RemoteSenior Data Engineer
Wpromote$102,000 - $125,000/year
- Full Time
- Senior (5 to 8 years)
RemoteStaff Data Engineer
Life360$166,500 - $245,000/year
- Full Time
- Expert & Leadership (9+ years)
RemoteStaff Data Scientist | Modeling
MachinifySalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteAnalytics Engineer
7shiftsSalary not specified
- Full Time
- Junior (1 to 2 years)
RemoteSenior PostgreSQL Database Engineer (Remote)
PerconaSalary not specified
- Full Time
- Senior (5 to 8 years)
RemotePrincipal Data Architect
eBaySalary not specified
- Full Time
- Expert & Leadership (9+ years)