Data Engineer at ShyftLabs

Noida, Uttar Pradesh, India

ShyftLabs Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
TechnologyIndustries

Requirements

  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • Minimum of 6+ years of experience in data engineering, preferably related to MDM systems
  • Strong expertise in SQL and other database query languages
  • Hands-on experience with data warehousing solutions and relational database management systems (RDBMS)
  • Proficiency in ETL tools and data pipeline construction
  • Familiarity with AWS services
  • Excellent programming skills, preferably in Python
  • Strong understanding of data privacy regulations like DSAR and CCPA
  • Good communication skills, both written and verbal, with the ability to articulate complex data concepts to non-technical stakeholders
  • Strong problem-solving skills and attention to detail

Responsibilities

  • Act as the first point of contact for data issues in the Master Data Management (MDM) system
  • Investigate and resolve data-related issues, such as duplicate data or missing records, ensuring timely and accurate updates
  • Coordinate with the Product Manager, QA Lead, and Technology Lead to prioritize and address tickets effectively
  • Work on data-related issues, ensuring compliance with regulations
  • Build and optimize data models to ensure efficient storage and query performance, including work with Snowflake tables
  • Write complex SQL queries for data manipulation and retrieval
  • Collaborate with other teams to diagnose and fix more complex issues that may require code changes or system updates
  • Utilize AWS resources like CloudWatch, Lambda, SQS, and Kinesis Streams for data storage, transformation, and analysis
  • Update and maintain the knowledge base to document common issues and their solutions
  • Monitor system logs and alerts to proactively identify potential issues before they affect customers
  • Participate in team meetings to provide updates on ongoing issues and contribute to process improvements
  • Maintain documentation of data engineering processes, data models, and system configurations

Skills

SQL
Snowflake
AWS
CloudWatch
Lambda
SQS
Kinesis Streams
MDM

ShyftLabs

Data-driven decision-making solutions for organizations

About ShyftLabs

ShyftLabs helps organizations adopt a data-first approach to their decision-making processes. Their services focus on establishing systems that enable companies to make quicker and more informed decisions based on data analysis. This approach allows businesses to gain insights that can keep them ahead of their competitors. Unlike other companies that may offer generic consulting services, ShyftLabs emphasizes the importance of data in driving decisions, ensuring that organizations can leverage their data effectively to enhance their strategic planning and operational efficiency.

None, CanadaHeadquarters
2018Year Founded
VENTURE_UNKNOWNCompany Stage
Data & Analytics, ConsultingIndustries
11-50Employees

Benefits

Health Insurance
Hybrid Work Options
Professional Development Budget

Risks

Increased competition from startups offering innovative, cost-effective solutions.
Growing demand for in-house analytics teams reducing reliance on consultants.
Rapid AI advancements may outpace ShyftLabs' current technology offerings.

Differentiation

ShyftLabs specializes in data governance, warehousing, and predictive analysis services.
The firm empowers organizations with a data-first approach for decision-making.
ShyftLabs establishes processes for faster, insightful decisions to outpace competition.

Upsides

Increased demand for data governance due to stricter privacy regulations.
Growing interest in predictive analytics in retail for inventory optimization.
Rising adoption of cloud-based BI tools among SMEs for cost-effectiveness.

Land your dream remote job 3x faster with AI