Senior Data Engineer at Pattern

Pune, Maharashtra, India

Pattern Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Ecommerce, TechnologyIndustries

Requirements

  • Bachelor’s Degree in Data Science, Data Analytics, Information Management, Computer Science, Information Technology, related field, or equivalent professional experience
  • Overall experience of more than 7+ years
  • 3+ years of experience working with SQL and Python
  • 3+ years of experience in implementing data pipelines using modern data architectures
  • 2+ years of experience working with data warehouses such as Redshift, BigQuery, Snowflake, or similar
  • Experience with open-source based data architectures: Spark, Hive, Trino / Presto or similar
  • Excellent software engineering and scripting knowledge
  • Strong communication skills (both in presentation and comprehension) along with the aptitude for cross-collaboration across data management and analytics domains
  • Expertise with data systems working with massive data volumes from various data sources
  • Ability to lead a team of Data Engineers
  • Preferred Qualifications
  • Experience working with time series databases
  • Advanced knowledge of SQL, including the ability to write stored procedures, triggers, analytic/windowing functions, and tuning
  • Advanced knowledge of Snowflake, including the ability to write and orchestrate streams and tasks
  • Background in Big Data, non-relational databases, Machine Learning and Data Mining
  • Experience with cloud-based technologies including SNS, SQS, SES, S3, Lambda, and Glue
  • Experience with modern data platforms like Redshift, Cassandra, DynamoDB, Apache Airflow, Spark, or ElasticSearch
  • Expertise in Data Quality and Data Governance

Responsibilities

  • Develop, deploy, and support automated, scalable real-time and batch data streams from a variety of sources into the lakehouse
  • Develop and implement data auditing strategies and processes to ensure data quality; identify and resolve problems associated with large scale data processing workflows; implement technical solutions to maintain data pipeline processes and troubleshoot failures
  • Collaborate with technology teams and partners to specify data requirements and provide access to data
  • Tune application and query performance using profiling tools and SQL or other relevant query language
  • Translate business and analytics requirements for data to a comprehensive data model and pipelines
  • Foster data expertise and own data quality for assigned areas of ownership
  • Work with data infrastructure to triage issues and drive to resolution

Skills

Key technologies and capabilities for this role

SQLPythondata pipelineslakehousedata qualityETLbatch processingreal-time streamingquery optimization

Questions & Answers

Common questions about this position

What is the salary for this Senior Data Engineer position?

This information is not specified in the job description.

Is this Senior Data Engineer role remote or does it require office work?

This information is not specified in the job description.

What skills are required for the Senior Data Engineer role?

Required skills include 3+ years with SQL and Python, 3+ years implementing data pipelines using modern data architectures, 2+ years with data warehouses like Redshift, BigQuery, or Snowflake, experience with open-source tools like Spark, Hive, or Trino/Presto, and strong software engineering and communication skills.

What is the company culture like at Pattern?

Pattern values data and the engineering required to take full advantage of it, with a focus on solving business problems that maintain a competitive edge. The company has recruited talent from top brands like Amazon, eBay, and Google, and works with major consumer brands.

What qualifications make a strong candidate for this Senior Data Engineer position?

Candidates need a Bachelor’s Degree in a relevant field or equivalent experience, more than 7 years overall experience, and the required technical skills in SQL, Python, data pipelines, warehouses, and open-source tools. Preferred qualifications include experience with time series databases, advanced Snowflake knowledge, and background in Big Data, ML, or Data Mining.

Pattern

Ecommerce acceleration and competitive analysis

About Pattern

Pattern.com focuses on ecommerce acceleration, particularly on Amazon, by providing a free digital shelf management software that analyzes data from millions of searches and products. This tool uses machine learning to give brands insights into their competition, helping them optimize their product listings. Unlike competitors, Pattern.com offers both free tools and premium services, including market insights and consultancy, to help brands grow on Amazon. The company's goal is to empower brands to enhance their visibility and sales on one of the largest online marketplaces.

Lehi, UtahHeadquarters
2013Year Founded
$269.4MTotal Funding
GROWTH_EQUITY_VCCompany Stage
Data & Analytics, Consulting, Consumer GoodsIndustries
1,001-5,000Employees

Risks

Increased competition from AI-driven ecommerce platforms could erode Pattern's market share.
The rapid growth of Amazon's third-party sellers may dilute Pattern's service effectiveness.
The partnership with Giggster may divert focus from core ecommerce services.

Differentiation

Pattern offers a free digital shelf management tool for Amazon sellers.
The company uses machine learning to provide customized insights for product optimization.
Pattern's premium services include deep market insights and patented technology solutions.

Upsides

Pattern was named one of the World's Most Innovative Companies in 2024.
The launch of the Shelf inventory solution expands Pattern's service offerings.
Pattern's AI models enhance seller performance across multiple retail marketplaces.

Land your dream remote job 3x faster with AI