Senior Data Engineer at Pattern

Pune, Maharashtra, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Ecommerce, TechnologyIndustries

Requirements

Bachelor’s Degree in Data Science, Data Analytics, Information Management, Computer Science, Information Technology, related field, or equivalent professional experience
Overall experience of more than 7+ years
3+ years of experience working with SQL and Python
3+ years of experience in implementing data pipelines using modern data architectures
2+ years of experience working with data warehouses such as Redshift, BigQuery, Snowflake, or similar
Experience with open-source based data architectures: Spark, Hive, Trino / Presto or similar
Excellent software engineering and scripting knowledge
Strong communication skills (both in presentation and comprehension) along with the aptitude for cross-collaboration across data management and analytics domains
Expertise with data systems working with massive data volumes from various data sources
Ability to lead a team of Data Engineers
Preferred Qualifications
Experience working with time series databases
Advanced knowledge of SQL, including the ability to write stored procedures, triggers, analytic/windowing functions, and tuning
Advanced knowledge of Snowflake, including the ability to write and orchestrate streams and tasks
Background in Big Data, non-relational databases, Machine Learning and Data Mining
Experience with cloud-based technologies including SNS, SQS, SES, S3, Lambda, and Glue
Experience with modern data platforms like Redshift, Cassandra, DynamoDB, Apache Airflow, Spark, or ElasticSearch
Expertise in Data Quality and Data Governance

Responsibilities

Develop, deploy, and support automated, scalable real-time and batch data streams from a variety of sources into the lakehouse
Develop and implement data auditing strategies and processes to ensure data quality; identify and resolve problems associated with large scale data processing workflows; implement technical solutions to maintain data pipeline processes and troubleshoot failures
Collaborate with technology teams and partners to specify data requirements and provide access to data
Tune application and query performance using profiling tools and SQL or other relevant query language
Translate business and analytics requirements for data to a comprehensive data model and pipelines
Foster data expertise and own data quality for assigned areas of ownership
Work with data infrastructure to triage issues and drive to resolution

Skills

SQL

Python

data pipelines

lakehouse

data quality

ETL

batch processing

real-time streaming

query optimization

Pattern

Ecommerce acceleration and competitive analysis

About Pattern

Pattern.com focuses on ecommerce acceleration, particularly on Amazon, by providing a free digital shelf management software that analyzes data from millions of searches and products. This tool uses machine learning to give brands insights into their competition, helping them optimize their product listings. Unlike competitors, Pattern.com offers both free tools and premium services, including market insights and consultancy, to help brands grow on Amazon. The company's goal is to empower brands to enhance their visibility and sales on one of the largest online marketplaces.

Lehi, UtahHeadquarters

2013Year Founded

$269.4MTotal Funding

GROWTH_EQUITY_VCCompany Stage

Data & Analytics, Consulting, Consumer GoodsIndustries

1,001-5,000Employees