Senior Data Quality / ETL Engineer at Pattern

Pune, Maharashtra, India

Pattern Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
N/AIndustries

Requirements

  • Experience with data quality frameworks (e.g., Soda, Great Expectations, Deequ, Monte Carlo, DBT Test)
  • Experience with modern cloud data ecosystems (AWS, Snowflake, Apache Spark, Redshift)
  • Advanced knowledge of SQL, including the ability to write stored procedures, triggers, analytic/windowing functions, and performance tuning
  • Familiarity with data pipeline tools like Airflow, DBT, or Informatica
  • Experience integrating data validation processes into CI/CD pipelines using tools like GitHub Actions, Jenkins, or similar
  • Background in big data platforms, data lakes, or non-relational databases
  • Understanding of data lineage and master data management (MDM) concepts
  • Experience with Agile/Scrum development methodologies
  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • 8+ years of experience as a Data Quality Engineer, ETL Tester, or a similar role
  • Strong understanding of ETL concepts, data warehousing principles, and relational database design
  • Proficiency in SQL for complex querying, data profiling, and validation tasks
  • Familiarity with data quality tools and testing methodologies

Responsibilities

  • Analyze business and technical requirements to design, develop, and execute comprehensive test plans for ETL pipelines and data transformations
  • Perform data validation, reconciliation, and integrity checks across various data sources and target systems
  • Build and automate data quality checks using SQL and/or Python scripting
  • Identify, document, and track data quality issues, anomalies, and defects
  • Collaborate with data engineers, developers, QA, and business stakeholders to understand data requirements and ensure data quality standards are met
  • Define data quality KPIs and implement continuous monitoring frameworks
  • Participate in data model reviews and provide input on data quality considerations
  • Perform root cause analysis for data discrepancies and work with teams to drive resolution
  • Ensure alignment to data governance policies, standards, and best practices

Skills

SQL
Python
ETL
AWS
Snowflake
Apache Spark
Redshift
Airflow
DBT
Informatica
Great Expectations
Deequ
Soda
Monte Carlo
GitHub Actions
Jenkins

Pattern

Ecommerce acceleration and competitive analysis

About Pattern

Pattern.com focuses on ecommerce acceleration, particularly on Amazon, by providing a free digital shelf management software that analyzes data from millions of searches and products. This tool uses machine learning to give brands insights into their competition, helping them optimize their product listings. Unlike competitors, Pattern.com offers both free tools and premium services, including market insights and consultancy, to help brands grow on Amazon. The company's goal is to empower brands to enhance their visibility and sales on one of the largest online marketplaces.

Lehi, UtahHeadquarters
2013Year Founded
$269.4MTotal Funding
GROWTH_EQUITY_VCCompany Stage
Data & Analytics, Consulting, Consumer GoodsIndustries
1,001-5,000Employees

Risks

Increased competition from AI-driven ecommerce platforms could erode Pattern's market share.
The rapid growth of Amazon's third-party sellers may dilute Pattern's service effectiveness.
The partnership with Giggster may divert focus from core ecommerce services.

Differentiation

Pattern offers a free digital shelf management tool for Amazon sellers.
The company uses machine learning to provide customized insights for product optimization.
Pattern's premium services include deep market insights and patented technology solutions.

Upsides

Pattern was named one of the World's Most Innovative Companies in 2024.
The launch of the Shelf inventory solution expands Pattern's service offerings.
Pattern's AI models enhance seller performance across multiple retail marketplaces.

Land your dream remote job 3x faster with AI