Principal Data Engineer at Pattern

Pune, Maharashtra, India

Pattern Logo
Not SpecifiedCompensation
Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
N/AIndustries

Requirements

  • 8+ years of experience in data engineering, with a focus on ETL, data modelling, and cloud-based architectures
  • Proficiency in SQL, Python, and tools like Spark and Snowflake
  • Strong knowledge of database design, dimensional modeling, and query optimization
  • Proven ability to lead teams, mentor engineers, and drive technical initiatives
  • Experience translating business requirements into scalable technical solutions
  • Alignment with core values: Game Changers, Data Fanatics, Partner Obsessed, Team of Doers
  • Preferred Qualifications
  • Expertise in machine learning model deployment or real-time analytics
  • Familiarity with DevOps practices (CI/CD, Docker, Kubernetes)

Responsibilities

  • Lead the design, development, and optimization of enterprise-scale data pipelines and architectures to drive data-driven decision-making
  • Architect efficient data tables and schemas to enhance query performance, ensuring seamless integration with cross-functional teams
  • Design and implement high-performance data pipelines using ETL processes, batch/streaming frameworks (e.g., Apache Spark, Airflow), and cloud platforms (AWS)
  • Optimize data ingestion, transformation, and storage workflows to meet scalability, reliability, and latency requirements
  • Architect database schemas and dimensional models (e.g., star/snowflake) to maximize query performance and reduce latency
  • Implement indexing strategies, partitioning, and materialized views to optimize data retrieval
  • Partner with data scientists, product managers, and engineers to align data infrastructure with business needs
  • Establish data governance frameworks, ensuring compliance with security, privacy, and quality standards
  • Mentor junior engineers and foster best practices in data engineering
  • Stay ahead of industry trends (e.g., AI/ML integration, real-time analytics) and advocate for emerging technologies
  • Lead technical strategy for data infrastructure, balancing innovation with operational stability

Skills

SQL
Python
Apache Spark
Airflow
AWS
Snowflake
ETL

Pattern

Ecommerce acceleration and competitive analysis

About Pattern

Pattern.com focuses on ecommerce acceleration, particularly on Amazon, by providing a free digital shelf management software that analyzes data from millions of searches and products. This tool uses machine learning to give brands insights into their competition, helping them optimize their product listings. Unlike competitors, Pattern.com offers both free tools and premium services, including market insights and consultancy, to help brands grow on Amazon. The company's goal is to empower brands to enhance their visibility and sales on one of the largest online marketplaces.

Lehi, UtahHeadquarters
2013Year Founded
$269.4MTotal Funding
GROWTH_EQUITY_VCCompany Stage
Data & Analytics, Consulting, Consumer GoodsIndustries
1,001-5,000Employees

Risks

Increased competition from AI-driven ecommerce platforms could erode Pattern's market share.
The rapid growth of Amazon's third-party sellers may dilute Pattern's service effectiveness.
The partnership with Giggster may divert focus from core ecommerce services.

Differentiation

Pattern offers a free digital shelf management tool for Amazon sellers.
The company uses machine learning to provide customized insights for product optimization.
Pattern's premium services include deep market insights and patented technology solutions.

Upsides

Pattern was named one of the World's Most Innovative Companies in 2024.
The launch of the Shelf inventory solution expands Pattern's service offerings.
Pattern's AI models enhance seller performance across multiple retail marketplaces.

Land your dream remote job 3x faster with AI