Solutions Architect, Data Engineering & Lakehouse Lake

Solutions Architect - Snowflake Professional Services

Salary: $128K - $178.5K Location Type: Remote Employment Type: FullTime

Position Overview

Join the Snowflake team where data does more. As enterprises modernize their data platforms and processes, Snowflake's Professional Services Organization provides market-leading technical capabilities and best practices for modernization. Our solutions span data migrations, validation, application development, data sharing, lakehouse implementations, and data science.

As a Solutions Architect, you will be instrumental in delivering exceptional outcomes for our customers during modernization projects, with a strong focus on modern data architectures including lakehouses and streaming data. You will engage with customers to migrate from legacy data platforms (e.g., Cloudera) and build modern data pipelines and lakehouse solutions on Snowflake, acting as the technical lead and expert. Additionally, you will collaborate with the internal team to provide requirements for our Snowconvert utility, ensuring continuous improvement based on project experiences.

This role reports to the Director of the Specialized Workload Solutions team within the PS&T organization at Snowflake.

Key Responsibilities

Delivery

• Be well-versed in migrations of applications, code, and data onto cloud platforms.
• Lead the design of subsequent services onto Snowflake, including lakehouse architectures using Iceberg.
• Outline the architecture of Spark, Scala, and Cloudera environments.
• Guide customers on architecting and building data engineering pipelines on Snowflake, including streaming data ingestion and processing.
• Design and implement data ingestion and transformation pipelines using Apache NiFi.
• Architect and implement Iceberg-based lakehouse solutions on Snowflake.
• Run workshops and design sessions with stakeholders and customers.
• Troubleshoot migration and implementation issues.
• Create repeatable processes and documentation resulting from customer engagements.
• Utilize scripting with Python and shell scripts for ETL workflows.
• Develop best practices, including knowledge transfer to enable customers to extend Snowflake capabilities independently.
• Provide guidance on resolving customer-specific technical challenges.
• Outline a testing strategy and plan.
• Optimize Snowflake for performance and cost.
• Design and implement solutions for streaming data ingestion and processing.

Product Strategy

• Communicate requirements for capabilities on Snowpark conversion for Scala/Python and Spark-based backend software modules.
• Communicate requirements for the design and development of backend big data frameworks for enhancements to our Snowpark platform.
• Provide input and develop frameworks for Distributed Computing, Apache Spark, PySpark, Python, HBase, Kafka, REST-based API, and Machine Learning as part of our tools development (Snowconvert) and overall modernization processes.
• Provide input on Snowflake's Lakehouse capabilities and integration with Iceberg.

Ideal Solutions Architect Profile

• Bachelor's degree in a technical discipline or equivalent practical experience.
• 6+ years of experience in a customer-facing technical role dealing with complex, technical implementation projects.
• Proven track record of delivering results with multi-party, multi-year digital transformation engagements.
• Experience in Data Warehousing, Business Intelligence, application modernization, lakehouse implementations, or Cloud projects.
• Experience building real-time and batch data pipelines using Apache Spark and Apache NiFi.