Lead Data Pipeline Engineer
Two Six TechnologiesFull Time
Junior (1 to 2 years)
Candidates should possess 4+ years of hands-on data engineering experience, demonstrating proficiency in Python, SQL, or Kotlin to address complex data challenges. They must have a proven track record of architecting and deploying resilient data pipelines integrating with third-party APIs, managing both batch processing and real-time data streams. Experience with cloud architecture, particularly AWS, including technologies like S3, SQS, RDS, EMR, Glue, Athena, and Lambda is essential. Familiarity with data warehouses such as Redshift, Snowflake, ClickHouse, or Google BigQuery is required, along with expertise in building CI/CD pipelines using tools like GitLab, GitHub actions, Terraform, or Jenkins. A strong understanding of microservices architecture and experience building cloud data lake solutions that drive business value are also necessary.
As a Senior Data Engineer, you will create and scale powerful data pipelines to integrate millions of property listings and market insights from various real estate data sources and APIs. You will champion data excellence by architecting automated governance systems to ensure data quality and observability across the platform. You will partner with the Data Analytics team to transform raw data into actionable insights, powering decision-making tools and market intelligence dashboards. Furthermore, you will lead the evolution of Perchwell’s data infrastructure to support rapid MLS onboarding, building solutions to serve real estate professionals nationwide, and collaborate with cross-functional teams including Data Insights, Product, Design, and other engineering teams to build robust data solutions.
Data analytics and visualization for real estate
Perchwell provides data visualization and analytics tools specifically designed for real estate professionals in the New York City area. The platform transforms large amounts of real estate data into actionable insights, allowing agents to quickly assess market trends and property values. Users can organize their interactions by property and client, which simplifies the management of multiple listings and clients. Perchwell operates on a subscription model, where real estate agents and brokers pay for access to features like personalized client recommendations and data-driven insights that can be shared through various channels. This focus on enhancing workflow and client management sets Perchwell apart from competitors, with the goal of helping real estate professionals grow their businesses more effectively.