Data Engineer / Senior Data Engineer
ArcadiaFull Time
Senior (5 to 8 years)
Candidates should possess 6+ years of hands-on data engineering expertise, with deep experience in Python, SQL, or Kotlin. A proven track record of architecting and deploying resilient data pipelines that integrate with third-party APIs, handling both batch processing and real-time data streams is required. Mastery of workflow orchestration tools like Airflow, Dagster, or Prefect, experience with cloud architecture (preferably AWS) and technologies including S3, SQS, RDS, EMR, Glue, Athena, and Lambda, and experience working with data warehouses such as Redshift, Snowflake, ClickHouse, or Google BigQuery are necessary. Experience building CI/CD pipelines using GitLab, GitHub Actions, Terraform, or Jenkins, and an understanding of microservices architecture with implementation of cloud data lake solutions are also essential. Ability to translate complex concepts for diverse audiences and thrive in collaborative environments is expected.
The Staff Data Engineer will collaborate with cross-functional teams to build robust data solutions, including creating and scaling powerful data pipelines that integrate property listings and market insights from multiple real estate data sources and APIs. They will champion data excellence by architecting automated governance systems for data quality and observability, and lead the evolution of data infrastructure to support rapid MLS onboarding. The role involves partnering with the Data Analytics team to transform raw property data into actionable insights for decision-making tools and market intelligence dashboards.
Data analytics and visualization for real estate
Perchwell provides data visualization and analytics tools specifically designed for real estate professionals in the New York City area. The platform transforms large amounts of real estate data into actionable insights, allowing agents to quickly assess market trends and property values. Users can organize their interactions by property and client, which simplifies the management of multiple listings and clients. Perchwell operates on a subscription model, where real estate agents and brokers pay for access to features like personalized client recommendations and data-driven insights that can be shared through various channels. This focus on enhancing workflow and client management sets Perchwell apart from competitors, with the goal of helping real estate professionals grow their businesses more effectively.