Job Description

Position Overview

• Location Type: Onsite (Playa Vista, California)
• Employment Type: Full-time
• Salary: $109,000 - $139,000 (Range - dependent on factors including experience, location, etc.)

This role focuses on building and optimizing data pipelines and databases within a large-scale environment. The ideal candidate will possess strong SQL skills, experience with various databases and data stores, and a deep understanding of data engineering best practices.

Requirements

• Education: BS degree in Computer Science or relevant work experience
• Experience: 5+ years of experience in developing data pipelines and databases
• Technical Skills:
  • Advanced working knowledge of SQL and query authoring
  • Proficiency in Python and SQL
  • Experience with relational databases (e.g., MSSQL) and NoSQL databases/data stores (e.g., Dynamodb)
  • Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka)
  • Experience with DBT and Airflow or similar tools for data transformation and workflow management
  • Knowledge of message queuing and stream processing
  • Experience with data stores like Snowflake, Postgres, Feast

Responsibilities

• Build and optimize 'big data' data pipelines, architectures, and data sets using AWS cloud services and Snowflake.
• Perform root cause analysis on internal and external data and processes to answer business questions and identify opportunities for improvement.
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management using DBT and Airflow or similar tools.
• Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores using Hadoop, Spark, Kafka, etc.
• Create a strong test suite, alerting, monitoring, and documentation for all pipelines.

Pluses

• Experience with cloud service providers (AWS, Azure, Google)
• Familiarity with analytical tools like Tableau
• Knowledge of data service and deployment frameworks (Docker, Kubernetes)
• Experience with data compliance and governance tools (OneTrust, DataGrail)
• Experience with the Kafka

Company Information

Commercial Real Estate Exchange, Inc. (“Crexi”) is a multi-state employer.