Principle Data Engineer

Nottingham, England, United Kingdom

Apply with AI Apply

Not SpecifiedCompensation

Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Business Messaging Solutions, Communications TechnologyIndustries

Requirements

Candidates must have extensive experience as a Data Engineer, with a significant portion in a principal or lead capacity. Deep expertise in Azure data platform services including Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Azure SQL Database/Azure Synapse Analytics is required. Strong proficiency in SQL, excellent programming skills in Python (Scala is a strong advantage), proven experience with data modeling and schema design, and a solid understanding of data governance, quality, and security principles are essential. Experience with version control systems like Git and strong problem-solving abilities are also necessary. Desirable qualifications include experience with real-time data streaming technologies, CI/CD pipelines for data solutions, containerization technologies, other cloud platforms, and relevant Microsoft Azure certifications.

Responsibilities

The Principal Data Engineer will lead the design, development, and implementation of high-performance, scalable data pipelines and ETL/ELT processes using Azure services. They will architect and manage data solutions within the Azure ecosystem, drive the adoption of best practices for data governance, quality, and security, and collaborate with cross-functional teams to define data requirements and solutions. Responsibilities also include optimizing data processing performance and cost efficiency, developing monitoring and alerting for data pipelines, mentoring junior engineers, evaluating new data technologies, contributing to the data strategy, and troubleshooting complex data issues.

Skills

Data Engineering

Data Architecture

Data Pipelines

ETL

ELT

Azure Data Factory

Databricks

Azure Data Lake Storage

Databricks DLT

Streaming

Event-Based Architectures

Data Governance

Data Quality

Data Security

Data Lineage

Spark

Monitoring

Alerting

Logging

Comfy

SaaS platform for smart building management

About Comfy

Comfy provides a Software-as-a-Service (SaaS) platform that enhances workplace productivity, safety, and overall experience in the smart building market. The platform connects employees to essential information and services, allowing corporate real estate leaders to manage their global portfolios effectively. By utilizing data analytics and Internet of Things (IoT) technology, Comfy helps organizations make informed decisions to optimize space usage and improve employee well-being. The company differentiates itself through strong partnerships with companies like SAP and Salesforce, aiming to create better work environments for employees.

Oakland, CaliforniaHeadquarters

2013Year Founded

$19.3MTotal Funding

SERIES_BCompany Stage

Data & Analytics, Enterprise Software, Real EstateIndustries

51-200Employees

Benefits

Market-leading software application centered on improving the workplace experience

Take-what-you-need vacation policy

Competitive salaries

Generous medical, dental and vision insurance

Matching 401k policy

Frequent team events (costumes optional)

Risks

Emerging competitors may challenge Comfy's market position.

Rapid tech advancements require significant R&D investment for Comfy.

Data privacy concerns could lead to regulatory challenges for Comfy.

Differentiation

Comfy integrates IoT and data analytics for smart building solutions.

Partnerships with SAP and Salesforce enhance Comfy's platform capabilities.

Comfy's SaaS model offers scalable solutions for global real estate portfolios.

Upsides

Growing demand for hybrid work solutions boosts Comfy's market potential.

Launch of Insights Access API strengthens Comfy's data analysis capabilities.

Advanced data analytics support informed decision-making in real estate.

Land your dream remote job 3x faster with AI

Try Jobo Free