Senior Data Engineer
DemandbaseFull Time
Senior (5 to 8 years)
Candidates should have a track record of delivering scalable and reliable service components and data ingestion and processing pipelines. Experience with Python is essential, along with the ability to write clear, concise, and maintainable code considering design principles and applying sound testing practices. Experience in designing and evolving data models and ETL pipelines is required. Proficiency with public cloud concepts and delivering working solutions on public cloud infrastructure, preferably GCP (BigQuery, BigTable, Pub/Sub), is necessary. A curious mindset, proactivity in continuous improvement, and excitement for learning quickly in a fast-growth environment are also key requirements. Bonus points for experience with Infrastructure as Code tools, containerization and orchestration tools, and end-to-end ownership of data governance and management.
The Senior Software Engineer, Data Engineering will manage and enhance API services using Python, develop robust data pipelines for efficient processing and transformation of large datasets, and maintain and enhance the microservices architecture for reliability and scalability. They will also build and maintain data dashboards using tools like Retool and Tooljet to provide actionable insights, design and implement scalable systems to handle increasing data volumes and user demands, and develop systems that manage the entire lifecycle of data, ensuring data quality, security, and accessibility. Additionally, the role involves mentoring junior engineers and designing features from scratch to build the foundation of the global data infrastructure.
Data protection and privacy compliance platform
Relyance AI specializes in data protection and privacy compliance by using machine learning to create a real-time inventory and map of personal data flows within organizations. Their software-as-a-service (SaaS) platform allows clients to monitor data processing activities, ensuring compliance with privacy regulations. What makes Relyance AI different is its focus on automating data tracking, which reduces manual workflows and compliance risks. The company's goal is to help organizations maintain user trust and meet regulatory requirements effectively.