Lead Data Engineer
LumosFull Time
Expert & Leadership (9+ years)
The ideal candidate will have over 4 years of hands-on experience in Data Engineering, with a strong focus on building and optimizing data platforms and cloud platforms. Expertise is required in designing and building distributed systems and data pipelines using tools like Astronomer, Fivetran, DBT, and Segment, with a focus on both structured and unstructured data. Proficiency in Python, Scala, SQL, and Spark is necessary for developing scalable data pipelines and automating data workflows. A solid understanding of cloud infrastructure (AWS/Azure) and data platforms (Databricks, Snowflake, Redshift) is essential, along with hands-on experience in Terraform for automating cloud resource management. The candidate should possess a passion for performance tuning, cost optimization, and efficient resource usage, along with an outcome-oriented and experimental interest in AI-driven development practices. Experience with data governance, security practices, and compliance (e.g., SOC II) is also required. Additionally, the ability to quickly learn new technologies and platforms, demonstrate emotional intelligence with strong collaboration and listening skills, and experience working in a rapid-growth or startup environment are crucial. Excellent communication skills for collaborating with distributed teams across time zones are also a must.
The Senior Data Engineer will be responsible for building, scaling, and optimizing the data platform using Databricks, Spark, and various data integration tools to ensure high performance, reliability, and cost efficiency. They will design and maintain robust data pipelines using Airflow, Fivetran, DBT, and Segment, and automate infrastructure using Terraform to enhance operational readiness, security, and governance. A key responsibility includes developing and maintaining the infrastructure and automation needed to support MLOps practices, such as model deployment pipelines, monitoring frameworks, and retraining automation. The role involves using AI tools as part of fundamental workflows, prototyping, implementing, and maintaining team projects and features, and serving as a technical expert, mentor, and leader. The engineer will build flexible and maintainable solutions, taking accountability for their quality, performance, and reliability. They will also elevate the team’s skills and knowledge by participating in technical designs, giving talks, and reviewing and improving code. Contributing to the constant improvement of the team’s processes and best practices is also expected.
Digital workspace for team collaboration
MURAL provides a digital workspace platform that enhances collaboration and creativity among teams. It allows users to brainstorm, plan, and design together in real-time, regardless of their location. The platform features digital whiteboards, sticky notes, templates, and integrates with other productivity tools, helping teams visualize ideas and streamline workflows. MURAL serves a wide range of clients, including businesses, educational institutions, and non-profits, and operates on a subscription-based model, offering different pricing tiers based on user count and features. This model supports a steady revenue stream and enables ongoing improvements to the service. MURAL distinguishes itself by focusing on uptime and reliability, ensuring that clients can depend on the platform for consistent service.