Data Engineer

About Us

Hi there! We are looking for a Data Engineer for the Sweed product startup remote.

At Sweed, we offer a comprehensive cannabis retail solution with a wide range of features, including powerful POS functionality, in-depth analytics, marketing and promotional tools, efficient inventory management, and more. Our progressive web-app can be easily accessed through the tablets already available in your store, without any additional hardware required. Since our establishment, we have been committed to creating an all-in-one system tailored to the specific needs of large cannabis retailers. Today, we are proud to be a market leader, owing much of our success to our signature killer feature – providing a full spectrum of software in one solution.

At our company, we are driven by our passion for the medicinal potential of plants, particularly in their ability to influence cancer treatment and overall well-being and quality of life. Although there is a significant amount of stigma associated with this area, we strongly believe that these plants possess unique properties and have helped countless people improve their quality of life. This is a rapidly growing industry that presents immense potential for career advancement and personal fulfillment, and we are excited to explore how we can contribute to this dynamic field.

Why Work With Us

We offer great chances for career growth in a fast-growing field. Our team is full of passionate experts who help you learn and grow. You'll gain new experiences and have freedom to pursue your goals your way. Plus, our flat structure means less red tape and more opportunity to make an impact.

Project Stage

The project is already 4 years on the market, at the stage of active development. Our current priority is to establish and maintain strong customer trust, which has driven the development of our delivery processes that allow us to launch new features on a daily basis. Given the highly specialized nature of the cannabis retail market, we are committed to rapidly meeting the evolving needs of our customers. Furthermore, the market's unique legal framework presents challenges with significant variations in state-level taxes, delivery regulations, and other factors.

Responsibilities

• Migrating the current reporting infrastructure to a new data platform (using Airbyte, dbt, Dagster, ClickHouse, and Cube).
• Setting up a data export pipeline for clients.
• Implementing data streams for ML workflows.
• Establishing pipeline monitoring and alerting systems.
• Set up and manage ingestion pipelines and integrate various data sources using tools like Airbyte or Fivetran.
• Create and optimize data transformation models using dbt, work with macros, and write data quality tests.

Required Skills

• Experience in Python for data processing tasks.
• Understanding of batch and real-time data processing.
• Proficiency with Git, CI/CD systems, and working with cloud platforms.
• Expertise in one or more pipeline orchestration frameworks (e.g., Airflow, Dagster, Kestra, mage.ai). Manage data pipelines, automate schedules, and handle error processing.
• Strong proficiency in SQL for complex queries and data manipulation.
• Experience in design and optimizing queries and data storage structures in ClickHouse, with experience handling large datasets.

Desired Skills

• Understanding of C# is a plus.
• Experience with Docker, Kubernetes (k8s), and Helm charts is highly desirable.

Language Requirements

• English: Upper-Intermediate and higher. You will need to communicate with the English-speaking part of the team and write and read the documentation in English.

Other Important Qualities

• We value proactive individuals who actively participate in feedback sessions. It's important for us to exchange.