Data Engineer / Senior Data Engineer
ArcadiaFull Time
Senior (5 to 8 years)
Candidates should possess significant experience designing and maintaining ETLs that process large-scale datasets, proficiency with Python, PySpark, SQL, and experience working on platforms/tools like Databricks, Snowflake, or DBT, strong problem-solving skills, and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions.
The Staff Data Engineer will build tools and frameworks to streamline customer integrations, create robust ETLs in PySpark and DBT to process billions of records from customer datasets, collaborate with product, engineering, and go-to-market teams to design and deliver data solutions for new products and features, identify and implement optimizations to improve ETL runtime and data processing scalability, solve real-world data quality challenges by working directly with messy, incomplete, or inconsistent customer data to extract the signal needed, investigate and implement new technologies into the data platform, and support team members by mentoring engineers, leading technical discussions, and providing clear, actionable feedback.
AI solutions for fresh food inventory management
Afresh Technologies provides solutions for grocery retailers to improve their inventory management in the fresh food supply chain. Their platform uses machine learning algorithms to help retailers reduce food waste and increase profitability by optimizing how they manage their stock. Retailers subscribe to Afresh's service, gaining access to its features and potentially additional services like data analytics and consulting. What sets Afresh apart from competitors is its specific focus on the fresh food sector and its commitment to helping retailers meet consumer demand while minimizing waste. The company's goal is to enhance the efficiency of fresh food management in retail.