Staff Data Engineer
Calendly- Full Time
- Senior (5 to 8 years)
Candidates should possess 5+ years of hands-on experience in a data engineering role, preferably within a SaaS environment, demonstrating expertise in SQL, dbt, and Python. They should also have advanced knowledge of data engineering tools, frameworks, and languages such as Airflow, Airbyte, and Kafka, along with experience working with services in a cloud environment like AWS or GCP.
The Data Engineer will own, build, and maintain data pipelines and ETL/reverse-ETL processes within BigQuery, ensuring data consistency, accuracy, and integrity through the implementation of orchestration tools and data quality tests. They will develop reliable data models, document all aspects of data pipelines, and collaborate with product and engineering teams to deliver data solutions. Furthermore, the Data Engineer will establish data engineering best practices, serve as a subject matter expert, and contribute to a data governance program, proactively communicating across multiple departments and stakeholder levels.
AI platform for business process optimization
Writer.com provides a platform that uses artificial intelligence to enhance business processes for various clients, including major companies. The platform integrates Large Language Models (LLMs), Natural Language Processing (NLP), and Machine Learning (ML) to tailor AI solutions to a client's specific brand and knowledge. LLMs generate human-like text, NLP helps computers understand human language, and ML enables learning from data. Writer's platform is built on secure, enterprise-grade LLMs called Palmyra, which are designed to be open and transparent, ensuring that client data is never used for training. This allows clients to self-host the models, giving them control and visibility over their data. The platform assists businesses in speeding up processes and generating customized outputs, such as summaries and insights, while adhering to legal and brand guidelines. Writer.com operates on a subscription-based model, where clients pay a recurring fee for access to its features.