Staff Data Engineer
CalendlySalary not specified
- Full Time
- Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Data & AnalyticsIndustries
Requirements
Candidates should possess 5+ years of hands-on experience in a data engineering role, preferably within a SaaS environment, demonstrating expertise in SQL, dbt, and Python. They should also have advanced knowledge of data engineering tools, frameworks, and languages such as Airflow, Airbyte, and Kafka, along with experience working with services in a cloud environment like AWS or GCP.
Responsibilities
The Data Engineer will own, build, and maintain data pipelines and ETL/reverse-ETL processes within BigQuery, ensuring data consistency, accuracy, and integrity through the implementation of orchestration tools and data quality tests. They will develop reliable data models, document all aspects of data pipelines, and collaborate with product and engineering teams to deliver data solutions. Furthermore, the Data Engineer will establish data engineering best practices, serve as a subject matter expert, and contribute to a data governance program, proactively communicating across multiple departments and stakeholder levels.
Skills
SQL
dbt
Python
Airflow
Airbyte
Kafka
GitHub workflows
Cloud services (AWS or GCP)
Writer
AI platform for business process optimization
About Writer
Writer.com provides a platform that uses artificial intelligence to enhance business processes for various clients, including major companies. The platform integrates Large Language Models (LLMs), Natural Language Processing (NLP), and Machine Learning (ML) to tailor AI solutions to a client's specific brand and knowledge. LLMs generate human-like text, NLP helps computers understand human language, and ML enables learning from data. Writer's platform is built on secure, enterprise-grade LLMs called Palmyra, which are designed to be open and transparent, ensuring that client data is never used for training. This allows clients to self-host the models, giving them control and visibility over their data. The platform assists businesses in speeding up processes and generating customized outputs, such as summaries and insights, while adhering to legal and brand guidelines. Writer.com operates on a subscription-based model, where clients pay a recurring fee for access to its features.
San Francisco, CaliforniaHeadquarters
2020Year Founded
$317.1MTotal Funding
SERIES_CCompany Stage
Data & Analytics, Enterprise Software, AI & Machine LearningIndustries
1,001-5,000Employees