Senior Data Engineer
Built TechnologiesSalary not specified
- Full Time
- Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Data & AnalyticsIndustries
Requirements
Candidates should possess 5+ years of hands-on experience in a data engineering role, ideally within a SaaS environment, and demonstrate expertise in SQL, dbt, and Python. Advanced knowledge of data engineering tools, frameworks, and languages such as Airflow, Airbyte, and Kafka, along with experience working with services in cloud environments like AWS or GCP, is required. A strong commitment to data quality, integrity, and security is also essential.
Responsibilities
The Data Engineer will own, build, and maintain data pipelines, ETL/reverse-ETL processes, and the BigQuery environment, implementing an orchestration tool and designing a suite of tests and validations to ensure data consistency and accuracy. They will develop reliable data models, optimize them for scale, and meticulously document all aspects of data pipelines, while partnering with product and engineering teams to deliver data solutions aligned with downstream use cases. Furthermore, the Data Engineer will establish data engineering best practices, serve as a subject matter expert on data architecture, and contribute to a data governance program.
Skills
SQL
dbt
Python
Airflow
Airbyte
Kafka
GitHub workflows
Cloud services (AWS, GCP)
Data modeling
Data quality
Data security
Data pipelines
ETL
Reverse-ETL
Writer
AI platform for business process optimization
About Writer
Writer.com provides a platform that uses artificial intelligence to enhance business processes for various clients, including major companies. The platform integrates Large Language Models (LLMs), Natural Language Processing (NLP), and Machine Learning (ML) to tailor AI solutions to a client's specific brand and knowledge. LLMs generate human-like text, NLP helps computers understand human language, and ML enables learning from data. Writer's platform is built on secure, enterprise-grade LLMs called Palmyra, which are designed to be open and transparent, ensuring that client data is never used for training. This allows clients to self-host the models, giving them control and visibility over their data. The platform assists businesses in speeding up processes and generating customized outputs, such as summaries and insights, while adhering to legal and brand guidelines. Writer.com operates on a subscription-based model, where clients pay a recurring fee for access to its features.
San Francisco, CaliforniaHeadquarters
2020Year Founded
$317.1MTotal Funding
SERIES_CCompany Stage
Data & Analytics, Enterprise Software, AI & Machine LearningIndustries
1,001-5,000Employees