Data engineer at Writer

New York, New York, United States

Writer Logo
$157,800 – $199,500Compensation
Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
TechnologyIndustries

Requirements

  • 5+ years of hands-on experience in a data engineering role, ideally in a SaaS environment
  • Expert-level proficiency in SQL, dbt, and Python
  • Strong experience with data pipeline orchestration (Airflow, Prefect, Dagster, etc.) and CI/CD for data workflows
  • Deep understanding of cloud-based data architectures (AWS, GCP) — including networking, IAM, and security best practices
  • Strong grasp of data modeling principles, warehouse optimization, and cost management
  • Experience with event-driven systems (Kafka, Pub/Sub, Kinesis) and real-time data streaming is a plus
  • Passionate about data reliability, testing, and monitoring — treat pipelines like production software
  • Thrive in ambiguous, fast-moving environments and enjoy building systems from the ground up
  • Intellectually curious and driven by building scalable systems that last
  • Pragmatic problem solver who values simplicity and clarity in design
  • Excellent communicator who can bridge technical and business perspectives
  • Humble, resilient, and motivated by impact over recognition
  • Embody values: Connect, Challenge, Own

Responsibilities

  • Design efficient and reusable data models optimized for analytical and operational workloads
  • Design and maintain scalable, fault-tolerant data pipelines and ingestion frameworks across multiple data sources
  • Architect and optimize data warehouse (Snowflake/BigQuery) to ensure performance, cost efficiency, and security
  • Define and implement data governance frameworks — schema management, lineage tracking, and access control
  • Build and manage robust ETL workflows using dbt and orchestration tools (e.g., Airflow, Prefect)
  • Implement monitoring, alerting, and logging to ensure pipeline observability and reliability
  • Lead automation initiatives to reduce manual operations and improve data workflow efficiency
  • Develop comprehensive data validation, testing, and anomaly detection systems
  • Establish SLAs for key data assets and proactively address pipeline or data quality issues
  • Implement versioning, modularity, and performance best practices within dbt and SQL
  • Partner with product and engineering teams to deliver data solutions that align with downstream use cases
  • Establish data engineering best practices and serve as a subject matter expert on data pipelines, models, and systems

Skills

Snowflake
BigQuery
dbt
Fivetran
Hightouch
Segment
AWS DMS
Google Datastream
Terraform
GitHub Actions
Airflow
Prefect
ETL
SQL
Data Pipelines

Writer

AI platform for business process optimization

About Writer

Writer.com provides a platform that uses artificial intelligence to enhance business processes for various clients, including major companies. The platform integrates Large Language Models (LLMs), Natural Language Processing (NLP), and Machine Learning (ML) to tailor AI solutions to a client's specific brand and knowledge. LLMs generate human-like text, NLP helps computers understand human language, and ML enables learning from data. Writer's platform is built on secure, enterprise-grade LLMs called Palmyra, which are designed to be open and transparent, ensuring that client data is never used for training. This allows clients to self-host the models, giving them control and visibility over their data. The platform assists businesses in speeding up processes and generating customized outputs, such as summaries and insights, while adhering to legal and brand guidelines. Writer.com operates on a subscription-based model, where clients pay a recurring fee for access to its features.

San Francisco, CaliforniaHeadquarters
2020Year Founded
$317.1MTotal Funding
SERIES_CCompany Stage
Data & Analytics, Enterprise Software, AI & Machine LearningIndustries
1,001-5,000Employees

Benefits

Generous Paid Time Off
Medical Insurance
Dental Insurance
Vision Insurance
Paid Parental Leave
Fertility Treatment Support
Family Planning Benefits
Health Savings Account/Flexible Spending Account
Home Office Stipend
Phone/Internet Stipend
Wellness Program
Company Equity
Stock Options
401(k) Retirement Plan
401(k) Company Match

Risks

Increased competition from Logic, offering similar AI integration services.
Google's Gemini AI integration in Workspace could overshadow Writer's offerings.
High investor expectations may strain Writer's resources and focus.

Differentiation

Writer's Palmyra Creative model addresses the 'sameness problem' in AI-generated content.
Writer offers a secure, enterprise-grade platform with self-hosted LLMs for client control.
Writer integrates AI with brand-specific knowledge, enhancing business process customization.

Upsides

Writer raised $200M in Series C funding, boosting its enterprise AI leadership.
Growing demand for AI-driven content personalization aligns with Writer's offerings.
Writer's orchestrator agents enhance AI integration, appealing to enterprise clients.

Land your dream remote job 3x faster with AI