Woflow

Software Engineer – Web Crawling

Remote

Not SpecifiedCompensation
Mid-level (3 to 4 years)Experience Level
Full TimeJob Type
UnknownVisa
AI & Machine Learning, Consumer Software, Data & AnalyticsIndustries

Position Overview

  • Location Type: Remote
  • Employment Type: Full-Time
  • Salary: Not specified
  • Company: Woflow

Woflow is a technology startup creating products and solutions to support a high-growth, on-demand economy. Our flagship product is an end-to-end platform that allows our customers to request and receive merchant data (think structured menu data, images, store information, etc) through a combination of web applications and public APIs. Behind the scenes, that data is created through a series of ML/AI models and workflow products along with a fully automated distributed workforce management platform. We are the world’s first Merchant Data Platform. Our customers include food delivery companies, online ordering platforms, and ecommerce marketplaces. We provide the data infrastructure to help these companies scale and grow.

Requirements

  • Experience: 3+ years of experience in software engineering.
  • Web Crawling Focus: Strong experience in web crawling and data extraction.
  • Node.js: Strong expertise in Node.js (preferred) for web crawling applications.
  • HTML/JavaScript: Deep understanding of HTML, JavaScript, and reverse engineering techniques.
  • Automation Libraries: Hands-on experience with Playwright, Puppeteer, and Cheerio for automation and scraping.
  • Security & Performance: Knowledge of security and performance best practices related to web crawling.

Responsibilities

  • Develop & Maintain Crawlers: Develop, enhance, and maintain web crawlers and scraping infrastructure.
  • Optimize Scraping: Optimize scraping techniques to handle anti-bot mechanisms, performance, and security challenges.
  • Collaboration: Collaborate with a geographically distributed team to identify and resolve issues.
  • High Availability: Ensure high availability, efficiency, and reliability of crawling operations.
  • AI Integration: Integrate AI solutions to enhance automation and data extraction accuracy.

Application Instructions

Company Information

  • Benefits:
    • Unlimited PTO (we mean it!)
    • Comprehensive medical, dental, and vision insurance plans
    • STD, LTD, AD&D, and life insurance coverage
    • Free membership to TalkSpace, Teladoc and Health Advocate
    • Free annual membership to One Medical in participating regions
    • 401(k) retirement plan with company matching
    • Pre-tax commuter benefits
    • Free equipment: laptop and home office stipend

Skills

Node.js
HTML
JavaScript
Reverse Engineering
Playwright
Puppeteer
Cheerio
Web Crawling
Data Extraction
Security
Performance

Woflow

Automates merchant data onboarding and management

About Woflow

Woflow automates the onboarding and management of merchant data for platforms and marketplaces. Its main product is an automation engine that uses machine learning and a distributed workforce to efficiently process and update merchant catalogs. This system works by breaking down tasks into smaller parts that can be completed simultaneously, ensuring accuracy and reliability through an automated consensus process. Woflow provides its services via an API, allowing developers to easily integrate its functionalities into their applications. This integration helps clients automate the digitization of catalogs, update merchant data in real-time, and manage job requests effectively. Woflow stands out from competitors by offering a customizable solution that reduces manual labor and speeds up onboarding processes. The company's goal is to improve operational efficiency and customer satisfaction for its clients by providing reliable and efficient data handling solutions.

San Francisco, CaliforniaHeadquarters
2017Year Founded
$10.6MTotal Funding
SERIES_ACompany Stage
Data & Analytics, Enterprise Software, AI & Machine LearningIndustries
201-500Employees

Benefits

Competitive salary & equity package
Unlimited PTO
Medical, dental, & vision insurance
STD, LTD, AD&D, & life insurance coverage
Free membership to TalkSpace, Teladoc & Health Advocate
Free annual membership to One Medical
401(k) with company matching
Pre-tax commuter benefits
Free equipment: laptop and home office stipend
Personalized sloth NFT

Risks

Emerging startups in data infrastructure could threaten Woflow's market share.
Rapid tech advancements may render Woflow's automation engine less competitive.
XtremeAI acquisition poses potential integration challenges affecting service delivery.

Differentiation

Woflow offers the world's first Merchant Data Platform for catalog digitization.
Their advanced automation engine uses machine learning for high-quality data processing.
Woflow provides seamless API and SDK integration for customized developer solutions.

Upsides

Growing demand for automated data solutions boosts Woflow's market potential.
API-first strategies align with Woflow's offerings, enhancing client integration.
Series A funding and XtremeAI acquisition expand Woflow's capabilities and market reach.

Land your dream remote job 3x faster with AI