Director of Software Engineering (Node.js & Web Scraping Expert) at PortPro

Los Angeles, California, United States

Apply Now

Not SpecifiedCompensation

Expert & Leadership (9+ years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

N/AIndustries

Requirements

Candidates should possess 10+ years of experience in software engineering with at least 5+ years focused on web scraping and large-scale data extraction, demonstrating strong hands-on expertise in Node.js, Puppeteer, Playwright, Cheerio, Selenium, and headless browser automation. They should have extensive experience in handling CAPTCHAs, IP rotation, session management, and anti-bot evasion techniques, along with deep knowledge of proxy management (residential, datacenter, rotating, and VPNs) and familiarity with NoSQL/SQL databases (MongoDB, PostgreSQL, Redis, Elasticsearch, etc.) and data processing frameworks (Kafka, RabbitMQ, Spark, Airflow, etc.).

Responsibilities

The Director of Software Engineering will lead the engineering team, designing and optimizing high-performance, distributed web scraping systems using Node.js, and developing data extraction pipelines to process large volumes of structured and unstructured data. They will be responsible for implementing solutions to bypass anti-bot mechanisms, optimizing scraping processes for performance and efficiency while managing proxy services, overseeing data storage and processing strategies, collaborating with Product, DevOps, and Data Science teams, implementing best practices for microservices, API integrations, and real-time data streaming, leading the transition to cloud-native architectures, ensuring compliance with legal and ethical standards, optimizing cloud resources, managing real-time monitoring and alerting systems, and working closely with DevOps teams to optimize CI/CD pipelines and system scalability. They will also lead, mentor, and grow a high-performance engineering team, defining the technology roadmap, fostering a culture of innovation, and implementing agile development methodologies.

Skills

Node.js

Puppeteer

Playwright

Cheerio

Selenium

MongoDB

PostgreSQL

Redis

Elasticsearch

Kafka

RabbitMQ

Spark

Airflow

AWS

GCP

Azure

PortPro

Transportation management system for drayage carriers

About PortPro

PortPro specializes in transportation management systems (TMS) specifically designed for container drayage carriers, which transport goods over short distances, often from ports to warehouses. Their main product, drayOS, helps these carriers manage shipments and communicate with customers more effectively. The system includes features like AI-based order entry, customer portals, and real-time container tracking, which enhance operational efficiency. Unlike many competitors, PortPro offers its TMS as a software-as-a-service (SaaS), allowing clients to subscribe for ongoing access and support. The company's goal is to provide a user-friendly platform that improves the logistics process for drayage carriers, ensuring they can deliver timely updates and maintain clear communication with their clients.

Jersey City, New JerseyHeadquarters

2019Year Founded

$11.7MTotal Funding

SERIES_ACompany Stage

Automotive & Transportation, Enterprise SoftwareIndustries

51-200Employees

Risks

Emerging competition from other TMS providers could erode PortPro's market share.

Economic fluctuations may impact PortPro's subscription-based revenue model.

New transportation regulations could necessitate costly software adjustments for PortPro.

Differentiation

PortPro's drayOS offers AI-based order entry and real-time container tracking.

PortPro launched the first-ever drayage TMS with an embedded email inbox in June 2024.

PortPro's TMS solutions are tailored specifically for drayage carriers and brokers.

Upsides

PortPro ranks #84 on Deloitte's Fast 500, showcasing rapid growth.

The drayage industry is projected to grow from $6.1 billion in 2022 to $8.3 billion by 2027.

PortPro raised $12 million in Series A funding, boosting its expansion capabilities.

Land your dream remote job 3x faster with AI

Try Jobo Free