Software Engineer, Data Platform

San Francisco, California, United States

Auto‑apply with AI Apply

Not SpecifiedCompensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Data & Analytics, Enterprise SoftwareIndustries

Requirements

Candidates should have experience building data pipelines and working with technologies such as Airflow, BigQuery, Dataflow, Dataproc, and VertexAI. A strong understanding of scalable and maintainable systems across the stack is essential, along with the ability to work collaboratively in a hybrid work environment.

Responsibilities

The Software Engineer will build batch and streaming data pipelines critical to Middesk’s data infrastructure. They will develop reliable, scalable, maintainable, and cost-efficient systems, enhance existing web scraping platforms for real-time data acquisition, and maintain the interface layer between the application and data platform stack to improve performance as the company scales.

Skills

Airflow

BigQuery

Dataflow

Dataproc

VertexAI

Web Scraping

Data Pipelines

Cloud Technologies

Middesk

Business identity verification and compliance automation

About Middesk

Middesk provides a business identity platform that helps companies verify the identity of other businesses, a process known as Know Your Business (KYB). This is especially important for financial institutions and technology companies that need to prevent fraud and comply with regulations. Middesk's services allow clients to automate their KYB processes, which saves time and improves efficiency in operations like loan processing and business onboarding. The platform offers easy-to-integrate Application Programming Interfaces (APIs) and a customizable dashboard, giving clients access to accurate data about businesses and Secretary of States. This flexibility allows businesses to tailor the information to their specific needs. Middesk generates revenue by charging clients for access to its platform and services, making it a valuable partner for those looking to streamline their operations and enhance customer onboarding.

South San Francisco, CaliforniaHeadquarters

2019Year Founded

$75MTotal Funding

SERIES_BCompany Stage

Fintech, Financial ServicesIndustries

51-200Employees

Benefits

Medical, dental, & vision coverage

Unlimited PTO

Stock-options

401(k)

Parental leave

Hybrid work

Risks

Increased competition from new entrants like Karma3 could challenge Middesk's market position.

Integration challenges with partners like Socure may affect service delivery.

Rapid expansion post-Series B funding could strain Middesk's operational capabilities.

Differentiation

Middesk automates business verification, streamlining KYB processes for financial institutions.

The platform integrates easily with APIs, offering customizable data solutions for clients.

Middesk's partnerships enhance its offerings, like the integration with Socure for KYB/KYC.

Upsides

Rising demand for automated KYB solutions boosts Middesk's market potential.

Winning Tearsheet's Best Data Product for Lenders award enhances Middesk's industry reputation.

$57 million Series B funding supports Middesk's expansion and operational growth.

Land your dream remote job 3x faster with AI

Try Jobo Free