Job Description

Employment Type: Full-Time Location Type: Remote Salary: $220,000 - $250,000 (Base salary range; actual salary will vary based on qualifications, experience, skill set, and certifications. This is one component of a total compensation package including equity, healthcare, flexible time off, and other benefits.)

Company Overview

Machinify is the leading provider of AI-powered software products that transform healthcare claims and payment operations. Each year, the healthcare industry generates over $200B in claims mispayments, creating incredible waste, friction, and frustration for all participants: patients, providers, and especially payers. Machinify’s revolutionary AI-platform has enabled the company to develop and deploy, at light speed, industry-specific products that increase the speed and accuracy of claims processing by orders of magnitude.

Position Overview

We are seeking a Staff/Lead Data Engineer to build and own critical data pipelines. This role involves understanding business problems, collaborating with cross-functional teams, and ensuring the availability and quality of data for the Data Science organization.

Responsibilities

• Independently understand all aspects of a business problem, including those unrelated to your area of expertise.
• Weigh pros and cons of different approaches and suggest ones likely to succeed.
• Work with a cross-functional organization including engineering, delivery teams, subject-matter experts, product managers, and platform engineers to deliver a scalable framework.
• Map customer data into Machinify's canonical form.
• Identify and ingest non-canonical fields and generalize the process to a minimal level of customization.
• Proactively design and adapt the canonical form to suit changing query patterns and needs.
• Ultimately own data availability and quality for the Data Science organization.

Requirements

• Deep experience as a hands-on Data Engineer building production data pipelines.
• Experience managing the delivery of complex data.
• Experience in ETL orchestration and workflow management tools, with a strong preference for Apache Airflow.
• Experience in Spark or other distributed computing frameworks.
• Proficiency in SQL and Python.
• Advanced SQL performance tuning.
• Experience with Kubernetes and building Docker images.
• Experience with AWS & GCP.
• Experience working with APIs to collect or ingest data.
• Experience managing SLAs for all pipelines in allocated areas of ownership.
• Experience with streaming technologies like Kafka, Spark Streaming, etc.
• Experience with ELK stack, Grafana, etc.

Equal Employment Opportunity at Machinify

Machinify is committed to hiring talented and qualified individuals with diverse backgrounds for all of its positions. Machinify believes that the gathering and celebration of unique backgrounds, qualities, and cultures enriches the workplace.