Specialist - Data Platform Engineering at FreshBooks

Chennai, Tamil Nadu, India

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Technology, SoftwareIndustries

Requirements

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
4-7 years of experience in data engineering, data platform management, or related domains
Strong programming expertise in one or more of the following: Scala, Spark, Java, or Python
Proven experience building event-driven or CDC-based pipelines using Kafka (Confluent or Apache)
Hands-on experience with distributed data processing frameworks such as Apache Spark, Databricks, or Flink
Deep understanding of distributed data systems

Responsibilities

Own and manage the enterprise Data Lake infrastructure on AWS and Databricks, ensuring scalability, reliability, and governance
Design, develop, and optimize data ingestion and transformation pipelines from MySQL to Kafka (CDC pipelines) and from Kafka to Databricks using Spark Structured Streaming
Build and maintain robust batch and real-time data pipelines to support high-volume, high-velocity data needs
Design and implement efficient MapReduce jobs to process and transform large-scale datasets across distributed systems
Optimize MapReduce workflows for performance, scalability, and fault tolerance in big data environments
Develop metadata-driven frameworks for processing consistency, lineage, and traceability
Implement observability and monitoring systems using Prometheus, Grafana, or equivalent tools to ensure proactive detection and resolution of issues
Apply best practices in code quality, CI/CD automation (Jenkins, GitHub Actions), and Infrastructure-as-Code (IaC) for consistent deployments
Continuously optimize system performance and reliability through monitoring, tuning, and fault-tolerant design
Work cross-functionally with Product, Regulatory, and Security teams to ensure compliance, data privacy, and quality across the data lifecycle
Collaborate with multiple teams to design and deliver end-to-end lakehouse solutions that integrate diverse data sources
Stay current with emerging technologies in data engineering, streaming, and distributed systems, and contribute to continuous improvement initiatives

Skills

Data Lake

Databricks

AWS

MySQL

Kafka

Spark

Data Pipelines

Data Engineering

Scalability

Governance

FreshBooks

Cloud-based accounting software for businesses

About FreshBooks

FreshBooks provides cloud-based accounting software aimed at simplifying financial management for small to medium-sized businesses and self-employed professionals. The software allows users to efficiently track expenses, time, and invoices, making it accessible even for those without accounting experience. Users subscribe to the service with various pricing tiers, and they can take advantage of a 30-day money-back guarantee and an 80% discount for the first four months. FreshBooks stands out from competitors by offering a user-friendly interface and mobile accessibility, enabling users to manage their finances on the go. The company's goal is to help business owners and accountants streamline their financial processes, improve organization, and enhance client relationships.

Toronto, CanadaHeadquarters

2003Year Founded

$149.6MTotal Funding

DEBTCompany Stage

Consumer Software, FintechIndustries

201-500Employees

Benefits

Health Insurance

Dental Insurance

401(k) Company Match

Stock Options

Unlimited Paid Time Off

Parental Leave

Home Office Stipend

Professional Development Budget

Risks

Increased competition from market leaders may impact FreshBooks' market share.

Dependency on Stripe's technology could pose risks if Stripe faces issues.

Economic downturns may threaten FreshBooks' subscription-based revenue model.

Differentiation

FreshBooks offers a user-friendly platform for non-accountants, simplifying financial management.

The company provides mobile-friendly solutions, catering to the rise of remote work.

FreshBooks' integration with Shopify enhances e-commerce capabilities for online businesses.

Upsides

FreshBooks' subscription model aligns with industry trends, boosting customer acquisition and retention.

The expansion of Stripe Connect features enhances FreshBooks Payments, improving payment processing.

AI-driven financial analytics tools can provide predictive insights, enhancing decision-making.

Land your dream remote job 3x faster with AI

Try Jobo Free