Lead Data Engineer
LumosSalary not specified
Full Time
Expert & Leadership (9+ years)
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Research, Healthcare, Life SciencesIndustries
Requirements
- 5+ years of professional experience in software or data engineering
- Proven track record building and optimizing large-scale batch and streaming data systems
- Proficiency with Spark, Spark Streaming, Airflow, and either Python or Scala
- Deep understanding of distributed system design, data modeling, and performance optimization
- Strong experience with test-driven development and CI/CD practices
- Ability to independently drive technical outcomes from problem to deployment
- Familiarity with Agile or other iterative development methodologies
Responsibilities
- Design and develop scalable data processing workflows and microservices using Spark, Spark Streaming, and Airflow
- Write modular, testable code in Python or Scala, aligned with software engineering best practices
- Lead implementation of system components that span multiple services and modules
- Diagnose and resolve complex technical issues in distributed data systems
- Participate in architecture discussions, design reviews, and engineering rituals
- Develop and maintain data models to support analytical and operational use cases
- Collaborate with cross-functional stakeholders to translate requirements into engineering solutions
- Contribute to mentoring and onboarding of junior engineers
- Champion continuous improvement and knowledge-sharing across the team
Skills
Key technologies and capabilities for this role
Questions & Answers
Common questions about this position
What skills are required for the Senior Software Engineer II role?
Candidates need 5+ years of professional experience in software or data engineering, proven track record building and optimizing large-scale batch and streaming data systems, proficiency with Spark, Spark Streaming, Airflow, and either Python or Scala, deep understanding of distributed system design, data modeling, and performance optimization, strong experience with test-driven development and CI/CD practices.
What will I be working on in this role?
You'll design and develop scalable data processing workflows and microservices using Spark, Spark Streaming, and Airflow, write modular code in Python or Scala, lead system components, diagnose issues in distributed systems, and collaborate with cross-functional teams.
What is the salary or compensation for this position?
This information is not specified in the job description.
Is this role remote or does it require office work?
This information is not specified in the job description.
What experience makes a strong candidate for this role?
A strong candidate has 5+ years in software or data engineering, proficiency in Spark, Airflow, Python or Scala, experience with large-scale data systems, distributed design, TDD, CI/CD, and the ability to drive technical outcomes independently, plus nice-to-haves like graph data models.
Remitly
International money transfer for immigrants
About Remitly
Remitly focuses on international money transfers, helping immigrants send money to their families quickly and securely at lower costs than traditional banks. The company charges transaction fees and earns from the exchange rate margin, offering various transfer options like bank deposits and cash pickups. Remitly enhances user experience through its website and mobile app, allowing real-time tracking of transfers, and engages with immigrant communities by providing helpful resources and educational support. Its goal is to meet the unique needs of immigrants while ensuring fast, affordable, and reliable money transfer services.
Seattle, WashingtonHeadquarters
2011Year Founded
$423.9MTotal Funding
IPOCompany Stage
Fintech, Financial ServicesIndustries
1,001-5,000Employees
Benefits
Continuing Education or Travel Stipend
Office Culture
Flexible PTO, Schedules and Leaves
DEI Learning Opportunities
Community Engagement
Inclusive Benefits
Risks
Swift's integration into banks' channels poses a competitive threat to Remitly.
AI agents' rise may challenge Remitly's operational model in efficiency and cost-effectiveness.
Schall Law Firm's investigation could impact investor confidence and Remitly's reputation.
Differentiation
Remitly focuses on immigrants, offering competitive rates and fast, secure transactions.
The company leverages technology for a seamless user experience via its app and website.
Remitly engages with immigrant communities through content and educational initiatives.
Upsides
Increased digital wallet adoption in key markets expands Remitly's reach to unbanked individuals.
AI agents in operations could reduce costs and improve Remitly's efficiency.
Visa collaboration enhances Remitly's cross-border fund flow services, boosting customer satisfaction.
Related Jobs
RemoteRemotePrincipal Data Engineer
Trella HealthSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteSenior Data Engineer (Pipeline)
DemandbaseSalary not specified
RemoteStaff Data Engineer, Energy
GoodleapSalary not specified
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteStaff Data Engineer (Spark)
WizardSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemotePython Data Engineer
Solace HealthSalary not specified
- Full Time
- Junior (1 to 2 years)
RemoteData Engineer, DaaS
PayPalSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSenior Software Developer, Streaming Platform
WealthsimpleSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSenior / Staff Software Engineer - Batch and Realtime Streaming
The Voleon GroupSalary not specified
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteSenior Software Engineer, Distributed Systems
MixpanelSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSenior Data Platform Engineer
Apollo.ioSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSenior Solutions Architect, Data Processing
NVIDIASalary not specified
RemoteStaff Data Operations Engineer
GoodleapSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteSenior Analytics Engineer II
AlmaSalary not specified
- Full Time
- Senior (5 to 8 years)