Data Engineer / Senior Data Engineer
ArcadiaSalary not specified
Full Time
Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Fintech, Payments, TechnologyIndustries
Requirements
- Academic background to at least undergraduate level in a relevant discipline, e.g., Computer Science, Mathematics, Physics, or Engineering
- Minimum 5 years experience in collaborative software engineering roles
- Mastery of Apache Spark in large scale, distributed computing environments
- Proven track record of optimizing Spark queries for performance at scale
- Familiarity with typical patterns and trade offs in columnar file formats (eg: Parquet), open table formats (eg: iceberg) and analytical query engines
- Strong experience building and maintaining machine learning pipelines
- Familiarity with modern software engineering principles and practices (e.g. agile, clean code, IDEs, source control, testing, code review)
- Familiarity with PyTorch-based machine learning models
Responsibilities
- Design and develop high-performance data pipelines and tooling to support Large Transaction Model training and analysis at global scale
- Optimize Spark pipelines and workflows for speed and efficiency across Visa’s evolving data warehousing and data analytics infrastructure
- Provide technical leadership and guidance to other members of the agile team, working with cross-functional stakeholders to align technical solutions with product goals
- Collaborate with data scientists to build production tooling and pipelines for training PyTorch-based machine learning models
- Ensure data systems meet Visa’s standards for security, reliability, scalability, and compliance
- Mentor junior engineers and contribute to Visa’s software engineering best practices
- Liaise with global technology and product teams to share tools, patterns, and innovations
- Drive continuous improvement of team processes and shared workflows
Skills
Data Engineering
Data Pipelines
ETL
AI Models
Machine Learning
Foundation Models
Agile
Technical Leadership
Python
Spark
Kubernetes
AWS
Visa
Global digital payment network provider
About Visa
Visa operates a global digital payment network that facilitates electronic payments for millions of people daily. The company connects consumers, businesses, financial institutions, and governments, allowing them to make transactions using Visa cards. Each time a card is used, Visa earns money through transaction, service, and data processing fees. Unlike many competitors, Visa focuses on expanding access to financial services for underserved communities and supporting local economies. The company's goal is to promote financial inclusivity and drive sustainable commerce, ensuring that more people can participate in the global economy.
San Francisco, CaliforniaHeadquarters
1958Year Founded
$55.8MTotal Funding
ANGEL_INDIVIDUALCompany Stage
Fintech, Financial ServicesIndustries
10,001+Employees
Benefits
Health Insurance.
Life Insurance.
Dental Insurance.
Disability Insurance.
Accidental Death & Dismemberment Insurance.
Risks
CBDCs could reduce reliance on Visa's payment network.
'Buy Now, Pay Later' services may decrease traditional credit card transactions.
Fintech startups offering zero-fee transactions could pressure Visa's revenue model.
Differentiation
Visa operates a global digital payment network connecting millions daily.
The company focuses on financial inclusivity and sustainability in its operations.
Visa collaborates with central banks on Central Bank Digital Currencies (CBDCs).
Upsides
Visa's partnership with fintechs enhances cross-border payment solutions.
Adoption of blockchain technology could revolutionize digital payments.
AI-driven fraud detection systems are reducing fraudulent activities.
Related Jobs
RemoteRemoteSenior Data Engineer (Pipeline)
Demandbase$190,000 - $284,000/year
- Full Time
- Senior (5 to 8 years)
RemoteMachine Learning Engineer
SweedSalary not specified
- Full Time
- Mid-level (3 to 4 years)
RemoteStaff Data Engineer
Kindred$190,000 - $230,000/year
- Full Time
- Expert & Leadership (9+ years)
RemotePrincipal Data Architect
Access SystemsSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteAnalytics Engineer
Machinify$180,000 - $200,000/year
- Full Time
- Mid-level (3 to 4 years)
RemotePlatform Engineer
KnockSalary not specified
- Full Time
- Junior (1 to 2 years)