Data Engineer / Senior Data Engineer
ArcadiaSalary not specified
Full Time
Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Payments, FinTech, TechnologyIndustries
Requirements
- Expertise in designing and implementing large-scale, distributed data systems integrating Hadoop, Apache Spark, Databricks, and cloud-native services (AWS/Azure)
- Experience developing robust ETL and streaming pipelines handling large volumes of transactional and behavioral data for machine learning and analytics
- Proficiency in data warehouse modernization, ensuring scalability, data quality, lineage, and governance
- Knowledge of AI/ML data infrastructure, including data models for ML pipelines, feature engineering, model training, and frameworks like LangChain, LangGraph, and MCP
- Skills in building reusable frameworks for extracting, transforming, and surfacing insights from structured, semi-structured, and unstructured data (e.g., JSON, logs, events)
- Experience leading POCs for emerging technologies (Delta Lake, Iceberg, Kafka, Arrow) and translating to production
- Understanding of security and compliance, including data encryption, secure access, and global data privacy standards
- Ability to mentor junior engineers and data scientists, fostering technical excellence and collaboration
- Capability to work with global teams across India and the US for consistent design and delivery
- Works directly with product owners and cross-functional teams (AI/ML, product, analytics, platform)
Responsibilities
- Architect and lead data solutions: Design and implement large-scale, distributed data systems integrating Hadoop, Apache Spark, Databricks, and cloud-native (AWS/Azure) services
- Build enterprise data pipelines: Develop robust ETL and streaming pipelines for transactional and behavioral data supporting ML and analytics
- Lead data warehouse modernization of Hadoop-based systems, ensuring scalability, data quality, lineage, and governance
- Collaborate with AI scientists to deliver data models optimized for ML pipelines, feature engineering, and model training
- Design and build reusable frameworks to extract, transform, and surface insights from diverse data sources
- Lead POC initiatives to evaluate emerging technologies and implement scalable production systems
- Ensure security and compliance through collaboration with InfoSec on encryption, access, and privacy standards
- Mentor and coach junior engineers and data scientists, promoting technical excellence and innovation
- Work closely with global data engineering teams in India and the US for design standards and architecture alignment
- Partner with product management, AI, and platform teams to align initiatives with business goals and data strategy
Skills
Data Engineering
Data Pipelines
Hadoop
AWS
Azure
AI/ML
Distributed Systems
Scalable Systems
ETL
Big Data
Cloud Infrastructure
Visa
Global digital payment network provider
About Visa
Visa operates a global digital payment network that facilitates electronic payments for millions of people daily. The company connects consumers, businesses, financial institutions, and governments, allowing them to make transactions using Visa cards. Each time a card is used, Visa earns money through transaction, service, and data processing fees. Unlike many competitors, Visa focuses on expanding access to financial services for underserved communities and supporting local economies. The company's goal is to promote financial inclusivity and drive sustainable commerce, ensuring that more people can participate in the global economy.
San Francisco, CaliforniaHeadquarters
1958Year Founded
$55.8MTotal Funding
ANGEL_INDIVIDUALCompany Stage
Fintech, Financial ServicesIndustries
10,001+Employees
Benefits
Health Insurance.
Life Insurance.
Dental Insurance.
Disability Insurance.
Accidental Death & Dismemberment Insurance.
Risks
CBDCs could reduce reliance on Visa's payment network.
'Buy Now, Pay Later' services may decrease traditional credit card transactions.
Fintech startups offering zero-fee transactions could pressure Visa's revenue model.
Differentiation
Visa operates a global digital payment network connecting millions daily.
The company focuses on financial inclusivity and sustainability in its operations.
Visa collaborates with central banks on Central Bank Digital Currencies (CBDCs).
Upsides
Visa's partnership with fintechs enhances cross-border payment solutions.
Adoption of blockchain technology could revolutionize digital payments.
AI-driven fraud detection systems are reducing fraudulent activities.
Related Jobs
RemoteRemotePrincipal Data Architect
Access SystemsSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteLead Data Engineer
LumosSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteSolutions Architect, Data Engineering
Snowflake$128,000 - $178,500/year
- Full Time
- Junior (1 to 2 years)
RemoteDBA & Enterprise Data Engineer
Authentic8Salary not specified
RemoteSenior Data Engineer, Intent (Pipeline)
Demandbase$190,000 - $284,000/year
- Full Time
- Senior (5 to 8 years)
RemoteSenior AI Data Architect
HumanaSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteEngineering Manager, Data Engineering
TRM LabsSalary not specified
- Full Time
- Expert & Leadership (9+ years)