Sr. Platform and DataLake Engineer
TetraScienceSalary not specified
Full Time
Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Fintech, Banking, Financial Services, BiotechnologyIndustries
Requirements
Candidates must have at least 2 years of relevant work experience and a Bachelor's degree, or 5+ years of relevant work experience. Proficiency in English at a B1 level or higher is required, along with strong experience as a Data Engineer. Familiarity with AWS services such as S3, DMS, Lambda, Kinesis, and IAM, along with Apache Spark or similar tools (Flink, Hadoop), and Python is essential. Experience with architectural design, Git/GitHub, monitoring tools like Grafana and CloudWatch, and SQL are also necessary. Desirable qualifications include CI/CD and Airflow experience, as well as CDC knowledge.
Responsibilities
The Data Engineer will serve as a senior technical contributor, leading the design and development of scalable data pipelines using Big Data frameworks. They will drive improvements in platform performance, reliability, and cost-effectiveness, and take ownership of production operations and monitoring. Responsibilities include collaborating with cross-functional teams to build data features, reducing technical debt, and mentoring peers through code reviews and feedback. The role also involves ensuring data pipelines adhere to best practices in testing, monitoring, observability, and security, participating in on-call rotations, building and optimizing ETL/ELT processes, maintaining data governance standards, conducting root-cause analyses, and promoting technical excellence across teams.
Skills
Data Pipelines
Big Data Frameworks
Platform Performance
Reliability
Cost-Effectiveness
Innovation
Production Operations
Monitoring
Data-Intensive Analytics
Streaming Data
Cloud-based Platform
Visa
Global digital payment network provider
About Visa
Visa operates a global digital payment network that facilitates electronic payments for millions of people daily. The company connects consumers, businesses, financial institutions, and governments, allowing them to make transactions using Visa cards. Each time a card is used, Visa earns money through transaction, service, and data processing fees. Unlike many competitors, Visa focuses on expanding access to financial services for underserved communities and supporting local economies. The company's goal is to promote financial inclusivity and drive sustainable commerce, ensuring that more people can participate in the global economy.
San Francisco, CaliforniaHeadquarters
1958Year Founded
$55.8MTotal Funding
ANGEL_INDIVIDUALCompany Stage
Fintech, Financial ServicesIndustries
10,001+Employees
Benefits
Health Insurance.
Life Insurance.
Dental Insurance.
Disability Insurance.
Accidental Death & Dismemberment Insurance.
Risks
CBDCs could reduce reliance on Visa's payment network.
'Buy Now, Pay Later' services may decrease traditional credit card transactions.
Fintech startups offering zero-fee transactions could pressure Visa's revenue model.
Differentiation
Visa operates a global digital payment network connecting millions daily.
The company focuses on financial inclusivity and sustainability in its operations.
Visa collaborates with central banks on Central Bank Digital Currencies (CBDCs).
Upsides
Visa's partnership with fintechs enhances cross-border payment solutions.
Adoption of blockchain technology could revolutionize digital payments.
AI-driven fraud detection systems are reducing fraudulent activities.
Related Jobs
RemoteRemoteData Engineer (Analytics)
NavaSalary not specified
- Full Time
- Junior (1 to 2 years)
RemoteSenior Data Engineer (Intent)
Demandbase$165,000 - $284,000/year
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteLead Data Pipeline Engineer
Two Six TechnologiesSalary not specified
- Full Time
- Junior (1 to 2 years)
RemoteSenior Data Platform Engineer
Apollo.ioSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteStaff Data Engineer - Data Operations
ArineSalary not specified
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteSenior Software Engineer - Integrations
ChartHop$140,000 - $200,000/year
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
RemoteSenior Java Engineer - Integrations
ClickhouseSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSenior Backend Engineer - Python/AWS
MoovSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSr. Data Engineer II
TrueMLSalary not specified
- Full Time
- Senior (5 to 8 years)