Sr. Platform and DataLake Engineer
TetraScienceSalary not specified
Full Time
Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Financial Services, Biotechnology, FintechIndustries
Requirements
Candidates must have at least 2 years of relevant work experience and a Bachelor's degree, or 5 years of relevant work experience. Proficiency in English at a B1 level or above is required. Essential skills include strong experience as a Data Engineer, good experience with AWS services such as S3, DMS, Lambda, Kinesis, and IAM, and experience with Apache Spark or similar tools like Flink and Hadoop. Candidates must also have Python experience, architectural design experience, Git/GitHub experience, experience with monitoring tools like Grafana and CloudWatch, and SQL experience. CI/CD and Airflow experience are desirable.
Responsibilities
The Data Engineer will serve as a senior technical contributor, leading the design and development of scalable data pipelines using Big Data frameworks. They will drive improvements in platform performance, reliability, and cost-effectiveness, and take ownership of production operations and monitoring. Responsibilities include collaborating with cross-functional teams to evolve data features, mentoring peers through code reviews, and ensuring data pipelines adhere to best practices for testing, monitoring, observability, and security. The role involves participating in on-call rotations, building and optimizing ETL/ELT processes for large-scale data, maintaining data governance and platform standards, conducting root-cause analyses, and influencing teams to promote technical excellence and continuous improvement.
Skills
Data Pipelines
Big Data
Streaming Data
Cloud Platform
Data Lake
Data Engineering
Platformization
Monitoring
Production Operations
Visa
Global digital payment network provider
About Visa
Visa operates a global digital payment network that facilitates electronic payments for millions of people daily. The company connects consumers, businesses, financial institutions, and governments, allowing them to make transactions using Visa cards. Each time a card is used, Visa earns money through transaction, service, and data processing fees. Unlike many competitors, Visa focuses on expanding access to financial services for underserved communities and supporting local economies. The company's goal is to promote financial inclusivity and drive sustainable commerce, ensuring that more people can participate in the global economy.
San Francisco, CaliforniaHeadquarters
1958Year Founded
$55.8MTotal Funding
ANGEL_INDIVIDUALCompany Stage
Fintech, Financial ServicesIndustries
10,001+Employees
Benefits
Health Insurance.
Life Insurance.
Dental Insurance.
Disability Insurance.
Accidental Death & Dismemberment Insurance.
Risks
CBDCs could reduce reliance on Visa's payment network.
'Buy Now, Pay Later' services may decrease traditional credit card transactions.
Fintech startups offering zero-fee transactions could pressure Visa's revenue model.
Differentiation
Visa operates a global digital payment network connecting millions daily.
The company focuses on financial inclusivity and sustainability in its operations.
Visa collaborates with central banks on Central Bank Digital Currencies (CBDCs).
Upsides
Visa's partnership with fintechs enhances cross-border payment solutions.
Adoption of blockchain technology could revolutionize digital payments.
AI-driven fraud detection systems are reducing fraudulent activities.
Related Jobs
RemoteRemoteBig Data Engineer
ZoomSalary not specified
- Full Time
- Junior (1 to 2 years), Mid-level (3 to 4 years)
RemoteDevOps AWS Cloud Engineer
H1Salary not specified
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
RemoteStaff Data Engineer - Data Engineering
ArineSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteData Engineer
Kraken$110,000 - $176,000/year
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
RemoteSenior Data Engineer (Intent)
Demandbase$165,000 - $284,000/year
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteSenior Backend Engineer - Python/AWS
MoovSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteStaff Data Engineer - Data Operations
ArineSalary not specified
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)