Core Data Engineer - Real Time at Flow Traders

Amsterdam, North Holland, Netherlands

Flow Traders Logo
Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Financial Services, TradingIndustries

Requirements

  • Organized with strong attention to detail and quality
  • Innately driven to generalize, systematize, and automate
  • Strong interpersonal skills, works very well with both technical and non-technical stakeholders
  • Ability to balance individual stakeholder requirements in order to preserve quality and wide applicability of data
  • Ability to define, manage, and execute projects (often several in parallel) while effectively triaging operational concerns
  • Primarily technical, but domain-literate (exchange market data, network traffic data, security reference/pricing data, ETF compositions, application log data; should not be solely exposed to Flow conventions)
  • Domain expertise a huge plus (but not strictly necessary)
  • Excellent programming skills (any language, Python preferred)
  • Working proficiency with Linux, SQL and relational databases, and version control systems
  • Proven experience with real-time OLAP databases like ClickHouse, Apache Pinot, StarRocks required
  • Experience with Airflow, Kafka, and GCP (esp. GKE, Dataproc, and Big Query) highly desired
  • Experience with Pandas, Spark, Apache Beam, Apache NiFi a plus

Responsibilities

  • Be accountable for timely and high-quality delivery of core data products to the rest of the organization: Market Data, Trades/Orders/Quotes/Inquiries, Application Logs with a specific focus on low-latency analytics
  • Develop and own the end-to-end lifecycle of these data products: build and maintain pipelines, develop quality checks, correct day-to-day issues, and systematize/automate manual processing steps
  • Define and manage project plans to assume ownership of these data products
  • Create and refine a common processing model (esp. fast vs slow path, use of alternative T3 solutions) across these data products
  • Investigate currently available sources of data and ensure that Flow extracts maximum information and value from them
  • Explore, evaluate, and onboard additional sources of available data (both independently and at the request of stakeholders)
  • Work closely with other teams to: automate existing workflows, develop real-time capabilities as platform offering, ensure pipelines leverage standard Flow technologies, provide guidance on data-related architecture/design topics, ensure licensing and access control are appropriate

Skills

Real-time Analytics
Data Pipelines
Low-Latency Processing
Market Data
Application Logs
Network Traffic
Data Quality Checks
Pipeline Automation
ETL

Flow Traders

Global liquidity provider for financial markets

About Flow Traders

Flow Traders is a global liquidity provider that focuses on Exchange Traded Products (ETPs) and is expanding into other asset classes. The company operates in major financial markets across the Americas, APAC, and EMEA regions. It utilizes a proprietary technology platform to set bid and ask prices for thousands of ETP listings and similar financial products, which helps ensure there are enough buyers and sellers in the market, facilitating easier trading for investors. Flow Traders primarily serves institutional clients, such as hedge funds and asset managers, who depend on their efficient trading services. The company earns profits by taking a small margin on a large volume of trades, capitalizing on their advanced technology and market knowledge to maintain a competitive edge. Additionally, Flow Traders is dedicated to corporate social responsibility, aiming to create shared value in economic, social, and environmental aspects.

Amsterdam, NetherlandsHeadquarters
2004Year Founded
IPOCompany Stage
Fintech, Financial ServicesIndustries
501-1,000Employees

Benefits

Medical, Vision, Dental Insurance coverage
401(k) plan with generous match
In-house lounge with a bar, game consoles, poker & billiards tables
Daily catered lunch, cold brew coffee on tap and a fully stocked kitchen
Weekly table massages and bi-weekly haircuts
Annual company trip and a variety of events throughout the year
Reimbursed gym membership or home equipment and other wellness initiatives
Global rotations between our offices worldwide
Flow Academy for continuous learning and opportunities to attend industry seminars and conferences

Risks

Rising competition from new digital asset exchanges challenges Flow Traders' market position.
Self-custodial trading platforms may reduce reliance on traditional liquidity providers.
Advanced cryptographic protocols could disrupt traditional data-sharing methods in financial markets.

Differentiation

Flow Traders specializes in Exchange Traded Products, expanding into diverse asset classes.
The company uses proprietary technology to provide liquidity in global financial markets.
Flow Traders invests in financial market innovators, enhancing transparency and efficiency.

Upsides

Growing interest in digital asset trading boosts demand for liquidity providers like Flow Traders.
Expansion into emerging technologies aligns with Flow Traders' strategic agenda.
Increased digitization in equity markets enhances market efficiency, benefiting Flow Traders.

Land your dream remote job 3x faster with AI