Senior Data Engineer

United Kingdom

Apply with AI Apply

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Cybersecurity, IntelligenceIndustries

Requirements

Candidates must have 5+ years of experience with Python in a professional software engineering environment with thorough code testing and review processes. They should possess strong problem-solving skills and experience troubleshooting data issues. A minimum of 5 years of experience maintaining production-ready, efficient data engineering pipelines and systems with extensive monitoring is required. A solid understanding of cybersecurity and an interest in analyzing dark web activities are essential. Experience with NLP, MongoDB, Elasticsearch, and AWS cloud services is highly desirable.

Responsibilities

The Senior Data Engineer will build, maintain, monitor, and collect data from difficult-to-reach dark web sites and ransomware blogs. They will own the reliability of automatic processing of structured raw data, investigate and resolve data processing problems, and improve data processing code to handle similar scenarios automatically. This role involves maintaining and improving the data ingestion pipeline for processing and indexing metadata from large files, including analytic-generation services that use NLP. The engineer will also lead by example in architecting, collaborating on, and delivering new and improved solutions.

Skills

Python

Data Ingestion

Data Processing

Data Collection

NLP

Software Engineering

Problem Solving

Code Testing

Code Review

Data Architecture

Recorded Future

Provides machine-readable threat intelligence solutions

About Recorded Future

Recorded Future provides threat intelligence in the cybersecurity industry by gathering and analyzing information about potential threats to organizations. Their intelligence is delivered in a machine-readable format, making it easy for clients like threat analysts and security teams to integrate with their existing systems. Unlike competitors, Recorded Future focuses on partnerships with Value Added Resellers (VARs) to enhance their offerings and provide comprehensive support. The company's goal is to help organizations lower the risk of cyber attacks through effective threat intelligence.

Somerville, MassachusettsHeadquarters

2009Year Founded

$57.1MTotal Funding

ACQUISITIONCompany Stage

CybersecurityIndustries

1,001-5,000Employees

Benefits

Professional development and career advancement

Flexible work environment, be yourself

Generous vacation policy

Wellness programs

Company outings

Competitive compensation and benefits

Free snacks, drinks, and coffee in the office

Parental leave program

Environmentally conscious

Risks

Integration challenges with Mastercard's systems could delay synergy realization post-acquisition.

The acquisition may shift strategic priorities, alienating clients preferring independent operations.

Competitive pressures from European cybertech firms may impact the Filigran partnership.

Differentiation

Recorded Future offers machine-readable threat intelligence for seamless integration with security systems.

The company indexes data from open, dark web, and technical sources for comprehensive insights.

Recorded Future partners with VARs, enhancing their reach and providing hands-on support.

Upsides

Mastercard's acquisition enhances Recorded Future's AI capabilities for improved cybersecurity services.

Integration with XDR platforms offers a comprehensive security approach for Recorded Future.

The rise of zero-trust models allows Recorded Future to tailor its threat intelligence offerings.

Land your dream remote job 3x faster with AI

Try Jobo Free