Senior Data Engineer at Recorded Future

Boston, Massachusetts, United States

Recorded Future Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Cybersecurity, IntelligenceIndustries

Requirements

  • 5+ years experience with Python working in a professional software engineering environment that involves thorough code testing and review processes
  • Strong problem solving capabilities and experience troubleshooting data issues within your own processes and those of your peers
  • 5+ years experience maintaining production-ready, efficient data engineering pipelines and systems with extensive monitoring to accommodate complex data ingestion problems
  • Very flexible and outcome-oriented. Comfortable in a work environment where urgent issues arise often, and where quickly resolving issues has immediate security value for our end customers
  • A solid understanding of cybersecurity, along with an interest in analyzing dark web activities related to computer and network security
  • Experience with NLP, as well as MongoDB, ElasticSearch, and AWS cloud services is highly desirable

Responsibilities

  • Build, maintain, monitor and collect data from hard-to-reach dark web sites and ransomware blogs
  • Own the reliability of the automatic processing of this structured raw data. Investigate and resolve data processing problems by improving our data processing code so it will automatically handle similar scenarios in the future
  • Maintain and improve our data ingestion pipeline that processes and indexes metadata from large files. This includes analytic-generation services that use NLP to extract content with the highest security value
  • Lead by example when architecting, collaborating and delivering new and improved solutions

Skills

Key technologies and capabilities for this role

PythonData EngineeringData IngestionData ProcessingNLPPipelineCode TestingCode ReviewTroubleshootingMonitoringAnalytics

Questions & Answers

Common questions about this position

What is the salary range for the Senior Data Engineer position?

The base salary range for this full-time position is $129,000-$193,500, determined by role, level, location, state, work location, job-related skills, and experience.

Is this a remote position or does it require working from an office?

This information is not specified in the job description.

What skills and experience are required for this Senior Data Engineer role?

Candidates need 5+ years of Python experience in a professional environment with code testing and review, 5+ years maintaining production-ready data engineering pipelines with monitoring, strong problem-solving and troubleshooting skills, flexibility in handling urgent issues, and a solid understanding of cybersecurity.

What is the work environment like at Recorded Future's Dark Web team?

The environment is fast-paced and flexible, with urgent issues arising often where quick resolutions provide immediate security value to customers, and team members lead by example in architecting and collaborating on solutions.

What makes a strong candidate for this Senior Data Engineer position?

A strong candidate has 5+ years of Python and data pipeline experience, excels at troubleshooting complex issues, thrives in urgent cybersecurity-focused environments, and brings desirable skills in NLP, MongoDB, ElasticSearch, and AWS.

Recorded Future

Provides machine-readable threat intelligence solutions

About Recorded Future

Recorded Future provides threat intelligence in the cybersecurity industry by gathering and analyzing information about potential threats to organizations. Their intelligence is delivered in a machine-readable format, making it easy for clients like threat analysts and security teams to integrate with their existing systems. Unlike competitors, Recorded Future focuses on partnerships with Value Added Resellers (VARs) to enhance their offerings and provide comprehensive support. The company's goal is to help organizations lower the risk of cyber attacks through effective threat intelligence.

Somerville, MassachusettsHeadquarters
2009Year Founded
$57.1MTotal Funding
ACQUISITIONCompany Stage
CybersecurityIndustries
1,001-5,000Employees

Benefits

Professional development and career advancement
Flexible work environment, be yourself
Generous vacation policy
Wellness programs
Company outings
Competitive compensation and benefits
Free snacks, drinks, and coffee in the office
Parental leave program
Environmentally conscious

Risks

Integration challenges with Mastercard's systems could delay synergy realization post-acquisition.
The acquisition may shift strategic priorities, alienating clients preferring independent operations.
Competitive pressures from European cybertech firms may impact the Filigran partnership.

Differentiation

Recorded Future offers machine-readable threat intelligence for seamless integration with security systems.
The company indexes data from open, dark web, and technical sources for comprehensive insights.
Recorded Future partners with VARs, enhancing their reach and providing hands-on support.

Upsides

Mastercard's acquisition enhances Recorded Future's AI capabilities for improved cybersecurity services.
Integration with XDR platforms offers a comprehensive security approach for Recorded Future.
The rise of zero-trust models allows Recorded Future to tailor its threat intelligence offerings.

Land your dream remote job 3x faster with AI