Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Recorded Future Logo

Manager, Data Engineering (web scraping)

Recorded Future

Salary not specified
Sep 30, 2025
Boston, MA, US
Apply Now

Recorded Future collects intelligence from many sources on the Dark Web, including terabytes of data dumps that are shared and trafficked in the underground, nefarious dark web forums, markets for stolen goods, and ransomware sites. The Dark Web team builds the data collection and analytics that transform this mass of raw data from these diverse sources into structured intelligence that our customers use to defend their people and networks.

Requirements

  • Significant experience in engineering management or leadership roles, particularly within data engineering or analytics teams, demonstrating a track record of success in high-pressure environments.
  • Strong capability in managing and guiding remote or hybrid teams, utilizing effective communication and collaboration tools to maintain team cohesion and productivity.
  • Understanding of Python, relevant database technologies and fundamental programming and data engineering concepts
  • Exceptional organizational skills, capable of turning complex requirements into actionable project plans and fostering incremental delivery within a software development framework.
  • Excellent communication skills, adept at conveying complex technical concepts in a clear and concise manner through various channels including emails, Slack, and in-person discussions.
  • A solid understanding of cybersecurity, along with an interest in analyzing dark web activities related to computer and network security.

Responsibilities

  • Deliver customer value by producing data and analytics that summarize information from the Dark Web and drive the alerting that our customers directly consume.
  • Lead, mentor, and develop a diverse team of six engineers focused on Dark Web data collection and analysis, fostering a culture of collaboration and continuous improvement.
  • Coordinate and oversee the development and maintenance of web harvesting and data processing applications and pipelines, ensuring they meet organizational and client needs.
  • Partner with the Product Manager, Dark Web to manage project timelines and deliverables in an often high-pressure context, maintaining focus on both short-term objectives and long-term strategic goals.
  • Collaborate closely with cross-functional teams, including cybersecurity researchers and other engineering units, to refine intelligence analytics and enhance product offerings.
  • Address and resolve elevated client escalations with a focus on maintaining relationships while delivering prompt and effective solutions.

Other

  • We are committed to maintaining an environment that attracts and retains talent from a diverse range of experiences, backgrounds and lifestyles.
  • By ensuring all feel included and respected for being unique and bringing their whole selves to work, Recorded Future is made a better place every day.
  • Recorded Future is an equal opportunity and affirmative action employer and we encourage candidates from all backgrounds to apply.
  • Recorded Future does not discriminate based on race, religion, color, national origin, gender including pregnancy, sexual orientation, gender identity, age, marital status, veteran status, disability or any other characteristic protected by law.
  • Recorded Future will not discharge, discipline or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about, discussed, or disclosed the compensation of the employee or applicant or another employee or applicant.