Recorded Future is looking for a Principal Data Engineer to design, build, and scale systems for their Attack Surface Intelligence module, focusing on critical data pipelines for ingesting and distributing intelligence signals.
Requirements
- Proven experience designing & maintaining scalable APIs and microservices in Python leveraging tools like Kafka, Clickhouse, and Elasticsearch.
- Deep understanding of distributed systems and service-oriented architecture
- Comfortable exploring data to debug, validate assumptions, and drive better system behavior
- Experience with informing and driving coding and design standards within a team
Responsibilities
- Lead the design and implementation of backend services and APIs in Python
- Architect and evolve microservice-based systems for scalability and resilience
- Proactively identify and resolve data and integration issues by diving deep into our pipelines and systems
- Drive observability and operational excellence across services
- Coordinate with internal stakeholders outside of the Attack Surface Intelligence team to inform solutions for data transfers around the greater Recorded Future ecosystem
- Contribute to technical roadmaps and long-term platform strategy
Other
- Collaborate with product managers and cross-functional partners to align technical work with business goals
- Mentor other engineers through code reviews and design discussions
- Excellent communication skills and the ability to work across teams to align on goals and priorities
- Track record of operating independently and driving complex projects, especially with a geographically distributed team
