Expel is looking for a Distinguished Engineer (Software Architect) to be the technical visionary for their Ingest and Detection Data Platform. This role will define the long-term technical vision for a platform that processes petabytes of security data to stop attackers, making foundational decisions to protect customers at an ever-increasing scale.
Requirements
- A distinguished career building and designing large-scale, complex distributed systems that are foundational to a company's success.
- Mastery of architectural patterns, observability, monitoring strategies, and secure software development practices.
- Expertise in Go and/or Python, and a mindset for reliability with a history of improving testing culture.
- Deep expertise in cloud-native data architecture, especially using AWS (S3, Glue, LakeFormation), and experience designing and optimizing modern data lake tables using Iceberg or Delta Lake.
- Hands-on experience with Apache Iceberg or Delta Lake; schema evolution and partitioning best practices
- Familiarity with distributed processing (Spark, Flink) and logging/observability platforms (e.g. ElasticSearch, DataDog)
- Strategic thinking around platform testing, security guardrails, and identity management
Responsibilities
- Guide architectural decisions across multiple teams, unblocking complexity and ensuring interoperability.
- Act as the ultimate technical guide for multiple engineering teams, ensuring their work aligns with the long-term strategy.
- Make the critical design and technology choices that will ensure our platform remains scalable, resilient, and ahead of the curve.
- Define the blueprint for our data platform's future, creating the architectural vision and technical roadmap for the next 2+ years that will influence the entire engineering organization.
- Architect our data lakehouse using AWS services like S3, Iceberg, Glue, and LakeFormation
- Define patterns for ingestion, transformation, normalization (e.g. OCSF), and governance across billions of records
- Jump in when needed to code a POC, debug a platform issue, or mentor an engineer through a tough design problem.
Other
- A strategic mindset, a history of thought leadership, and the ability to create and communicate a compelling long-term technical vision.
- A passion for mentoring other senior and principal-level engineers and a track record of cross-team influence.
- Typically 10+ years of professional software engineering experience.
- Experience in the cybersecurity or a regulated industry is a major plus.
- We’re only hiring those authorized to work in the United States. We do not currently sponsor immigration visas.
