The Xpanse Collections team is expanding and needs a Senior Software Engineer to design and develop data collection pipelines, architect scalable ETL/ELT processes, and optimize data storage solutions to support Xpanse's Attack Surface Management and Threat Hunt products. This role aims to gather an 'attacker's view' of publicly accessible services for customers to understand their technology footprint and vulnerability risk.
Requirements
- 4+ years of experience as a professional software engineer writing back end software
- Proficient in Java or Golang
- Familiar with at least one of the major cloud platforms (eg., GCP, AWS or Azure)
- Have expertise with any of the following: GCP, Kubernetes, Terraform, BigQuery, PostgreSQL, MySQL, BigTable, Apache Beam, low-level Internet protocols, database profiling
- Have experience using and enhancing CI/CD systems
Responsibilities
- Design and develop robust data collection pipelines using Java multithreading and Apache Beam frameworks
- Architect and implement scalable ETL and ELT processes to handle data ranging from gigabytes to petabytes in size
- Design and optimize data storage and indexing solutions for both real-time streaming and batch processing applications
- Enhance and optimize Internet scanning workloads in Golang
- Investigate new data sources and perform data analysis to estimate customer impact
- Collaborate with the rest of your team on architectural direction, managing technical debt, and continuously evolving the team's agile development process
- Engage with downstream teams to enable the creation of new customer-facing features
Other
- Have a passion for writing software that boosts the productivity of other software development teams.
- Excited to dig in, prototype, build, test, and see projects through to production; results driven, with strong analytical and problem-solving skills
- Experienced and opinionated about API design and distributed backend systems. Able to switch between research, design, prototype, and implementation
- Mentor other engineers and ensure that your team delivers high-quality output
- Take ownership of projects, drive them to completion, and support them in production
