The Xpanse Collections team is looking to expand its capabilities in scanning the public Internet, extracting public data sets, and integrating with 3rd party data sets to create the foundation for Xpanse’s Attack Surface Management and Threat Hunt products.
Requirements
- Proficient in Java or Golang
- Familiar with at least one of the major cloud platforms (eg., GCP, AWS or Azure)
- Have expertise with any of the following: GCP, Kubernetes, Terraform, BigQuery, PostgreSQL, MySQL, BigTable, Apache Beam, low-level Internet protocols, database profiling
- Experienced and opinionated about API design and distributed backend systems
- Have experience using and enhancing CI/CD systems
- 10+ years of experience as a professional software engineer writing back end software
- Able to switch between research, design, prototype, and implementation
Responsibilities
- Design and develop robust data collection pipelines using Java multithreading and Apache Beam frameworks
- Architect and implement scalable ETL and ELT processes to handle data ranging from gigabytes to petabytes in size
- Design and optimize data storage and indexing solutions for both real-time streaming and batch processing applications
- Enhance and optimize Internet scanning workloads in Golang
- Investigate new data sources and perform data analysis to estimate customer impact
- Collaborate with the rest of your team on architectural direction, managing technical debt, and continuously evolving the team's agile development process
- Engage with downstream teams to enable the creation of new customer-facing features
Other
- 10+ years of experience as a professional software engineer writing back end software
- Have a passion for writing software that boosts the productivity of other software development teams
- Results driven, with strong analytical and problem-solving skills
- Mentor and lead other engineers and ensure that your team delivers high-quality output
- Take ownership of projects, drive them to completion, and support them in production
