Starburst is looking for a Software Engineer to work with our globally distributed engineering team on Starburst's industry-leading data ingestion and transformation platform. In this role, you'll contribute directly to the evolution of Starburst, tackling complex challenges across our managed SaaS, open source, and proprietary offerings - an ideal environment for learning and innovation. As a Software Engineer on our Icehouse team, you'll build highly scalable systems for ingesting and transforming data on Starburst's open data lakehouse.
Requirements
- Prior experience developing distributed systems
- Extensive software development experience with Java. Experience with other systems programming languages (Rust, C++, Go, etc) can be considered.
- Demonstrated experience with software engineering and design best practices
- Prior experience with software development using Trino, Apache Iceberg, Apache Kafka, or cloud object storage a huge plus
Responsibilities
- Design, develop and operate systems and features relating to data ingestion and transformation. You'll build on our systems which have proven ingestion up to 100GB/second.
- Build and implement features for creating and operating data lakes based on Apache Iceberg, such as streaming ingestion from Apache Kafka and Kafka-compatible systems; file ingestion from cloud object storage such as Amazon S3; data transformations; and automated scalable data maintenance.
- Provide considerate and timely review of your peers' design proposals pull requests.
Other
- 3+ years of experience developing software
- Work cross functionally to ensure the best experience for our customers.
- Help to build a highly effective culture across Starburst and your team.
- Demonstration of ownership, grit, and bias for action - core values at Starburst
- Ability to Travel