Confluent is looking to solve complex distributed storage systems and infrastructure problems by building the next generation of storage solutions for Kora, transforming it into a true multi-modal storage engine. The goal is to enable streaming data to be consumed both as a table and as a stream seamlessly.
Requirements
- Proven experience designing and building large-scale, distributed storage systems.
- Deep knowledge of distributed systems concepts, including fault tolerance, consistency, and scalability.
- Expertise in modern cloud-based infrastructure and multi-tenant environments.
- Familiarity with or has experience contributing to the following open-source technologies: Apache Kafka, Apache Iceberg, Apache Flink
- Experience/knowledge with public clouds (AWS, Azure or GCP)
Responsibilities
- Design and implement innovative strategies for table schematization, materialization, and compaction at massive scale.
- Build and maintain multi-tenant, highly available infrastructure that powers background computational tasks for Kora’s long-term storage.
- Ensure that the platform is optimized for scalability, reliability, and resilience, in alignment with organizational objectives.
- Guide and mentor team members in contributing to relevant open-source projects such as Apache Iceberg.
- Advocate for best practices in open-source collaboration and foster a culture of giving back to the community.
- Set the standard for engineering excellence.
- Act as a trusted advisor for both internal and cross-functional teams, providing guidance on complex technical problems and contributing to high-level decision-making processes.
Other
- BS, MS, or PhD in computer science or a related field, or equivalent work experience
- Strong leadership skills with a demonstrated ability to mentor and guide engineers to success.
- Excellent communication and collaboration skills, with the ability to influence and guide stakeholders at all levels.
- Interest in evangelism (giving talks at tech conferences, writing blog posts evangelizing your work)
- We work across time zones and backgrounds, knowing the best ideas come from different perspectives.
