At Cloudera, we empower people to transform complex data into clear and actionable insights, and we're looking for an exceptional software engineer to join the Storage Engineering team focused on building Apache Ozone to overcome the limitations of Hadoop Distributed File System (HDFS).
Requirements
- Strong backend engineering skill set with expertise in Java, or strong C++ skills, with intermediate Java expertise
- Experience with large-scale, distributed systems design and development with a strong understanding of scaling, replication, consistency, and high availability
- Solid experience with system software design and development with a strong understanding of computer architecture, storage, network, and IO subsystems, and distributed systems
- Hands-on programmer with strong data structures and algorithms skillset
- Strong background in a distributed storage system, including file systems, database storage internals, NoSQL storage, or distributed hash tables
- Strong background in performance tuning, identifying performance bottlenecks, and implementing performance optimizations
- Strong understanding of the Apache Big Data ecosystem and over 3+ years of experience in systems software, including file systems
Responsibilities
- You will be directly involved in the design and implementation of the core feature set of Apache Ozone and Apache Ratis (open-source RAFT implementation)
- You will regularly contribute code and design docs to the Apache open-source community.
- As part of storage engineering, you will support enterprise customers running 100s of petabytes-scale big data analytics and ML/AI pipelines.
- You will partner with Engineering leaders, product managers, and cross-functional teams as a part of the Cloudera Data platform ecosystem in understanding requirements and turning them into a solid design and implementation, and facilitating integration and adoption.
- Additionally, in this role, you will be responsible for leading a talented group of engineers working on a feature and mentoring junior engineers.
- You will be involved in the design and implementation of the core feature set of Apache Ozone
- You will contribute to the Apache open-source community
Other
- Bachelor's +10, Master's +8 years of relevant industry experience required (5+ for PhD candidate)
- This role is not eligible for immigration sponsorship
- Good understanding of storage development, RAFT replication framework, or equivalent distributed consensus frameworks
- Recognized contributions to open source projects
- Strong oral and written communication skills
