DataDirect Networks (DDN) is looking to solve the problem of powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to financial services, autonomous cars, Government, academia, research and manufacturing, by developing a cutting-edge data intelligence platform to accelerate AI workloads and extract maximum value from data.
Requirements
- 10+ years of experience building large-scale systems software in C/C++.
- Deep understanding of I/O path optimization, storage scheduling, memory management, and data layout strategies.
- Proven experience implementing erasure coding, data redundancy, and recovery algorithms in a distributed context.
- Hands-on experience integrating or optimizing with SPDK or similar user-space storage frameworks.
- Strong knowledge of distributed concurrency, locking mechanisms, and fault-tolerant design principles.
- Familiarity with performance profiling tools, memory allocators, and benchmarking methodologies.
- Excellent debugging skills, with the ability to diagnose complex race conditions, performance regressions, and hardware/software interactions.
Responsibilities
- Design, develop, and optimize the Infinia I/O path to achieve extreme performance, low latency, and high concurrency under real-world workloads.
- Implement and refine erasure coding algorithms, data durability techniques, and storage efficiency strategies across large clusters.
- Integrate and optimize SPDK (Storage Performance Development Kit) into the I/O layer to leverage direct hardware access and minimize kernel overhead.
- Work on distributed locking mechanisms and concurrency models to ensure consistency, fault tolerance, and throughput at scale.
- Analyze and improve I/O subsystems under stress — including memory usage, buffer management, caching strategies, and scheduling mechanisms.
- Drive performance tuning, data path tracing, and throughput profiling across multi-node, multi-device environments.
- Participate in the design of asynchronous, event-driven architectures that support AI pipelines, high-speed data ingestion, and real-time analytics.
Other
- Participation in an on-call rotation to provide after-hours support as needed.
- Occasional in-person meetings or team events may be required.
- Strong communication skills are crucial for the success of our teams and the company as a whole.
- Ability to work in a remote environment, with occasional travel to Boston, MA; Raleigh, NC; Denver, CO; or Tucson, AZ.
- DataDirect Networks (DDN) is an Equal Opportunity/Affirmative Action employer.
