Crusoe's mission is to accelerate the abundance of energy and intelligence by crafting the engine that powers a world where people can create ambitiously with AI — without sacrificing scale, speed, or sustainability. The Crusoe Cloud Managed AI team seeks an ambitious Software Engineer to join their team to shape the architecture and scalability of their next-generation AI inference platform.
Requirements
- Proven experience in distributed systems design and implementation.
- Expertise in using cloud-based services, such as elastic compute, object storage, virtual private networks, managed databases, etc.
- Experience with container runtimes (e.g., Kubernetes) and microservices architectures.
- Experience using REST APIs and common communication protocols, such as gRPC.
- Demonstrated experience in the software development cycle and familiarity with CI/CD tools.
- Proficiency in Golang or Python for large-scale, production-level services. (Preferred)
- Familiarity with AI infrastructure, including training, inference, and ETL pipelines. (Preferred)
Responsibilities
- Design and develop core infrastructure for the Managed AI platform:
- Lead the design and implementation of resilient fault-tolerant queues, model catalogs, and scheduling mechanisms.
- Build and optimize systems for high-volume AI inference, handling millions of API requests per second.
- Develop and maintain core services for AI model deployment and management.
- Design and implement systems with high availability, low latency, and fault tolerance.
- Optimize performance across all stages of the AI inference pipeline, including model loading, execution, and response handling.
- Continuously monitor and improve the performance and reliability of AI services.
Other
- Advanced degree in Computer Science, Engineering, or a related field.
- Experience in Generative AI (Large Language Models, Multimodal).
- Proven track record of delivering early-stage projects under tight deadlines.
- Strong communication and collaboration skills.
- Proactive and results-oriented with the ability to work independently and as part of a team.
