Crunchyroll's Platform Development organization needs to drive the design and evolution of core platform services that power Crunchyroll's global ecosystem, spanning authentication and security enhancements, notification services, and ML inference runtimes, to enable engineering teams to build reliable, secure, and intelligent experiences at scale.
Requirements
- Hands-on experience building and optimizing AI/ML inference runtimes (e.g., KServe, TorchServe, TensorRT, Triton) and integrating with CI/CD and MLOps pipelines (e.g., SageMaker, Kubeflow, BentoML).
- Expertise in JavaScript/TypeScript, with additional experience in Golang or Kotlin.
- Experience with containers, orchestration (Kubernetes/ECS), cloud platforms (AWS preferred), and distributed systems.
- Experience with performance profiling, model optimization, GPU acceleration, and designing inference workloads to meet latency/throughput SLAs.
- Experienced in building scalable APIs (REST/gRPC), caching strategies, and high-performance systems, including relational and NoSQL databases.
- Familiar with monitoring, observability tools, security, and compliance best practices in production ML/AI services.
- Proven ability to collaborate with ML/AI teams, bridge research and production, and mentor peers.
Responsibilities
- Architect, build, and maintain ML inference runtimes for multi-model serving, autoscaling, and GPU/TPU utilization.
- Optimize inference pipelines and platform services for performance, reliability, and scalability.
- Lead deployment, operationalization, and maintenance of ML workloads in collaboration with ML and data science teams.
- Shape and maintain core platform services, including authentication, security, and notifications.
- Ensure seamless integration with platform infrastructure, CI/CD pipelines, and observability systems.
- Define scalable system architectures and guide cross-team design alignment.
- Develop benchmarking, validation, and monitoring tools to measure and maintain system performance.
Other
- 12+ years of backend software engineering experience, with a track record of leading complex projects end-to-end.
- Strong problem-solving, communication, and engineering best practices, with attention to detail and quality.
- Bachelor's degree in Computer Science, Engineering, or a related field—or equivalent practical experience.
- Flexible time off policies
- Generous medical, dental, vision, STD, LTD, and life insurance
