Development and implementation of the infrastructure layer for multi-modal data processing and ML.
Requirements
- Proficient in Python and Linux
- Proficient in batch cloud computing and storage technologies
- Proficient in Ray or Spark.
- Experience in Data/AI/ML platform.
Responsibilities
- Design and deliver software and tools as part of our state-of-the-art Machine Learning platform
- Systems architecture design, including management of upstream and downstream dependencies
- Provide technical leadership, influence and partner with fellow engineers to architect, design and build scalable solutions for ML technology that can stand the test of scale and availability, while reducing operational overhead
- Build batch processing pipelines, search infrastructures for large volumes of multi-modal data
- Participate in periodic on-call rotations and be available for critical issues
- Collaborate with platform, product and security engineering teams, and enable successful use of the latest AI techniques.
Other
- 5 years of working experience in the software engineering industry
- Bachelor degree in computer science, computer engineering or related fields
- Master or PhD degree in computer science, computer engineering or related fields
- Participate in periodic on-call rotations and be available for critical issues
- Collaborate across Platform Engineering teams which include areas such as networking, storage, compute, big data and cloud engineering.
