May Mobility is transforming cities through autonomous technology to create a safer, greener, more accessible world. The Senior Manager, Autonomy Data Engineering is responsible for ensuring that May’s drive (and other related) data is stored responsibly (including cost effectiveness and cyber security), processed efficiently, and maximally used to increase insight and performance of May’s autonomous vehicle capabilities both in R&D and commercial activities.
Requirements
- Hands-on experience with distributed systems and databases such as Kafka, NATS, Spark, Flink, Druid, Clickhouse, Pinot
- Strong working knowledge of data structures and algorithms
- Proficient in a professional software language such as C++, Rust, Python, or Java
- Experience building and managing large-scale data-processing pipelines in a cloud environment
- Working knowledge of telemetry systems and real-time data processing
Responsibilities
- Own the many different types of data streams that our systems and operations produce so that they may be used effectively to scale our software development and operations
- Lead design, manage, and scale our real-time and historical data pipelines to enable our fleet to operate and facilitate continuous development of our system
- Build infrastructure others can use: define best practices and set technical standards for ingestion, transformation, validation, and testing
- Identify technical bottlenecks and resourcing gaps, propose scalable solutions or team structure adjustments, and contribute to the technical roadmap while mentoring others to improve team capacity
- Own data observability, integrity, and monitoring best practices
- Collaborate across teams to make data accessible via APIs and internal tools
Other
- Ability to undergo a driving record check
- Excellent attention to detail and rigorous testing methodology
- Identifies complex problems and devises optimal and innovative solutions that often cross organizational boundaries
- Removes organizational barriers. Ability to make optimal trade-offs in own goals and resources (staff and budget) to help the team achieve its goals
- Ability to mentor staff of various skills and personalities, including both technical staff and other managers
