Microsoft is seeking to build mission critical data pipelines that ingest, process and publish data streams from personal AI, Copilot systems to fine tune models, support introspection and retrospection of data, and constantly evolve and improve human AI interactions.
Requirements
- Coding in languages including, but not limited to, Python, Java, Spark, SQL.
- Experience working with Apache Hadoop eco system, Kafka, NoSQL, etc.
- Experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP.
- Extensive use datastores like RDBMS, key-value stores, etc.
- Experience building distributed systems at scale and extensive systems knowledge that spans bare-metal hosts to containers to networking.
- Ability to identify, analyze, and resolve complex technical issues, ensuring optimal performance, scalability, and user experience.
- Dedication to writing clean, maintainable, and well-documented code with a focus on application quality, performance, and security.
Responsibilities
- Build scalable data pipelines for sourcing, transforming and publishing data assets for AI use cases.
- Work collaboratively with other Platform, infrastructure, application engineers as well as AI Researchers to build next generation data platform products and services.
- Ship high-quality, well-tested, secure, and maintainable code.
- Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively.
- Enjoy working in a fast-paced, design-driven, product development cycle.
- Ability to manage a small team of 4 or 5 senior data engineers, talent management experiences.
- Owning engineering and operational excellence for data platform which includes PR reviews, code quality, engineering productivity, etc.
Other
- Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling or data engineering work
- Ability to clearly communicate complex technical concepts to both technical and non-technical stakeholders.
- Ability to work in a fast-paced environment, manage multiple priorities, and adapt to changing requirements and deadlines.
- Dedication to writing clean, maintainable, and well-documented code with a focus on application quality, performance, and security.
- Working from a designated Microsoft office at least four days a week if they live within 50 miles (U.S.) or 25 miles (non-U.S., country-specific) of that location.
