The M365 Copilot App Platform team needs to design, build, and optimize scalable data pipelines and platforms that power advanced analytics and AI solutions for Microsoft's Copilot ecosystem.
Requirements
- 3+ years experience in building distributed data processing systems leveraging technologies including, but not limited to, Spark, Azure Data Lake, or Synapse
- 5+ years of experience in data engineering or software development with a focus on large-scale data systems
- 2+ years experience developing and maintaining low/no-code dashboards and data-driven apps (e.g., Power BI, Vibe-coded apps) to enable self-service analytics for stakeholders
- Proficiency in managing machine learning data pipelines and feature engineering processes
- Proficiency in data security, privacy compliance, and governance frameworks.
Responsibilities
- Design and implement robust ETL/ELT workflows for structured and unstructured data using modern data engineering frameworks.
- Build distributed data processing systems leveraging technologies such as Spark, Azure Data Lake, and Synapse.
- Establish standards for data integrity, lineage, and compliance with enterprise security and privacy policies.
- Monitor and tune data pipelines for efficiency, scalability, and cost optimization.
- Develop and maintain low/no-code dashboards and data-driven apps (e.g., Power BI, Vibe-coded apps) to enable self-service analytics for stakeholders.
- Help maintain and enhance experiment platforms, including Cosmos streams and VC(s), ensuring reliability and scalability for A/B testing and feature experimentation.
- Partner with cross-functional teams to integrate data solutions into AI products and mentor team members/engineers on best practices.
Other
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
- Demonstrate effective communication and collaboration skills in a dynamic, fast-paced environment
- Creativity, insightfulness, and sensitivity for a dynamic approach to problem-solving, combined with being motivated and self-driven, are essential
