Microsoft Security aims to reshape security and empower users, customers, and developers with a security cloud. The COO organization is seeking to drive operational excellence and transformation through AI and continuous improvement, specifically by designing and delivering data foundations for autonomous fraud and abuse detection.
Requirements
- 1+ years experience with distributed data processing (e.g., Spark, Flink) and real-time streaming (e.g., Kafka, Pulsar).
- 2+ years experience of data modeling, ETL, and pipeline automation.
- Hands-on experience with vector databases (e.g., FAISS, Weaviate, Pinecone) and semantic search.
- Familiarity with LLM techniques, embeddings, and retrieval-augmented generation.
- Exposure to agentic AI concepts, autonomous systems, or reinforcement learning.
- Experience with cloud-native data architectures (Azure, AWS, GCP).
- Contributions to open-source AI or data infrastructure projects.
Responsibilities
- Architect and implement data systems that support Agentic AI workflows, including RAG pipelines and semantic memory.
- Design and optimize vector database solutions for context-aware retrieval and embedding storage.
- Build real-time and near-real-time data ingestion pipelines from diverse sources (e.g., telemetry, APIs, user interactions).
- Develop automation frameworks for data processing, transformation, and enrichment.
- Collaborate with data engineering, data science, and analytics teams to deliver seamless integration across data pipelines, model training, LLMs, inference services, MCP servers, and continuous feedback loops.
- Implement semantic search capabilities using embeddings, transformers, and large dataset optimization techniques.
- Ensure data quality, lineage, and governance across agentic systems.
Other
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
- Embody our Culture & Values
