Sony Interactive Entertainment is looking to build an AI Middleware for the enterprise to enable AI agent consumption of enterprise systems, tools, and data, and to productize and optimize AI services.
Requirements
- Proficiency in Python or TypeScript (ideally both) with strong software-engineering fundamentals (testing, design patterns, observability, performance tuning).
- Practical knowledge of ML/GenAI concepts: embeddings, vector search, prompt engineering, fine-tuning, and evaluation metrics.
- Solid understanding of workflow orchestration frameworks for LLM/GenAI pipelines.
- Hands-on experience with data-pipeline tooling and batch/stream ETL.
- Solid understanding of cloud platforms (AWS preferred), containerization (Docker, Kubernetes), and infrastructure-as-code (Terraform, CDK).
- LLM tooling: LangChain, LangGraph, LlamaIndex, Hugging Face Transformers, OpenAI or Anthropic APIs
- Data stores: Postgres, DynamoDB, Redis, and vector databases such as Pinecone, Weaviate, FAISS
Responsibilities
- Build and Operate AI Middleware: Implement, and manage Model Context Protocol (MCP) servers, gateways, and API wrappers that securely expose enterprise systems, tools, and data for AI agent consumption.
- Build and Govern Agentic Workflows: Deploy and extend agentic AI platforms (e.g., LangGraph, LangChain) to deliver resilient orchestration, enforcing governance, tracing, audit logs, and human-in-the-loop controls.
- Develop Enterprise Data & Context Pipelines: Build scalable pipelines for parsing, cleaning, embedding, and storing structured and unstructured enterprise data (text, code, multimedia) to enable retrieval-augmented generation and domain-specific agent knowledge.
- Productize and Optimize AI Services: Translate prototypes into production-grade microservices (Python/TypeScript, Kubernetes, CI/CD), optimizing for latency, throughput, resilience, and token/cost efficiency.
- Ensure Security, Compliance, and Reliability: Engineer AI middleware and workflows that meet enterprise standards for safety, governance, compliance, and fault tolerance, with built-in monitoring, telemetry, and automated evaluation harnesses.
- Partner multi-functionally with architects, platform teams, and product owners to deliver business-aligned AI solutions, while staying at the forefront of emerging LLM and middleware trends.
Other
- 6+ years of software engineering experience, including approximately 2 years working on ML, data, or LLM-focused systems.
- Excellent communication skills and a proven ability to collaborate across teams in a fast-paced environment.
- Observability: distributed tracing, metrics dashboards, cost monitoring for token-based services
- Security & Responsible AI: PII redaction, content-safety filters, bias evaluation
- Bonus: proficiency in Go, experience with multimodal or edge inference, contributions to GenAI open-source projects
