Morgan Stanley is seeking a Gen AI Search Engineer to revolutionize its enterprise search capabilities by integrating cutting-edge Generative AI models with its existing search platform, aiming to provide users with intuitive, contextually rich, and highly relevant information.
Requirements
- Proven experience (typically 5+ years) in search engineering or a related software development
- 5+ years of Programming experience preferably using Python.
- Strong understanding of search engine principles, information retrieval, and relevance ranking.
- Hands-on experience working with Search Engine like Lucidworks Fusion, including pipeline development, query processing, and analytics.
- Significant experience working with OpenAI APIs and models (e.g., completions, embeddings, fine-tuning).
- Solid programming skills in languages such as Python and Java or experience with UI development such as AngularJS, ReactJS will be a plus
- Experience with NLP techniques and libraries (e.g., NLTK, spaCy, Transformers).
Responsibilities
- Design, develop, and support existing Gen AI-powered search solution leveraging OpenAI models (e.g., GPT-3, GPT-4, embeddings).
- Integrate and fine-tune large language models (LLMs) with GenAI search pipelines to enhance query understanding, semantic search, summarization, question answering, and content generation.
- Develop and implement strategies for indexing, retrieving, and ranking information optimized for Gen AI applications.
- Build robust and scalable APIs and microservices to connect Gen AI models with the Fusion platform.
- Work on potential transition from Fusion and Redis Vector DB to Elastic Search.
- Explore other GenAI search and agentic capabilities with Microsoft Search and Copilot Studio.
- Develop robust backend search infrastructure for an Embeddings Lake to enhance search efficiency and accuracy.
Other
- Lead Software Engineering position at the Director level
- Ability to work independently and collaboratively in a fast-paced environment.
- Excellent problem-solving, analytical, and communication skills.
- Contributions to open-source projects in the search or NLP domains.
- Familiarity with agile development methodologies.
