Gen AI Search Engineer

We are seeking a talented and passionate Gen AI Search Engineer to revolutionize our search capabilities. In this pivotal role, you will be at the forefront of integrating cutting-edge Generative AI models, particularly from OpenAI, with our enterprise search platform powered by Lucidworks Fusion (and Apache Solr). You will design, develop, and implement intelligent search solutions that provide users with intuitive, contextually rich, and highly relevant information. This is an exciting opportunity to shape the future of how our organization accesses and utilizes knowledge.

In the Technology division, we leverage innovation to build the connections and capabilities that power our Firm, enabling our clients and colleagues to redefine markets and shape the future of our communities. This is a Software Engineering III position at the Director level, which is part of the job family responsible for developing and maintaining software solutions that support business needs.

Morgan Stanley is an industry leader in financial services, known for mobilizing capital to help governments, corporations, institutions, and individuals around the world achieve their financial goals.

Interested in joining a team that’s eager to create, innovate and make an impact on the world? Read on.

Enterprise Technology & Services (ETS) delivers shared technology services for Morgan Stanley supporting all business applications and end users. ETS provides capabilities for all stages of Morgan Stanley's software development lifecycle, enabling productive coding, functional and integration testing, application releases, and ongoing monitoring and support for over 3,000 production applications. ETS also delivers all workplace technologies (desktop, mobile, voice, video, productivity, intranet/internet) in integrated configurations that boost the personal productivity of employees. Application and end user functions are delivered on a scalable, secure, and reliable infrastructure composed of seamlessly integrated datacenter, network, compute, cloud, storage, and database functions.

What you’ll do in the role:

• Design, develop, and deploy Gen AI-powered search features leveraging OpenAI models (e.g., GPT-3, GPT-4, embeddings) and Lucidworks Fusion. 

• Integrate and fine-tune large language models (LLMs) with Fusion's search pipelines to enhance query understanding, semantic search, summarization, question answering, and content generation. 

• Develop and implement strategies for indexing, retrieving, and ranking information optimized for Gen AI applications within the Fusion environment. 

• Build robust and scalable APIs and microservices to connect Gen AI models with the Fusion platform. 

• Collaborate with data scientists, search architects, and product managers to define requirements and deliver innovative search solutions. 

• Experiment with different Gen AI techniques and evaluate their effectiveness in improving search relevance and user experience. 

• Monitor and analyze the performance of Gen AI-enhanced search features, identifying areas for optimization and improvement. 

• Stay up-to-date with the latest advancements in Generative AI, natural language processing (NLP), and search technologies. 

• Contribute to the development of best practices and documentation for Gen AI integration within the search architecture. 

• Troubleshoot and resolve technical issues related to Gen AI and Fusion integration 

What you’ll bring to the role:

• Bachelor's or higher degree in Computer Science, Engineering, or a related field. 

• Proven experience (typically 5+ years) in search engineering or a related software development

• 2+ years of Programming experience preferably using Python.

• Strong understanding of search engine principles, information retrieval, and relevance ranking. 

• Hands-on experience working with Lucidworks Fusion, including pipeline development, query processing, and analytics. 

• Significant experience working with OpenAI APIs and models (e.g., completions, embeddings, fine-tuning). 

• Solid programming skills in languages such as Python and Java. 

• Experience with NLP techniques and libraries (e.g., NLTK, spaCy, Transformers). 

• Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and containerization technologies (e.g., Docker, Kubernetes). 

• Excellent problem-solving, analytical, and communication skills. 

• Ability to work independently and collaboratively in a fast-paced environment. 

Preferred Qualifications: 

• Experience with other enterprise search platforms (e.g., Elasticsearch, Solr). 

• Knowledge of vector databases and similarity search techniques. 

• Experience with MLOps practices for deploying and monitoring AI models. 

• Contributions to open-source projects in the search or NLP domains. 

• Familiarity with agile development methodologies.

WHAT YOU CAN EXPECT FROM MORGAN STANLEY:

We are committed to maintaining the first-class service and high standard of excellence that have defined Morgan Stanley for over 89 years. Our values - putting clients first, doing the right thing, leading with exceptional ideas, committing to diversity and inclusion, and giving back - aren’t just beliefs, they guide the decisions we make every day to do what's best for our clients, communities and more than 80,000 employees in 1,200 offices across 42 countries. At Morgan Stanley, you’ll find an opportunity to work alongside the best and the brightest, in an environment where you are supported and empowered. Our teams are relentless collaborators and creative thinkers, fueled by their diverse backgrounds and experiences. We are proud to support our employees and their families at every point along their work-life journey, offering some of the most attractive and comprehensive employee benefits and perks in the industry. There’s also ample opportunity to move about the business for those who show passion and grit in their work.

Salary range for the position: $99,000 - $156,000 per year. The successful candidate may be eligible for an annual discretionary incentive compensation award. The successful candidate may be eligible to participate in the relevant business unit’s incentive compensation plan, which also may include a discretionary bonus
component. Morgan Stanley offers a full spectrum of benefits, including Medical, Prescription Drug, Dental, Vision, Health Savings Account, Dependent Day Care Savings Account, Life Insurance, Disability and Other Insurance Plans, Paid Time Off (including Sick Leave consistent with state and local law, Parental Leave and 20 Vacation Days annually), 10 Paid Holidays, 401(k), and Short/Long Term Disability, in addition to other special perks reserved for our employees. Please visit mybenefits.morganstanley.com to learn more about our benefit offerings.

Morgan Stanley's goal is to build and maintain a workforce that is diverse in experience and background but uniform in reflecting our standards of integrity and excellence. Consequently, our recruiting efforts reflect our desire to attract and retain the best and brightest from all talent pools. We want to be the first choice for prospective employees.

It is the policy of the Firm to ensure equal employment opportunity without discrimination or harassment on the basis of race, color, religion, creed, age, sex, sex stereotype, gender, gender identity or expression, transgender, sexual orientation, national origin, citizenship, disability, marital and civil partnership/union status, pregnancy, veteran or military service status, genetic information, or any other characteristic protected by law.

Morgan Stanley is an equal opportunity employer committed to diversifying its workforce (M/F/Disability/Vet).