Manager Data Science, Generative AI - Hybrid

8901 - Corp Office West Crk - 12800 Tuckahoe Creek Parkway, Richmond, Virginia, 23238

CarMax, the way your career should be! 

Data Science Manager - Generative AI 

  

About this Job 

As a Data Science Manager on the Generative AI team you'll have the opportunity to shape the way that CarMax uses generative AI to create value across the company.  The pace of innovation in the AI space today means that keeping up with the industry innovation and ensuring it can be applied effectively across the enterprise is a complex and critical role for us. 

  

In this role you will: 

• Research, design, and implement evaluation methods for generative AI applications.  Our primary focus today is on language understanding and generation, primarily with AI chatbot assistants but also with summarization, ticket routing, and other use cases.  This includes both automated evaluation methods (LLM as judge) as well as systematic approaches to manual review and monitoring. 

• Research, design, and implementation of search methods including vector databases and semantic search algorithms , and associated performance evaluation methods.  Our primary focus in this space today is powering a knowledge base search system that powers a RAG pipeline for our AI assistant chatbots. 

• Research methods for the advanced use of LLMs, e.g. fine tuning, custom training of open source models, and evaluation/comparison of available foundation and open source models.  While we are not heavily focusing our efforts in this space today, it's important that we keep up with industry trends and maintain a perspective on how CarMax can make the best use of current technology. 

• Keep up to date on industry trends in technology products and third party solutions, provide a perspective on where CarMax should consider investing, and occasionally conduct technology evaluations. 

  

Qualifications and Requirements:

• Advanced Degree (Master’s/Ph.D.) in quantitative discipline (AI, Machine Learning, Statistics, Math, Data Science, Computer Science) is preferred 

• 3+ years of experience in the following areas: 

• Python development 

• Data mining, machine learning, statistical modeling tools and underlying algorithms 

• Data Lake and cloud computing fundamentals 

• Strong analytical curiosity and passion for applying advanced modeling techniques in problem solving 

• Sound analytical thinker with a proven track record of providing actionable insights and clear strategic direction 

• Ability to convey complex, technical subject matter in a clear and straightforward manner; demonstrated ability to effectively communicate through written and oral presentations with all levels of the organization 

• Solid project management skills with the ability to juggle multiple priorities simultaneously in a fast-paced environment     

  

Preferred Experience 

• Research and development experience with AI, data science or other scientific / technology methods, exploring the practical application of emerging methods 

• Applied NLP to analyze and work with text data at scale 

• Experience working with LLM's and the application of generative AI to drive practical business value 

• Python development and cloud engineering, specifically working a production quality code base to test new features and contribute usable code 

• Chatbot design, development and evaluation are a plus 

 

Work Location and Arrangement: This role will be based out of the either the Richmond, VA Home Office, the Dallas, TX Technology Hub or the Atlanta, GA CarMax Auto Finance Office and has a Hybrid work arrangement in office 2 days a week.

Work Authorization:  Applicants must be currently authorized to work in the United States on a full-time basis. Sponsorship will not be considered for this specific role.  

About CarMax

CarMax disrupted the auto industry by delivering the honest, transparent and high-integrity experience customers want and deserve. This innovative thinking around the way cars are bought and sold has helped us become the nation’s largest retailer of used cars, with over 200 locations nationwide.

Our amazing team of more than 25,000 associates work together to deliver iconic customer experiences. Along the way, we help every associate grow their career and achieve their best, at work and in their community.  We are recognized for our commitment to training and diversity and are one of the FORTUNE 100 Best Companies to Work For®.

CarMax is an equal opportunity employer, and all qualified candidates will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, genetic information, national origin, protected veteran status, disability status, or any other characteristic protected by law.

Upon an applicant's request, CarMax will consider reasonable accommodation to complete the CarMax Job Application.