Research Scientist, Media Fusion

At Google DeepMind, we value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunity regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, pregnancy, or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation, please do not hesitate to let us know.

Snapshot

Media Fusion is a project of Google DeepMind (GDM) Generative AI (GenAI), the division of Google bringing Gemini to the world, contributing to teach LLMs to generate fused media like infographics, with application in, health, education, science, and business. Our multidisciplinary team includes research scientists, research engineers, software engineers, UX designers, and game designers. We are uniquely positioned to make a tangible impact on how people interact with information and express themselves.

About us

Artificial Intelligence could be one of humanity’s most useful inventions. At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

The role

The Research Scientist role involves applying scientific expertise to advance GDM's mission. You will work independently on research assignments, conduct literature reviews, evaluate impact, balance immediate needs with long-term goals, and escalate issues as needed, while also leading project segments, using independent judgment and discretion to make decisions and develop new methods.

The ideal candidate will develop new approaches to teach LLMs to explain advanced concepts graphically, and create evaluations to measure performance. They will then contribute to new ventures involving multimodal AI, spanning text, images, audio, and video across various domains. This work involves training and evaluating Gemini, and publishing research.

Key responsibilities

• Develop new approaches to teach LLMs to explain advanced concepts graphically.
• Create new evaluation methods to measure performance.
• Venture in novel research directions  involving multimodal AI, spanning text, images, audio, and video across various domains.
• Train and evaluate new versions of Gemini.
• Publish research.

About you

In order to set you up for success as a Research Scientist at Google DeepMind, we look for the following skills and experience:

• PhD degree in artificial intelligence or related discipline; strong math and machine learning background; expertise in computer vision and  language models. 
• Experience training or fine tuning (vision) language models, text to image diffusion models, or other generative AI models.
• Experience developing and running human evaluations and data collection.
• An interest in how humans will use the new generation of GenAI, human-computer interaction, cognitive science, or user-experience design.

In addition, the following would be an advantage: 

• Strong analytical, problem-solving and critical-thinking skills.
• Ability and desire to work on cross-disciplinary practical problems.
• Strong programming skills; proficiency in Python and Deep Learning frameworks.
• Autonomy to manage individual projects priorities, deadlines and deliverables.
• Good oral and written communication skills.

The US base salary range for this full-time position is between $136,000 - $245,000 + bonus + equity + benefits. Your recruiter can share more about the specific salary range for your targeted location during the hiring process.