Research Scientist, Multi-modal AI

Reality Labs at Meta is building products that make it easier for people to connect with the ones they love most by enabling compelling experiences in novel computing platforms: SmartGlasses and VR headsets . We are a team of world-class experts developing and shipping products pushing the envelope in both AI and compute. The Core-AI team brings together a team of applied Vision-Language researchers and systems ML experts working on a range of foundational problems in perception, vision-language models, generative models and model optimization. We do a mix of fundamental research and technology development. We are seeking researchers with a passion to bring the power of generative vision and language models to resource constrained settings.Research Scientist, Multi-modal AI Responsibilities

• Drive the organization’s goal towards relevant machine learning techniques in the area of multi-modal understanding and generation to build & optimize our intelligent systems that improve Meta’s products and experiences
• Effectively communicate complex features and systems in detail while advocating for higher product quality and engineering efficiency
• Conduct applied research to advance the State of the Art in efficient generative models(Diffusion models, Multi-modal LLMs, Vision Language Action models) and efficient perception models (Scene and Video understanding)
• Apply research to advance Meta's smartglasses and VR product lines.
• Consistently and sustainably advance the state of the art for your problem, including setting and executing against roadmaps for 6-month plus timeframes.
• Collaborate with different cross-functional teams across the globe in research and product.
• Present the outcomes of the research findings as papers in world class conferences in the area.

Minimum Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
• 5+ years of experience leading research projects with industry-wide impact
• Proven development skills in Deep Learning, working with PyTorch or TensorFlow.
• Experience developing deep learning models or infrastructure in Python or C/C++.
• Experience in one or more of the following areas: deep learning, Computer Vision, language models, Machine Learning or artificial intelligence
• First-authored publications at peer-reviewed conferences, e.g. ICLR, ICML, CVPR, ECCV, ICCV, NeurIPS

Preferred Qualifications

• PhD in Computer Science or a related field with published projects in the fields of machine learning, Deep learning with a focus on vision-language models
• Experience solving complex problems and comparing alternative solutions, trade-offs, and different points of view to determine a path forward.
• Experience with CPU/GPU and mobile optimization.

For those who live in or expect to work from California if hired for this position, please click here for additional information. About Meta Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.
$177,000/year to $251,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Equal Employment Opportunity Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.
Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.