Research Engineer - Machine Learning for Behavioral AI

Meta’s Reality Labs Research (RL-R) brings together a world-class team of researchers, developers, and engineers to create the future of Mixed Reality (MR), Augmented Reality (AR), and Wearable Artificial Intelligence (AI). Within RL-R, the ACE team solves complex challenges in behavioral inference from sparse information. We leverage multimodal, egocentric data and cutting edge machine learning to deliver robust, efficient models that serve everyone. Our research provides core building blocks to unlock comfortable, intuitive, and helpful Wearable AI, empowering everyone to harness the superpowers of this emerging technology in their daily lives. We are looking for an AI ML engineer to join us in this initiative.

In this role, you will work closely with Research Scientists and Engineers from across RL-R to develop novel state-of-the-art AI algorithms to infer human behavior patterns, with an emphasis on those that inform attention, cognition or emotion. Examples include longitudinal gaze behaviors, gestures, or vocal cues. You will develop end-to-end wearable AI experiential validation platforms using cutting edge generative AI and language models to validate the impact of these signals. Further, you will work with system engineers to optimize these models for efficiency and latency in constrained compute platforms. You will learn constantly, dive into new areas with unfamiliar technologies, and embrace the ambiguity of AR, VR, and AI problem solving.

Together, we are going to build cutting-edge prototypes, technologies, and toolsets that can define a paradigm shift in how we interact with our surroundings. We invite you to step into the adventure of a lifetime, as we make science fiction real and change the world.Research Engineer - Machine Learning for Behavioral AI Responsibilities

• Using data from wearable devices, employ state-of-the-art AI algorithms to infer human behavior patterns that inform attention, cognition or emotion. Examples include longitudinal gaze behaviors, gestures, or vocal cues.
• Develop data collection strategies, benchmarks, and metrics to validate and improve efficiency, scalability, and stability of these models.
• Collaborate with researchers and engineers across diverse disciplines through all stages of project development to identify gaps, build solutions, and transfer technology
• Contribute to research that can eventually be applied to Meta products and services and run on billions of media items every day
• Create tools, infrastructure, and documentation to accelerate research
• Perform code reviews that improve software engineering quality
• Learn constantly, dive into new areas with unfamiliar technologies, and embrace the ambiguity of AR/VR problem solving

Minimum Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• Bachelor’s degree plus 5+ years experience or a PhD degree in Computer Science or other relevant technical field plus 2+ years experience, or equivalent practical experience
• Experience with Python
• Experience with a common machine learning framework (preferably PyTorch)
• Experience with ML computer vision
• Experience developing, maintaining and improving (accuracy, speed, compute costs) complex ML systems

Preferred Qualifications

• Experience with multimodal sensing platforms, multimodal signal processing and analysis, and converting raw sensor streams into robust models solving complex tasks
• Experience with Multimodal Deep Learning approaches and research
• Experience with Large Language Models
• Experience with C++
• Experience with non-Machine Learning computer vision, especially with OpenCV
• Experience with 3D engines such as Unreal or Unity
• Experience working in Augmented Reality or Virtual Reality
• Experience developing software in a research environment

For those who live in or expect to work from California if hired for this position, please click here for additional information. About Meta Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.
$70.67/hour to $208,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Equal Employment Opportunity Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.
Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.