Robotics ML/CV Research Scientist, Reality Labs Research
Redmond, WA | Burlingame, CA
Meta
Giving people the power to build community and bring the world closer togetherWe are looking for a Research Scientist with expertise in multimodal ML and CV and experience in robotics applications to join our team within Reality Labs Research. You will work on advancing the state of the art for hand-centric foundation models for dexterous manipulation by leveraging groundbreaking advances in tools for human and robot data collection. You will work with a broad and highly interdisciplinary team of researchers, engineers, and designers, and will have access to cutting edge technology, resources, and testing facilities.Robotics ML/CV Research Scientist, Reality Labs Research Responsibilities
- Develop machine learning and computer vision models for applications such as robotics, dexterous manipulation, hand pose estimation, object detection, contextual understanding, and gesture recognition
- Design and implement ML pipelines and systems that collect and process datasets and enable algorithm experimentation
- Develop experimental protocols for human-subjects research and collaborate across an interdisciplinary team to collect multimodal datasets from prototype wearable sensing systems
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
- Ph.D. in Artificial Intelligence, Robotics, Computer science, relevant technical field, or equivalent practical experience
- 5+ years experience in advanced ML techniques such as representation learning, self-supervised learning, cross-embodiment, multimodal learning, vision-language-action (VLA) models, reinforcement learning, imitation learning, LLMs, and/or robotics policy development
- 5+ years experience with deep learning frameworks (e.g., PyTorch, TensorFlow) and programming in Python
- 2+ years experience in robotics-related research areas
- Experience manipulating and analyzing complex, large scale, high-dimensionality multimodal data from varying sources
- A track record of research output with work published in top conferences and journals such as Robotics (RSS, ICRA, IROS, CoRL, T-RO, IJRR), Machine Learning (NeurIPS, ICML, ICLR, AAAI, JMLR), and Computer Vision (CVPR, ICCV, ECCV, TPAMI)
- Experience designing data collection protocols and constructing high quality machine learning datasets
- Experience bringing-up and debugging prototype/scientific software-hardware systems (e.g., robotics platforms, multi-camera sensing/tracking solutions, wearable sensing systems)
- Experience working and communicating cross-functionally to collaborate across disciplines and organizations
$147,000/year to $208,000/year + bonus + equity + benefits
Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.
Equal Employment Opportunity Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.
Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.
Tags: Computer Science Computer Vision Deep Learning Engineering ICLR ICML JMLR LLMs Machine Learning NeurIPS Physics Pipelines Python PyTorch R Reinforcement Learning Research Robotics TensorFlow Testing VR
Perks/benefits: Career development Conferences Equity / stock options Health care Salary bonus
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.