Research Engineer, Large Behavior Models - Computer Vision
Los Altos, CA
Full Time Senior-level / Expert USD 152K - 228K
Toyota Research Institute
If our mission of revolutionizing robot learning through simulation and large behavior models resonates with you, we’d love to talk about how we can build it together.
Responsibilities
- Develop and manage physics-based robot simulation environments using Drake, enabling scalable training and evaluation of learning-based behavior models in realistic, physically grounded scenarios.
- Integrate and validate learned policies in simulation, assessing real-world applicability, generalization, and performance across diverse environments, tasks, geometries, and sensor viewpoints.
- Build, improve, and robustify end-to-end integrated ML pipelines for training multimodal (language, images, 3D, video, actions) models at scale.
- Train, fine-tune, and serve robot foundation models with a strong MLOps approach.
- Build processes for integrating collaboration-produced and open-source advancements and code into our internal stack.
- Collaborate with internal research scientists and our partner labs at top academic institutions and Toyota research labs to drive groundbreaking research at scale.
Qualifications
- 2+ years of professional engineering experience at an AI/ML-focused organization.
- Strong proficiency in Python and experience with simulation frameworks such as Drake, PyBullet, MuJoCo, or similar.
- Hands-on experience with robotics simulation, reinforcement learning, or large-scale machine learning.
- Familiarity with the latest methods in behavior learning and/or computer vision.
- Experience integrating ML models into simulated or real-world environments.
- Extensive practical experience with PyTorch.
- Ability to alternate between rapid prototyping and production-quality implementation.
- Demonstrated understanding of software engineering best practices, including testing, CI/CD, and documentation.
Bonus Qualifications
- Experience deploying models on embodied systems/robots.
- Experience working in mixed teams of research scientists and engineers.
- Exposure to MLOps tools and infrastructure (e.g., Docker, EC2, S3, Sagemaker).
- Experience with Bazel.
Please reference this Candidate Privacy Notice to inform you of the categories of personal information that we collect from individuals who inquire about and/or apply to work for Toyota Research Institute, Inc. or its subsidiaries, including Toyota A.I. Ventures GP, L.P., and the purposes for which we use such personal information.
TRI is fueled by a diverse and inclusive community of people with unique backgrounds, education and life experiences. We are dedicated to fostering an innovative and collaborative environment by living the values that are an essential part of our culture. We believe diversity makes us stronger and are proud to provide Equal Employment Opportunity for all, without regard to an applicant’s race, color, creed, gender, gender identity or expression, sexual orientation, national origin, age, physical or mental disability, medical condition, religion, marital status, genetic information, veteran status, or any other status protected under federal, state or local laws.
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records for employment.
Tags: Bazel CI/CD Computer Vision Docker EC2 Engineering Machine Learning ML models MLOps Open Source Physics Pipelines Privacy Prototyping Python PyTorch Reinforcement Learning Research Robotics SageMaker Testing
Perks/benefits: Career development Flex vacation Medical leave Parental leave Salary bonus
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.