Senior Machine Learning Engineer, Test Foundations

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. 

At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. 

A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.

As a Senior ML Engineer on the Test Foundations team, you will serve as a pivotal technical contributor, leveraging advanced ML models and MLLMs to spearhead the research, design, and implementation of test automation tools and systems. These efforts will support the expeditious, frequent, and high-quality release of products. Responsibilities:

• Customize innovative AI solutions for our Test Automation systems, bridging the gap between general-purpose LLMs and the specialized requirements of Test Automation, encompassing areas from test case generation to intelligent reporting.
• Implement scalable AI/ML solutions for the automated testing of the Roblox App across all supported platforms, including mobile, desktop, console, and VR.
• Identify existing workflow and system inefficiencies that could benefit from AI integration.
• Drive innovation by exploring state-of-the-art ML research, including multimodal AI, LLMs, Reinforcement Learning, and Generative AI, and applying practical, impactful solutions for Test Automation.
• Provide mentorship to other engineers and contribute to the technical strategy across teams.
• Engage in effective collaboration with cross-functional partners, including engineers, product managers, and researchers throughout Roblox.

Qualifications:

• Hands-On Experience: A minimum of three years of practical experience in designing, building, and deploying complex machine learning models into production environments at scale.
• MLLM Expertise: A robust understanding and practical application of MLLMs and AI systems to resolve challenges in testing and test automation.
• Technical Proficiency: Demonstrated mastery of deep learning frameworks (e.g., PyTorch, TensorFlow) and the ML development lifecycle. Strong programming skills, particularly in Python, are essential.
• Execution Orientation: A proven ability to successfully execute complex technical projects, make critical design decisions, influence technical roadmaps, and guide teams.
• Problem-Solving Mindset: A proactive, results-oriented approach to addressing ambiguous and challenging technical problems.

Preferred Qualifications:

• Experience in leveraging ML and AI models for automation and multi-platform testing.
• Experience in constructing and working with robust, cross-platform test automation frameworks.

For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual salary could fall outside of this expected range. This pay range is subject to change and may be modified in the future. All full-time employees are also eligible for equity compensation and for benefits as described on this page.

Annual Salary Range$192,890—$238,520 USD

Roles that are based in our San Mateo, CA Headquarters are in-office Tuesday, Wednesday, and Thursday, with optional in-office on Monday and Friday (unless otherwise noted).

Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations for all candidates during the interview process.