Research Engineer - Embedded AI

The Audio team within RL Research is looking for a Researcher Engineer with expertise in efficient multimodal machine learning and embedded systems to join our team. You will be building technologies that improve the listener's hearing under challenging listening conditions using wearable computing. We are looking for expertise in building efficient representation models using audio, visual and speech signals; bridge and integrate AI models with conversational context and domain understanding. You will operate at the intersection of large-scale machine learning systems design and development, and egocentric audio-visual learning and computer vision, and partnering with experts in systems processing; and hardware/software co-design.Research Engineer - Embedded AI Responsibilities

• Work with AI researchers and audio/acoustics domain experts on designing and building novel low-compute, low-power ML and CV for egocentric audio-visual learning
• Lead the implementation, benchmarking, and optimization of ML models running on edge devices
• Support quick prototyping, proof of concept, or proof-of-experience and demonstrations via the real-time integration of ML and CV models into research & development platforms for wearables.
• Develop and maintain technical documentation for AI model implementation and optimization

Minimum Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
• Familiarity with SoC Architecture: System-level understanding of data flows and memory management, including simulation of HW components and functions such as NPU, GPU, CPUs and DSPs.
• 3+ years of experience in developing, implementing, and optimizing real-time AI models on edge devices
• Demonstrated experience of common AI engines on camera and System-on-Chip (SoC)
• Familiarity with relevant tools such as ExecuTorch, TensorFlow Lite, or similar frameworks
• Demonstrated experience in programming skills in C++, Python, or other relevant languages
• Experience with cross-group and cross-discipline collaboration.

Preferred Qualifications

• Master’s Degree in Computer Sciences, Computer Engineering, Deep Learning, Artificial Intelligence, Machine Learning, Robotics, Computer Vision, Computational Neuroscience, Signal Processing, Speech and Language technologies, or a related field, or equivalent practical experience.
• 3+ years of experience working on efficient machine learning or computer vision algorithms.
• Experience with end-to-end real-time ML pipelines, large-scale ML benchmarking, real-time statistical modeling including heuristics driven computer vision methods.
• Experience working on evaluation and benchmarking for vision based LLamas, or related generative AI models
• Experience working with datasets on preprocessing methods, dataloaders, data tooling and related software engineering platforms.
• Experience with large-scale or distributed cluster computing for training, development and offline inference of machine learning models.
• Experience working and communicating cross functionally in a team environment.
• Experience solving complex problems and comparing alternative solutions, tradeoffs, and broad points of view to determine a path forward.
• Proven track record of achieving significant results as demonstrated by project launch, research grants, fellowships, patents, as well as publications at leading workshops, journals or conferences such as ACL, NeurIPS, ICLR, EMNLP, CVPR, ICCV, ICML, ECCV, ICASSP, InterSpeech, or similar.

For those who live in or expect to work from California if hired for this position, please click here for additional information. About Meta Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.
$147,000/year to $208,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Equal Employment Opportunity Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.
Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.