Software Engineer, Systems ML - GenAI Evals Platform
Bellevue, WA | Menlo Park, CA | New York, NY
Meta
Giving people the power to build community and bring the world closer together
We are aiming to make Llama 4 the leading SoTA model and Meta AI the leading assistant in the world by the end of 2025. None of these goals would be possible without a robust set of evals and a highly reliable and performant platform backing them.
On the GenAI Evals Platform team, you will be helping build a state-of-the-art platform that enables:
- Intuitive authoring/maintenance of complex evals and judges for multi-modal, agentic and reasoning use cases
- Reliable, efficient and automated execution of evals at scale over a fleet of GPUs/CPUs
- Seamless eval reporting, analysis and debuggingSoftware Engineer, Systems ML - GenAI Evals Platform Responsibilities
$70.67/hour to $208,000/year + bonus + equity + benefits
Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.
Equal Employment Opportunity Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.
Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.
On the GenAI Evals Platform team, you will be helping build a state-of-the-art platform that enables:
- Intuitive authoring/maintenance of complex evals and judges for multi-modal, agentic and reasoning use cases
- Reliable, efficient and automated execution of evals at scale over a fleet of GPUs/CPUs
- Seamless eval reporting, analysis and debuggingSoftware Engineer, Systems ML - GenAI Evals Platform Responsibilities
- Design methods, tools, and infrastructure to push forward the state of the art in evaluating large language models.
- Collaborate with AI research scientists to accelerate the next generation of Generative AI models by facilitating development of novel evals and judges
- Optimize GPU / CPU utilization to maximize efficiency and speed of running evals
- Hold a high bar in engineering quality with a focus on reliability, scalability and user experience
- Work with a large and globally distributed team.
- Contribute to publications and open-sourcing efforts.
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
- Programming experience in Python and hands-on experience with frameworks such as PyTorch
- Experience with architectural patterns of large scale software applications, especially in the ML Systems domain
- Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment
- A Bachelor's degree in Computer Science, Computer Engineering, relevant technical field and 6+ years of experience in AI framework development OR a Master's degree in Computer Science, Computer Engineering, relevant technical field and 4+ years of experience in AI framework development OR a PhD in Computer Science Computer Engineering, or relevant technical field and 3+ years of experience in AI framework development
- Direct experience with Generative AI and LLMs
- Proven track record of execution in a dynamic environment, preferably on AI/ML infra projects
- Knowledge of GPU, CPU, or AI hardware accelerators
- Experience in system performance optimizations such as runtime analysis of latency, memory bandwidth, I/O access, compute utilization analysis and associated tooling development
$70.67/hour to $208,000/year + bonus + equity + benefits
Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.
Equal Employment Opportunity Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.
Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.
Job stats:
3
1
0
Tags: Computer Science Engineering Generative AI GPU LLaMA LLMs Machine Learning PhD Physics Python PyTorch Research VR
Perks/benefits: Career development Equity / stock options Health care Salary bonus
Region:
North America
Country:
United States
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
BI Developer jobsData Engineer II jobsStaff Data Scientist jobsSr. Data Engineer jobsPrincipal Data Engineer jobsBusiness Intelligence Analyst jobsStaff Machine Learning Engineer jobsPrincipal Software Engineer jobsData Science Manager jobsData Manager jobsData Science Intern jobsSoftware Engineer II jobsJunior Data Analyst jobsDevOps Engineer jobsData Analyst Intern jobsData Specialist jobsBusiness Data Analyst jobsSr. Data Scientist jobsLead Data Analyst jobsStaff Software Engineer jobsAI/ML Engineer jobsResearch Scientist jobsSenior Backend Engineer jobsData Engineer III jobsBI Analyst jobs
NLP jobsAirflow jobsOpen Source jobsEconomics jobsMLOps jobsTerraform jobsKPIs jobsKafka jobsLinux jobsNoSQL jobsJavaScript jobsComputer Vision jobsData Warehousing jobsGoogle Cloud jobsPhysics jobsRDBMS jobsPostgreSQL jobsGitHub jobsScikit-learn jobsBanking jobsHadoop jobsScala jobsStreaming jobsData warehouse jobsR&D jobs
Pandas jobsdbt jobsBigQuery jobsOracle jobsClassification jobsLooker jobsCX jobsReact jobsDistributed Systems jobsScrum jobsRAG jobsPySpark jobsRedshift jobsELT jobsRobotics jobsJira jobsPrompt engineering jobsMicroservices jobsIndustrial jobsGPT jobsSAS jobsTypeScript jobsNumPy jobsMySQL jobsModel training jobs