Machine Learning Engineer - Evaluation
Tasks
- Audit evaluation for bias
- Build LLM powered evaluation pipelines
- Build RAG pipelines
- Build model fine tuning workflows
- Define evaluation benchmarking infrastructure
- Design and run evaluation experiments
- Detect evaluation drift and regressions
- Own evaluation methodology end to end
- Translate model behavior into product outcomes
Perks/Benefits
Skills/Tech-stack
Benchmarking | Bias detection | Evaluation methodology | Experiment design | Fine Tuning | LLM Evaluation | Language Models | Large Language Models | Machine Learning | Prompt engineering | RAG
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Senior Customer Success Engineer, North USD 144K-152KData Science | Databricks | Dataiku | Enterprise analytics | Generative AI401k company match | Commuter benefits | Dental insurance | Employer paid disability coverage | Flexible spending accountsSenior-level Full TimeUnited States, Remote R11h ago
-
Senior AI Engineer - Grafana Ops, AI/ML | USA | Remote USD 154K-185KAWS | Agent Frameworks | Agent workflows | Azure | Cloud Computing100 percent remote | Bonus | Company funded AI coding assistant usage budget | Equity | Global annual leave policySenior-level Full TimeUnited States (Remote) R15h ago
-
Data Engineer (remote) USD 85K-100KAgile | Apache Spark | Artificial Intelligence | Azure Data | Azure Data Factory401k match | Employee assistance program | Flexible schedule | Health insurance | Paid parental leaveMid-level Full TimeWork From Home, United States R16h ago
-
AI/ML Engineer USD 110K-165KAgile | Apache Spark | DevOps | Git | Machine Learning401k match | Dental insurance | Education & training benefits | Health insurance | Paid HolidaysMid-level Full TimeTampa, Hanscom, Colorado Springs, San Diego, … R18h ago
-
AI | Accelerated computing | Competitive Analysis | Content development | Data centerCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional developmentSenior-level Full TimeWashington R1d ago
-
Accelerated computing | Artificial Intelligence | Competitive Analysis | Content development | Cross-Functional CollaborationCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional development opportunitiesSenior-level Full TimePennsylvania R1d ago
-
Accelerated computing | Artificial Intelligence | Competitive Analysis | Data center | Data center architectureCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional development opportunitiesSenior-level Full TimeMichigan R1d ago
-
AI Inference | Accelerated computing | Competitive Analysis | Cross-Functional Collaboration | Cross-functionalCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional development opportunitiesSenior-level Full TimeMassachusetts R1d ago
-
AI Inference | Accelerated computing | Competitive Analysis | Data center | Data center architectureCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional developmentSenior-level Full TimeMaryland R1d ago
-
AI | Accelerated computing | Competitive Analysis | Data Science | Data centerCollaborative innovative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional development opportunitiesSenior-level Full TimeIllinois R1d ago
-
Accelerated computing | Artificial Intelligence | Competitive Analysis | Data center | Data center architectureCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional development opportunitiesSenior-level Full TimeFlorida R1d ago
-
AI Inference | Accelerated computing | Artificial Intelligence | Competitive Analysis | Data centerCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional developmentSenior-level Full TimeConnecticut R1d ago
-
AI Inference | Accelerated computing | Competitive Analysis | Content development | Cross-Functional CollaborationCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional development opportunitiesSenior-level Full TimeCalifornia R1d ago
-
Senior AI and LLM Engineer USD 184K-356KData-driven | Data-driven metrics | Deep learning | Generative AI | Language ModelsEquity | Hybrid workSenior-level Full TimeUS, CA, Remote, United States R1d ago
-
AI/ML Engineer (Senior Associate) - Remote USD 130K-188KAPI Development | AWS | Autogen | Azure | CI/CDDental insurance | Medical insurance | Remote work | Travel as needed | Vision insuranceSenior-level Full TimeChicago - 550 Van Buren, United … R1d ago
-
Senior-level Full TimeSan Francisco, United States R1d ago
-
Principal Machine Learning Engineer USD 245K-393KCloud infrastructure | Data Science | Distributed Systems | Infrastructure as Code | ML pipelinesSenior-level Full TimeChicago, Illinois, USA R1d ago
-
Sr Sales Engineer, West USD 160K-196KAnalytics | Apache Spark | Artificial Intelligence | Dataiku | Kubernetes401k match | Dental insurance | Employer paid disability coverage | Flexible spending accounts | Medical insuranceSenior-level Full TimeUnited States, Remote R1d ago
-
AI Engineer USD 53K-119KAPI Design | Cost Optimization | Embeddings | Evaluation | JSONDental insurance | Gym stipend | Health insurance | Medical membership | Offsite retreatsSenior-level Full TimeRemote, US R1d ago
-
Android Development | C Sharp | C plus plus | C# | Command LineMid-level Full TimeMountain View, CA, US; Redmond, WA, … R1d ago
-
Senior Machine Learning Engineer, Operations Research USD 173K-218KCombinatorial Optimization | Deep learning | Keras | Machine Learning | Mathematical ProgrammingAnnual refresh grants | Equity grant | Flexible work policy | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Engineer, Chakra USD 120K-235KAgentic AI | Benchmarking | Conversational AI | Data Pipelines | Deep learningMid-level Full TimeHybrid in Santa Clara, CA R1d ago
-
Machine Learning & Game Tech Architect USD 186K-257KAPI Design | C# | C++ | Game engines | Go401k matching | Dental insurance | Flexible schedule | Flexible working hours | Health insuranceSenior-level Full TimeBoston, MA, United States R1d ago
-
Machine Learning PhDs - AI Trainer USD 36K-40KComputational Methods | Information Retrieval | Machine Learning | Optimization | Probabilistic methodsFlexible schedule | Fully remoteEntry-level Full TimeRemote (USA) R1d ago
-
Machine Learning Engineer, Integrity USD 120K-235KAdversarial Machine Learning | Anomaly Detection | Audio analysis | Behavioral analytics | BenchmarkingMid-level Full TimeHybrid in Santa Clara, CA R1d ago