Machine Learning Engineer - Evaluation
Tasks
- Audit evaluation for bias
- Build LLM powered evaluation pipelines
- Build RAG pipelines
- Build model fine tuning workflows
- Define evaluation benchmarking infrastructure
- Design and run evaluation experiments
- Detect evaluation drift and regressions
- Own evaluation methodology end to end
- Translate model behavior into product outcomes
Perks/Benefits
Skills/Tech-stack
Benchmarking | Bias detection | Evaluation methodology | Experiment design | Fine Tuning | LLM Evaluation | Language Models | Large Language Models | Machine Learning | Prompt engineering | RAG
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Data Platform Engineer USD 235K-376KCI/CD | Data Contracts | Data Modeling | Data Products | Data pipelineCell phone reimbursement | Health/Dental/Vision | Learning & development stipend | Mental Health & Wellness | PTOMid-level Full TimeSan Francisco, CA • New York, … R11h ago
-
Senior Software AI Engineer USD 149K-186K.NET | AWS | Agentic Systems | Cloud Computing | Code review401k match | Commuter benefits | Fertility and Family Planning Programs | Fitness benefits | Health insuranceSenior-level Full TimeRemote US R11h ago
-
Senior Customer Success Engineer, North USD 144K-152KData Science | Databricks | Dataiku | Enterprise analytics | Generative AI401k company match | Commuter benefits | Dental insurance | Employer paid disability coverage | Flexible spending accountsSenior-level Full TimeUnited States, Remote R13h ago
-
Forward Deployed AI Product Engineer USD 155K-210KAI Agents | APIs | AWS | Azure | CI/CDAutonomy | Flexible work environment | On site client collaboration | Remote-first culture | Travel opportunitiesSenior-level Full TimeUS-Remote R13h ago
-
Senior Machine Learning Engineer, Payments USD 191K-223KAirflow | Cost monitoring | Deep learning | Drift monitoring | Fine TuningSenior-level Full TimeRemote-USA R16h ago
-
Senior Solutions Engineer, Media & Entertainment USD 165K-216KAnalytics | Cloud Computing | Data Warehouse | ETL | Machine LearningSenior-level Full TimeUS-NY-New York City-Remote R16h ago
-
Senior AI Engineer - Grafana Ops, AI/ML | USA | Remote USD 154K-185KAWS | Agent Frameworks | Agent workflows | Azure | Cloud Computing100 percent remote | Bonus | Company funded AI coding assistant usage budget | Equity | Global annual leave policySenior-level Full TimeUnited States (Remote) R16h ago
-
Data Engineer (remote) USD 85K-100KAgile | Apache Spark | Artificial Intelligence | Azure Data | Azure Data Factory401k match | Employee assistance program | Flexible schedule | Health insurance | Paid parental leaveMid-level Full TimeWork From Home, United States R17h ago
-
AI/ML Engineer USD 110K-165KAgile | Apache Spark | DevOps | Git | Machine Learning401k match | Dental insurance | Education & training benefits | Health insurance | Paid HolidaysMid-level Full TimeTampa, Hanscom, Colorado Springs, San Diego, … R19h ago
-
AI | Accelerated computing | Competitive Analysis | Content development | Data centerCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional developmentSenior-level Full TimeWashington R1d ago
-
Accelerated computing | Artificial Intelligence | Competitive Analysis | Content development | Cross-Functional CollaborationCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional development opportunitiesSenior-level Full TimePennsylvania R1d ago
-
Accelerated computing | Artificial Intelligence | Competitive Analysis | Data center | Data center architectureCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional development opportunitiesSenior-level Full TimeMichigan R1d ago
-
AI Inference | Accelerated computing | Competitive Analysis | Cross-Functional Collaboration | Cross-functionalCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional development opportunitiesSenior-level Full TimeMassachusetts R1d ago
-
AI Inference | Accelerated computing | Competitive Analysis | Data center | Data center architectureCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional developmentSenior-level Full TimeMaryland R1d ago
-
AI | Accelerated computing | Competitive Analysis | Data Science | Data centerCollaborative innovative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional development opportunitiesSenior-level Full TimeIllinois R1d ago
-
Accelerated computing | Artificial Intelligence | Competitive Analysis | Data center | Data center architectureCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional development opportunitiesSenior-level Full TimeFlorida R1d ago
-
AI Inference | Accelerated computing | Artificial Intelligence | Competitive Analysis | Data centerCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional developmentSenior-level Full TimeConnecticut R1d ago
-
AI Inference | Accelerated computing | Competitive Analysis | Content development | Cross-Functional CollaborationCollaborative work environment | Comprehensive benefits package | Equity opportunities | Flexible work arrangements | Professional development opportunitiesSenior-level Full TimeCalifornia R1d ago
-
Senior AI and LLM Engineer USD 184K-356KData-driven | Data-driven metrics | Deep learning | Generative AI | Language ModelsEquity | Hybrid workSenior-level Full TimeUS, CA, Remote, United States R1d ago
-
AI/ML Engineer (Senior Associate) - Remote USD 130K-188KAPI Development | AWS | Autogen | Azure | CI/CDDental insurance | Medical insurance | Remote work | Travel as needed | Vision insuranceSenior-level Full TimeChicago - 550 Van Buren, United … R1d ago
-
Senior-level Full TimeSan Francisco, United States R1d ago
-
Senior Software Engineer (Hybrid) - 28172 USD 165K-240KAWS | Anthropic API | Azure | Function Calling | Git401k benefit | Education/training allowances | Generous PTO | Hybrid work flexibility | Paid HolidaysSenior-level Full TimeColumbia, MD, Maryland, United States R1d ago
-
Junior Software Engineer (Hybrid) - 28171 USD 90K-120KAI Observability | API Design | AWS | Agile | Anthropic401k matching | Dental insurance | Education/training allowances | Health insurance premium paid | Hybrid work environmentEntry-level Full TimeColumbia, MD, Maryland, United States R1d ago
-
Principal Machine Learning Engineer USD 245K-393KCloud infrastructure | Data Science | Distributed Systems | Infrastructure as Code | ML pipelinesSenior-level Full TimeChicago, Illinois, USA R1d ago
-
Sr Sales Engineer, West USD 160K-196KAnalytics | Apache Spark | Artificial Intelligence | Dataiku | Kubernetes401k match | Dental insurance | Employer paid disability coverage | Flexible spending accounts | Medical insuranceSenior-level Full TimeUnited States, Remote R1d ago