Machine Learning Engineer - Evaluation

Hybrid in Santa Clara, CA R

USD 120K-235K Mid-level Full Time

@ H...

Apply Save

Found 1mo ago

Tasks

Audit evaluation for bias
Build LLM powered evaluation pipelines
Build RAG pipelines
Build model fine tuning workflows
Define evaluation benchmarking infrastructure
Design and run evaluation experiments
Detect evaluation drift and regressions
Own evaluation methodology end to end
Translate model behavior into product outcomes

Perks/Benefits

Skills/Tech-stack

Education

N/A

Apply Save

Language: en Views:

0 Clicks:

0 Saves: 0

Related jobs

Machine Learning Engineer USD 131K-178K

AWS | Cassandra | Convolutional Neural Networks | Data Lakes | Data Pipelines

Mid-level Full Time

Remote, NY, US R

14h ago
Software Engineer, Machine Learning USD 213K-293K

API Design | Agent Orchestration | Artificial Intelligence | Bias Mitigation | C++

Senior-level Full Time

Sunnyvale, CA | Remote, US | … R

17h ago
Staff Machine Learning Engineer USD 189K-389K

Calibration | Contextual Bandits | Contextual Decisioning | Data Validation | Embeddings

Equity eligible | In Office 1 Day Per Week

Senior-level Full Time

San Francisco, CA, US; Remote, US R

1d ago
Quantitative Researcher, Global Allocation - Vice President USD 162K-215K

Agile | C++ | Deep learning | Distributed Computing | GPU Computing

Discretionary bonus | Flexible time off | Healthcare | Leave benefits | Retirement benefits

Executive-level Full Time

NY7 - 50 Hudson Yards, New … R

1d ago
Senior Software Engineer, AI USD 171K-210K

Airflow | Amazon Web Services | Apache Hive | Apache Impala | C#

Career development access | Employee resource groups | Flexible WFH | Generous PTO | Internet reimbursement

Senior-level Full Time

US-California-Remote, United States R

1d ago
Senior Software Engineer USD 144K-192K

AWS | Angular | Apache Spark | Azure | Buildah

Career development | Employee resource groups | Flexible WFH | Generous PTO | Paid volunteer time

Senior-level Full Time

US-California-Remote, United States R

1d ago
Edge AI Engineer USD 100K-150K

Benchmarking | Bias Evaluation | C++ | Core ML | DSPs

Senior-level Full Time

United States - Remote R

1d ago
AI Research Engineer (Applied AI) USD 100K-150K

Ablation Studies | Accelerator hardware | Computer Vision | Data Quality | Data labeling

Career growth | Full-time employment | Remote work

Mid-level Full Time

United States - Remote R

1d ago
AI Data Infrastructure Engineer USD 100K-150K

Active Learning | Apache Beam | CI/CD | Code review | Data Governance

Career growth | Health benefits | Remote work

Mid-level Full Time

United States - Remote R

1d ago
LLM Fine-Tuning Engineer USD 100K-150K

Adapter methods | Attention Optimization | DPO | Deep learning | FSDP

Benefits package | Career growth potential | Full-time employment | Remote work | W2 employment

Mid-level Full Time

United States - Remote R

1d ago
Senior Machine Learning Engineer USD 156K-211K

API Development | AWS | Agentic Workflows | CI/CD | Cloud Architecture

Award-winning time-off plans | Comprehensive health, dental, vision coverage | Flexible work models | Life and disability insurance | Retirement and savings plan

Senior-level Full Time

US - California - Thousand Oaks … R

1d ago
AI Performance Optimization Engineer USD 100K-150K

Benchmarking | C++ | CUDA | Compiler optimization | Continuous batching

Career growth | Remote work

Mid-level Full Time

United States - Remote R

1d ago
Prompt Engineering Architect USD 100K-150K

Agentic Systems | Chunking | Cost Optimization | Embeddings | Evaluation Frameworks

100 percent remote | Career growth | Mentorship

Senior-level Full Time

United States - Remote R

1d ago
Software Engineer AI/ML USD 112K-150K

A/B | A/B Testing | AWS | Anomaly Detection | Automated testing

Dental benefits | Employee assistance program | Health Coach | Health benefits | Retirement benefits

Mid-level Full Time

Evendale, United States R

1d ago
Sr. Data Engineer USD 93K-124K

AWS CloudFormation | AWS DMS | AWS Glue | AWS Lambda | AWS X-Ray

401k matching | Adoption Assistance | Dental & vision insurance | Health benefits | Paid parental leave

Senior-level Full Time

Remote, United States R

1d ago
Sr Staff Gen AI Application Engineer USD 174K-210K

API Development | Agentic Workflows | Application Security | CI/CD | Claude Code

Adoption Assistance | Disability insurance | Employee assistance program | Health Coach | HealthAhead programs

Senior-level Full Time

Remote, United States R

1d ago
Staff Backend AI Engineer, Remote USD 140K-215K

API Gateway | AWS CDK | AWS ECS | AWS EKS | AWS Fargate

401k matching | Dental insurance | Flexible time off | Flexible work schedule | Medical insurance

Senior-level Full Time

United States, UNITED STATES, United States R

1d ago
Data Engineer USD 160K-210K

API Integration | AWS | Amazon Kinesis | Artificial Intelligence | CI/CD

Senior-level Full Time

US - Remote R

1d ago
Senior Machine Learning Engineer, Agentic USD 163K-245K

A/B | A/B Testing | B testing | Collaborative Filtering | Content-Based Filtering

401-K matching | Fertility benefits | Health insurance | Life and disability insurance | Mental health benefits

Senior-level Full Time

Bellevue, WA; Menlo Park, CA R

1d ago
Robotics Engineer USD 137K-187K

Benchmarks | Calibration | Computer Vision | Data logging | Data synchronization

Entry-level Full Time

SF Bay Area, CA, Remote, International, … R

1d ago
Senior Solution Engineer USD 165K-216K

APIs | AWS | Apache Airflow | Apache Kafka | Apache Spark

401k | Flexible PTO | Health/Dental/Vision | Professional development budget

Senior-level Full Time

US-TX-Remote R

1d ago
Principal Machine Learning Engineer USD 245K-393K

Distributed Systems | Infrastructure as Code | Lifecycle Management | ML pipelines | Machine Learning

Senior-level Full Time

Chicago, Illinois, USA R

1d ago
Agentic AI Engineer USD 130K-201K

AI Assistant | AI coding | AI coding tools | Automated testing | CI/CD

Senior-level Full Time

Chicago, IL R

1d ago
Senior Software Engineer (Backend) - AI/ML USD 141K-232K

API Design | AWS | Azure | Cloud Computing | Cloud platform

Employer health care contributions | Flexible time off | Global company offsites | Home office setup reimbursement | Remote-friendly

Senior-level Full Time

United States (remote) R

1d ago
Principal AI/ML Researcher / Engineer Reasoning, Planning, and Decision-making systems USD 296K-370K

Agent systems | Belief State Tracking | C++ | Decision Making | Distributed Reinforcement Learning

Senior-level Full Time

United States R

1d ago

Machine Learning Engineer - Evaluation

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs