Machine Learning Research Scientist, Evaluations
San Francisco, CA; Seattle, WA; New York, NY
USD 180K-225K Entry-level Full Time
Tasks
- Analyze model behavior to diagnose failure modes
- Apply post training techniques to connect failures to interventions
- Design and build benchmarks
- Develop evaluation methods
- Publish research findings in AI conferences
Perks/Benefits
- Commuter stipend
- Comprehensive health, dental and vision coverage
- Generous PTO
- Learning and development stipend
- Retirement benefits
Skills/Tech-stack
Benchmark development | Deep learning | Failure analysis | Fine Tuning | Human Feedback | Instruction Tuning | Language Models | Large Language Models | Learning from Human Feedback | Machine Learning | Model Evaluation | Model Fine-tuning | Preference Modeling | Reinforcement Learning | Reinforcement Learning from Human Feedback | Reward Modeling | Supervised Fine Tuning
Education
Regions
Countries
States
Related jobs
-
Senior Machine Learning Engineer USD 149K-224KAIOps | Cloud MLOps | Cloud deployment | Data Analysis | Data Visualization401k match | Career growth opportunities | Dental insurance | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States5h ago
-
Lead Full-Stack Engineer -- Advanced AI USD 132K-238KAPI Design | Agentic Systems | Application Architecture | CI/CD | Code review401k | Dental insurance | Employee discount | Health insurance | Life insuranceSenior-level Full Time7000 Target Pkwy N,NCD-0375 Brooklyn Park,MN … R10h ago
-
C++ | Deep learning | Distributed Training | ETL | GoSenior-level Full TimeMountain View, CALIFORNIA, United States R10h ago
-
AI Engineer, Enablement USD 150K-195KAWS | Agent architecture | Cloud platform | Containers | Debugging401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceMid-level Full TimeNew York, NY R11h ago
-
Staff Machine Learning Engineer, Agent Eval Platform USD 176K-308KAI Feedback | Calibration | Experimentation | Fine Tuning | Human FeedbackRemote work flexibilitySenior-level Full TimeMountain View, CALIFORNIA, United States R11h ago
-
AI Engineer III USD 120K-140KAI ethics | AWS | Agentic AI | Amazon S3 | Apache Airflow401k matching | Employee assistance | Flexible PTO | Life insurance | Medical, dental & vision coverageSenior-level Full TimeSan Antonio, TX, United States12h ago
-
Sr. Solutions Engineer - Games USD 152K-209KAWS | Apache Spark | Azure | Cloud platform | Data EngineeringSenior-level Full TimeNortheast - United States12h ago
-
Machine Learning Engineer USD 155K-194KAWS | Airflow | Anomaly Detection | Apache Flink | Apache SparkMid-level Full TimeRemote - US R13h ago
-
Senior AI/ML Architect, Embodied AI USD 153K-222KC++ | CUDA | Critical Systems | Dagger | Data GovernanceSenior-level Full TimeSunnyvale, CA, United States14h ago
-
Member of Technical Staff (AI Software Engineer, Agents) USD 220K-405KAI Evaluation | Agentic Systems | Browser extensions | Chrome DevTools | Chrome DevTools ProtocolSenior-level Full TimeSan Francisco14h ago
-
AI Agents | Algorithms | Cloud Computing | Containerization | Data Engineering401k plan | Accident insurance | Dental insurance | Flexible spending account | Health savings accountSenior-level Full TimeFort Belvoir, Virginia, United States R15h ago
-
Machine Learning Research Scientist, Post-Training USD 180K-225KDeep learning | Fine Tuning | Human Feedback | Instruction Tuning | Language ModelsCommuter stipend | Health, dental and vision coverage | Learning and development stipend | Paid time off | Retirement benefitsMid-level Full TimeSan Francisco, CA; Seattle, WA; New …15h ago
-
(Senior) Scientist, Computational Neuroscience USD 132K-259KComputational modeling | Data Analysis | Machine Learning | Neural Data | Neural data analysisAnnual incentive program | Healthcare coverage | Retirement benefitsSenior-level Full TimeCambridge, MA USA16h ago
-
Senior AI Engineer USD 188K-248KAPI Design | Agentic Systems | Agile | Cloud Architecture | Code reviewCell phone allowance | Comprehensive health coverage | Equity grants | Growth-focused environment | Home office setup allowanceSenior-level Full TimeRemote - US R16h ago
-
Senior-level Full TimeLos Angeles, CA R16h ago
-
Ai Engineer USD 160K-170KAgentic Workflows | Anomaly Detection | Context engineering | Experimentation | Language Models401k | Employee assistance program | Health Spending Account HSA | Life insurance | Long-term disabilityMid-level ContractPalo Alto, California, USA R16h ago
-
Lead Data Scientist - Applied AI (P4656) USD 125K-207KAI Agent | AI Agents | AI agent evaluation | Agent Traceability | Agent evaluation401k matching | Dental insurance | Health insurance | Health savings account | Paid time offSenior-level Full TimeCincinnati, OH; Chicago, IL17h ago
-
Staff Data Scientist USD 123K-185KArcGIS | Artificial Intelligence | Automated testing | Bias detection | CI/CD401k | Adoption Assistance | Employee assistance programs | Fitness subsidies | Flexible work arrangementsSenior-level Full TimeAustin,Texas,United States17h ago
-
Agentic AI Engineer, Automation USD 220K-292KAgent Orchestration | Batching | C++ | Caching | Context ManagementNone Full TimeCosta Mesa, California, United States17h ago
-
Staff Data Engineer USD 164K-282KAmazon S3 | Apache Airflow | Cost Optimization | DBT | Dagster401k match | Electric Car Charging Station | Employee assistance program | Flexible spending account | Health savings accountSenior-level Full TimeMountain View, USA17h ago
-
Senior ML Engineer, Core Development USD 220K-292KActive Learning | Aeroelastic simulation | CFD | Data Engineering | Data PipelinesSenior-level Full TimeCosta Mesa, California, United States17h ago
-
Data Scientist/Senior Data Scientist USD 136K-183KAgentic Systems | Calculus | Classification | Cloud Native | Distributed ComputingSenior-level Full TimeRedwood City, California, United States17h ago
-
Senior Lead Data Scientist USD 204K-226KCode standards | Data Pipelines | Deep learning | Language Processing | MLOps401k plan | Caregiver referral network | Commuter program | Dental insurance | Disability insuranceSenior-level Full TimeAventura, Florida, United States17h ago
-
Senior Lead Data Scientist USD 204K-226KDeep learning | Language Processing | MLOps | Model Deployment | Model Monitoring401k plan | Commuter program | Dental benefits | Disability insurance | Employee assistance programSenior-level Full TimeBoston, Massachusetts, United States17h ago
-
Senior Lead Data Scientist USD 204K-226KData Manipulation | Deep learning | Language Processing | MLOps | Machine Learning401k plan | Commuter program | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeAustin, Texas, United States17h ago