Machine Learning Researcher - RL and Agentic Systems
Tasks
- Automate dataset validation environment generation rollout analysis and benchmark construction
- Benchmark model behavior in reinforcement learning and agentic settings
- Build quality scorecards and evaluation methods
- Build scalable evaluation and validation tooling
- Collaborate with research and engineering teams to improve evaluation methodology and best practices
- Connect model failures to dataset environment and task design gaps
- Design and build datasets tasks and environments
- Develop frameworks for evaluating real world data quality
- Evaluate planning tool use robustness recovery and generalization
- Improve infrastructure for reproducible experimentation and evaluation quality
- Translate real world workflows into structured tasks interaction traces trajectories and stateful environments
Perks/Benefits
- N/A
Skills/Tech-stack
Agentic Systems | Benchmarking | Data Validation | Dataset Quality Evaluation | Dataset quality | Decision Making | Evaluation methodology | Experimental Design | Imitation Learning | Large Scale Data | Large-scale | Machine Learning | Offline Reinforcement Learning | Online Reinforcement Learning | Quality evaluation | RLAIF | RLHF | Reinforcement Learning | Reproducible experimentation | Reward Modeling | Sequential decision making | Simulation Environments | Task design
Education
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R17d ago
-
Machine Learning Engineer PhD USD 116K-160KAWS | Azure | C++ | CI/CD | Cloud NativeDirect impact on client projects | Flexible working hours | High-end hardware | Remote work | Training budgetMid-level Full TimeRemote R4h ago
-
Senior Data Engineer (Dataiku DSS) EUR 54K-72KData Cleansing | Data Lakehouse | Data Pipelines | Data Transformation | Data ValidationFully remote work | Healthcare | International projects | Long-term B2B contract | Multinational environmentSenior-level Full TimeRemote R4h ago
-
Mid-level Full TimeAtlanta, GA, US / Remote (US) R5h ago
-
Mid-level Full TimeTel Aviv/ Hybrid (Israel), Israel R9h ago
-
AI Engineer (m/w/d) // Remote möglich EUR 47K-47KAI monitoring | Agent systems | Automation | Cloud Computing | Cloud platformAdditional vacation days | Company bike option | Employee discount | Paid vacation and holiday bonus | Remote work optionsSenior-level Full TimeStuttgart, Germany R10h ago
-
Data Scientist (m/w/d) // Remote möglich EUR 21K-21KAWS | Agile | Azure | CatBoost | GCPAdditional retirement contributions | Additional vacation days | Company bike | Employee discount | Leadership programsEntry-level Full TimeBerlin, Germany R10h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R14h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R19h ago
-
Senior AI/LLM Data Scientist in Agentic AI TRY 840K-1080KAPI Integration | Embeddings | Evaluation | Fine Tuning | Generative AIEnglish Language Development Support | Hybrid work | Meal card | Multisport membership | Private health insuranceSenior-level Full TimeIstanbul (VADI ISTANBUL PARK), Türkiye R19h ago
-
AI Engineer - FDE (Forward Deployed Engineer) GBP 80K-110KAWS | Apache Spark | Azure | Cloud platform | Data EngineeringConference presentations | Remote work | Travel opportunitiesSenior-level Full TimeRemote - United Kingdom R1d ago
-
Mid-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1d ago
-
Artificial Intelligence | Change Management | Language Models | Large Language Models | Machine LearningExecutive-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1d ago
-
Mid-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1d ago
-
(Senior) AI Engineer (all genders) EUR 65K-80KCloud Computing | Containerization | DevOps | Docker | Language ModelsBusiness bike | Company boat | E-learning support | Extra vacation | Family Friendly ProgramMid-level Full TimeBremen, Munich, Mannheim, Mainz, Berlin, Remote R1d ago
-
Senior Staff Generative AI Scientist USD 185K-210KAWS | Apache Spark | Artificial Intelligence | Azure | Cloud platform401k matching | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeRemote, United States R1d ago
-
Sr. Data Scientist USD 126K-190KDashboards | Data Engineering | ETL | Elasticsearch | GrafanaCareer development | Education and Training | Health, dental, vision insurance | Paid retirement contribution | Paid time offSenior-level Full TimeLinthicum Heights, MD - Remote/Hybrid R1d ago
-
AI Researcher USD 225K-300KCryptography | Distributed inference | Distributed machine learning | Federated Learning | Incentive designMid-level Full TimeAnywhere R1d ago
-
AI Research Engineer USD 205K-344KCryptography | Distributed Systems | Federated Learning | Fine Tuning | GoEntry-level Full TimeAnywhere R1d ago
-
Senior Applied Scientist - Search USD 200K-200KData Science | Embedding | Fine Tuning | Hybrid search | Information Retrieval401k retirement | Annual leave | Equity package | Health coverage | Hybrid scheduleSenior-level Full TimeNew York City R1d ago
-
Senior Data Scientist (USA / Israel) USD 168K-200KClassification | Clustering | Cold Start | Cross-validation | Data MiningFlexible remote work | Unlimited paid time offSenior-level Full TimeRemote, USA / Israel R1d ago
-
AI Lead (Brazil) BRL 144K-146KAI Platform | Analytics | Data Analysis | Language Processing | Machine LearningCareer growth opportunities | Remote-first companySenior-level Full TimeRemote/Brazil R1d ago
-
Data Scientist (Remote) USD 66K-110KMachine Learning | Microsoft Excel | Microsoft Outlook | Microsoft Word | PythonRemote workMid-level Full TimeOak Brook, IL, United States R2d ago
-
Senior Data Engineer USD 114K-154KAgile | Alteryx | Autosys | Azure Data | Azure Data Factory401k | Career growth | Dental insurance | Education reimbursement | Flexible spending accountSenior-level Full TimeRemote R2d ago
-
Mid-level Full TimeRemote job R2d ago