Research Engineer, Gemini AutoRater
Mountain View, California, US
USD 166K-244K (estimate) Senior-level Full Time
Tasks
- Analyze model error patterns
- Collect training data
- Deploy models to production
- Document research findings
- Evaluate against human raters
- Improve LLM evaluation pipelines
- Present results to stakeholders
- Prototype LLM systems
- Train AutoRaters
- Train reward models
Perks/Benefits
- N/A
Skills/Tech-stack
Data collection | Fine Tuning | Foundation Models | Human evaluation | Language Models | Large Language Models | Machine Learning | Model Evaluation | Production Deployment | Programming N/A | Reinforcement Learning | Self Verification | Supervised Fine Tuning
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Related jobs
-
AI infrastructure | Accelerator Virtualization | Container Runtime | Distributed Systems | GPUSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA1h ago
-
Staff Software Engineer, AI/ML, YouTube USD 207K-300KAudio Processing | Data Processing | Debugging | Distributed Systems | Fine TuningSenior-level Full TimeSan Bruno, CA, USA1h ago
-
Senior Staff Software Engineer, AI/ML, Google Cloud USD 262K-365KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Fine TuningSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Software Engineer, AI/ML, Google Cloud AI USD 174K-252KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA1h ago
-
Staff Software Engineer, AI/ML Data Processing USD 207K-300KAPIs | Checkpointing | Cloud technologies | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA1h ago
-
2026 Summer Internship | Data Analytics & AI USD 50K-90KDashboarding | Data Engineering | Data Pipelines | Data analytics | ETLCareer development opportunities | Community service opportunities | Executive spotlights | Hybrid schedule | Professional development sessionsEntry-level InternshipMiramar, FL, US, 331325h ago
-
Senior Machine Learning Engineer USD 150K-200KDistributed Systems | Feature Engineering | Feature Selection | Language Models | Language Processing401k matching | Cell phone and internet stipend | Employee stock purchase plan | Flexible time off | Learning programsSenior-level Full TimeRemote - USA R7h ago
-
Senior LLM Software Engineer USD 191K-287KAWS | Agentic Automation | Data Pipelines | Event Driven | Event-driven architecture401k retirement plan | Caregiver leave | Commuter benefits | Dental insurance | Disability insuranceSenior-level Full TimeCosta Mesa, California, United States10h ago
-
Senior-level Full TimeHybrid (Salt Lake City, UT, US) R11h ago
-
Machine Learning Engineer, Geometry Team USD 175K-215K3D Spatial Reasoning | C++ | Computer Vision | Distributed Training | JAXSenior-level Full TimeKirkland, Washington, United States12h ago
-
AI Search | AWS | Amazon SageMaker | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States12h ago
-
Senior Staff AI Engineer, AI Privacy Expert USD 198K-326KAI privacy | Data Memorization | Differential Privacy | Explainability | Federated LearningHealth and wellness programs | Time offSenior-level Full TimeMountain View, CA, United States13h ago
-
Sr. Staff AI Engineer, GenAI Safety USD 191K-315KAI Safety | Content Safety | Distillation | Distributed Systems | Evaluation PipelineHealth and wellness programs | Time offSenior-level Full TimeMountain View, CA, United States13h ago
-
Staff AI Engineer, AI Privacy Specialist USD 170K-277KAnonymization | Data Memorization | Data Utility | Differential Privacy | Evaluation FrameworksHealth and wellness programs | Hybrid work flexibility | Time away from workSenior-level Full TimeSunnyvale, CA, United States13h ago
-
Software Engineer - Perception (Fallback Stack) USD 151K-255KC++ | Computational Geometry | Confidence Calibration | Deep learning | Linear Optimization401k matching | Comprehensive health insurance | Learning and wellness stipends | Paid time offMid-level Full TimeSunnyvale, California, United States14h ago
-
Generative AI | Language Models | Large Language Models | Machine Learning | Recommender SystemsHealth and wellness programs | Time away from workExecutive-level Full TimeMountain View, CA, United States15h ago
-
AI Engineer USD 150K-215KAgent Orchestration | Agent systems | AgentOps | Amazon Bedrock | Azure OpenAIMid-level Full TimeRemote United States R15h ago
-
AI, Data & Technology - AI-ML Engineer USD 112K-179KAWS | Apache Spark | Azure | BigQuery | CI/CDHybrid work model | In person work two days per week | Travel up to 40 percentSenior-level Full TimeChicago, IL, United States15h ago
-
Senior-level Full TimeSan Jose, California, United States15h ago
-
Principal Staff Software Engineer, AI Training Platform USD 207K-340KAutomatic mixed precision | C++ | Container Orchestration | Containerization | Data parallelismCommute to office based on team needs | Hybrid work options | Mentorship and career growth | Work from homeExecutive-level Full TimeMountain View, CA, United States15h ago
-
Senior Specialist AI Engineer - Foundations USD 139K-229KCUDA | Deep learning | Distributed Training | GPU Acceleration | Generative AIHealth and wellness programs | Time awaySenior-level Full TimeSunnyvale, CA, United States15h ago
-
Senior Data Engineer USD 146K-180KAWS | AWS CDK | Amazon Redshift | Apache Airflow | CircleCI401k matching | Disability insurance | Flexible PTO | Free therapy access for employees and one household member | Friends and family discountSenior-level Full TimeNew York, NY (Hybrid) R15h ago
-
Senior AI Engineer USD 139K-229KAnt | Configuration Management | Data Mining | Data Science | Deep learningHealth and wellness programs | Hybrid work schedule | Time offSenior-level Full TimeSunnyvale, CA, United States15h ago
-
Staff AI Engineer USD 170K-277KBig Data | Data Mining | Deep learning | Information Retrieval | JavaHealth and wellness programs | Hybrid work | Paid time offSenior-level Full TimeSunnyvale, CA, United States15h ago
-
Full-Stack AI Engineer USD 140K-190KAWS | Authentication | Authorization | Azure | CI/CD401k | Collaborative work environment | Health, dental, and vision insurance | Paid time off | Professional development opportunitiesSenior-level Full TimeWashington, D.C.16h ago