Research Engineer, Gemini AutoRater
Mountain View, California, US
USD 166K-244K (estimate) Senior-level Full Time
Tasks
- Analyze model error patterns
- Collect training data
- Deploy models to production
- Document research findings
- Evaluate against human raters
- Improve LLM evaluation pipelines
- Present results to stakeholders
- Prototype LLM systems
- Train AutoRaters
- Train reward models
Perks/Benefits
- N/A
Skills/Tech-stack
Data collection | Fine Tuning | Foundation Models | Human evaluation | Language Models | Large Language Models | Machine Learning | Model Evaluation | Production Deployment | Programming N/A | Reinforcement Learning | Self Verification | Supervised Fine Tuning
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Related jobs
-
Research Engineer, FAIR AI & Society USD 117K-173KAI alignment | Apache Hive | Apache Spark | Artificial Intelligence | DPOEntry-level Full TimeMenlo Park, CA | New York, …3h ago
-
AI Research Engineer, FAIR Chemistry USD 147K-208KApplied Mathematics | Artificial Intelligence | Computational modeling | Computational statistics | Data ScienceCollaborative research environment | Open source contributions | Reproducible researchSenior-level Full TimeSan Francisco, CA3h ago
-
AI Compression | AV1 | AV2 | Audio CODEC | Automated testingSenior-level Full TimeBellevue, WA | Menlo Park, CA …3h ago
-
Software Engineer, Video AI/ML Specialist USD 141K-208KAV synchronization | AV1 | AV2 | Audio CODEC | Automated testingMid-level Full TimeBellevue, WA | Menlo Park, CA3h ago
-
AI infrastructure | Accelerator Virtualization | Container Runtime | Distributed Systems | GPUSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA3h ago
-
Staff Software Engineer, AI/ML, YouTube USD 207K-300KAudio Processing | Data Processing | Debugging | Distributed Systems | Fine TuningSenior-level Full TimeSan Bruno, CA, USA3h ago
-
Senior Staff Software Engineer, AI/ML, Google Cloud USD 262K-365KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Fine TuningSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Senior Software Engineer, AI/ML, Google Cloud AI USD 174K-252KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA3h ago
-
Staff Software Engineer, AI/ML Data Processing USD 207K-300KAPIs | Checkpointing | Cloud technologies | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA3h ago
-
2026 Summer Internship | Data Analytics & AI USD 50K-90KDashboarding | Data Engineering | Data Pipelines | Data analytics | ETLCareer development opportunities | Community service opportunities | Executive spotlights | Hybrid schedule | Professional development sessionsEntry-level InternshipMiramar, FL, US, 331327h ago
-
Senior Machine Learning Engineer USD 150K-200KDistributed Systems | Feature Engineering | Feature Selection | Language Models | Language Processing401k matching | Cell phone and internet stipend | Employee stock purchase plan | Flexible time off | Learning programsSenior-level Full TimeRemote - USA R9h ago
-
Senior LLM Software Engineer USD 191K-287KAWS | Agentic Automation | Data Pipelines | Event Driven | Event-driven architecture401k retirement plan | Caregiver leave | Commuter benefits | Dental insurance | Disability insuranceSenior-level Full TimeCosta Mesa, California, United States12h ago
-
Senior-level Full TimeHybrid (Salt Lake City, UT, US) R13h ago
-
Machine Learning Engineer, Geometry Team USD 175K-215K3D Spatial Reasoning | C++ | Computer Vision | Distributed Training | JAXSenior-level Full TimeKirkland, Washington, United States14h ago
-
AI Search | AWS | Amazon SageMaker | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States14h ago
-
Senior Staff AI Engineer, AI Privacy Expert USD 198K-326KAI privacy | Data Memorization | Differential Privacy | Explainability | Federated LearningHealth and wellness programs | Time offSenior-level Full TimeMountain View, CA, United States15h ago
-
Sr. Staff AI Engineer, GenAI Safety USD 191K-315KAI Safety | Content Safety | Distillation | Distributed Systems | Evaluation PipelineHealth and wellness programs | Time offSenior-level Full TimeMountain View, CA, United States15h ago
-
Staff AI Engineer, AI Privacy Specialist USD 170K-277KAnonymization | Data Memorization | Data Utility | Differential Privacy | Evaluation FrameworksHealth and wellness programs | Hybrid work flexibility | Time away from workSenior-level Full TimeSunnyvale, CA, United States15h ago
-
Software Engineer - Perception (Fallback Stack) USD 151K-255KC++ | Computational Geometry | Confidence Calibration | Deep learning | Linear Optimization401k matching | Comprehensive health insurance | Learning and wellness stipends | Paid time offMid-level Full TimeSunnyvale, California, United States15h ago
-
Generative AI | Language Models | Large Language Models | Machine Learning | Recommender SystemsHealth and wellness programs | Time away from workExecutive-level Full TimeMountain View, CA, United States16h ago
-
AI Engineer USD 150K-215KAgent Orchestration | Agent systems | AgentOps | Amazon Bedrock | Azure OpenAIMid-level Full TimeRemote United States R16h ago
-
AI, Data & Technology - AI-ML Engineer USD 112K-179KAWS | Apache Spark | Azure | BigQuery | CI/CDHybrid work model | In person work two days per week | Travel up to 40 percentSenior-level Full TimeChicago, IL, United States16h ago
-
Senior-level Full TimeSan Jose, California, United States17h ago
-
Principal Staff Software Engineer, AI Training Platform USD 207K-340KAutomatic mixed precision | C++ | Container Orchestration | Containerization | Data parallelismCommute to office based on team needs | Hybrid work options | Mentorship and career growth | Work from homeExecutive-level Full TimeMountain View, CA, United States17h ago
-
Senior Specialist AI Engineer - Foundations USD 139K-229KCUDA | Deep learning | Distributed Training | GPU Acceleration | Generative AIHealth and wellness programs | Time awaySenior-level Full TimeSunnyvale, CA, United States17h ago