Software Engineer, Gemini Eval Infra, DeepMind
Tasks
- Advocate testing and system design practices
- Build abstractions for LLM agent loops and tool use
- Create observability dashboards
- Design distributed evaluation execution engines
- Design error classification and automated retry policies
- Implement automated LLM as a judge rating systems
- Maintain evaluation pipeline service level objectives
- Mentor engineers and enforce code quality
- Orchestrate inference steps across TPU and GCU pools
- Partner with research scientists and data science teams on evaluation needs
Perks/Benefits
- N/A
Skills/Tech-stack
Automated testing | Data Structures | Data Structures and Algorithms | Distributed Systems | GCU | Inference | Language Models | Large Language Models | Machine Learning | Observability | Python | Retries | Service Level | Service-Level Objectives | Software Architecture | System design | TPU
Education
Bachelor of Engineering | Bachelor of Science | Master of Arts | Master of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R25d ago
-
Mid-level Full TimeUS-Kansas-Wichita2h ago
-
Gen AI Developer Specialist USD 118K-204KAI Evaluation | AWS | AWS Bedrock | Access Management | Cause analysisSenior-level Full TimeUnited States3h ago
-
Mid-level Full TimeUS-Kansas-Wichita3h ago
-
Data cleaning | Data collection | Deep learning | Machine Learning | Model EvaluationSenior-level Full TimeSan Jose, California, United States3h ago
-
3D Generation | AIGC | Agentic Models | Computer Vision | Fine TuningEntry-level Full TimeSan Jose, California, United States3h ago
-
AI | CPU | GPU | Kubernetes | Machine LearningSenior-level Full TimeSan Jose, California, United States3h ago
-
Software Engineer- Metadata Storage USD 156K-387KAutomation | Disaster Recovery | Distributed Systems | Distributed locking | Key-Value StorageMid-level Full TimeSan Jose, California, United States3h ago
-
Containerd | Docker | Go | Java | KubernetesSenior-level Full TimeSeattle, Washington, United States3h ago
-
AI | AI workloads | C++ | CPU | Distributed SystemsSenior-level Full TimeSeattle, Washington, United States3h ago
-
Research Scientist - LLM Training System as a Service - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 212K-450KCUDA | Deep learning | Distributed Training | GPU Performance | Language ModelsEntry-level Full TimeSan Jose, California, United States3h ago
-
AI Engineer Graduate (Client Arch) - 2027 Start USD 100K-118KArtificial Intelligence | Automation | CI/CD | Code Refactoring | Continuous DeliveryEntry-level Full TimeSan Jose, California, United States3h ago
-
Algorithms | C++ | Data Mining | Data Pipelines | Data StructuresDevelopment workshops | Learning programs | Social eventsEntry-level InternshipSan Jose, California, United States3h ago
-
Data Engineer Graduate (Monetization Data) - 2027 Start USD 115K-177KAmazon Redshift | Apache Airflow | Apache Flink | Apache Hive | Apache KafkaEntry-level Full TimeSan Jose, California, United States3h ago
-
Machine Learning Engineer Graduate (TikTok-Data-Search-Recommendation-Global E-Commerce) - 2027 Start USD 116K-177KC++ | Computer Vision | Data Mining | Data Pipelines | DatabasesEntry-level Full TimeSeattle, Washington, United States3h ago
-
Machine Learning Engineer, AI Agent USD 148K-180KAI Agents | Agent systems | C++ | Context engineering | Deep learningMid-level Full TimeSan Jose, California, United States3h ago
-
Advertising Systems | Algorithms | C# | C++ | Data StructuresEntry-level Full TimeSan Jose, California, United States3h ago
-
Machine Learning/Research Engineer Graduate (Monetization Technology-Ads Core Global) - 2027 Start (PhD) USD 113K-250KAlgorithms | C++ | Computer Vision | Counterfactual Optimization | Data StructuresEntry-level Full TimeSan Jose, California, United States3h ago
-
Agent Registry | Agentic AI | C++ | Computer Vision | Feature StoreEntry-level Full TimeSan Jose, California, United States3h ago
-
(General Hire) Machine Learning Engineer Graduate (Performance Monetization) - 2027 Start (PhD) USD 118K-250KC++ | Debugging | Go | MXNet | Machine LearningEntry-level Full TimeSan Jose, California, United States3h ago
-
(General Hire) Machine Learning Engineer Graduate (Performance Monetization) - 2027 Start USD 113K-250KC# | C++ | Debugging | Go | MXNetEntry-level Full TimeSan Jose, California, United States3h ago
-
Active Learning | Algorithm Optimization | C plus plus | CTR modeling | CVR ModelingEntry-level Full TimeSan Jose, California, United States3h ago
-
Anomaly Detection | Apache Flink | Apache Spark | C plus plus | Causal InferenceLearning opportunities | Mentorship | Real project ownership from day oneEntry-level Full TimeSan Jose, California, United States3h ago
-
Active Learning | C++ | CTR modeling | CVR Modeling | Data AnalysisDevelopment workshops | Hands-on experience | Industry exposure | Learning programs | Social eventsEntry-level InternshipSan Jose, California, United States3h ago
-
Agent Frameworks | Agent systems | C++ | Context engineering | Deep learningEntry-level Full TimeSan Jose, California, United States3h ago