Software Engineer, Gemini Eval Infra, DeepMind
Tasks
- Advocate testing and system design practices
- Build abstractions for LLM agent loops and tool use
- Create observability dashboards
- Design distributed evaluation execution engines
- Design error classification and automated retry policies
- Implement automated LLM as a judge rating systems
- Maintain evaluation pipeline service level objectives
- Mentor engineers and enforce code quality
- Orchestrate inference steps across TPU and GCU pools
- Partner with research scientists and data science teams on evaluation needs
Perks/Benefits
- N/A
Skills/Tech-stack
Automated testing | Data Structures | Data Structures and Algorithms | Distributed Systems | GCU | Inference | Language Models | Large Language Models | Machine Learning | Observability | Python | Retries | Service Level | Service-Level Objectives | Software Architecture | System design | TPU
Education
Bachelor of Engineering | Bachelor of Science | Master of Arts | Master of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R25d ago
-
Mid-level Full TimeUS-Kansas-Wichita1h ago
-
Gen AI Developer Specialist USD 118K-204KAI Evaluation | AWS | AWS Bedrock | Access Management | Cause analysisSenior-level Full TimeUnited States2h ago
-
Mid-level Full TimeUS-Kansas-Wichita2h ago
-
3D Generation | AIGC | Agentic Models | Computer Vision | Fine TuningEntry-level Full TimeSan Jose, California, United States2h ago
-
Advertising Systems | Algorithms | C# | C++ | Data StructuresEntry-level Full TimeSan Jose, California, United States2h ago
-
Machine Learning/Research Engineer Graduate (Monetization Technology-Ads Core Global) - 2027 Start (PhD) USD 113K-250KAlgorithms | C++ | Computer Vision | Counterfactual Optimization | Data StructuresEntry-level Full TimeSan Jose, California, United States2h ago
-
Active Learning | C# | C++ | CNN | CTR modelingEntry-level Full TimeSan Jose, California, United States2h ago
-
Algorithms | C plus plus | Convolutional Neural Networks | Data Structures | Deep learningEntry-level Full TimeSan Jose, California, United States2h ago
-
API Development | API Gateway | Access Control | Artificial Intelligence | Audit LoggingEntry-level Full TimeSan Jose, California, United States2h ago
-
Staff Software Engineer, Agentic AI, Trust and Safety USD 207K-300KAgentic AI | Anti-Abuse Engineering | Anti-abuse | Artificial Intelligence | CI/CDBonus | Employee support programs | Equity | Health insurance | Paid time offSenior-level Full TimeKirkland, WA, USA3h ago
-
Senior Software Engineer, AI/ML System Infrastructure USD 174K-252KArtificial Intelligence | C# | C++ | CI/CD | Cloud infrastructureSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA3h ago
-
Alooma | Batch Processing | Big Data | C plus plus | Cloud platformSenior-level Full TimeNew York, NY, USA; Atlanta, GA, …3h ago
-
C# | C++ | Cryptography | Distributed Systems | GoSenior-level Full TimeSunnyvale, CA, USA3h ago
-
C# | C++ | Compute Technologies | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeNew York, NY, USA; Madison, WI, …3h ago
-
Staff Software Engineer, Gen AI/Applied ML, Ads USD 207K-300KC++ | Data Pipelines | Data Structures | Data Structures and Algorithms | DatabaseBonus | Equity | Health insurance | Paid time off | Retirement planSenior-level Full TimeIrvine, CA, USA3h ago
-
Artificial Intelligence | Fine Tuning | GPU | Google Kubernetes | Google Kubernetes EngineSenior-level Full TimeSunnyvale, CA, USA; Cambridge, MA, USA3h ago
-
As-a-Service | C++ | Cloud platform | Data Structures | Data Structures and AlgorithmsBonus | Equity compensation | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Senior Staff Software Engineer, Search Ads, AdsML, LLM USD 262K-364KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA; Pittsburgh, PA, …3h ago
-
Research Engineer, Conversational Agentic AI, DeepMind USD 207K-300KArtificial Intelligence | Audio Processing | Data Analysis | Data Pipelines | Dialog SystemsSenior-level Full TimeMountain View, CA, USA; New York, …3h ago
-
Software Engineer III, Google Security Operations, AI/ML USD 147K-210KAlgorithms | Angular | C# | Cloud infrastructure | Computer VisionSenior-level Full TimeReston, VA, USA3h ago
-
Senior Platform Engineer - Data Infrastructure EUR 65K-80KAWS | Amazon Aurora | Amazon EKS | Amazon ElastiCache | Amazon MSKChildcare compensation | Company events | English classes reimbursement | Flexible hours | Gym subscriptionSenior-level Full TimeMadrid, MD, Spain6h ago
-
Senior Robotics Software Engineer USD 162K-221K3D Geometry | APIs | C++ | CI/CD | Collision Checking401k matching | Dental insurance | Equity | Free Lunches | Free parkingSenior-level Full TimeBerkeley, California9h ago
-
PIM - Sr Databricks & Reporting Analyst USD 123K-178KAI | Apache Spark | Artificial Intelligence | Azure Data | Azure Data FactoryRelocation assistance | TeleworkSenior-level Full TimeReston, VA, US9h ago
-
AI Engineer, Senior - Enterprise Value Creation (NJUS) USD 131K-190KAWS | Azure | CI/CD | Data Engineering | Distributed Computing401k match | Dental insurance | Employee assistance program | Flexible spending account | Health savings accountSenior-level Full TimeColumbus, OH, US9h ago