Senior Staff Software Engineer, Agent Data Quality, DeepMind
Tasks
- Analyze agent behavior
- Build agent data processing pipelines
- Build automated evaluation frameworks
- Build experiment framework for agent and model evaluation
- Construct quantitative benchmarks
- Develop real time feedback for agent and model development
- Identify edge cases
- Identify failure modes
- Identify performance bottlenecks
- Provide data insights and visualization systems
- Recommend actionable improvements
- Use LLM as a judge for evaluation
Perks/Benefits
- N/A
Skills/Tech-stack
Artificial Intelligence | Automated Evaluation | Behavior analytics | C# | C++ | Data Pipelines | Data Visualization | Experiment Framework | Java | JavaScript | LLM Evaluation | Machine Learning | Physics Simulators | Python | Quantitative Benchmarking | Robotics | Sentiment Analysis | User Behavior | User Behavior Analytics
Education
Roles
Regions
Countries
States
Related jobs
-
Production Engineer (University Grad) USD 182K-200KAI tools | API | Agent Orchestration | C++ | CDNTraining and development | Work authorization sponsorshipSenior-level Full TimeSunnyvale, CA | New York, NY2h ago
-
Software Engineer, SystemML - AI Networking USD 170K-251KC# | C++ | CUDA | Data-parallel | Deep learningMid-level Full TimeMenlo Park, CA2h ago
-
Senior Software Engineer, Applied AI, Commerce USD 174K-252KC++ | Deterministic testing | Gemini | Language Models | Language ProcessingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA2h ago
-
Staff Software Engineer, Gemini Evals, GenAI, DeepMind USD 207K-300KAgent evaluation | Automated Retry | Distributed Systems | Error classification | InferenceSenior-level Full TimeMountain View, CA, USA; New York, …2h ago
-
Code Safety | Data Processing | Debugging | Distributed Systems | Fine TuningSenior-level Full TimeMountain View, CA, USA2h ago
-
Senior Software Engineer, Generative AI, Core ML USD 174K-252KAgentic Applications | Automated testing | Computer Vision | Data Processing | DebuggingSenior-level Full TimeMountain View, CA, USA2h ago
-
APIs | Agent systems | Cloud platform | Cost Per Request | CrewAIEmployee discounts | Health insurance | Paid time off | Retirement plansMid-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …2h ago
-
Software Engineer III, Generative AI, Agent Engineering USD 147K-211KArtificial Intelligence | BigQuery | CI/CD | Cloud Storage | Computer VisionSenior-level Full TimeKirkland, WA, USA2h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-252KAPIs | Agent systems | Cloud platform | Conversational AI | DebuggingTravel opportunitiesSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …2h ago
-
Mechanical Engineer, Data Center Technology Systems USD 171K-248KASME B31 | C++ | Fire Protection | Fuel Systems | HVACSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Software Engineer III, Infrastructure/Cloud Storage USD 147K-211KC++ | Cloud Computing | Code review | Debugging | Distributed SystemsSenior-level Full TimeSeattle, WA, USA2h ago
-
Artificial Intelligence | Documentation | Gemini | Hugging Face | JAXMid-level Full TimeMountain View, CA, USA2h ago
-
Forward Deployed Engineer II, Applied AI, Google Cloud USD 147K-211KAPI Integration | APIs | Agent systems | Cloud platform | Evaluation PipelinesTravel opportunitiesMid-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …2h ago
-
Senior Software Engineer, BigQuery Managed Storage USD 174K-252KBigQuery | C++ | Change Data Capture | Cloud platform | Data CaptureSenior-level Full TimeKirkland, WA, USA2h ago
-
Senior Staff Software Engineer, Generative AI USD 262K-365KComputer Vision | Data Processing | Debugging | Deep learning | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Engineer IV, Embedded Software Developer USD 111K-133KC# | Change Management | Circuit Schematics | Digital circuit | Digital circuit schematicsTelecommutingEntry-level Full TimePeoria, IL, US, 61639 R5h ago
-
Junior AI Engineer (Open to remote) USD 110K-135KAPI Development | Language Model | Language Model Evaluation | Language Models | Language Processing401k | Dental insurance | Health savings account | Medical insurance | Paid time offEntry-level Full TimeNew York, NY, US, NY 10019 R6h ago
-
Senior Data Platform Engineer, Remote USD 135K-180KAWS | AWS Lambda | Access Control | Amazon Aurora | Amazon CloudWatchSenior-level Full TimeUnited States, UNITED STATES, United States R8h ago
-
Robotics Application Engineer USD 100K-300KAutonomous Systems | C++ | Computer Vision | Machine Learning | PythonMid-level Full TimePittsburgh, San Mateo8h ago
-
Software Engineer (Computer Vision) TS/SCI with Poly) USD 170K-175KAgile | CSS | Computer Vision | Dash | Git401k | Dental insurance | Employee discount program | Employee referral bonuses | Flexible spending accountSenior-level Full TimeFORT MEADE, MD, US10h ago
-
AI Software Engineer USD 181K-270KAWS | CI/CD | Docker | Edge Functions | GitHub CopilotComprehensive benefits | Equity | Learning stipend | Remote-first cultureSenior-level Full TimeUnited States or Canada R12h ago
-
Senior-level Full TimeLos Angeles, CA12h ago
-
Machine Learning Intern USD 80K-90KAWS | Apache Hive | Apache Spark | C++ | Cloud platformFinal evaluation | Mentorship | Performance feedbackEntry-level InternshipMountain View, USA12h ago
-
Forward Deployment AI Engineer USD 120K-150KAgent Orchestration | Autogen | Automation | Cloud services | Data extractionClient site travel | Client-facing role | Hybrid workMid-level Full TimeCleveland, OH or Columbus, OH13h ago
-
AWS Cloud | Amazon Bedrock | Amazon SageMaker | Data analytics | Deep learningSenior-level Full TimeNew York, New York, USA13h ago