Technical Program Manager, Gemini Evals, DeepMind
Tasks
- Conduct Loss Analysis
- Coordinate alignment with model teams
- Design and integrate model evals
- Execute model evals
- Identify risks and communicate to stakeholders
- Implement workflow improvements
- Lead multi-disciplinary engineering projects
- Manage Gemini autorater platform
- Manage project schedules
- Plan compute capacity
- Plan requirements with internal customers
- Provide proactive stakeholder status updates
- Track priorities and issues
- Triage autorater issues to modeling team
Perks/Benefits
- N/A
Skills/Tech-stack
Capacity Planning | Compute Capacity Planning | Compute capacity | Data Science | Experimentation | Infrastructure Planning | Language Models | Large Language Models | Loss analysis | Machine Learning | Model Evaluation | Project Management | Risk Management | Stakeholder management
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R14d ago
-
AI strategy | Artificial Intelligence | Data Science | KPI Development | Language ProcessingHybrid work scheduleMid-level Full TimeWashington, DC, United States2h ago
-
Expense Analytics Associate Director USD 136K-175KAudit management | Automation | Card Programs | Controls monitoring | Corporate CardCareer growth opportunity | Flexibility | Supportive work environmentMid-level Full TimeChicago, IL, United States4h ago
-
Senior Social Analytics Manager, YouTube Marketing USD 171K-248KAnalytics Dashboards | Data Visualization | Experimental Design | Machine Learning | Marketing AnalyticsSenior-level Full TimeNew York, NY, USA; Chicago, IL, …6h ago
-
C# | C++ | Database Design | Database Internals | Database ProgrammingSenior-level Full TimeSunnyvale, CA, USA6h ago
-
AI infrastructure | Cross-Functional Collaboration | Cross-functional | Functional collaboration | Hardware engineeringSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Business Analytics | Business Partnering | Data Analysis | Funnel Management | Opportunity ManagementExecutive-level Full TimeSunnyvale, CA, US, 940869h ago
-
Senior Manager Marketing Analytics USD 115K-138KAdobe Analytics | Affiliate Marketing | Alteryx | Amplitude | AppsflyerSenior-level Full TimePortland, OR, US R11h ago
-
Technical Program Lead, AI Delivery USD 162K-226KData Modeling | Data Pipelines | Data Science | Generative AI | KPI TrackingClient-facing work | Executive visibility | Hybrid work | Mentorship and team leadershipSenior-level Full TimeSan Francisco14h ago
-
Research Cyberinfrastructure Manager USD 99K-150KAgile | CI/CD | Cloud Computing | Code review | DevOpsMid-level Full TimeMadison, WI, US15h ago
-
Sr. Manager, Finance PMO & Operations (Procure-To-Pay) USD 152K-245KGoogle Slides | Jira | OKR | Process Automation | Process ImprovementSenior-level Full TimeWest Coast - United States16h ago
-
Senior Manager, Strategic Initiatives (Fulfillment) USD 127K-159KBusiness Intelligence | Capacity Planning | Data Modeling | Excel | ForecastingDental insurance | Flexible time off | Medical insuranceSenior-level Full TimeLos Angeles Warehouse18h ago
-
Cloud | IP cameras | Internet Protocol | Jira | Microsoft Dynamics401k match | Fitness programs | Learning and development programs | Medical/Dental/Vision | Mental wellness supportMid-level Full TimeTexas-Remote, United States R19h ago
-
Data Analytics Manager, Elections USD 130K-185KArtificial Intelligence | Automation | Dashboards | Data Validation | Data Visualization401k | Dental insurance | Discounts | Medical insurance | Paid leaveMid-level Full TimeNew York, NEW YORK, United States19h ago
-
CX Manager, AI Optimization USD 85K-95KAI Automation | Agent Assist | Chatbot | Customer Journey | Customer journey mappingEducation and conference reimbursements | Fun relaxed work environment | Remote workMid-level Full TimeRemote, United States R20h ago
-
Senior Manager, International Business Analytics USD 73K-138KArtificial Intelligence | Big Data | Business Intelligence | Data Modeling | Data analytics401k | Long-term incentive programs | Medical/Dental/Vision insurance | Paid time offEntry-level Full TimeMettawa, IL, United States21h ago
-
Tech Lead Manager, Data Infrastructure USD 250K-375KAudio Processing | Data Augmentation | Data Engineering | Data Pipelines | Data Preprocessing401k | Commuter allowance | Dental insurance | Flexible PTO | Health insuranceSenior-level Full Time*HQ - San Francisco, CA21h ago
-
Staff Product Manager, ML Foundations and GenAI USD 214K-321KAPI Development | Artificial Intelligence | Cross-functional | Cross-functional leadership | Data AnalysisSenior-level Full TimeSeattle, San Francisco, New York, US … R21h ago
-
Senior Manager, AI/ML Engineering USD 180K-200KAPIs | Cloud Platforms | Data Pipelines | Databricks | Enterprise Architecture401k | Adoption leave | Employer Paid Long-term Disability | Employer Paid Short-term Disability | Health insuranceSenior-level Full TimeChicago, Illinois, United States21h ago
-
Dealership Performance and Analytics Manager USD 100K-125KAcceptance Testing | Agile | Data Quality | Dealership Accounting | Financial statements401k match | Dental coverage | Life insurance | Long-term disability | Medical coverageMid-level Full TimeAtlanta23h ago
-
Senior Manager, Machine Learning USD 130K-180KCI/CD | Classical machine learning | Cloud Platforms | Containerization | Data labelingSenior-level Full TimeSan Francisco, CA1d ago
-
VP of Research, Machine Learning (ML), Artificial Intelligence (AI) Required, Work From Home A USD 250K-300KAgent systems | Artificial Intelligence | GPU | JAX | Knowledge DistillationDental insurance | Medical insurance | Paid time off | Remote work | Savings plan optionsExecutive-level Full TimeSan Francisco, CA, United States R1d ago
-
Algorithms | Artificial Intelligence | Computer Science | Computer science fundamentals | Data StructuresDental insurance | Medical insurance | Paid time off | Remote | Savings planMid-level Full TimeSan Francisco, CA, United States R1d ago
-
Audit Testing | Audit documentation | C plus plus | Compliance | Controls monitoringEntry-level Full TimeDallas, TX, United States1d ago
-
Mgr Supply Chain Optimization USD 70K-114KBuying | Capital management | Cost Reduction | Customer Service | Data ManagementSenior-level Full TimeManassas, VA, United States1d ago