Staff Software Engineer, NotebookLM, Generative AI, Labs
Tasks
- Collaborate with product and engineering teams
- Define quality metrics
- Design evaluation systems
- Experiment with evaluation methods
- Improve monitoring logging alerting
- Launch evaluation workflows
- Maintain evaluation infrastructure
- Research evaluation techniques for LLMs
- Run evaluation pipelines
- Write evaluation code
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Computer Vision | Data Processing | Data Structures | Data structures algorithms | Experimentation | Fine Tuning | Kotlin | LLM Evaluation | Language Models | Language Processing | Large Language Models | Logging | Machine Learning | Model Deployment | Model Evaluation | Monitoring | Natural Language | Natural Language Processing | Python | Software Architecture
Education
Roles
Regions
Countries
States
Related jobs
-
Apache Spark | Computer Vision | Data Curation | Data Pipelines | GroundingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …1h ago
-
Computer Vision | Data Preparation | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA2h ago
-
Staff Software Engineer, AI/ML, App Ads Quality USD 207K-300KCross-Functional Collaboration | Cross-functional | Data Processing | Data Storage | Data StructuresSenior-level Full TimeMountain View, CA, USA2h ago
-
Agentic AI | Computer Vision | Continuous integration | Data Processing | DebuggingSenior-level Full TimeMountain View, CA, USA2h ago
-
Senior Software Engineer, AI Powered GRC Automation USD 174K-252KContinuous controls monitoring | Controls monitoring | Data Mining | Data Processing | Data StructuresSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA2h ago
-
Systems Development Engineer, Quantum AI USD 138K-198KAutomation | CI/CD | Cloud APIs | Cloud infrastructure | Configuration ManagementMid-level Full TimeGoleta, CA, USA2h ago
-
Software Engineer, AI/ML, Workspace USD 147K-211KData Generation | Data Processing | Debugging | Experimentation | Language ProcessingMid-level Full TimeSunnyvale, CA, USA; New York, NY, …2h ago
-
Software Engineer III, AI/ML, Display Ads USD 147K-211KAlgorithms | C++ | Data Analysis | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA2h ago
-
Senior-level Full TimePeoria, IL, US, 616394h ago
-
AI/ML Engineer USD 117K-171KA/B | A/B Testing | API Development | AWS | B testingDental insurance | Health insurance | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US4h ago
-
Cloud Data Engineer USD 92K-113KAgile | Apache Airflow | Beam | BigQuery | Cloud ComposerOnsite workMid-level Full TimeAda, MI, United States, 493556h ago
-
Sr. Staff Software Engineer - Managed Tables USD 228K-314KAlgorithms | Automation | Capacity Planning | Data Structures | Database systemsSenior-level Full TimeMountain View, California11h ago
-
Senior Machine Learning Engineer, Agentic USD 163K-245KArtificial Intelligence | Direct Preference Optimization | Evaluation | Fine Tuning | Human-in-the-loop401k matching | Catered meals | Employee events | Employer-paid disability insurance | Employer-paid life insuranceSenior-level Full TimeBellevue, WA; Menlo Park, CA11h ago
-
Forward Deployed Machine Learning Engineer USD 180K-300KAPI Design | Cloud Computing | Deep learning | Diffusion Models | Fine TuningIn-person collaboration days | Remote work flexibility | Travel cost coverageSenior-level Full TimeSan Francisco (USA) R12h ago
-
Senior ML Engineer, Fauna USD 184K-250KComputer Vision | Data Quality | Distributed Training | Edge Deployment | Evaluation PipelinesSenior-level Full TimeNew York, New York, USA13h ago
-
Forward Deployment Engineer - Gen AI USD 162K-224KAWS Bedrock | AWS SageMaker | Autogen | Azure OpenAI | ChromaCareer development opportunities | Individual responsibility | Travel to client sitesMid-level Full TimeNew York, New York, United States13h ago
-
Computer Vision | Experiment design | Experiment tracking | Generative AI | Image ProcessingSenior-level Full TimeAEP Headquarters, United States13h ago
-
Senior Software Engineer, Knowledge Graph USD 196K-230KApache Flink | Apache Spark | Data Ingestion | Data Processing | DatabasesEmployee travel credits | Remote eligibleSenior-level Full TimeUnited States13h ago
-
Specialist Solutions Architect - AI/ML USD 180K-247KAI guardrails | Amazon Web Services | Apache Spark | Artificial Intelligence | Cloud ComputingMentorship | Remote work | Technical training | Travel up to 30 percentSenior-level Full TimeUnited States13h ago
-
Lead Data Engineer USD 115K-130KAgile | Apache Airflow | Azure Data | Azure Data Factory | Cloud Orchestration401k | Dental insurance | Medical insurance | Paid leave | Tuition reimbursementSenior-level Full TimeUniversal City, CALIFORNIA, United States14h ago
-
Principal AI Platform Engineer USD 167K-220KAgent Orchestration | Backend Development | Braintrust | Cost Optimization | Data PipelinesEquity | Flexible Token Limits | Health, dental, vision coverage | Unlimited paid time offSenior-level Full TimeSan Francisco, California R14h ago
-
Machine Learning Engineer USD 168K-198KAPIs | Amazon SageMaker | Anthropic API | Asynchronous processing | CI/CDAdoption reimbursement | Commuter stipend | Fertility reimbursement | Flexible PTO | Learning and development allowanceSenior-level Full TimeSan Francisco, California, United States15h ago
-
AWS MSK | Amazon Kinesis | Apache Flink | Apache Kafka | AutomationSenior-level Full TimeUSA - Atlanta, GA; USA - …15h ago
-
Cyber Data Engineer USD 140K-145KAWS | ArcSight | Bash | Cribl | DHCP401k match | Accrued PTO | Health/Dental/Vision | Life insurance | Long-term disabilitySenior-level Full TimeSpringfield, VA15h ago
-
Ansible | ArgoCD | CI/CD | Chef | Configuration ManagementSenior-level Full TimeNew York, NY, United States16h ago