Tech Lead Manager, Commerce AI, Quality and Evals
Sunnyvale, CA, USA; Kirkland, WA, USA
USD 262K-365K Senior-level Full Time
Tasks
- Coordinate with product management and engineering
- Drive vertical first architectural strategy
- Enforce launch bar quality standards
- Ensure expectation compliance
- Ensure release pass rate thresholds
- Host state of quality syncs
- Improve action accuracy
- Improve search accuracy
- Lead and mentor quality and evals team
- Maintain hermetic holdout datasets
- Manage no regression release gates
- Orchestrate hill climbing to improve agent metrics
Perks/Benefits
- N/A
Skills/Tech-stack
AI Agent | AI agent orchestration | Agent Orchestration | C# | C++ | Computer Vision | Data Pipelines | Data Processing | Debugging | Deterministic testing | Fine Tuning | GenAI | Java | JavaScript | LLM Evaluation | Language Models | Large Language Models | Machine Learning | Machine Learning Infrastructure | Model Deployment | Model Evaluation | Model Fine-tuning | Monte Carlo | Monte Carlo Simulation | Observability | Prompt engineering | Python | RAG | Release Engineering | Retrieval-Augmented Generation | Software development | Team leadership | Telemetry | Tool-Calling
Education
N/A
Regions
Countries
States
Related jobs
-
Manager - Data , Analytics, & AI USD 110K-180KA/B | A/B Testing | AI Governance | AWS | B testing401k matching | Employee assistance program | Employee stock purchase plan | Health insurance | Healthcare FSAMid-level Full Time500 Woodward Avenue, MI, 601 S. … R2h ago
-
ArcGIS Enterprise | BigQuery | BusinessObjects | Data Entry Management | Data GovernanceSenior-level Full TimeThornton, CO, USA; Atlanta, GA, USA4h ago
-
Artificial Intelligence | Cause analysis | Cross-Functional Collaboration | Cross-functional | Data PipelinesMid-level Full TimeMountain View, CA, USA4h ago
-
Forward Deployed Full Stack Group Product Manager USD 240K-334KAI Coding Assistants | AI coding | APIs | Application development | Artificial IntelligenceBenefits | Bonus | Equity | Hybrid workSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Senior Product Manager, Applied AI, DeepMind USD 256K-278KAgentic Architectures | Artificial Intelligence | B2B | Cloud Computing | Enterprise SoftwareSenior-level Full TimeMountain View, CA, USA; New York, …4h ago
-
Tech Lead, Robotic AI Model USD 150K-180KAction Chunking | Action Tokenization | Behavior Cloning | DPO | DeepSpeedSenior-level Full TimeEl Segundo, California, United States14h ago
-
Strategic AI Lead USD 150K-210KAgile | Confluence | Data Quality | Data Visualization | Data labeling401k matching | Medical/Dental/VisionSenior-level Full TimeNew York City, NY (Hybrid); Redwood … R15h ago
-
Manager, Data Science USD 144K-216KCausal Inference | Dashboards | Modeling | Predictive Analytics | Python401k match | Employee product discounts | Paid Holidays | Paid parental leave | Paid vacationSenior-level Full TimeRenton, Washington, US, 9805615h ago
-
Data Analyst - Global Growth Luxury Strategy USD 99K-123KData Automation | Data Modeling | Data Visualization | Experiment measurement | Machine Learning401k match | Child care benefits | Dental insurance | Family building benefits | Lyft Pink membershipMid-level Full TimeSan Francisco, CA R17h ago
-
Analytics Manager, Credit Risk USD 191K-215KCredit Risk | Machine Learning | Python | SQL | UnderwritingESPP | Flexible spending wallets | Health care coverage | Remote-first | Time offMid-level Full TimeRemote US R18h ago
-
Data Science Manager, Consumer USD 217K-303KA/B | A/B Testing | Analytics | B testing | Causal Inference401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Healthcare benefitsMid-level Full TimeRemote - United States R19h ago
-
Analytics Tagging Manager (Google Tag Manager) USD 81K-128KConsent Management | Conversion API | Data Layer | Floodlight | Google AnalyticsOnsite schedule adherence | Remote day per weekMid-level Full TimeBoca Raton, FL, United States19h ago
-
Senior Manager, Strategic Health Analytics USD 164K-230KBiostatistics | Business Intelligence | Data Modeling | Data Science | Data analytics401k plan | Backup care | Dental insurance | Disability insurance | Employee resource groupsSenior-level Full TimeUnited States20h ago
-
Manager, Embedded Systems USD 175K-205KC++ | Design for Reliability | Documentation Control | Embedded Systems | Firmware Development401k plan | Cell phone reimbursement | Employee assistance program | Employee purchase program | Medical, dental & vision coverageMid-level Full TimeSan Francisco, CA20h ago
-
Sr. Manager, Field Engineering - Public Sector (SLED) USD 192K-264KArchitecture Review | Big Data | Customer Success | Data Engineering | Data InfrastructureSenior-level Full TimeUnited States21h ago
-
Data Engineering Manager (remote) USD 87K-110KAgile | BigQuery | Data Governance | Data Modeling | Data Quality401k match | Employee assistance program | Employee stock purchase plan | Flexible schedules | Health insuranceMid-level Full TimeWork From Home, United States R21h ago
-
Quant Analytics Manager USD 165K-205KAWS | Agile | Databricks | Jira | Jira AlignBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeColumbus, OH, United States22h ago
-
Engineering Manager, Agentic Systems - Moveworks USD 113K-192KC++ | Deep learning | DeepSpeed | Distributed Training | GPU infrastructureMid-level Full TimeMountain View, CALIFORNIA, United States22h ago
-
Sr. Manager, AI Forward Deployed Engineering (FDE) USD 211K-291KAWS | Azure | Cloud Computing | Customer consulting | Data ScienceEastern or Central time zone preference | Monthly travel | Remote within United StatesSenior-level Full TimeUnited States23h ago
-
Excel | Google BigQuery | PowerPoint | Python | R401k matching | Dental insurance | Disability insurance | Flexible time off | Health insuranceSenior-level Full TimeLas Vegas, NV, United States23h ago
-
Sr. Manager, Analytics and Operational Data Governance USD 107K-203KAlteryx | Azure | Databricks | ERP | Machine LearningSenior-level Full TimeHouston, TX, United States23h ago
-
AWS | Amazon Redshift | Asana | BigQuery | Cloud platform401k matching | Dental insurance | Flexible work policy | Learning and development programs | Medical insuranceSenior-level Full TimeColorado R23h ago
-
AWS | Amazon Redshift | Asana | BI reporting | Basecamp401k matching | Company events | Dental insurance | Flexible work policy | Learning and development programsSenior-level Full TimeCalifornia R23h ago
-
Director of Data & Analytics USD 170K-230KAWS | Advanced Analytics | Agile | Apache Airflow | Artificial IntelligenceExecutive-level Full TimeCharlotte, NC, United States23h ago
-
Analytics Solutions Manager - Vice President USD 215K-260KAWS Redshift | Alteryx | Capacity Planning | Cloud adoption | Cost modelingBackup childcare | Financial coaching | Health care | Mental health support | On-site health and wellness centersExecutive-level Full TimeChicago, IL, United States1d ago