Staff ML Engineer - Embodied AI Evaluation Foundations
GM Automation - Sunnyvale - GM Automation - Sunnyvale, United States
R
USD 189K-300K Senior-level Full Time
Tasks
- Build evaluation signal and introspection tools
- Connect evaluation signals to data selection training and launch decisions
- Design and implement large scale evaluation workflows
- Develop model performance visualization tools
- Enable model behavior introspection
- Establish evaluation tooling best practices
- Maintain evaluation metrics presentation
- Provide technical leadership through design reviews and code reviews
- Run evaluation flywheel to improve signal and data
Perks/Benefits
- N/A
Skills/Tech-stack
BigQuery | Data Streaming | Data Visualization | High Throughput | High Throughput Data Streaming | High-throughput data | Jupyter | Kubernetes | Machine Learning | Model Evaluation | Model Introspection | Node.js | Python | React | Spark | Streamlit | TypeScript | WebGPU | Webgl
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R13d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R26d ago
-
Senior Embedded Software Engineer - Future Forward USD 134K-201KAuthentication | C# | C++ | CAN | CUDASenior-level Full TimeSunnyvale, CA, United States R6h ago
-
Senior AI Engineer (m/f/d) USD 100K-140K.NET | AI Search | AIOps | API Integration | AWS100 percent salary during sick leave | 4 weeks remote work per year | Childcare support | Coursera access | Experience daysSenior-level Full TimeMadrid, MD, Spain R11h ago
-
AI Forward Deployed Engineer | $120K-$150K + Hybrid + Equity | AI-Based Outage Intelligence Company A USD 120K-150KAI workflows | API Integration | Automation | Backend Development | Customer IntegrationDirect impact on company growth | Equity | Fast-moving startup environment | Hybrid work environment | Significant ownershipMid-level Full TimeKing of Prussia, PA, United States R19h ago
-
Software Engineer, AI Developer Experience USD 171K-190KAI | CLI Integration | Cloud Computing | Code review | Evaluation FrameworksCareer coaching and support | In-office culinary options | Inclusive family building benefits | Mental health wellness and fitness benefits | Retirement savings plansSenior-level Full TimeNew York City R1d ago
-
Artificial Intelligence | Automation | LLM integrations | Langchain | Language ModelsContractor | Fully remoteSenior-level ContractLos Angeles R1d ago
-
Software Engineer AI/ML USD 112K-150KA/B | A/B Testing | AWS | Anomaly Detection | Automated testingDental insurance | Employee assistance program | Health and wellness programs | Health insurance | Retirement benefitsMid-level Full TimeEvendale, United States R1d ago
-
Sr Data Engineer USD 91K-163KAI/ML | Azure DevOps | CI/CD | Code review | Data Compliance401k contribution | Career development opportunities | Comprehensive benefits | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
Senior AI/ML Engineer - Remote (Central Time Zone) USD 91K-163KAWS App Runner | AWS AppSync | AWS Bedrock | AWS Lambda | Agents SDK401k contribution | Benefits package | Equity stock purchase | Incentive and recognition programs | Remote workSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
Senior Applied AI Engineer USD 125K-230KAI Chatbot Development | AI chatbot | API Development | AWS | Amazon ConnectRemote work flexibilitySenior-level Full TimeAppliance Park KY US, United States R1d ago
-
Lead Machine Learning Engineer USD 172K-276KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksLearning and development programs | Mentorship and coachingSenior-level Full TimeChicago, Illinois, USA R1d ago
-
Solution Engineer USD 165K-216KAnalytics | Cloud Computing | Data Lake | Data Warehousing | Data fabricSenior-level Full TimeUS-FL-Remote R1d ago
-
Senior Data Engineer USD 126K-180KAmazon Kinesis | Apache Airflow | Apache Beam | Apache Flink | Apache Spark401k match | Bonus | Equity grant | Flexible time off | Health plansSenior-level Full TimeNew York, New York; Miami, Florida; … R1d ago
-
Senior Analytics Engineer USD 126K-180KAutomation | BI reporting | DBT | Data Modeling | Data Quality401k with company matching | Bonus | Equity grant | Flexible time off | Health plansSenior-level Full TimeNew York, New York; Miami, Florida; … R1d ago
-
Senior Applied Scientist USD 170K-286KApache Spark | C++ | Computer Vision | Data Processing | Edge inferenceComprehensive health insurance | Parental leave | Professional development stipend | Remote work | Travel up to 5 percentSenior-level Full TimeRemote - US R1d ago
-
AI Integrations Staff Engineer USD 150K-230KAI Models | Agent Harness | Agent SDK | Back-end | Back-end development401k contribution | Company retreats | Dental insurance | Employee referral program | EquitySenior-level Full TimeRemote R1d ago
-
Senior Data Engineer-JT0224 USD 115K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R1d ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R1d ago
-
Senior WEM AQM Prompt Engineer USD 88K-247KA/B | A/B Testing | API Integration | B testing | CalibrationInclusive environment | Remote work | Team-first cultureSenior-level Full TimeUnited States (Remote) R1d ago
-
Analytics Engineer USD 195K-264KAirflow | Cloud Data | Cloud Data Warehouse | DBT | Data ModelingCommuter stipend | Dental coverage | Flexible PTO | Lunch and dinner stipends | Medical coverageSenior-level Full TimeSan Francisco, CA & New York, … R1d ago
-
Staff Backend Engineer, AI Systems USD 181K-226KAPIs | Asynchronous processing | Azure OpenAI | Context retrieval | Distributed SystemsBenefits | Remote-first workSenior-level Full TimeUnited States Remote R1d ago
-
Artificial Intelligence | Assessment | Curriculum Development | Live coding | Machine LearningEntry-level Part TimeRemote, United States R1d ago
-
Cloud DevOps Engineer, Data & Analytics USD 195K-250KAWS | Azure | Bash | CI/CD | Disaster RecoveryHybrid work | Remote 2 days per week | Supportive collaborative environmentMid-level Full TimeAtlanta; Boston; Charlotte; Chicago; Dallas; Los … R1d ago
-
Staff Designated Support Engineer USD 122K-160KAI workflows | AWS | As-a-Service | Azure | Cloud DataSenior-level Full TimeUS-TX-Remote R1d ago