AI/ML Test Engineer
Tasks
- Capture data for evaluation
- Conduct operational validation for multiple models
- Detect data drift
- Develop data annotation workflows
- Document evaluation results and support briefings
- Execute AI ML evaluations in test evaluation environment
- Maintain automated evaluation pipelines
- Perform integration testing for AI ML workflows
- Troubleshoot workflow and data issues
- Validate operational datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Artificial Intelligence | Automated testing | CI Polygraph | Cloud Computing | Data Annotation | Data Capture | Data Drift | Data Drift Detection | Data Validation | DevSecOps | Drift Detection | Integration Testing | Machine Learning | Model Performance Assessment | Model performance | Operational testing | Performance Assessment | Test automation
Education
Roles
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R20d ago
-
Machine Learning Engineer II USD 75K-85KAPI Development | AWS | Algorithms | Azure | Big Data401k match | Dental insurance | Disability insurance | Life insurance | Medical insuranceMid-level Full TimeSaint Charles, MO, United States4h ago
-
AI Governance | AI Solution | AI Solution Architecture | API Integration | CI/CDSenior-level Contract Full TimeTampa, FL, United States8h ago
-
Golang | Information Retrieval | Language Processing | Language Understanding | Log Analysis401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States9h ago
-
Experimentation | Golang | Information Retrieval | Language Processing | Log Analysis401k match | ESPP | Family Leave Program | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States9h ago
-
Information Retrieval | Language Models | Language Processing | Large Language Models | Machine Learning401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States9h ago
-
2026 Computer Scientist Opportunities in Las Vegas, NV USD 122K-149KConfiguration Management | Development Lifecycle | Integration Testing | Software Development Lifecycle | Software development401k matching | Dental insurance | Disability insurance | Health savings accounts | Life insuranceNone Full TimeLas Vegas, NV, United States11h ago
-
Anomaly Detection | Confidence scoring | Confusion matrix | Data Annotation | Data DriftSenior-level ContractCalabasas, United States13h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KCloud Computing | Computer Vision | Image Processing | Machine Learning | Object DetectionEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsEntry-level Full TimeDallas, United States13h ago
-
Lead Applied AI Engineer II USD 118K-243K.NET | AI Agent | AI agent orchestration | AWS | AWS BedrockSenior-level Full TimeAustin, Texas, United States; Dallas, Texas, …14h ago
-
Director, AI Architecture USD 159K-230KAzure | Bias detection | CI/CD | Computer Vision | Data PipelinesOnsite childcare | Paid parental leave | Paid time off | Public Service Loan Forgiveness Qualified Employer | Retirement programsSenior-level Full TimeTexas-Dallas-5323 Harry Hines Blvd15h ago
-
Data Science Team Leader USD 165K-165KCI/CD | Cloud platform | Docker | Google BigQuery | Google CloudSenior-level Full TimeDenver, Colorado, United States15h ago
-
Software Engineer - Video ML Foundations team USD 124K-259KComputer Vision | Data Engineering | Deep learning | Efficient AI | GPU InferenceEntry-level Full TimeMenlo Park, CA16h ago
-
Senior-level Full TimeSunnyvale, CA | Remote, US | … R16h ago
-
[T] Software Engineer III, AI/ML GenAI, Google Cloud USD 147K-211KC++ | Cloud platform | Computer Vision | Data Processing | DebuggingSenior-level Full TimeNew York, NY, USA16h ago
-
Principal Engineer, GDC Storage, Google Cloud USD 307K-428KCloud Computing | Cloud Identity | Cloud Monitoring | Cloud identity and security | Cloud loggingBenefits | Bonus | EquitySenior-level Full TimeSunnyvale, CA, USA; Cambridge, MA, USA16h ago
-
Staff Software Engineer, AI/ML, Google Public Sector USD 207K-301KC++ | Cloud Native | Cloud Object Storage | Cloud-native infrastructure | Data IngestionSenior-level Full TimeReston, VA, USA16h ago
-
Technical Lead, Machine Learning, Google Play USD 207K-301KC++ | Computer Vision | Data Structures | Data Structures and Algorithms | ExperimentationSenior-level Full TimeMountain View, CA, USA16h ago
-
Software Engineer III, AI/ML, Google Security Operations USD 147K-211KC++ | Cloud Platforms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Software Engineer III, AI/ML, Google Cloud Performance USD 147K-211KC++ | Data Processing | Debugging | Language Processing | Machine LearningSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Software Engineer III, AI/ML GenAI, Search USD 147K-211KAudio generation | C++ | Data Processing | Debugging | Image GenerationSenior-level Full TimeMountain View, CA, USA16h ago
-
Software Engineer III, AI/ML, Gmail Ads Quality USD 147K-211KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA16h ago
-
Software Engineer III, AI/ML, YouTube Ads Bidding USD 147K-211KC++ | Data Processing | Debugging | Machine Learning | Model DeploymentSenior-level Full TimeMountain View, CA, USA16h ago
-
AI Solutions Engineer USD 126K-176KArchitecture Design | Artificial Intelligence | Data Mapping | Data Templates | DataverseHybrid work arrangement | Relocation N/A | Travel opportunityMid-level Full TimePhoenix, AZ, US22h ago
-
Staff Data Scientist - Digital Intelligence USD 191K-230KAdversarial Modeling | Anomaly Detection | Apache Spark | Data Processing | Distributed dataSenior-level Full TimeHybrid - US R22h ago