AI Validation Engineer
Auburn Hills, MI, United States
USD 140K-220K (estimate) Mid-level Full Time
Tasks
- Analyze test results to identify root causes
- Build AI assisted test generation tools
- Create evaluation datasets and benchmarks
- Design validation frameworks for deep learning models
- Develop automated test pipelines for LLM features
- Implement automated regression testing for model updates
- Implement model monitoring and drift detection
- Integrate AI validation into CI CD pipelines
Perks/Benefits
Skills/Tech-stack
Adversarial Testing | Agile | Bias Fairness Analysis | Bias/fairness | CI/CD | Dataset curation | Deep learning | Drift Detection | Fairness analysis | GitHub Actions | GitLab CI | Hallucination detection | Jenkins | Kubeflow | LLM Evaluation | Language Processing | MLflow | Model Monitoring | Natural Language | Natural Language Processing | Prompt Regression | Prompt Regression Testing | Pytest | Python | Regression testing | Robot Framework | Statistical Analysis | Weights and Biases
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
A/B | A/B Testing | B testing | Cause analysis | Chatbot optimizationRemote workMid-level Full TimeOak Brook, IL, United States1d ago
-
AI | ClickHouse | Confluence | ETL | Git401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeColumbia, Maryland1d ago
-
Data Governance | Data Modeling | Data Structures | Data pipeline | Java401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer 1 - (Python, UI/UX, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer 1 - (AI, Python, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Docker | Helm401k match | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer, Machine Learning Infrastructure USD 140K-230KAPI Development | AWS | Airflow | Alerting | CI/CD401k access | Flexible PTO | Health, dental, vision coverage | Paid mealsMid-level Full TimeSan Francisco, CA, US1d ago
-
APIs | AWS | Apache Spark | Azure | Azure Data401k matching | Dental insurance | Flexible working arrangements | Health insurance | Life insuranceSenior-level Full TimeSkokie, United States1d ago
-
Anomaly investigation | Bitbake | Bitbucket Pipelines | C# | C++Travel up to 20 percentMid-level Full TimeHerndon, United States1d ago
-
Data Engineer, PDPO - Offense & Defense USD 147K-269KApache Spark | ClickHouse | Data Modeling | Data Warehousing | Distributed SystemsEntry-level Full TimeSan Jose, California, United States1d ago
-
Software Engineer Systems Machine Learning - Frameworks USD 112K-166KC# | C++ | CPU | CUDA | Compiler optimizationEntry-level Full TimeSunnyvale, CA | Bellevue, WA1d ago
-
Research Scientist, ML H/W-SW Codesign USD 177K-251KC# | C++ | Deep learning | GPU Architecture | Hardware accelerationMid-level Full TimeSunnyvale, CA1d ago
-
Robotics Verification & Validation Engineer USD 170K-230KAI Risk | AI Risk Assessment | Automated testing | Bias Mitigation | C++Senior-level Full TimeBurlingame, CA1d ago
-
Senior Software Developer, Machine Learning, Applied AI USD 174K-252KAI Agents | Agentic development | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA; Toronto, ON, Canada1d ago
-
Software Engineer, GenAI Silicon Automation, DeepMind USD 174K-252KABC | Application Programming | Application Programming Interfaces | C++ | CI/CDMid-level Full TimeMountain View, CA, USA1d ago
-
Senior Software Engineer, Search Quality, AI/ML USD 174K-252KAgentic Workflows | Algorithms | Backend Development | C++ | Data StorageSenior-level Full TimeNew York, NY, USA1d ago
-
Data Engineer, gTech Users and Products Engineering USD 106K-150KApache Flume | Data Modeling | Data Pipelines | Data Warehousing | Dimensional dataBonus target | Equity | Health insurance | Paid time off | Retirement planEntry-level Full TimeBoulder, CO, USA1d ago
-
Algorithms | Backend Development | C# | C++ | Code reviewSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Software Engineer III, AI/ML, Keywordless Search Ads USD 147K-210KC++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeMountain View, CA, USA1d ago
-
Software Engineer, Google Cloud Storage USD 147K-210KAccess Control | Best practices | Block Storage | C++ | Chaos EngineeringMid-level Full TimeRaleigh, NC, USA; Durham, NC, USA1d ago
-
AI Solutions Engineer USD 123K-178KAI Agents | Azure DevOps | Azure Machine Learning | Bias detection | CI/CDDental insurance | Disability insurance | Medical insurance | Paid time off | Supplemental insuranceSenior-level Full TimeReston, VA, US1d ago
-
Algorithm Engineer USD 150K-170KCI/CD | Code review | Data labeling | Deep learning | Digital SignalIn person office hubs | Remote work flexibilityMid-level Full TimeBoston, MA / Remote R1d ago
-
Principal Software Engineer - CoreAI USD 142K-274KAzure | Context engineering | Experiment design | Experimentation | Generative AISenior-level Full TimeUnited States, California, Mountain View; United …2d ago
-
Analytics Engineer USD 130K-170KCI/CD | DBT | Data Modeling | Data Quality | Data Quality Testing401k match | Flexible time off | Health benefits day one | Paid caregiver leave | Paid parental leaveSenior-level Full TimeUnited States (Remote) R2d ago
-
Staff Machine Learning Engineer, Shopping Ads USD 230K-322KConversion modeling | Data labeling | Deep learning | Distributed Systems | Feature Engineering401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R2d ago
-
A/B | A/B Testing | B testing | Distributed Training | Embeddings401k matching | Commuter benefits | Dental insurance | FSA | HSASenior-level Full TimeMountain View, California, United States2d ago