Senior QA Validation Engineer for AI Initiatives (Teradyne, North Reading, MA)
Tasks
- Assess AI model performance with manual and automated review
- Automate validation suites for agentic systems integration testing and CI CD pipelines
- Conduct bias detection and explainability testing
- Design and execute data quality test strategies
- Develop accuracy bias robustness and regression test strategies
- Lead audit processes documentation and risk assessments
- Lead end to end AI ML validation testing and quality assurance
- Maintain data lineage traceability for audit readiness
- Perform scenario based testing for generative AI and LLM applications
- Validate AI ML data sources structure pipelines and governance
- Validate prompt engineering outputs with verified data
Perks/Benefits
- Flexible spending accounts
- Health and well-being benefits
- Life and disability insurance
- Paid vacation and holidays
- Retirement savings plan
- Tuition assistance
Skills/Tech-stack
API Integration | API Integration Testing | Agent Orchestration | Bias detection | CI/CD | Data Governance | Data Lake | Data Lineage | Data Warehouse | Data profiling | ELT | ETL | Explainability | Generative AI | Integration Testing | Java | Machine Learning | Prompt engineering | Python | SQL | Schema Validation | Test automation
Education
Regions
Countries
States
Related jobs
-
Partner Engineer, Generative AI USD 159K-223KAWS | Agent Orchestration | Bias Mitigation | C# | C++Entry-level Full TimeMenlo Park, CA7h ago
-
Customer and Product Solutions Engineer, GenAI USD 127K-182KC++ | CSS | Cloud Platforms | Data Analysis | Gemini APIEquity compensation | Health insurance | Paid time off | Retirement benefitsMid-level Full TimeSunnyvale, CA, USA7h ago
-
Staff Software Engineer, Gen AI, Blackbelt Team USD 207K-300KCloud Architecture | Cloud Computing | Computer Vision | Data Processing | Deep learningSenior-level Full TimeSunnyvale, CA, USA; New York, NY, …7h ago
-
AI Algorithms | APIs | Backend Services | C++ | Cloud infrastructureMid-level Full TimeSunnyvale, CA, USA7h ago
-
Advertising Systems | Benchmarking | Data Processing | Deep learning | Distributed ComputingSenior-level Full TimeMountain View, CA, USA7h ago
-
Senior Software Engineer, Generative AI, Search Health USD 174K-252KA/B | A/B Testing | B testing | Computer Vision | Data AnalysisSenior-level Full TimeMountain View, CA, USA7h ago
-
RTL Design Engineer, Machine Learning Accelerators USD 138K-197KASIC design | Code review | High Performance | High-Performance Design | Learning algorithmsMid-level Full TimeSunnyvale, CA, USA7h ago
-
Accelerated inference | Android | Application Programming | Application Programming Interfaces | CPUBonus | Equity compensation | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA7h ago
-
API Development | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote workSenior-level Full TimeWork from home, VA, United States12h ago
-
ClaimsXM Data Engineer III USD 125K-140KAnalysis Services | Azure | Azure Data | Azure Data Factory | Data Cleansing401k employer match | Health insurance | Paid Holidays | Paid Long Term Disability | Paid Short Term DisabilitySenior-level Full TimeUnited States12h ago
-
A Star | AutoWare | Behavior planning | C Sharp | C#Senior-level Full TimeUnited States, Washington, Redmond17h ago
-
Acceptance Testing | Cause analysis | Data Analysis | Electrical troubleshooting | IMUSecurity screening required | Travel opportunitiesSenior-level Full TimeUnited States, Washington, Redmond17h ago
-
Senior-level Full TimeUnited States18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAI APIs | AWS | Apache Spark | Application development | Artificial IntelligenceCustomer travel 20 percent timeSenior-level Full TimeSan Francisco, California18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percent timeSenior-level Full TimeRemote - Washington D.C. R18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Azure | CI/CD | DatabricksTravel 20 percentSenior-level Full TimeNew York City, New York18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAPI Integration | AWS | Apache Spark | Artificial Intelligence | AzureTravel 20 percent timeSenior-level Full TimeChicago, Illinois18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Artificial Intelligence | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeAustin, Texas; USCA18h ago
-
Machine Learning Video Engineer USD 166K-284KComputer Architecture | Computer Vision | Deep learning | Edge Computing | Image ProcessingSenior-level Full TimeCupertino19h ago
-
Senior Spacecraft Embedded Linux Engineer, C++ USD 169K-216KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k match | Dental insurance | EV charging | FSA | Flexible PTOSenior-level Full TimeEl Segundo, California, United States20h ago
-
Spacecraft Embedded Linux Engineer, C++ USD 131K-184KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k employer match | EV charging | Flexible PTO | Gym Wellness Reimbursement | HSA employer matchEntry-level Full TimeEl Segundo, California, United States20h ago
-
Senior Data Scientist - Ontology USD 128K-170KCypher | Data integration | Data profiling | Description logics | Entity ResolutionSenior-level Full TimeOffice Location or Remote - USA R20h ago
-
Machine Learning Engineer I, Network USD 151K-189KClassification | Data Pipelines | Deep learning | Embedding Models | Experiment tracking401k match | Commuting support | Fertility benefits | Flexible PTO | Free lunchSenior-level Full TimeSan Francisco, CA20h ago
-
Blade design | CFD | CHT | Cross-Functional Collaboration | Cross-functional401k match | Dental insurance | Educational assistance | Employee assistance program | Employer-subsidized health insuranceSenior-level Full TimePhoenix, AZ, United States20h ago
-
Data Analysis | Machine Learning | Model Predictive | Model-Predictive Control | Optimal ControlSenior-level Full TimeSeattle20h ago