QA Validation Engineer for AI Initiatives (Teradyne, North Reading, MA)
Tasks
- Assess model performance and output quality
- Automate validation suites for multi agent systems
- Collaborate with data engineering data science and product teams on data quality standards
- Conduct bias detection and explainability testing
- Develop data quality test strategies
- Ensure data integration across multi agent architectures and APIs
- Execute completeness consistency lineage timeliness testing
- Lead audit documentation and risk assessments
- Lead end to end validation of AI and ML systems
- Maintain data lineage traceability for audit readiness
- Oversee generative AI and LLM output scenario testing
- Perform regression testing for AI systems
- Run integration testing for ML models
- Validate accuracy reliability compliance and ethical use of data
- Validate governance regulatory and compliance standards for AI data
- Validate human plus AI workflow data flows
- Validate prompt engineering outputs with verified data sources
Perks/Benefits
- Dental insurance
- Disability insurance
- Flexible spending accounts
- Health insurance
- Life insurance
- Paid Holidays
- Paid vacation
- Retirement savings plan
- Tuition assistance
- Vision insurance
Skills/Tech-stack
API Integration | Agent Orchestration | Bias detection | CI/CD | Data Governance | Data Lake | Data Lineage | Data Warehouse | Data audit | Data profiling | ELT testing | ETL Testing | Explainability | Generative AI | Java | Language Models | Large Language Models | Learning Metrics | Machine Learning | Machine learning metrics | Prompt engineering | Python | Risk Assessment | SQL | Schema Validation | Test automation | Test frameworks
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Regions
Countries
States
Related jobs
-
Partner Engineer, Generative AI USD 159K-223KAWS | Agent Orchestration | Bias Mitigation | C# | C++Entry-level Full TimeMenlo Park, CA7h ago
-
Customer and Product Solutions Engineer, GenAI USD 127K-182KC++ | CSS | Cloud Platforms | Data Analysis | Gemini APIEquity compensation | Health insurance | Paid time off | Retirement benefitsMid-level Full TimeSunnyvale, CA, USA7h ago
-
Staff Software Engineer, Gen AI, Blackbelt Team USD 207K-300KCloud Architecture | Cloud Computing | Computer Vision | Data Processing | Deep learningSenior-level Full TimeSunnyvale, CA, USA; New York, NY, …7h ago
-
AI Algorithms | APIs | Backend Services | C++ | Cloud infrastructureMid-level Full TimeSunnyvale, CA, USA7h ago
-
Advertising Systems | Benchmarking | Data Processing | Deep learning | Distributed ComputingSenior-level Full TimeMountain View, CA, USA7h ago
-
Senior Software Engineer, Generative AI, Search Health USD 174K-252KA/B | A/B Testing | B testing | Computer Vision | Data AnalysisSenior-level Full TimeMountain View, CA, USA7h ago
-
RTL Design Engineer, Machine Learning Accelerators USD 138K-197KASIC design | Code review | High Performance | High-Performance Design | Learning algorithmsMid-level Full TimeSunnyvale, CA, USA7h ago
-
Accelerated inference | Android | Application Programming | Application Programming Interfaces | CPUBonus | Equity compensation | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA7h ago
-
API Development | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote workSenior-level Full TimeWork from home, VA, United States12h ago
-
ClaimsXM Data Engineer III USD 125K-140KAnalysis Services | Azure | Azure Data | Azure Data Factory | Data Cleansing401k employer match | Health insurance | Paid Holidays | Paid Long Term Disability | Paid Short Term DisabilitySenior-level Full TimeUnited States12h ago
-
A Star | AutoWare | Behavior planning | C Sharp | C#Senior-level Full TimeUnited States, Washington, Redmond17h ago
-
Acceptance Testing | Cause analysis | Data Analysis | Electrical troubleshooting | IMUSecurity screening required | Travel opportunitiesSenior-level Full TimeUnited States, Washington, Redmond17h ago
-
Senior-level Full TimeUnited States18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAI APIs | AWS | Apache Spark | Application development | Artificial IntelligenceCustomer travel 20 percent timeSenior-level Full TimeSan Francisco, California18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percent timeSenior-level Full TimeRemote - Washington D.C. R18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Azure | CI/CD | DatabricksTravel 20 percentSenior-level Full TimeNew York City, New York18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAPI Integration | AWS | Apache Spark | Artificial Intelligence | AzureTravel 20 percent timeSenior-level Full TimeChicago, Illinois18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Artificial Intelligence | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeAustin, Texas; USCA18h ago
-
Machine Learning Video Engineer USD 166K-284KComputer Architecture | Computer Vision | Deep learning | Edge Computing | Image ProcessingSenior-level Full TimeCupertino19h ago
-
Senior Spacecraft Embedded Linux Engineer, C++ USD 169K-216KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k match | Dental insurance | EV charging | FSA | Flexible PTOSenior-level Full TimeEl Segundo, California, United States20h ago
-
Spacecraft Embedded Linux Engineer, C++ USD 131K-184KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k employer match | EV charging | Flexible PTO | Gym Wellness Reimbursement | HSA employer matchEntry-level Full TimeEl Segundo, California, United States20h ago
-
Senior Data Scientist - Ontology USD 128K-170KCypher | Data integration | Data profiling | Description logics | Entity ResolutionSenior-level Full TimeOffice Location or Remote - USA R20h ago
-
Machine Learning Engineer I, Network USD 151K-189KClassification | Data Pipelines | Deep learning | Embedding Models | Experiment tracking401k match | Commuting support | Fertility benefits | Flexible PTO | Free lunchSenior-level Full TimeSan Francisco, CA20h ago
-
Blade design | CFD | CHT | Cross-Functional Collaboration | Cross-functional401k match | Dental insurance | Educational assistance | Employee assistance program | Employer-subsidized health insuranceSenior-level Full TimePhoenix, AZ, United States20h ago
-
Data Analysis | Machine Learning | Model Predictive | Model-Predictive Control | Optimal ControlSenior-level Full TimeSeattle20h ago