QA Engineering Lead, AI Native
Tasks
- Build test strategies for AI models
- Define quality metrics and measurements
- Develop AI model evaluation processes
- Ensure product quality and risk assessment
- Execute scenario based adversarial testing
- Implement responsible AI quality controls
- Lead QA efforts for scalable iteration
- Partner with engineering for test automation
- Plan develop and execute test strategies
Perks/Benefits
- N/A
Skills/Tech-stack
Accuracy testing | Adversarial Testing | Analytics | Automation coverage | Automation frameworks | Black box testing | Black-box | Box testing | C++ | Cultural sensitivity | Defect Escape Rate | Ethics compliance | Explainability | Grounding evaluation | Java | LLM | Language Processing | Localization | Machine Learning | Natural Language | Natural Language Processing | PHP | Policy Compliance | Prompt engineering | Python | Quality Assurance | Relevance Testing | Responsible AI | Safety evaluation | Scenario testing | Test Agents | Test Coverage | Test Execution | Test Planning | Test automation | Test triage | White-box | White-box testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Regions
Countries
States
Cities
Related jobs
-
Lead Applied Scientist USD 150K-170KAgentic AI | Autogen | CrewAI | Data Quality | Deep learning401k match | Dental insurance | Employee assistance program | Employee recognition | Employee stock purchase planSenior-level Full TimeWork From Home, United States R12h ago
-
Tech Lead, GTM Applied AI and Analytics USD 138K-225KAirflow | Amazon SageMaker | DBT | Databricks | Deep learningSenior-level Full TimeSan Francisco, CA, United States12h ago
-
Lead Data Architect USD 173K-276KAI metadata | Cloud Platforms | Data Architecture | Data Governance | Data Lakes401k | Dental insurance | Health insurance | Paid time off | Vision insuranceExecutive-level Full TimeFoster City, CA, United States16h ago
-
Principal System Integration Lead (Quantum Hardware) USD 195K-260KCause analysis | Change Control | Configuration Management | Controls engineering | DOORSSenior-level Full TimeMilpitas, California, United States1d ago
-
Lead Architect , AI Solutions Architecture - PI USD 169K-279KAI Act | AI Foundry | AI RMF | AI Services | API Integration401k match | Health insurance | Mental health counseling | Paid Holidays | Paid time offSenior-level Full TimeHartford - Tower, United States1d ago
-
Lead Architect , AI Solutions Architecture - EDDA USD 169K-279KAI RMF | AWS Bedrock | Agentic AI | Artificial Intelligence | CI/CD401k match | Health insurance | Paid time off | Volunteer rewards | Wellness programSenior-level Full TimeHartford - Tower, United States1d ago
-
Lead Architect, AI Solutions Architecture - BSI/Cyber USD 169K-279KAI Act | AI Ops | AI RMF | AWS Bedrock | Agentic AI401k match | Health insurance | Mental health counseling | Paid time off | Volunteer rewardsSenior-level Full TimeHartford - Tower, United States1d ago
-
Lead Architect , AI Solutions Architecture - Claim USD 169K-279KAI Act | AI Ops | AWS Bedrock | Agent Orchestration | Agentic AI401k match | Employee assistance program | Health insurance | Matching gift program | Paid time offSenior-level Full TimeHartford - Tower, United States1d ago
-
Lead Architect , AI Solutions Architecture - BI/INTL USD 169K-279KAI Act | AI Ops | AI RMF | AI Services | AWS Bedrock401k match | Free counseling services | Health coaching | Health insurance | Matching giftSenior-level Full TimeHartford - Tower, United States1d ago
-
AICS- AI Solution Lead USD 160K-180KAI Coding Assistants | AI coding | Agent systems | Coding assistants | Databricks Genie401k plan | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeCalifornia, United States1d ago
-
Lead AI Engineer USD 150K-230KAI Services | Agile | Angular | Argo CD | CI/CD401k matching | Career growth | Healthcare benefits | Online learning platform | Paid time offSenior-level Full TimeUSA - Georgia - Alpharetta - …1d ago
-
AWS | Agile | CSS | Docker | GoPerformance-Based Incentives | Remote eligibleSenior-level Full TimeMcLean, VA, United States R1d ago
-
Cloud Data Platform Engineering Lead USD 138K-231KAI/ML | AI/ML Integration | Apache Flink | Apache Spark | Argo Workflows401k | Education reimbursement | Health benefits | Hybrid work | Mental health benefitSenior-level Full TimeChicago - 20 S. Wacker, United …1d ago
-
Lead Data Engineer (Python, Spark, Glue, AWS) USD 179K-204KAWS Glue | Agile | Amazon Redshift | Amazon Web Services | Apache HadoopComprehensive health benefits | Financial benefits | Performance-Based IncentivesSenior-level Full TimeRichmond, VA, United States1d ago
-
Senior Lead Machine Learning Engineer USD 229K-286KAWS | Apache Spark | Bias Variance | Big Data | Cloud ArchitectureSenior-level Full TimeNew York, NY, United States1d ago
-
Lead Machine Learning Engineer USD 197K-225KAWS | Azure | Cloud platform | Continuous Deployment | Continuous integrationSenior-level Full TimeMcLean, VA, United States1d ago
-
Lead Data Engineer USD 172K-260KAWS | Airflow | Azure | CI/CD | DBT401k | Employee stock purchasing program | Hybrid work option | Life and disability insurance | Medical/Dental/VisionSenior-level Full TimeWashington - Seattle, United States1d ago
-
Cause analysis | DBT | Data Governance | Data Quality | Data Reconciliation401k match | Dental insurance | Employee assistance program | Flexible work/life support | Health insuranceSenior-level Full TimeBOSTON, United States1d ago
-
Lead Data Engineer (Remote) USD 102K-188KAPIs | Azure Data | Azure Data Factory | Azure SQL | Azure SQL ServerBenefits | Bonus eligible | Flexible work hours | Remote workSenior-level Full TimeMichigan, Portage 1941 Stryker Way, United … R1d ago
-
Architecture | Data Engineering | Data Governance | Data platform | DatabricksSenior-level Full TimeBoston, MA, United States1d ago
-
Business Intelligence | Dashboards | Data Products | Data Visualization | PythonSenior-level Full TimeBoston, MA, United States1d ago
-
Lead Machine Learning Engineer USD 157K-237KA/B | A/B Testing | Airflow | B testing | Data PipelinesSenior-level Full TimeUS TX Austin1d ago
-
Lead Data Scientist USD 225K-275KA/B | A/B Testing | API Integration | B testing | DBTCollaborative work environment | Dental insurance | Education Impact | Health insurance | Hybrid work modelSenior-level Full TimeSan Francisco R1d ago
-
Treasury Deposit Analytics & Liquidity Vice President USD 175K-235KAlteryx | Capital management | Data Wrangling | Deposit pricing | ExcelBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site wellness centersExecutive-level Full TimeColumbus, OH, United States1d ago
-
Technical Lead Manager, AI/ML Networking USD 207K-300KArtificial Intelligence | C++ | Compute Technologies | Dataplane Encryption | Deep Learning Execution ProviderSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA1d ago