QA Engineering Lead, AI Native
Tasks
- Build test strategies for AI models
- Define quality metrics
- Develop AI model evaluation processes
- Drive cross platform test planning and execution
- Implement QA automation for AI models
- Measure test effectiveness and efficiency
- Partner with engineering and infrastructure teams
- Perform adversarial testing
- Reduce regressions through automation
- Validate Responsible AI outputs
Perks/Benefits
- N/A
Skills/Tech-stack
Adversarial Testing | Automation frameworks | Black box testing | Black-box | Box testing | C++ | Data analytics | Ethics | Explainability | Java | JavaScript | KPI Management | LLM Testing | Model Evaluation | Multimodal Models | PHP | Prompt engineering | Python | Quality Assurance | Regression testing | Responsible AI | Safety | Scenario testing | Test Execution | Test Planning | Test automation | Test triage | White-box | White-box testing
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Lead Software Engineer - Java/Python - Learn AI / LLM USD 175K-215KAgile | Amazon Web Services | Application Resiliency | Artificial Intelligence | CI/CDBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeNew York, NY, United States4h ago
-
AI ethics | Agent Orchestration | Bias Mitigation | Capacity Planning | Data StorytellingSenior-level Full TimeBellevue, WA | Menlo Park, CA5h ago
-
Data Infrastructure Lead, Partner and User Analytics USD 153K-222KBusiness Intelligence | Dashboards | Data Visualization | Data analytics | Database DesignSenior-level Full TimeNew York, NY, USA; Mountain View, …6h ago
-
Data Lead- Dallas, TX USD 46K-162KAWS | Airflow | Azure | BM25 | Cosine similarity401k | Dental insurance | Health insurance | Paid Holidays | Paid time offSenior-level Full TimeUnited States16h ago
-
Applied AI Team Lead USD 125K-180KArtificial Intelligence | Data access | Language Processing | Machine Learning | Natural Language100% remote | 401k plan | Dental insurance | Health insurance | InsuranceSenior-level Full TimeRemote - United States R20h ago
-
Lead Data Engineer USD 110K-140KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure FunctionsSenior-level Full TimeUnited States20h ago
-
People Analytics & AI Transformation Lead USD 90K-119KArtificial Intelligence | Dashboards | Data Infrastructure | Data Security | Data Storytelling401k match | Dental insurance | Health insurance | Holidays | Paid time offSenior-level Full TimeRemote, USA R21h ago
-
Lead Experimental Physicist USD 120K-199KData Analysis | Data Processing | Deformable Mirrors | Diagnostics development | Excimer Lasers401k company match | Annual Company Shutdown | Dental insurance | Equity | Life insuranceSenior-level Full TimeDenver, CO21h ago
-
Staff Data Analyst USD 122K-165KB2B SaaS | Behavioral segmentation | Cohort Analysis | Dashboarding | Data Instrumentation401k match | Dental insurance | Family planning resources | Flexible vacation policy | Fully remoteSenior-level Full TimeRemote - USA R22h ago
-
Data Analytics Team Lead USD 130K-170KAI visuals | APIs | Azure Data | Azure Data Factory | Azure Data Lake401k matching | Dental insurance | Life insurance | Medical insurance | Paid time off (PTO)Senior-level Full TimeRemote, US R1d ago
-
Lead Software Engineer - AI/ML USD 175K-185KAI Evaluation | Agile | Algorithms | Application Resiliency | Application developmentBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeHouston, TX, United States1d ago
-
Lead Software Engineer - AI/ML USD 175K-185KAWS | Agile methodologies | Algorithms | Automation | CI/CDSenior-level Full TimeHouston, TX, United States1d ago
-
Lead Software Engineer - Python/Cloud/AI/ML USD 173K-190KAWS | Agile | Apache Cassandra | Apache Kafka | Application ResiliencyBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePlano, TX, United States1d ago
-
Sr. Data Engineer USD 127K-164KAgentic AI | DBT | Data Governance | Data Quality | Data SecurityComprehensive benefits | Extensive training initiatives | Group insurance | Growth opportunities | Hospitalization insuranceSenior-level Full TimeBangalore, FL, US, 5600761d ago
-
Lead Analyst, Member & Product Analytics USD 130K-175KA/B | A/B Testing | B testing | Churn modeling | Data VisualizationFree lunch and snacks | Opportunity to build teamSenior-level Full TimeNew York1d ago
-
AI Enablement Services Lead USD 140K-180KAgentic Workflows | Artificial Intelligence | AutoGPT | Langchain | Language ModelsBonus day for birthday | Health & wellness days | Holiday and Vacation Time | Medical, dental & vision coverageSenior-level Full TimeChicago, IL, United States1d ago
-
Data Scientist Lead ID USD 99K-162KData Science | Data analytics | Large dataset | Large dataset analytics | Peer reviewBereavement leave | Federal Holidays | Health benefits | Jury duty leave | Paid time offSenior-level Full TimeMcLean , VA1d ago
-
Senior/Lead Data Scientist- Pricing Optimization USD 150K-185KAzure | Cross-functional | Cross-functional leadership | Data Analysis | Data ScienceCareer developmentSenior-level Full TimeNew York, New York, United States … R1d ago
-
Data Science Practice Lead USD 140K-285KA/B | A/B Testing | Agentic Workflows | Agile | Artificial IntelligenceComprehensive health care | Educational assistance | Emotional well-being support | Employee matching charitable giving | Hybrid work scheduleSenior-level Full Time245 Summer St, Boston MA, United …1d ago
-
Robotics Quality Lead USD 180K-287KCause analysis | Continuous Improvement | Corrective and Preventive Actions | Data Quality | Data ValidationSenior-level Full TimeCA Client Field Office (San Fran …1d ago
-
Lead Data Engineer - Databricks USD 150K-175KApache Spark | Data Ingestion | Data Transformation | Databricks | Distributed ProcessingDental insurance | Disability insurance | Life insurance | Medical insurance | PTOSenior-level Full TimeRemote, FL, United States R1d ago
-
Data Governance | Data Visualization | Elasticity Modeling | Excel | Forecasting401k plan | Disability benefits | Life insurance | Paid time off | Parental leaveSenior-level Full Time141753-NC-Three Wells Fargo Center, Charlotte, United …1d ago
-
Senior-level Full TimeChicago, IL, United States1d ago
-
Lead Machine Learning Engineer USD 172K-276KAWS | Azure | CI/CD | Databricks | Distributed SystemsRemote workSenior-level Full TimeChicago, Illinois, USA R1d ago
-
Lead Data Engineer USD 173K-276KAWS | Azure | CI/CD | Data Governance | Data Lake401k | Dental insurance | FSA/HSA | Life insurance | Medical insuranceExecutive-level Full TimeBellevue, WA, United States2d ago