QA Engineering Lead, AI Native
Tasks
- Build test strategies for AI models
- Define quality metrics
- Develop AI model evaluation processes
- Drive cross platform test planning and execution
- Implement QA automation for AI models
- Measure test effectiveness and efficiency
- Partner with engineering and infrastructure teams
- Perform adversarial testing
- Reduce regressions through automation
- Validate Responsible AI outputs
Perks/Benefits
- N/A
Skills/Tech-stack
Adversarial Testing | Automation frameworks | Black box testing | Black-box | Box testing | C++ | Data analytics | Ethics | Explainability | Java | JavaScript | KPI Management | LLM Testing | Model Evaluation | Multimodal Models | PHP | Prompt engineering | Python | Quality Assurance | Regression testing | Responsible AI | Safety | Scenario testing | Test Execution | Test Planning | Test automation | Test triage | White-box | White-box testing
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
AWS | Artificial Intelligence | Azure AI | Data Analysis | DatabricksBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeChicago, IL, United States22h ago
-
Senior Lead Data Engineer USD 250K-286KAWS | Agile | Amazon Redshift | Apache Kafka | Apache SparkFinancial benefits | Health benefits | Inclusive work environment | Performance incentivesSenior-level Full TimeNew York, NY, United States23h ago
-
Vice President, Portfolio Analytics USD 143K-181KAccounting | Data Quality | Data Reconciliation | Data analytics | Data consolidation401k savings plan | Adoption Assistance | Commuting subsidies | Fertility services | Fitness subsidiesExecutive-level Full TimeNew York, United States23h ago
-
Cybersecurity Analytics Lead USD 116K-184KAnomaly Detection | Apache Spark | Cybersecurity | Data Analysis | Data IngestionComprehensive health coverage | Federal holidays off | Flexible PTO | Onsite position | Professional development supportSenior-level Full TimeWashington, D.C. Metro1d ago
-
Lead Risk Analytics Data Scientist USD 125K-155KAI Automation | Actuarial pricing | Claims analytics | DBT | Data Modeling401k | Dental insurance | Medical insurance | Paid time off | Vision insuranceSenior-level Full TimeRemote, US R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative innovative work environment | Flexible remote working options | Health dental and retirement benefits | Professional development and training opportunitiesSenior-level Full TimeNew York R1d ago
-
Agentic AI Data Lead Software Engineer USD 168K-190KABAC | AWS Athena | AWS Glue | AWS IAM | AWS KMSSenior-level Full TimeColumbus, OH, United States1d ago
-
AI Lead/Manager USD 250K-340KAgent systems | Applied Machine Learning | Architecture | Code review | DebuggingSenior-level Full TimeNew York City1d ago
-
Practice Lead, Data & Analytics USD 155K-200KAWS | Agile | Amazon Redshift | Azure | Azure Data401k matching | Flexible vacation | Medical/Dental/Vision | Training SponsorshipSenior-level Full TimeLos Angeles, CA1d ago
-
Technical Delivery Lead USD 94K-164KAgentic AI | Apache Kafka | CI/CD | Cloud Native | Cloud Native ArchitectureBonus eligibility tied to performance | Comprehensive total rewards packageSenior-level Full TimeDayton WFH, United States R1d ago
-
Feature Lead - GenAI Team USD 106K-173KAgentic Retrieval Augmented Generation | Agile | Automation | Data Ingestion | Data ManagementPaid time offSenior-level Full TimeNew York, United States1d ago
-
Lead AI Software Engineer- (Hybrid NYC) USD 159K-309KAI Agents | AWS | Agent Orchestration | Automated testing | Cloud NativeAdoption benefits | Family care resources | Fertility benefits | Health and wellness benefits | Hybrid work scheduleSenior-level Full TimeNew York, NY, United States R1d ago
-
Lead Analytics Consultant USD 139K-224KCredit Risk | Decisioning | Fraud analytics | Payments | Power BISenior-level Full Time141753-NC-Three Wells Fargo Center, Charlotte, United …1d ago
-
Lead Data Engineer USD 224KAirflow | Apache Beam | BigQuery | CI/CD | Cloud Build401k plan | Commuter benefits | Disability benefits | Disaster caregiving leave | Discounts and savingsSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R1d ago
-
Lead Data Engineer USD 224KAirflow | Apache Beam | Apache Dataflow | Auto Scaling | BigQuery401k plan | Adoption reimbursement | Commuter benefits | Disability benefits | Discounts and savingsSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R1d ago
-
Lead Data Engineer USD 224KApache Airflow | Apache Beam | BigQuery | CI/CD | Cloud BuildHybrid work | Paid time off | Parental leave | Tuition reimbursementSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R1d ago
-
Lead Data Analyst USD 107K-229KAI-enabled | AI-enabled analytics | Behavior tracking | Causal Impact | Causal Inference13 paid holidays | 401k match | Dental insurance | ESPP | Fertility benefitsSenior-level Full TimeCA HQ, United States1d ago
-
Analytics Team Lead USD 109K-230KData Analysis | Data Modeling | Experimentation | Financial crime | Fraud DetectionAnnual incentive bonus | Remote work optionsSenior-level Full TimeHome based-Florida, United States R1d ago
-
Lead Databricks Consultant USD 122K-174KAccess Control | Amazon Web Services | Apache Spark | Azure | CI/CD401k retirement plan | Dental insurance | Employee assistance program | Medical insurance | Paid HolidaysSenior-level Full TimeUSA, TX, Work-at-Home, United States R1d ago
-
Lead Embedded Engineer USD 128K-192KAVB | C# | C++ | CAN | CAN-FD401k savings plan | Adoption benefits | Career development | Disability benefits | Employee assistance programSenior-level Full TimeMossville, Illinois, United States1d ago
-
Lead Perception Engineer USD 175K-235K3D Reconstruction | C++ | CUDA | Computer Vision | Coordinate TransformSenior-level Full TimeWoburn, Massachusetts, United States1d ago
-
Analytics Team Lead USD 109K-230KA/B | A/B Testing | B testing | Crime analysis | Data AnalysisBonus eligibility | Remote workSenior-level Full TimeHome based-Florida, United States R1d ago
-
Senior-level Full TimeSan Jose, CA, United States1d ago
-
Senior Lead Data Engineer USD 250K-286KAgile | Amazon Web Services | Cassandra | EMR | Google CloudSenior-level Full TimeNew York, NY, United States1d ago
-
Lead Data Engineer USD 179K-204KAWS Big Data | AWS Big Data Services | Agile | Amazon Redshift | Amazon Web ServicesSenior-level Full TimePlano, TX, United States1d ago