QA Engineering Lead, AI Native
Tasks
- Build test strategies for AI models
- Define quality metrics and measurements
- Develop AI model evaluation processes
- Ensure product quality and risk assessment
- Execute scenario based adversarial testing
- Implement responsible AI quality controls
- Lead QA efforts for scalable iteration
- Partner with engineering for test automation
- Plan develop and execute test strategies
Perks/Benefits
- N/A
Skills/Tech-stack
Accuracy testing | Adversarial Testing | Analytics | Automation coverage | Automation frameworks | Black box testing | Black-box | Box testing | C++ | Cultural sensitivity | Defect Escape Rate | Ethics compliance | Explainability | Grounding evaluation | Java | LLM | Language Processing | Localization | Machine Learning | Natural Language | Natural Language Processing | PHP | Policy Compliance | Prompt engineering | Python | Quality Assurance | Relevance Testing | Responsible AI | Safety evaluation | Scenario testing | Test Agents | Test Coverage | Test Execution | Test Planning | Test automation | Test triage | White-box | White-box testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Regions
Countries
States
Cities
Related jobs
-
Senior-level Full TimeSalem, NH, United States5h ago
-
Senior-level Full TimeNew York, NY, United States5h ago
-
Product Marketing Lead, GenAI USD 154K-193KAI/ML | AI/ML Fundamentals | Community building | Competitive Intelligence | Content StrategyCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; New York, NY21h ago
-
Head of Global Enterprise GenAI USD 164K-237KChatGPT enterprise | Cloud Operations | Enterprise platform | Enterprise platform management | Generative AI401k matching | Dental benefits | Flexible time off | Flexible work schedule | Healthcare benefitsExecutive-level Full TimeTexas, TX, United States R1d ago
-
Lead Software Engineer - Full Stack-Generative AI USD 184K-215KAWS | CI/CD | CrewAI | DevOps | GitHub ActionsSenior-level Full TimePlano, TX, United States1d ago
-
Lead Software Engineer - Cloud/AI Engineer USD 178K-215KAI Agents | AWS | Algorithms | CI/CD | Data StructuresBackup childcare | Financial coaching | Health care coverage | Mental health support | Retirement savings planSenior-level Full TimePlano, TX, United States1d ago
-
Data Science Manager USD 155K-225KEvaluation Frameworks | Experiment design | GenAI | Logging | Machine LearningMid-level Full TimeRemote, United States R1d ago
-
Chief of Staff to the Managing Director of AI USD 140K-242KAirtable | Artificial Intelligence | Asana | Business case | Change ManagementEquity participation | Performance bonuses | Remote-friendly | TravelSenior-level Full TimeDenver, CO1d ago
-
Product Analytics Team Lead, New Products USD 150K-180KAirflow | ClickHouse | Git | Grafana | Matplotlib31 days off | Co-working | English learning courses | Equity options | Gym or swimming poolSenior-level Full TimeCyprus - Remote R1d ago
-
Business Marketing Workflow Automation Lead USD 122K-176KAgentic Systems | Artificial Intelligence | Campaign Optimization | Data Analysis | ExperimentationSenior-level Full TimeAustin, TX | Menlo Park, CA …1d ago
-
Data Platform Lead USD 155K-190KAWS | Access Control | Apache Kafka | Apache Spark | Data anonymizationSenior-level Full TimeNew York City1d ago
-
Senior-level Full TimeMcLean, VA, United States1d ago
-
AI/ML Capability Lead - Aviation Analytics USD 146K-234KAgentic AI | Artificial Intelligence | Data Fusion | Data Generation | Data ScienceSenior-level Full TimeAnnapolis Junction, MD, United States1d ago
-
Lead Data Architect - Aviation Analytics USD 146K-234KAPIs | Analytics | Cloud Platforms | Data Architecture | Data EngineeringSenior-level Full TimeAnnapolis Junction, MD, United States1d ago
-
Senior AI/ML Lead USD 125K-160KAnomaly Detection | Databricks | Distributed Computing | Feature Engineering | Fraud DetectionHybrid work schedule | Onsite days per month | Technical reviews and stakeholder briefings supportSenior-level Full TimeArlington, VA1d ago
-
Head of AI Enablement USD 220K-285KAI literacy | Bias Mitigation | Data Privacy | GDPR | Generative AI401k plan | Basic life insurance | Dental insurance | Medical insurance | Paid HolidaysExecutive-level Full TimeUnited States of America - Remote … R1d ago
-
Senior Lead Data Engineer USD 209K-262KAWS | Agile | Amazon EMR | Amazon Redshift | Apache KafkaHealth benefits | Incentive compensation | Inclusive work environment | Performance bonusSenior-level Full TimeMcLean, VA, United States1d ago
-
Lead Data Engineer USD 128K-171KAI | Access Management | Alerting | Auditability | AutomationHybrid work model | MentorshipSenior-level Full TimeMalvern, PA, United States1d ago
-
Lead Databricks Consultant USD 122K-174KAWS | Access Control | Apache Spark | Azure | Batch Processing401k retirement plan | Comprehensive employee assistance program | Dental insurance | Medical insurance | Paid HolidaysSenior-level Full TimeUSA, TX, Work-at-Home, United States R1d ago
-
Lead Data Engineer (Databricks, SQL) USD 150K-170KAdvanced Analytics | Agile | Automation | Azure | Azure Blob401k | Disability insurance | Health savings account | Hybrid work arrangement | Life insuranceSenior-level Full TimeIL-70 W Madison St, 8th Fl, …1d ago
-
Artificial Intelligence | Data Architecture | Data Modeling | Deep learning | Fine TuningCareer development opportunitiesSenior-level Full TimeJersey City, New Jersey, United States1d ago
-
Senior-level Full TimeMcLean, VA, United States1d ago
-
Data Engineering Supervisor USD 96K-119KADLS Gen2 | Analysis Services | Azure Analysis | Azure Analysis Services | Azure Data401k plan | Company paid life insurance | Dental insurance | Medical insurance | Paid time offSenior-level Full TimeNewton, New Jersey, United States1d ago
-
Lead Platform Data Engineer USD 131K-205KAI/ML | AWS | Airflow | AsyncAPI | Azure401k match | Coaching and strengths development | Community involvement | Employee discounts | Health, dental, vision insuranceSenior-level Full TimeCarmel, IN, United States1d ago
-
Artificial Intelligence | Azure | Backend Development | Cloud Computing | Decision TreeRemote workSenior-level Full TimeOrlando, FL1d ago