AI Chatbot Tester
Tasks
- Analyze conversational flows
- Assist with evaluation framework improvements
- Collaborate with AI trainers and prompt engineers
- Conduct regression testing
- Contribute to testing standards and best practices
- Document test results and findings
- Evaluate chatbot responses
- Execute test plans
- Identify defects inconsistencies and performance issues
- Perform user acceptance testing
- Prepare testing reports and performance insights
- Provide testing feedback to development teams
- Recommend improvements to responses and workflows
- Review chatbot interactions
- Support chatbot optimization initiatives
- Validate chatbot functionality
- Verify compliance with business requirements
Perks/Benefits
- N/A
Skills/Tech-stack
AI Evaluation | AI evaluation metrics | Acceptance Testing | Case design | Chatbot testing | Compliance testing | Conversation Analysis | Conversational AI | Defect documentation | Evaluation metrics | Generative AI | Management Tools | Prompt engineering | Quality Assurance | Regression testing | Reporting tools | Software testing | Test Case | Test Case Design | Test Management | Test Planning | Test management tools | User Acceptance | User Acceptance Testing | User Experience | User Experience Testing
Roles
AI | AI Chatbot Tester | Chatbot Tester | Software Tester | Tester
Related jobs
-
Senior Business Analyst, AI & Automation USD 101K-160KAcceptance Testing | Acceptance criteria | Agile | Analytics | Artificial IntelligenceEqual opportunity workplace | Remote workSenior-level Full TimeUnited States R21h ago
-
AI Foundry | AWS Bedrock | Agent Frameworks | Agent Orchestration | AnthropicMid-level Full TimeHouston, TX, United States R1d ago
-
Practice Manager - AI & Data USD 160K-190KAI Regulations | AWS | AWS Bedrock | AWS SageMaker | Agent systemsCareer growth opportunities | Comprehensive benefits | Mentorship | On-site work optionsSenior-level Full TimeTroy, Michigan, United States1d ago
-
Senior AI/ML Engineer USD 125K-188KAWS | AWS Architecture Patterns | AWS CDK | AWS Lambda | AWS architecture401k matching | Dental | Health savings account | Life insurance | MedicalSenior-level Full TimeHerndon, Virginia, United States R1d ago
-
Director, AI Engineering USD 121K-262KAI Agents | AI Risk | API Integration | Access Control | Applied Machine LearningExecutive-level Full TimeFifth Third Center Cincinnati, United States1d ago
-
Sr Full Stack AI Engineer USD 155K-200KAgent Orchestration | Agent systems | Anthropic Cloud Code | Audit Logging | CI/CD401k | Dental insurance | Health insurance | Life insurance | Sick timeSenior-level Full Time47006 Boston - 290 Congress St, …1d ago
-
Principal People Digital Experience Specialist-AI Lead USD 132K-179KAdoption strategy | Artificial Intelligence | Automation | Backlog Management | Change ManagementHybrid work | Training and enablement resourcesSenior-level Full TimeOakland, CA, US, 946121d ago
-
Data Architect USD 150K-201KAWS | AWS Bedrock | AWS Lambda | AWS Step Functions | Agent OrchestrationBackground check | Mentoring | Remote work | Team leadership | Travel 20 percentSenior-level Full TimeUnited States1d ago
-
205969 - AI Engineer USD 96K-133KArtificial Intelligence | Autogen | Business Process | Business Process Design | GovernanceRemote workMid-level Full TimeCanada R1d ago
-
Associate – AI Solutions and Business Enablement USD 155K-187KAction tracking | Alteryx | Audit Support | Capacity Planning | ComplianceBackup childcare | Financial coaching | Health insurance | Mental health support | Retirement savings planMid-level Full TimeNew York, NY, United States1d ago
-
AI Architect Lead (Hybrid-within BankUnited's footprint) USD 140K-205KAI Foundry | AWS | AWS Bedrock | Agentic AI | Architecture ReviewHybrid work modelSenior-level Full TimeMiami Lakes, FL, United States R1d ago
-
Applied AI Architect USD 117K-206KAI Agents | APIs | Artificial Intelligence | Automation | Data workflowsEquity and opportunity | Work-life harmonySenior-level Full TimeChicago1d ago
-
Senior AI Engineer USD 156K-224KDebugging | Evaluation | Information Retrieval | Language Models | Large Language ModelsSenior-level Full TimeUS-CA-Menlo Park2d ago
-
A/B | A/B Testing | APIs | Anthropic | B testingDental insurance | Medical insurance | PTO | Remote | Savings plan optionsMid-level Full TimeSan Francisco, CA, United States R2d ago
-
Security Engineer III - AI/ML USD 170K-215KAPI Development | AWS | Anomaly Detection | Azure | BERTSenior-level Full TimePlano, TX, United States2d ago
-
Senior AI Solutions Deployment Developer, Applied AI USD 152K-222KAPI tools | Agentic AI | Architecture | Cloud Architecture | Cloud platformSenior-level Full TimeWaterloo, ON, Canada; Cambridge, MA, USA2d ago
-
Security Operations AI Engineer, Contract USD 151K-225KAI Governance | AI RMF | AI Security | Adversarial Attacks | Adversarial Machine LearningMid-level Full TimeRemote, United States R2d ago
-
AKS | API Design | Agent systems | Azure Cloud | Azure Cloud InfrastructureContinuous learning | Disability insurance | Fully remote work | Life insurance | Medical/Dental/Vision insuranceSenior-level Full TimeCanada R2d ago
-
AI Software Engineer - Fixed Income Technology USD 110K-150KAPI Integration | AWS | Azure | CI/CD | Data PipelinesHealth insurance | Hybrid work | Life insurance | Paid time off | Retirement planSenior-level Full TimeIL01 - Chicago, United States2d ago
-
Senior AI Solutions Architect, Generative AI USD 180K-225KAI Act | AI Foundry | AI Pipelines | AI RMF | AWS401k matching | Disability insurance | Educational reimbursement | Employee stock purchase plan | Health, dental, and vision insuranceSenior-level Full TimeUS-VA-Reston-Corp - HQ (VA231), United States2d ago
-
Lead Data Scientist USD 150K-210KAI Agent Builder | API Integration | Agent Builder | Agent systems | Artificial IntelligenceDisability insurance | Employee assistance program | Health insurance | Life insurance | Paid time offSenior-level Full TimeChicago, IL, US2d ago
-
Principal, Data & AI Platform Engineer USD 110K-186KAccess Control | Agile | Authentication | Authorization | ContainerizationSenior-level Full TimeBerkeley Heights, New Jersey, United States2d ago
-
Feature Lead - Technology, AI/ML USD 106K-173KAI Observability | AWS | Agentic AI | Agile | AngularCareer development opportunities | Flexible benefits | In office collaboration culture | Inclusive workplaceSenior-level Full TimePlano, United States2d ago
-
Prompt Engineer USD 100K-150KAgent architecture | Chunking | Cost Optimization | Deterministic Evaluation | EmbeddingsCareer growth | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
AI Engineer - ICAM USD 153K-207KAI Governance | AI Risk | AI platforms | AI risk management | Access Management401k match | Flexible work weeks | Paid Holidays | Paid parental leave | Paid time offSenior-level Full TimeUSA VA Home Office (VAHOME), United … R2d ago