AI Chatbot Tester
Tasks
- Analyze conversational flows
- Assist with evaluation framework improvements
- Collaborate with AI trainers and prompt engineers
- Conduct regression testing
- Contribute to testing standards and best practices
- Document test results and findings
- Evaluate chatbot responses
- Execute test plans
- Identify defects inconsistencies and performance issues
- Perform user acceptance testing
- Prepare testing reports and performance insights
- Provide testing feedback to development teams
- Recommend improvements to responses and workflows
- Review chatbot interactions
- Support chatbot optimization initiatives
- Validate chatbot functionality
- Verify compliance with business requirements
Perks/Benefits
- N/A
Skills/Tech-stack
AI Evaluation | AI evaluation metrics | Acceptance Testing | Case design | Chatbot testing | Compliance testing | Conversation Analysis | Conversational AI | Defect documentation | Evaluation metrics | Generative AI | Management Tools | Prompt engineering | Quality Assurance | Regression testing | Reporting tools | Software testing | Test Case | Test Case Design | Test Management | Test Planning | Test management tools | User Acceptance | User Acceptance Testing | User Experience | User Experience Testing
Roles
AI | AI Chatbot Tester | Chatbot Tester | Software Tester | Tester
Related jobs
-
AI/BI Analyst – Hybrid Role USD 77K-120KAI Agents | AWS | Amazon Bedrock | Automation | Business IntelligenceMid-level Full TimeAtlanta, Georgia R11h ago
-
Researcher, Frontier Strategy and Governance, DeepMind USD 156K-228KArtificial Intelligence | Data Structures | Evaluation metrics | Machine Learning | ResearchMid-level Full TimeMountain View, CA, USA; New York, …12h ago
-
AI Solutions Developer USD 130K-175KAI Agents | AWS CDK | AWS Lambda | AWS X-Ray | Amazon CloudWatch401k match | Dental insurance | Education assistance | Health insurance | Identity theft protectionMid-level Full TimeWheeling, IL, US19h ago
-
Senior Engineer, AI Engineering (R5450) USD 123K-216KAPI Design | API Integration | Access Control | Agents | Audit LoggingSenior-level Full TimeUnited States1d ago
-
Senior Engineer, AI Engineering (R5459) USD 137K-237KAI Governance | API Design | APIs | Access Control | Agents401k matching | Dental insurance | Health insurance | Paid time off | Relocation assistanceSenior-level Full TimeUnited States1d ago
-
Agentic AI | Full Stack | Full-Stack Development | Generative AI | Machine LearningHybrid work | Stable employmentSenior-level Full TimeLos Angeles, CA, United States1d ago
-
Member of Technical Staff (AI Software Engineer, Agents) USD 220K-405KAI Evaluation | Browser Extension | Browser extension development | Chrome DevTools | Chrome DevTools ProtocolSenior-level Full TimeSan Francisco1d ago
-
AI Safety | Deep learning | Experiment design | Generative AI | Language ModelsSenior-level Full TimeCupertino1d ago
-
Manager, Applied AI Solutions & Enablement, Marketing USD 108K-135KAPI Integration | Analytics | Artificial Intelligence | Automation | Data integration401k matching | Child care benefits | Commuter benefits | Dental insurance | Health insuranceMid-level Full TimeNew York, NY R1d ago
-
Manager, Applied AI Solutions & Enablement, Marketing USD 108K-135KAgent Development | Artificial Intelligence | Automation | Data analytics | GenAI401k match | Child care benefits | Commuter benefits | Family building benefits | Health insuranceMid-level Full TimeSan Francisco, CA R1d ago
-
AI Governance | AWS | Agentic AI | Agile | AnalyticsSenior-level Full TimeFlorida, United States1d ago
-
Senior Intelligent Automation & AI Engineer USD 165K-165K800-37 | 800-53 | APIs | Artificial Intelligence | Automation Roadmapping401k match | Dental insurance | FSA | HSA | Health benefitsSenior-level Full TimeFort Meade, MD1d ago
-
AI Researcher USD 130K-195KAI Collaboration | AI Foundry | Agent Frameworks | Autodesk | Azure AI401k | AD D Insurance | Adoption Assistance | Dental plan | Disability insuranceMid-level Full TimeMinneapolis, MN, United States1d ago
-
AI Program Manager USD 120K-165KAI Agents | AI Governance | AI ethics | Agile | Change ManagementRemote workMid-level Full TimeUnited States R1d ago
-
Care Innovation - Senior Solution Engineer 135-2034 USD 118K-175K.NET | Agentic Workflows | App Service | Autogen | Automated testingSenior-level Full TimeTulsa, OK, US1d ago
-
AI Developer Fall Intern USD 60K-80KAPI Design | Algorithms | Backend Development | ChatGPT | Cloud ComputingEntry-level InternshipEllicott City, MD, United States1d ago
-
GenAI Analyst USD 63K-90KAI Agents | AI Safety | Adversarial prompting | Data Quality | Generative AIMid-level Full TimeNew York, US1d ago
-
Senior-level Full TimeChicago, IL1d ago
-
AI/BI Analyst – Hybrid Role USD 74K-120KAWS | Amazon Bedrock | Data Governance | Data Modeling | DatabricksDental insurance | Educational assistance | Flexible spending account | Health savings account | Life insuranceMid-level Full TimeAtlanta, Georgia R1d ago
-
Oracle Configurator/Prompt Engineer USD 100K-203KAI Assistants | API | Agent-based | Agent-based automation | Approval HierarchySenior-level Full TimeWashington, DC1d ago
-
AI Engineer - AI Agents (Remote-United States) USD 112K-216KA/B | A/B Testing | Agent Orchestration | Automated testing | B testing401k retirement plan | Employee stock purchase plan | Medical/Dental/Vision insurance | Mental health support | Paid HolidaysSenior-level Full TimeUnited States R1d ago
-
Product Policy Manager, GenAI USD 161K-228KAccuracy review | Adversarial Simulation | Artificial Intelligence | Bias Mitigation | ComplianceSenior-level Full TimeWashington, DC1d ago
-
Founding Prompt Engineer USD 105K-145KAI Agents | AI coding | AI coding tools | Automation | Coding Tools401k | Calm subscription | Enhanced parental leave | Healthcare plan | Holiday daysNone Full TimeUSA1d ago
-
Senior Responsible AI Researcher, AI.x USD 157K-254KAI Governance | AI Safety | Adversarial Robustness | Adversarial Testing | AlignmentSenior-level Full TimeSan Francisco, CA, United States1d ago
-
Python + Gen AI Developer - New York USD 56K-196KAPI Security | Asynchronous programming | CI/CD | Docker | Embeddings401k | Dental insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeUnited States1d ago