AI Chatbot Tester
Tasks
- Analyze conversational flows
- Assist with evaluation framework improvements
- Collaborate with AI trainers and prompt engineers
- Conduct regression testing
- Contribute to testing standards and best practices
- Document test results and findings
- Evaluate chatbot responses
- Execute test plans
- Identify defects inconsistencies and performance issues
- Perform user acceptance testing
- Prepare testing reports and performance insights
- Provide testing feedback to development teams
- Recommend improvements to responses and workflows
- Review chatbot interactions
- Support chatbot optimization initiatives
- Validate chatbot functionality
- Verify compliance with business requirements
Perks/Benefits
- N/A
Skills/Tech-stack
AI Evaluation | AI evaluation metrics | Acceptance Testing | Case design | Chatbot testing | Compliance testing | Conversation Analysis | Conversational AI | Defect documentation | Evaluation metrics | Generative AI | Management Tools | Prompt engineering | Quality Assurance | Regression testing | Reporting tools | Software testing | Test Case | Test Case Design | Test Management | Test Planning | Test management tools | User Acceptance | User Acceptance Testing | User Experience | User Experience Testing
Roles
AI | AI Chatbot Tester | Chatbot Tester | Software Tester | Tester
Related jobs
-
AI Solutions Architect Engineer USD 130K-197K.NET | API | Azure | Backend Development | C#Contract-to-hire | Hybrid work model | Onsite schedule flexibility | Remote work on selected daysSenior-level Full TimeHouston, United States R6h ago
-
AI and Data Science Engineer III USD 110K-218KArtificial Intelligence | Containerization | Data Analysis | Data Pipelines | DockerDiscretionary annual incentive program | Mentorship programs | Professional development opportunities | US travel opportunitiesSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …8h ago
-
AWS | Agile | Airtable | Anthropic | Artificial IntelligenceMentorship | Professional development | Travel opportunitySenior-level Full TimePittsburgh, Pennsylvania, United States8h ago
-
Director, AI Architect USD 230K-287KAWS | Agentic Workflows | Artificial Intelligence | Azure | Bias MitigationHealthcare coverage | Lifelong membership | Parental leave | Retirement savings match | Wellness stipendSenior-level Full TimeSan Francisco - Hybrid R1d ago
-
Forward Deployment AI Engineer USD 120K-150KAgent Orchestration | Anthropic API | Autogen | Chroma | Cloud servicesClient facing work environment | Client site travel | Professional development opportunitiesMid-level Full TimeCleveland | Tampa | San Diego …1d ago
-
AI Engineer III - Agentic AI USD 123K-190KAWS | Agentic AI | Debugging | Evaluation | GCPCareer growth opportunities | Comprehensive well-being support | Mentorship | Open source supportSenior-level Full TimePhoenix, AZ, United States1d ago
-
Member of Technical Staff (AI Software Engineer, Agents) USD 220K-405KAI Evaluation | Agent architecture | Browser technologies | Chrome DevTools | Chrome DevTools ProtocolSenior-level Full TimeSan Francisco1d ago
-
Senior AI Software Engineer USD 119K-261KAPIs | Automated testing | Azure AI | Azure Databricks | CI/CDSenior-level Full TimeUnited States1d ago
-
AI Deployment Engineer USD 197K-278KAPI Integration | ChatGPT | Cloud Architecture | Generative AI | JavaScriptHybrid work model | Relocation assistanceSenior-level Full TimeSan Francisco1d ago
-
AI Solutions Architect USD 150K-175KAccess Control | Application Programming | Application Programming Interfaces | CI/CD | ComplianceDental insurance | Flexible time off | Health insurance | Investment Savings Plan | Paid parental leaveSenior-level Full TimeCharlotte, United States1d ago
-
AI Foundry | AWS | Amazon Bedrock | Anthropic Claude | Autogen401k plan | Bonus opportunities | Dental insurance | Life insurance | Long-term disabilityMid-level Full TimeDallas, 5205 N OConnor Las Colinas, …1d ago
-
AI Performance Optimization Engineer USD 100K-150KBenchmarking | C++ | Compiler optimization | Continuous batching | Deep learningBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Principal Agentic AI Engineer USD 176K-299KAPI Design | AWS | Agentic architecture | Angular | AzureEmployee benefits | Flexible work options | Health and well-being benefits | Hybrid work model | Professional developmentSenior-level Full TimePalo Alto, CA, US, 943041d ago
-
Senior AI/ML Engineer USD 125K-188KAWS | AWS Architecture Patterns | AWS CDK | AWS Lambda | AWS architecture401k matching | Dental insurance | Health savings account | Medical insurance | Online trainingSenior-level Full TimeHerndon, Virginia, United States R1d ago
-
Principal AI Engineer – Agentic AI USD 172K-236KAWS | Azure | CI/CD | Cloud Computing | ContainerizationSenior-level Full TimeWaterside Bldg, United States1d ago
-
Senior-level Full TimeWestlake, United States1d ago
-
AI Solutions and Adoption Lead USD 147K-230KAI Agents | API Integration | Artificial Intelligence | Automation | ClassificationSenior-level Full TimeWAV01 - Vancouver, Washington, US, United …1d ago
-
Mid-level Full TimeCosta Mesa, California, United States1d ago
-
Principal AI/ML Architect, Applied Field Engineering USD 189K-248KAWS | Apache Airflow | Apache Spark | As-a-Service | Cloud platformSenior-level Full TimeUS-NY-New York2d ago
-
Senior AI/ML Architect, Applied Field Engineering USD 165K-216KAWS | Apache Airflow | Apache Spark | As-a-Service | Cloud platformSenior-level Full TimeUS-NY-New York2d ago
-
AI Research Scientist, Applied AI USD 120K-170KAPI Integration | Agent systems | Bayesian Methods | CI/CD | Code ReviewsEquity compensation | Remote work | Technical publications supportEntry-level Full TimeRemote, United States R2d ago
-
AI Engineer USD 140K-160KAPIs | AWS | Agent Orchestration | Agentic AI | Anthropic401k match | AD and D insurance | Accident insurance | Annual Walking Challenge | Commuter programMid-level Full TimeIrvine, CA, US2d ago
-
Senior Director, AI Solutions - Onsite in Dallas, TX USD 160K-200KArtificial Intelligence | Business case | Business case development | Case Development | ComplianceMotor Vehicle Records check | Travel up to 25 percentSenior-level Full TimeDallas, TX, United States2d ago
-
Director, AI Solutions Architect (Remote) USD 152K-223KAPI Gateway | Amazon Bedrock | Azure OpenAI | BigQuery | CI/CDFlexible after hours support for releases | Occasional travel | Overtime available | Remote workSenior-level Full TimeOak Brook, IL, United States R2d ago
-
AI Scientist USD 150K-200KC++ | Continuous integration | Deep learning | Git | Language Models401k | Casual dress code | Dental insurance | Employee resource groups | Flexible spending accountMid-level Full TimeWest Palm Beach2d ago