Senior/Lead Quality Engineer - Chatbot
Tasks
- Analyze testing gaps and propose improvements
- Build proof of concepts for testing tools
- Define quality signals validation processes acceptance criteria
- Design testing for non deterministic AI systems
- Design testing frameworks and release processes
- Develop quality strategies for chatbot products
- Establish chatbot evaluation methodologies
- Execute performance testing for AI and LLM workflows
- Identify and improve AI safety measures
- Measure chatbot quality reliability performance regression risks
- Mentor engineers on testing practices
- Perform code review collaboration with software engineers
- Promote quality engineering best practices
Perks/Benefits
- Company laptop
- Coworking budget
- Flexible working hours
- Fully remote
- Health benefits
- Learning and development budget
- Paid time off
- Parental leave
- Remote setup support
- Retirement benefits
- Stock options
- Team events
Skills/Tech-stack
AI Testing | Agile | Automated testing | Code review | Injection Protection | LLM | Machine Learning | Performance Testing | Programming language | Prompt injection | Prompt-injection protection | Quality Assurance | Quality Engineering | Regression testing | Software Quality Assurance | Software quality | Test automation | Test frameworks
Education
N/A
Related jobs
-
AI Agents | Alerting | C# | Event Driven | Event-driven architectureContinuous learning | Fully remote work | Professional growthMid-level Full TimeCanada R6h ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Services | Azure SynapseContract opportunity | Fully remote CanadaMid-level Contract Full TimeCanada R6h ago
-
AI Risk Management Framework | Adversarial Machine Learning | Adversarial Robustness | Adversarial Robustness Toolbox | Adversarial TrainingCareer growth | Flexible work environment | Fully remoteSenior-level Full TimeCanada R1d ago
-
Senior AI Engineer CAD 145K-180KA/B | A/B Testing | AI Search | Agent Orchestration | Audit LoggingSenior-level Full TimeVancouver - Hybrid (3x in office/week) R1d ago
-
C++ | Compiler design | Computer Architecture | Linux | Machine LearningHealth insurance | Hybrid work model | Life insurance | Paid time off | Retirement savings matchSenior-level Full TimeRemote, Canada R1d ago
-
Data Analysis | Data pipeline | Machine Learning | Multimodal Learning | PythonMid-level Full TimeSan Francisco, California; Toronto, Canada; Redwood … R1d ago
-
Active Learning | Adaptive Sampling | Deep learning | Direct Preference Optimization | Human FeedbackMid-level Full TimeSan Francisco, California; Remote, US or … R1d ago
-
Artificial Intelligence | Cloud Computing | Data integration | Generative AI | High AvailabilityMid-level Full TimeNew York City, NY; Toronto, Ontario; … R1d ago
-
AI | AWS | Apache Kafka | Azure | C#Collaborative culture | Fully remote | Leadership opportunitySenior-level Full TimeRemote, Toronto R1d ago
-
AWS | AWS Bedrock | AWS CDK | Anthropic | CelerySenior-level Full TimeKitchener, Ontario; Remote, Canada; Remote, Canada; … R1d ago
-
Senior-level Full TimeRemote, Canada; Remote, Canada; Toronto, Ontario; … R1d ago
-
Data Curation | Experimentation | MLOps | Machine Learning | Machine learning modelingSenior-level Full TimeToronto, Canada; Remote, Canada; Kitchener, Ontario; … R1d ago
-
Senior-level Full TimeCanada or US, N/A; Toronto, Ontario; … R1d ago
-
Anomaly Detection | Classification | Clustering | Data Modeling | Data PipelinesHealth benefits | Hybrid work arrangement | Paid time off | Professional developmentSenior-level Full TimeToronto, Ontario; Kitchener, Ontario; The Valley, … R1d ago
-
AI frameworks | API Development | AWS | AWS GenAI | Agentic SystemsSenior-level Full TimeRemote, Canada; Remote, Canada; Remote, Canada; … R1d ago
-
API Design | Distributed Systems | LLM | Python | RAGEarly-stage environment | Enterprise customer impact | High autonomySenior-level Full TimeRemote, Canada or US; Remote, Canada; … R1d ago
-
AWS | Agentic AI | Agile | Amazon Bedrock | Apache AirflowSenior-level Full TimeToronto, Ontario; New York, USA; Bay … R1d ago
-
API Integration | Access Control | Audit Logging | CI/CD | Cloud DataAnnual off-site | Asynchronous work | Coworking allowance | Dependent coverage support | Employee equityMid-level Full TimeCanada R2d ago
-
AI Engineer CAD 67K-100KAgentic Frameworks | Deep learning | Embeddings | Fine Tuning | Generative AIMid-level Full TimeRBC CENTRE, 155 WELLINGTON ST W:TORONTO, … R2d ago
-
Software Engineer, AI Platform CAD 100K-140KAlerting | C# | Event Driven | Event-driven architecture | LLMMid-level Full TimeRemote - Canada R2d ago
-
Senior-level Full TimeKitchener, Canada R2d ago
-
Machine Learning Engineer CAD 95K-141KBandit Algorithms | Ethical AI | Fine Tuning | LLM Fine-tuning | Language ModelsMid-level Full TimeToronto, Canada R3d ago
-
Adversarial Robustness | Adversarial Robustness Toolbox | Adversarial Training | Adversarial examples | BenchmarkingFull cycle support | Fully remote | Growth path to staff and principal level influenceMid-level Full TimeCanada - Remote R3d ago
-
Senior AI/LLM Engineer USD 179K-201KAPI Development | CI/CD | Embeddings | Fine Tuning | Guardrails401k match | Dental insurance | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote (US/Canada) R6d ago
-
Data and Artificial Intelligence Fall Student CAD 52K-52KBusiness Intelligence | Data Engineering | Data Visualization | Generative AI | Machine LearningAccess to data and technology tools | Collaborative inclusive environment | Hybrid work arrangements | Remote work flexibility | Travel for office workNone Full TimeSt Catharines, Ontario, Canada; Etobicoke, Ontario, … R6d ago