AI Quality Engineer, DTC e-commerce

Logitech is the Sweet Spot for people who want their actions to have a positive global impact while having the flexibility to do it in their own way.

The AI Quality Engineer will play a critical role in ensuring the quality and reliability of AI applications through comprehensive testing and evaluation methodologies. This role requires expertise in assessing AI technologies for response quality, privacy and security adherence, governance, and efficiency, with a focus on enforcing robust safeguard mechanisms. The candidate will collaborate across teams to validate solutions that align with organizational strategies and uphold responsible AI standards.

About the Role

This position involves testing AI applications to evaluate user interaction quality, validate operational effectiveness, and ensure the systems meet specified regulatory, security, and privacy frameworks. The AI Tester will strategically enhance AI-driven experiences by deploying advanced testing methodologies, including but not limited to A/B testing, model evaluation using metrics like precision, recall, F1-score, and BLEU, adversarial testing for robustness, and prompt engineering evaluation for user interaction quality. They will also utilize system evaluation techniques such as benchmarking and performance testing to guarantee consistent results and optimal, ethical, and secure behavior of AI systems.

Responsibilities

• AI Testing & Evaluation:

  • Design and execute testing strategies for AI systems to ensure quality, accuracy, and reliability of responses under various conditions and use cases.

  • Use structured evaluation methodologies (e.g., eval frameworks) to assess AI system performance, robustness, and user experience.

  • Measure systems against defined quality standards, reporting inconsistencies and suggesting improvements.

• Governance & Safeguards:

  • Validate privacy, security, and governance structures integrated into AI applications, ensuring compliance with organizational policies and external regulations.

  • Evaluate guardrails for responsible AI practices and any potential risks in deployment.

• Collaboration & Reporting:

  • Work closely with development teams to provide actionable feedback on issues discovered during testing phases.

  • Document test results comprehensively and communicate findings to relevant stakeholders for improvements.

  • Collaborate with internal AI teams and IT departments to align testing with business needs, system goals, and infrastructure requirements.

• Continuous Improvement:

  • Stay updated with emerging AI testing methodologies and tools to refine the quality assurance processes.

  • Proactively identify opportunities for improving AI systems and solutions through testing insights.

Key Qualifications

• Bachelor’s degree in Computer Science, Data Science, or a related field.

• Proven experience in quality assurance or software testing, preferably in AI and ML systems.

• Familiarity with testing frameworks like retrieval-augmented generation (RAG) pipelines, agent orchestration systems, or similar methodologies.

• Hands-on experience with modern AI development technologies and testing tools including LangChain, LangGraph, or proprietary evaluation SDKs.

• Proficiency in assessing multimodal AI systems using text, images, audio, or documents as inputs.

• Strong understanding of responsible AI practices and governance mechanisms.

Preferred Skills

• Expertise in privacy, security evaluation, and guardrails implementation.

• Ability to analyze and validate quality metrics for AI solutions in enterprise environments.

• Experience testing region-specific solutions in diverse market settings.

• Good understanding of vector stores, memory architectures, and system feedback loops.

• Effective communication and reporting skills for team-wide collaboration.

Work Environment

Logitech empowers collaboration and enables global teams to work efficiently, regardless of location. Our hybrid work model supports flexibility while maintaining productivity across teams - with opportunities to work remotely as well.

Across Logitech we empower collaboration and foster play. We help teams collaborate/learn from anywhere, without compromising on productivity or continuity so it should be no surprise that most of our jobs are open to work from home from most locations. Our hybrid work model allows some employees to work remotely while others work on-premises. Within this structure, you may have teams or departments split between working remotely and working in-house.

Logitech is an amazing place to work because it is full of authentic people who are inclusive by nature as well as by design. Being a global company, we value our diversity and celebrate all our differences. Don’t meet every single requirement? Not a problem. If you feel you are the right candidate for the opportunity, we strongly recommend that you apply. We want to meet you!

We offer comprehensive and competitive benefits packages and working environments that are designed to be flexible and help you to care for yourself and your loved ones, now and in the future. We believe that good health means more than getting medical care when you need it. Logitech supports a culture that encourages individuals to achieve good physical, financial, emotional, intellectual and social wellbeing so we all can create, achieve and enjoy more and support our families. We can’t wait to tell you more about them being that there are too many to list here and they vary based on location.

All qualified applicants will receive consideration for employment without regard to race, sex, age, color, religion, sexual orientation, gender identity, national origin, protected veteran status, or on the basis of disability.

If you require an accommodation to complete any part of the application process, are limited in the ability, are unable to access or use this online application process and need an alternative method for applying, you may contact us toll free at +1-510-713-4866 for assistance and we will get back to you as soon as possible.