Automation Test Engineer

This is a remote position.

We're hiring for an exciting project with a leading company specializing in artificial intelligence and machine learning solutions. We’re looking for an Automation Test Engineer who not only builds automated tests, but also thinks strategically about quality across systems—from observability to identifying systemic risks. You’ll collaborate closely with developers and product managers to design and implement comprehensive test suites for services built in .NET and Python, running on Azure infrastructure. This role is ideal for someone with a strong background in automated testing and a proactive mindset for spotting edge cases, reducing risk, and ensuring performance in production.

Responsibilities

• Multi-Level Test Ownership: Own and drive testing across API/integration layers, end-to-end workflows with Playwright, load/performance validation, and smoke test coverage.

• Quality Leadership: Take initiative in identifying systemic risks to reliability or accuracy. Partner with engineering to recommend improvements beyond just test coverage—including logging, monitoring, and resilience patterns for distributed systems.

• Regression & Smoke Testing: Contribute to regular regression cycles and smoke tests. Take ownership of converting our existing manual smoke tests into automated tests, and collaborate with developers to integrate them into CI/CD workflows.

• Test Strategy & Case Authoring: Collaborate with engineering leadership to define test strategies, author test cases in TestRail, and work toward automating those tests.

• Performance & Load Testing: Help identify performance bottlenecks and validate the system under varying loads using appropriate tools.

• Coverage & Risk Analysis: Participate in incident reviews and use tooling (e.g., Jira, code analytics platforms) to identify hotspots and areas needing improved test coverage.

• Cross-functional Collaboration: Work closely with engineers, DevOps, and product managers to clarify requirements, validate assumptions, and ensure high-quality releases.

Requirements

• Experience Level: Minimum of 3 years in test automation for frontend and backend/cloud-based services.

• End-to-End (E2E) & UI Testing: Strong experience with Playwright (in JavaScript). Comfortable working with locators, async operations, reusable test patterns, and debugging with Playwright’s trace tools.

• API & Integration Testing: Proficiency in testing RESTful APIs and integration points, including schema validation, mocking external services, and validating data flows across microservices. Familiarity with Postman, and OpenAPI/Swagger.

• Test Case Management: Experience authoring, maintaining, and organizing test cases in tools like TestRail.

• Systems Quality Mindset: Able to think beyond test scripts—identifying gaps in observability, risk areas, and opportunities to improve end-to-end system confidence.

• Collaboration & Communication: Strong written and verbal communication skills with the ability to work across teams to define quality goals, validate assumptions, and drive issue resolution.

Desirables
• Accessibility Testing: Experience validating UI accessibility using screen readers and other assistive technologies. Familiarity with WCAG standards and tools such as axe-core or browser-based extensions is a plus.

• CI/CD Integration: Demonstrated experience integrating automated test suites into CI/CD pipelines using tools like Azure DevOps, GitHub Actions, or equivalent is a plus.