AI Automation QA
Taguig, National Capital, Philippines
PHP 250K-250K (estimate) Senior-level Full Time
Tasks
- Align testing logging and monitoring with privacy audit and regulatory requirements
- Apply LLM evaluation frameworks
- Build automated evaluation harnesses for agent performance
- Collaborate with developers to improve prompts and workflow design
- Define quality criteria for accuracy latency safety compliance
- Define testing and quality assurance strategies for AI workflows
- Develop automated test suites with Playwright and custom scripts
- Develop runbooks for common failure modes
- Implement continuous production monitoring for anomalies
- Produce quality dashboards and reports
Perks/Benefits
- N/A
Skills/Tech-stack
API Testing | Data Analysis | DeepEval | Evidently | LLM Evaluation | Playwright | Production Monitoring | Python | Ragas | Regression testing | Safety Compliance | Test automation | UI Testing
Education
N/A
Related jobs
-
AWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3Career mentoring and coaching | Health insurance | Hybrid work setup | Life insurance | Paid HolidaysMid-level Full TimeManila, PH15h ago
-
Data Management Engineer OnPrem ETL Sr PHP 4375K-4375KAgile | Automation | Big Data | Data Governance | Data LakesHybrid workSenior-level Full TimeMéxico D.F., CDMX, México R3d ago
-
Applied AI Engineer (Philippines) PHP 240K-360KAutomation | Fintech | Guardrails | JavaScript | LLM EvaluationFast interview process | Remote workMid-level Full TimePhilippines3d ago
-
Apache Airflow | CI/CD | DBT | Data Warehousing | Data integrationHealth insurance | Hybrid work setup | Life insurance | Mentoring and coaching | Paid time offMid-level Full TimeManila, PH3d ago
-
Senior-level Full TimeQuezon City, Metro Manila, Philippines4d ago
-
Data Engineer PHP 674K-900KApache Spark | Azure | Cloud platform | Data Governance | Data LakehouseDependent coverage | HMO coverage | Hybrid work schedule | Work location flexibility up to 30 days per yearMid-level Full TimePasig, PH4d ago
-
Convai Software Test Engineer PHP 130K-186KCase design | Conversational AI | Data Design | Defect Tracking | Functional testingFlexible working hours | Police Check | Travel opportunitiesMid-level Full TimeRemote Work Location - PH, Philippines R5d ago
-
AWS | Azure | CI/CD | Docker | ELKNetworking opportunities | Professional developmentEntry-level Full TimeAsia6d ago
-
Cx Oracle | Dask | MariaDB | Mysql connector python | OracleRemote workMid-level Full TimeCiudad de México, Ciudad de México, …6d ago
-
AI Developer PHP 150K-220KLangchain | Language Models | Large Language Models | MySQL | PostgreSQLGlobal work environment | International team collaborationEntry-level Full TimeHybrid (Monterrey, Monterrey, Mexico) R7d ago
-
Ai Engineer PHP 420K-432KAI Safety | API Integration | Cloud deployment | Error Handling | Function CallingFlexible schedule | Remote work optionsMid-level Full TimePasig, Metro Manila, Philippines7d ago
-
Mid-level Full TimeQuezon City, Metro Manila, Philippines7d ago
-
Azure + AI Developer PHP 300K-360KArtificial Intelligence | Azure | CI/CD | Debugging | JavaCompany trainings | Employee assistance program | Health insurance | Life insurance | Non-taxable allowanceMid-level Full TimePZZ04 - DXC Manila IPC McKinley …7d ago
-
Applied AI Engineer - Finance Super App (Philippines) PHP 130K-175KAPI Integration | Agents | Automation | Backend Development | Cost OptimizationFast hiring process | Remote workMid-level Full TimePhilippines8d ago
-
Mid-level Full TimeMakati City, Metro Manila, Philippines8d ago
-
Data Engineer-Snowflake and dbt (Philippines) PHP 674K-900KAccess Control | CTE | DBT | Data Modeling | Data ReconciliationFlexible working arrangements | Home office expense allowance | Paid parental leave | Study leave | Wellness allowanceMid-level Full TimeRemote (Philippines) R8d ago
-
Azure DevOps | Azure Machine Learning | CI/CD | Cognitive Services | DatabricksAgile environment | Hybrid work | Night shiftMid-level Full TimeMakati City, Metro Manila, Philippines R10d ago
-
Senior Data Engineer / Analyst PHP 840K-1080KAWS | Automation | Data Analysis | Data Management | Data ModelingCompany events | Dependent benefits | HMO coverage | Health and safety focus | Health insuranceSenior-level Full TimePhilippines, PH - Manila11d ago
-
AWS SageMaker | Airflow | Apache Spark | Azure Databricks | CI/CDAdditional benefits | Hybrid work | Indefinite contract | Legal benefitsMid-level Full TimeCiudad de México, Ciudad de México, …11d ago
-
Senior-level Full TimePhilippines, Bonifacio Global City12d ago
-
Senior-level Full TimePhilippines, Bonifacio Global City13d ago
-
Embedded Software Engineer (Robotics) PHP 200K-250KADC | Agile | Automated testing | Bare Metal | C#Senior-level Full TimePhilippines, Bonifacio Global City13d ago
-
Data Engineer II PHP 690K-900KAI Governance | API Integration | Automation | Data Documentation | Data GovernanceMid-level Full TimePHL-RE Shared Services-Manila, Philippines13d ago
-
Mid-level Full Time21F The Globe Tower, Philippines13d ago
-
Data Governance | Data Management | Data Modeling | Data Security | Data WarehousingHybrid work setup | Professional development opportunities | Regular engagement activitiesMid-level Full TimePasig, Metro Manila, Philippines14d ago