AI Automation QA
Taguig, National Capital, Philippines
PHP 250K-250K (estimate) Senior-level Full Time
Tasks
- Align testing logging and monitoring with privacy audit and regulatory requirements
- Apply LLM evaluation frameworks
- Build automated evaluation harnesses for agent performance
- Collaborate with developers to improve prompts and workflow design
- Define quality criteria for accuracy latency safety compliance
- Define testing and quality assurance strategies for AI workflows
- Develop automated test suites with Playwright and custom scripts
- Develop runbooks for common failure modes
- Implement continuous production monitoring for anomalies
- Produce quality dashboards and reports
Perks/Benefits
- N/A
Skills/Tech-stack
API Testing | Data Analysis | DeepEval | Evidently | LLM Evaluation | Playwright | Production Monitoring | Python | Ragas | Regression testing | Safety Compliance | Test automation | UI Testing
Education
N/A
Related jobs
-
Senior Data & Analytics Engineer PHP 160K-250KAirflow | Azure | Azure Data | Azure Data Factory | Azure FabricHMO | Hybrid work | Leave credits | No graveyard shifts | Performance bonusesSenior-level Full TimeTaguig, Metro Manila, Philippines11h ago
-
AI Engineer - Internship PHP 206K-206KArtificial Intelligence | Data Modeling | Data integration | Machine Learning | Model DeploymentGlobal network growth | Hands-on experience | Professional developmentEntry-level InternshipCebu City, Central Visayas, Philippines1d ago
-
Entry-level Full TimeCalamba, LAGUNA, Philippines1d ago
-
Data Engineer PHP 900K-1020KAWS | Azure | BigQuery | CCPA | Data GovernanceGov t mandated benefitsMid-level Full TimeQuezon City, Metro Manila, Philippines3d ago
-
API Integration | AWS | Anthropic | CRM | DjangoFlexible schedule | Independent contractor flexibility | Remote work | Work from homeMid-level Full TimePhilippines - Remote R4d ago
-
Senior Intelligence Analyst PHP 200K-250KAPI Integration | Agentic AI | Consumer Review Mining | Data Analysis | Data VisualizationSenior-level Full TimeMakati City, Metro Manila4d ago
-
Data Engineer PHP 350K-400KAPM | AWS | Agile | Bash | Design PatternsHealth benefits | Hybrid work | Remote workMid-level Full TimeManila, Philippines5d ago
-
ADC | Bare Metal | C# | C++ | CANContinuous learning | Mentorship | Work-life balanceSenior-level Full TimePhilippines, Bonifacio Global City5d ago
-
Anomaly Detection | Atlan | Claude API | Cortex Analyst | DAXIndependent contractor flexibility | Remote work flexibility | Work from homeSenior-level Full TimePhilippines - Remote R5d ago
-
Data Engineer II PHP 240K-252KAPI Integration | Automation | Data Documentation | Data Governance | Data IngestionMid-level Full TimePHL-RE Shared Services-Manila, Philippines5d ago
-
Backend Engineer (BE + LLM) PHP 250K-450KAI Agents | API Design | Angular | Async jobs | AuthenticationEntry-level Full TimeAsia R6d ago
-
Mid-level Full TimeABC Manila Office, Philippines7d ago
-
2026-7981 Data Engineer-Mid Level PHP 420K-480KAzure | Azure Data | Azure Data Factory | Data Factory | Data Integration ServicesMid-level Full TimeMakati City, NCR, Philippines7d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Inclusive workplace | Remote-friendlyMid-level Full TimeManila, Philippines8d ago
-
Lead Data Platform Engineer PHP 1200K-1440KAirflow | Apache Kafka | Automated testing | CI/CD | ContainerizationCareer development and training | Defined career progression paths | Mentorship | Performance incentives | Recognition programsSenior-level Full TimeTaguig, Metro Manila, Philippines9d ago
-
Lead Data Scientist PHP 150K-220KMLOps | Machine Learning | Model Governance | PyTorch | PythonCareer development and training opportunities | Defined career progression paths | Mentorship | Performance-Based Incentives | Recognition programsSenior-level Full TimeTaguig, Metro Manila, Philippines9d ago
-
API Development | Automation | LLM Agents | Language Models | Large Language ModelsCareer development | Flexible schedule | Remote workMid-level Part TimePhilippines9d ago
-
Workforce Data Science Lead PHP 360K-450KAmazon Redshift | Anomaly Detection | Data Modeling | Data Preprocessing | Data QualitySenior-level Full TimeNCR, PH10d ago
-
Data Platform Engineer PHP 216K-264KAutomated testing | CI/CD | Containerization | DBT | DatabricksCareer development and training | Mentorship | Performance incentives and recognitionEntry-level Full TimeTaguig, Metro Manila, Philippines11d ago
-
AI Prompt Engineer PHP 250K-250KAI Evaluation | Conversational AI | Generative AI | JavaScript | Language ModelsSenior-level Full TimePhilippines12d ago
-
Senior AI Data Engineer | WFH | Dayshift PHP 80K-160KAWS | Azure | CI/CD | Data Governance | DevOpsOn-call rotations | Shift flexibility | Work from homeSenior-level Full TimeTaguig City, PH R12d ago
-
Senior-level Full TimeQuezon City, Metro Manila, Philippines - … R12d ago
-
Sr. Engineer, Data (Data Governance Team) PHP 200K-220KAirflow | CI/CD | Cloud Storage | Cost Allocation | DBTSenior-level Full TimeWarehouse, Monterrey, Mexico12d ago
-
Mid-level Full TimePhilippines - Ecoprime Building - Taguig …12d ago
-
C# | CI/CD | Docker | Git | Google CloudCross-functional team collaboration | Hybrid work environment | Remote work optionMid-level Full TimeQuezon City, Metro Manila, Philippines12d ago