LLM Evaluation Product Operations Specialist – TikTok
Tasks
- Conduct user research analysis
- Coordinate execution of evaluation programs
- Define experience quality standards
- Deliver analytical insights and recommendations
- Design evaluation framework
- Develop scenario based evaluation metrics
- Implement AI chatbot evaluation
- Use automated evaluation methods
Perks/Benefits
- N/A
Skills/Tech-stack
Automated testing | Cross-Functional Collaboration | Cross-functional | Data Analysis | Evaluation metrics | Functional collaboration | Language Processing | Machine Learning | Natural Language | Natural Language Processing | Product Operations | User Research
Education
N/A
Related jobs
-
Agent systems | Artificial Intelligence | GenAI | Google Cloud | MLOpsSenior-level Full TimeSingapore10h ago
-
Senior Manager, Marketing Mix Modeling Analytics SGD 108K-150KDashboarding | Data Analysis | Data Quality | Incrementality testing | KPI DevelopmentSenior-level Full TimeSingapore, Singapore19h ago
-
Artificial Intelligence | Data Analysis | KPI | Machine Learning | MonitoringMid-level Full TimeSingapore, Singapore1d ago
-
Artificial Intelligence | Change Management | Data Modeling | Data Visualization | Data analyticsContract employment | Staff benefitsMid-level Full TimeNPB - Human Resources Branch, Singapore1d ago
-
Manager/ Senior Manager (Data Science and AI) SGD 92K-150KAPI Integration | Amazon Web Services | Apache Spark | Azure | C#Senior-level Full TimeRH, Singapore1d ago
-
API Development | Amazon Web Services | Artificial Intelligence | Azure | Change ManagementSenior-level Full TimeRH, Singapore1d ago
-
Manager/Senior Manager (Digital Product Insights) [PDD] SGD 100K-140KAdobe Analytics | Dashboarding | Data Analysis | Data Governance | Data ManagementTraining opportunities | Upskilling opportunitiesSenior-level Full TimePaya Lebar Quarter -PLQ 2, Singapore1d ago
-
AWS S3 | Apache Spark | Business Intelligence | CI/CD | Data QualityCompetitive remuneration package | Comprehensive benefitsSenior-level Full TimeSingapore2d ago
-
Senior Manager - Data Science SGD 122K-220KAgile project management | Deep learning | Generative AI | Language Models | Language ProcessingCareer growth | Development as a leader | Holistic well-being support | Learning opportunitiesSenior-level Full TimeSingapore4d ago
-
Robotics Automation Engineer Manager SGD 60K-91KAutomation | Collaborative Robotics | Cross-Functional Collaboration | Cross-functional | End EffectorCareer development opportunities | Health and wellbeing programs | Supportive work cultureMid-level Full TimeSingapore,SGP4d ago
-
Product Policy Manager, GenAI and Emerging Products SGD 111K-150KAI Governance | Abuse prevention | Artificial Intelligence | Data Analysis | Machine LearningMid-level Full TimeSingapore, Singapore5d ago
-
Manager, Data Analytics - HSBC Life SGD 115K-143KBigQuery | Business Analysis | Campaign analytics | Dashboarding | Data MartsFlexible working | Inclusive culture | Professional developmentMid-level Full TimeSingapore, Central Singapore, Singapore5d ago
-
AI/ML | Agent systems | Context engineering | Data Governance | Data readinessSenior-level Full TimeSingapore6d ago
-
Data Analytics - Support - MGR SGD 70K-98KAdobe Analytics | Campaign Management | Cloudera | Customer Segmentation | Customer metricsMid-level Full TimeSGP-Head Office, Singapore6d ago
-
Manager, Analytics & Insights SGD 70K-133KAutoml | Business Intelligence | Cloud Data | Cloud Data Warehouses | Data AnalysisFlexible work arrangements | Health and wellness benefits | Internal mobility opportunities | Training and development programsMid-level Full TimeSingapore, Singapore6d ago
-
AI Engineer, Manager - Technology Consulting SGD 153K-220KAWS | Azure | Batching | CI/CD | CUDACoaching | Continuous learning | Diverse and inclusive culture | Flexible working arrangements | Inclusive work cultureSenior-level Full TimeSG, 0485837d ago
-
Specialist, Operations Intelligence, AI/ML Engineer SGD 120K-220KAI platforms | Agentic Workflow | Cloud AI | Cloud AI Platforms | Data PreparationEntry-level Full TimeSingapore11d ago
-
AWS | Artificial Intelligence | C++ | CI/CD | Cloud ComputingExecutive-level Full TimeSingapore, Singapore, Singapore11d ago
-
Data & AI Platform Product Manager – Vice President, APAC Chief Data & Analytics Office SGD 180K-252KAI Governance | API | Access Control | Auditability | Backlog ManagementExecutive-level Full TimeSingapore11d ago
-
AI Governance | API Design | Access Control | Backlog Management | Data GovernanceExecutive-level Full TimeSingapore11d ago
-
Senior Manager, Data Insights SGD 102K-130KAzure | Azure Data | Azure Data Services | Azure Databricks | DBTSenior-level Full TimeSJ Singapore HQ Tower 111d ago
-
Data Analytics & Business Intelligence Manager, APAC SGD 90K-133KBERT | DAX | Data Engineering | Data Visualization | Deep learningMid-level Full TimeSingapore - Singapore : DUO Tower11d ago
-
Algorithm Design | Attribution Modeling | Data analytics | Data diagnostics | Data strategyMid-level Full TimeSingapore, Singapore13d ago
-
AI model | AI model development | Agent systems | Architecture Best Practices | Artificial IntelligenceCareer development | Strategic alignment | Team leadership | Technical mentorshipSenior-level Full TimeSingapore13d ago
-
Technical Program Manager, Google Pay Data Platform SGD 143K-153KCross-functional | Cross-functional leadership | Data Governance | Data Pipelines | Data WarehousingMid-level Full TimeSingapore13d ago