LLM Evaluation Product Operations Specialist – TikTok
Tasks
- Conduct user research analysis
- Coordinate execution of evaluation programs
- Define experience quality standards
- Deliver analytical insights and recommendations
- Design evaluation framework
- Develop scenario based evaluation metrics
- Implement AI chatbot evaluation
- Use automated evaluation methods
Perks/Benefits
- N/A
Skills/Tech-stack
Automated testing | Cross-Functional Collaboration | Cross-functional | Data Analysis | Evaluation metrics | Functional collaboration | Language Processing | Machine Learning | Natural Language | Natural Language Processing | Product Operations | User Research
Education
N/A
Related jobs
-
APAC Data Quality Governance Manager SGD 85K-133KCause analysis | Data Governance | Data Lineage | Data Modeling | Data MonitoringMid-level Full TimeSG003 Science Park Drive (Ascent), Singapore19h ago
-
Technical Manager, Data and AI SGD 60K-108KAI Governance | Access Control | Analytics engineering | Automation | CI/CDFun workplace | Teamwork cultureMid-level Full TimeSJ Campus, Singapore19h ago
-
Senior Manager (Research) SGD 104K-144KData Analysis | Data Visualization | Data cleaning | Exploratory Data Analysis | Language ProcessingSenior-level Full TimePAS-Peoples Association Headquarters, Singapore19h ago
-
Data Analysis | Data Exception Management | Data Governance | Data Management | Data QualityEntry-level Full TimeSingapore, Singapore1d ago
-
Technical Lead Manager, Applied AI, DeepMind SGD 140K-200KC# | C++ | Cloud Computing | Cloud platform | Data ProcessingSenior-level Full TimeSingapore1d ago
-
(Senior) Development Partner, Logistics Sector Resilience / Crisis Distribution (Data Platforms & Operations) SGD 128K-168KApache Spark | Artificial Intelligence | Cloud Migration | Dashboarding | Data GovernanceSenior-level Full TimeESG - Bugis Junction Office Tower, …1d ago
-
AI/ML Senior Project Manager SGD 160K-205KAgile | Artificial Intelligence | Backlog Management | Data Privacy | DevOpsSenior-level Full TimeSingapore R1d ago
-
Risk Control Strategy Product Manager Graduate (Disposal Optimization, TikTok BRIC Singapore), 2027 Start SGD 70K-78KAI machine learning | Adversarial risk | Anti-cheat | Anti-cheat systems | Content SafetyEntry-level Full TimeSingapore2d ago
-
AI Program Manager (Data Annotation Model Operations) - AI Data Service and Operations SGD 120K-170KArtificial Intelligence | Cause analysis | Data Analysis | Data Annotation | Evaluation metricsMid-level Full TimeSingapore2d ago
-
Manager/Senior Manager, Analytics and Insights (PID) SGD 105K-140KAnomaly Detection | Data Analysis | Data Features | Data Modeling | Data Science2-year contract | Career development | Potential extensionSenior-level Full TimePaya Lebar Quarter -PLQ 2, Singapore2d ago
-
Senior-level Full TimeSingapore, Singapore5d ago
-
Senior/Manager, Data Scientist (2 years contract) SGD 72K-144KApache Spark | Azure | Data Engineering | Feature Engineering | GenAISenior-level Contract Full TimeHealth Promotion Board, Singapore5d ago
-
Manager, Data Engineer, Group Technology & Ops SGD 123K-145KApache Flink | Apache Hadoop | Apache Hive | Apache Iceberg | Apache KafkaMid-level Full TimeWest Region (City Area), Singapore5d ago
-
Data Preparation | Data Visualization | Data cleaning | Data labeling | ExcelSenior-level Full TimeSingapore6d ago
-
Strategic AI/BI Account Executive SGD 163K-252KAnalytics architecture | Artificial Intelligence | Business Intelligence | Cloud Data | Cloud data platformExecutive-level Full TimeSingapore6d ago
-
Cause analysis | Data Analysis | Data Governance | Data Lineage | Data PipelinesMid-level Full TimeSingapore, Singapore, Singapore6d ago
-
Forward Deployed Engineering Manager, AI, Google Cloud SGD 140K-214KAgent systems | Artificial Intelligence | Context engineering | Data Governance | ExplainabilitySenior-level Full TimeSingapore7d ago
-
Manager/Senior Manager (Data Analytics) SGD 98K-144KArtificial Intelligence | Dashboarding | Data Curation | Data Governance | Data Management2-year contractSenior-level Full TimeRH, Singapore7d ago
-
API Integration | Acceptance Testing | Alteryx | Automation Anywhere | Blue PrismTraining and development | Travel opportunitiesSenior-level Full TimeSingapore7d ago
-
Agent workflows | Cross-Functional Collaboration | Cross-functional | Feature planning | Functional collaborationMid-level Full TimeSingapore, Singapore8d ago
-
Data Analysis | Data Visualization | Data cleaning | Data labeling | ExcelSenior-level Full TimeSingapore8d ago
-
Agent systems | Artificial Intelligence | Data Sovereignty | Engineering leadership | EnglishSenior-level Full TimeSingapore8d ago
-
Deputy Director, AI Risk Supervision (Perm/Contract) SGD 130K-240KAI Governance | Artificial Intelligence | Data Science | Machine Learning | Policy DevelopmentExecutive-level Contract Full TimeMAS: MAS Building, Singapore8d ago
-
Amazon Web Services | Business Analytics | Business Intelligence | Cloud Computing | Data ScienceCareer growth | Inclusive culture | Mentorship | Work-life balanceSenior-level Full TimeSGP8d ago
-
Data Analysis | Data Processing | Data Visualization | Database Management | DigitalizationExecutive-level Contract Full TimeITE-HQ (Headquarters), Singapore8d ago