TikTok LIVE - AI/ ML Data Operations Manager
Tasks
- Align model prompts and agent skills with policies
- Build and scale prompt and data operating workflow intake sampling labeling qc evaluation release
- Define tooling requirements for case retrieval batch testing and prompt debugging
- Design training and evaluation data strategies
- Drive continuous improvement from production signals case RCA and policy constraints
- Drive labeling team delivery with quality control and ground truth alignment
- Establish prompt writing standards and quality requirements
- Lead prompt engineering and data operations lifecycle
- Mine edge cases and run error analysis
- Own evaluation iteration and rollout diagnostics
- Run canary testing and A B testing for rollout decisions
- Track multi queue delivery and maintenance cycles
- Update prompts skills and data from RCA findings and hard policy constraints
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | Agent systems | B testing | Batch testing | Benchmarking | Case Retrieval | Content Moderation | Content governance | Data Operations | Data labeling | Evaluation Frameworks | Experiment design | Golden Set | Machine Learning | Metric analysis | Model Evaluation | Multimodal Models | Offline evaluation | Online Inference | Prompt debugging | Prompt engineering | Python | Quality Control | Risk Assessment | SQL | Taxonomy design | Tool use | Trust and Safety
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
LLM Algorithm Engineer Intern - Global Frontier Tech Recruitment Program - 2027 Start (PhD) SGD 84K-91KDeep learning | Fine Tuning | Information Extraction | Intent Classification | Language ModelsCredit bearing internshipEntry-level InternshipSingapore, Singapore4h ago
-
Senior AI Engineer SGD 90K-199KAPIs | Arcpy | Data Pipelines | Deep learning | FMEEmployee assistance program | Employee stock purchase plan | Flexible work options | Paid time off | Retirement savings planSenior-level Full TimeSingapore, Singapore9h ago
-
Entry-level InternshipSingapore21h ago
-
Database Administrator (DBA / DBRE) SGD 45K-50KAWS RDS | Auditing | Aurora | Backup and Recovery | Cloud SQLBlameless post mortems | Cross-functional collaboration | On-call rotationEntry-level InternshipSingapore21h ago
-
.NET | AKS | App Service | Azure App | Azure App ServiceMid-level Full TimeSingapore, Singapore1d ago
-
APIs | Azure Data | Azure Data Explorer | Azure Data Factory | Azure DevOpsOnsite workMid-level Full TimeSingapore, Singapore1d ago
-
.NET | Agent Orchestration | Agent systems | App Service | Azure AppSenior-level Full TimeSingapore, Singapore1d ago
-
AI Feedback | Agent systems | Agents | Automated Evaluation | Context modelingEntry-level InternshipSingapore1d ago
-
C# | C++ | Debugging | Embedded Hardware | Embedded SystemsSenior-level Full TimeSingapore, Singapore, Singapore1d ago
-
Control Theory | Data Pipelines | Domain Randomization | Imitation Learning | Isaac LabOpen source contributionsMid-level Full TimeSingapore1d ago
-
C++ | Contact Rich Control | Control Theory | Data collection | Grasp PlanningCompetitive compensation | Equity | Open source contributionsMid-level Full TimeSingapore R1d ago
-
C++ | Dynamic Obstacle Avoidance | Embedded Systems | Footstep planning | Global planningCompetitive compensation | EquitySenior-level Full TimeSingapore1d ago
-
Software Engineer, Enterprise Technology Services SGD 149K-191KActor Model | Apache | Couchbase | GRPC | GoSenior-level Full TimeSingapore1d ago
-
DB2 | Database querying | Java | SQLEntry-level InternshipSingapore, Singapore1d ago
-
Microsoft Full Stack Engineer - Professional SGD 96K-114KAlerting | Apache Kafka | Apache Pulsar | Broker Configuration | Consumer groupsSenior-level Full TimeSingapore1d ago
-
Senior-level Full TimeSingapore - Central, Downtown Core1d ago
-
AWS | Agile | Algorithms | AngularJS | AzureConstant learning | Great benefits | Skill growthMid-level Full TimeSingapore, SG, 1174401d ago
-
Agentic AI | Anomaly Detection | CI/CD | DevOps | LLM orchestrationExecutive-level Full TimeDBS Asia Hub, Singapore1d ago
-
Machine Learning Engineer (EC AI) SGD 70K-130KData Analysis | Experimental Design | Machine Learning | Predictive Modeling | PythonMid-level Full TimeCrimson House Singapore1d ago
-
Data Engineer (ETL & PySpark) SGD 90K-120KAWS | AWS Glue | Agile Scrum | Amazon EMR | Apache AirflowSenior-level Full TimeSingapore, Singapore, Singapore1d ago
-
[Lta-Itcd] Senior Ai Engineer / Ai Engineer SGD 74K-74KAI Governance | Agentic AI | Cloud Platforms | Computer Vision | Data ManagementSenior-level Full TimeLTA HSO B6 02, Singapore1d ago
-
AI Integration Engineer SGD 70K-130KAPI Keys | Analytics Integration | Audit Logging | Authentication | AutomationFlexible working arrangements | Job stability | Professional development | Technical autonomyMid-level Full TimeSJ Singapore HQ Tower 11d ago
-
AI Solutions & Technical Support (2-year Contract) SGD 70K-133KAPIs | Cause analysis | Cloud Computing | LLM | Microsoft CopilotMid-level Contract Full TimeMapletree Business City, Singapore, Singapore1d ago
-
AI Engineer (AIAP) SGD 60K-108KAWS | Azure | CI/CD | Computer Vision | DockerMentorship opportunities | Professional development | Workshop and seminar participationMid-level Full TimeNTU Main Campus, Singapore1d ago
-
Anomaly Detection | Artificial Intelligence | Cause analysis | Dashboarding | Data AnnotationEntry-level Full Time InternshipSOH01 - Singapore HP Campus Block …1d ago