Model Data Operations Specialist, Evaluation & Judgement Center, Platform Responsibility
Singapore, Singapore
SGD 106K-125K (estimate) Senior-level Full Time
Tasks
- Annotate LLM training data
- Build AI content quality management system
- Conduct AI special projects for product R and D
- Create annotation SOPs from policy documents
- Customize solutions and train models
- Define Golden Set and access criteria
- Deliver ground truth through queue demand analysis and acceptance
- Design rule routing logic for LLM execution
- Diagnose problems and analyze data
- Ensure security compliance
- Establish adjudication mechanism for risk judgments
- Evaluate model iteration effectiveness
- Optimize model performance and resource utilization
- Perform quality assurance for data delivery
- Research industry applications
Perks/Benefits
- N/A
Skills/Tech-stack
Content Safety | Data Annotation | Data Pipelines | Ground Truth | LLM Content Safety | Language Models | Large Language Models | Machine Learning | Model Evaluation | Model Optimization | Policy Documentation | Prompt engineering | Quality Assurance | Risk Assessment | Rule-based | Rule-based Systems | SOP Development | Security Compliance
Education
N/A
Roles
AI | AI Engineer | Data Operations Specialist | Engineer | Operations Specialist | Specialist
Related jobs
-
Compiler optimization | Distributed Systems | Elastic Scheduling | GPU scheduling | High PerformanceEntry-level Full TimeSingapore, Singapore11h ago
-
Senior-level Full TimeSingapore15h ago
-
Artificial Intelligence | Big Data | Data Visualization | Database Programming | HadoopEntry-level Full TimeSingapore22h ago
-
Data & AI Engineer SGD 100K-143KAWS | AWS Glue | AWS Lambda | Airflow | Amazon EC2Mentorship | Professional growthMid-level Full TimeSingapore, Singapore, Singapore23h ago
-
Senior Machine Learning Engineer SGD 74K-130KAlerting | Automated retraining | CI/CD | Data Quality | Feature EngineeringSenior-level Full TimeSG Ensign Kallang Place, L9 (Right …23h ago
-
Machine Learning Engineer SGD 54K-60KData Structures | Information Retrieval | Java | Language Processing | Machine LearningEntry-level Full Time新加坡1d ago
-
Assistant Algorithm Engineer SGD 60K-78KComputer Vision | Deep learning | Machine Learning | PyTorch | TensorFlowEntry-level InternshipSingapore1d ago
-
Senior Software Engineer AI/ML SGD 139K-150KAPI Design | CI/CD | Deployment | Docker | GitEquity | Learning stipends | Remote-firstSenior-level Full TimeSingapore R1d ago
-
Backend Engineer - Applied Machine Learning Platform SGD 120K-155KCloud Computing | Data Pipelines | Data Processing | Debugging | Deep learningMid-level Full TimeSingapore, Singapore1d ago
-
Machine Learning Engineer - Logistics Fulfillment SGD 60K-108KAlgorithm Development | Data Modeling | Deep reinforcement learning | Demand forecasting | Dynamic Route PlanningMid-level Full TimeSingapore, Singapore1d ago
-
Accelerator | Data Analysis | Deep learning | Diffusers | Experiment designAutonomy | Career growth | Continuous learning | Flexible distributed environment | Fully remote workMid-level Full TimeSingapore R1d ago
-
Software Engineer, Perception SGD 120K-143K3D Reconstruction | C++ | CUDA | Computer Vision | Deep learningMid-level Full TimeSingapore1d ago
-
Principal AI Architect - Product and Framework SGD 112K-171KAI Agents | API Architecture | APIs | Cloud Native | Enterprise AICareer mobility | Continuous learning | Employee assistance programs | Flexible working hours | Inclusive cultureSenior-level Full TimeSingapore, Singapore1d ago
-
AI Value & Business Insights Lead - Data Architect SGD 100K-130KCloud Computing | Data Governance | Data Modeling | Data Quality | Data pipelineCareer mobility | Continuous learning | Employee assistance programs | Flexible working hours | Inclusive cultureSenior-level Full TimeSingapore, Singapore1d ago
-
AI Engineer SGD 83K-120KAPIs | Arcpy | Dashboards | Data Pipelines | Deep learningDental insurance | Disability benefits | Employee assistance program | Employee stock purchase plan | Flexible work optionsSenior-level Full TimeSingapore, Singapore1d ago
-
Data Annotation | Data Augmentation | Data Quality | Data cleaning | Data labelingMid-level Full TimeCrimson House Singapore1d ago
-
Customer Success & Insights Engineer SGD 120K-200KAgile methodology | Amazon Web Services | Big Data | Data Analysis | Data EngineeringSenior-level Full TimeSOH02 - Singapore HP Campus Block …1d ago
-
Container Orchestration | Distributed Computing | HPC | Kubernetes | LinuxMid-level Full TimeSingapore2d ago
-
A/B | A/B Testing | B testing | Continual Learning | Dataset ConstructionSenior-level Full TimeSingapore, Singapore3d ago
-
GenAI Engineer SGD 165K-220KAI Platform | AI Services | API Integration | AWS Bedrock | AWS FargateSenior-level Full TimeSingapore3d ago
-
Attention to detail | Content labeling | Data Annotation | Data Quality | Fact-checkingFlexible schedule | Freelance work | Part-time work | Remote workEntry-level FreelanceSingapore - Remote R3d ago
-
BigQuery | Cloud Data Catalog | Cloud Functions | Cloud Storage | Cloud platformMid-level Full TimeSingapore, Singapore4d ago
-
API Integration | Azure Data | Azure Data Explorer | Azure Data Factory | Azure DevOpsOnsite workMid-level Full TimeSingapore, Singapore4d ago
-
.NET | AKS | Agentic AI | App Service | Azure AppMid-level Full TimeSingapore, Singapore4d ago
-
Content Safety | Data Analysis | Knowledge Base | Knowledge base construction | Language ModelsMid-level Full TimeSingapore, Singapore4d ago