Model Data Operations Specialist, Evaluation & Judgement Center, Platform Responsibility
Tasks
- Annotate LLM training data
- Build AI content quality management system
- Conduct AI special projects for product R and D
- Create annotation SOPs from policy documents
- Customize solutions and train models
- Define Golden Set and access criteria
- Deliver ground truth through queue demand analysis and acceptance
- Design rule routing logic for LLM execution
- Diagnose problems and analyze data
- Ensure security compliance
- Establish adjudication mechanism for risk judgments
- Evaluate model iteration effectiveness
- Optimize model performance and resource utilization
- Perform quality assurance for data delivery
- Research industry applications
Perks/Benefits
- N/A
Skills/Tech-stack
Content Safety | Data Annotation | Data Pipelines | Ground Truth | LLM Content Safety | Language Models | Large Language Models | Machine Learning | Model Evaluation | Model Optimization | Policy Documentation | Prompt engineering | Quality Assurance | Risk Assessment | Rule-based | Rule-based Systems | SOP Development | Security Compliance
Education
N/A
Roles
AI | AI Engineer | Data Operations Specialist | Engineer | Operations Specialist | Specialist
Related jobs
-
Android Development | C plus plus | Data Processing | Debugging | Language ProcessingMid-level Full TimeSingapore8h ago
-
Senior-level Full TimeSingapore, Singapore13h ago
-
AI Sales Enablement Intern SGD 42K-57KAPI Integration | Data Analysis | Data reporting | Digital Advertising | Media PlanningEntry-level InternshipSingapore13h ago
-
AI Tooling | C++ | Embedded C | Embedded firmware | Firmware Quality AssuranceSenior-level Full TimeMSB, Singapore19h ago
-
Computational Algorithms | Generative AI | Machine Learning | NumPy | Numerical MethodsPart-time freelance | Remote workMid-level FreelanceSingapore - Remote R19h ago
-
BigQuery | Cloud Data Catalog | Cloud Functions | Cloud Storage | Data CatalogMid-level Full TimeSingapore, Singapore1d ago
-
Causal Inference | Deep learning | Language Models | Large Language Models | Machine LearningEntry-level Full TimeSingapore, Singapore1d ago
-
Senior-level Full TimeSingapore, Singapore1d ago
-
Senior Product Analytics Engineer SGD 96K-132KAWS SageMaker | Agentic AI | Azure Machine Learning | Cause analysis | Copilot StudioSenior-level Full TimeMSB, Singapore1d ago
-
Head of Applied AI & Products SGD 160K-246KData Pipelines | Document processing | Entity Resolution | Human-in-the-loop | Information ExtractionCommunity initiatives | Learning and development opportunities | Sustainability focused mission | Volunteering opportunitiesExecutive-level Full TimeSGP-Singapore1d ago
-
Senior / Software Engineer (AI Computer Vision) SGD 147K-180KAPI Development | Artificial Intelligence | Cloud Computing | Cloud on-prem | Cloud/on-prem architectureComprehensive benefitsSenior-level Full TimeST Electronics Hub, SG1d ago
-
Senior-level Full TimeSingapore, Singapore2d ago
-
Machine Learning Engineer - Singapore SGD 147K-180KActive Learning | Anomaly Detection | Bayesian optimization | C++ | CUDASenior-level Full TimeOne-north2d ago
-
AI Deployment Strategist - Singapore SGD 70K-100KAPI Integration | Fine Tuning | Frontend Development | LLM | Machine LearningGym membership allowance | Health insurance | Meal allowance | Parking reimbursement | Public transport reimbursementMid-level Full TimeSingapore2d ago
-
Artificial Intelligence | Cloud Native | Data Lakehouse | Data Pipelines | Data platformsAccess To Career Development | Employee resource groups | Flexible work from home | Generous paid time off | Paid volunteer timeSenior-level Full TimeSingapore-Singapore2d ago
-
Anomaly Detection | Boosting | Data Modeling | Data Transformation | Data cleaningInclusive teamEntry-level Full Time InternshipFab 10N/X, Singapore2d ago
-
AWS SageMaker | Algorithmic trading | Amazon Bedrock | Applied Mathematics | Cloud ComputingMid-level Full TimeMarina Bay Financial Centre, Singapore2d ago
-
Machine Learning Engineer SGD 48K-60KAlgorithms | Data Structures | Exploration | Information Retrieval | JavaMandarin proficiency preferredEntry-level Full Time新加坡3d ago
-
Data Science Internship SGD 57K-57KAnti-Money Laundering | Data Engineering | Data Pipelines | Data cleaning | Fraud DetectionFlexible remote work options | Focus Fridays | Generous PTO | Hybrid work options | Learning and development opportunitiesEntry-level InternshipSingapore - Singapore4d ago
-
Capacity Planning | Computer Vision | Deep reinforcement learning | LLM | Language ModelsMid-level Full TimeSingapore, Singapore4d ago
-
Algorithm Implementation | Automatic Parameter Optimization | Capacity Scheduling | Data Modeling | Dynamic Route PlanningMid-level Full TimeSingapore, Singapore4d ago
-
Backend Software Engineer, Manus SGD 140K-143KAPI Design | AWS | Azure | Best practices | Bias MitigationMid-level Full TimeSingapore4d ago
-
AI Agent Engineer, Manus SGD 57K-57KAPI Design | Agent System | Agent System Architecture | Prompt engineering | RAGEntry-level Full TimeSingapore4d ago
-
Senior Machine Learning Engineer, Compliance SGD 106K-106KAML | Anomaly Detection | Automation workflows | Batch Data Processing | Batch dataCandidate Support Programs | Company events | Education subsidy | Healthcare schemes | L and D programsSenior-level Full TimeSingapore, Singapore4d ago
-
AI Engineer (Data and Analytics Department) SGD 140K-200KCI/CD | Continuous Training | Data Drift | Data Drift Detection | Deep learningSenior-level Full TimeEMA HQ, Singapore4d ago