Software Engineer, AI i18n and Evaluations
Tasks
- Craft evaluation datasets, metrics, and pipelines
- Create auto-raters
- Develop strategies to scale country and language capabilities
- Ensure evaluation metrics consistency
- Establish evaluation benchmarks
- Evaluate and optimize model behavior across languages and locales
- Influence cross team roadmap priorities
- Integrate new models into evaluation pipelines
- Lead research and development for AI i18n evaluations
- Mentor team and remove bottlenecks
Perks/Benefits
- N/A
Skills/Tech-stack
Android Development | Data Processing | Debugging | Fine Tuning | Information Retrieval | Language Processing | Machine Learning | Model Deployment | Model Evaluation | Model Fine-tuning | Natural Language | Natural Language Processing | On-device Machine Learning | Reinforcement Learning | Speech Recognition
Education
Roles
Related jobs
-
C++ | Cloud Computing | Cloud Databases | Force control | Hardware IntegrationSenior-level Full TimeSingapore23h ago
-
Chain-of-Thought | Content Moderation | Data Construction | Efficient Fine Tuning | Few-Shot LearningSenior-level Full TimeSingapore, Singapore1d ago
-
Applied AI Researcher (OCR) SGD 106K-120KA/B | A/B Testing | B testing | CI/CD | Computer VisionCommuter benefits | Dental insurance | Employee assistance program | Flexible spending account | Health insuranceSenior-level Full TimeSingapore1d ago
-
Applied AI Researcher SGD 128K-171KA/B | A/B Testing | Amazon Redshift | B testing | CI/CDEmployee benefits | Flexible work environment | Remote-friendly work culture | Self-care supportSenior-level Full TimeSingapore1d ago
-
Senior-level Full TimeSingapore - Technology Centre1d ago
-
AI Model Training | AI model | Artificial Intelligence | Cloud Computing | Dashboard DevelopmentFlexible work hours | Multidisciplinary collaboration | Research-focused environmentMid-level Full TimeNTU Main Campus, Singapore1d ago
-
Apache Spark | Azure | Computer Vision | Decision Trees | Deep learningMedical coverage | Staff volunteerism | Subsidized serviced residence rates | Training and development | Wellness programmesSenior-level Contract Full TimeCapital Tower, Singapore1d ago
-
Apache Spark | Azure OpenAI | Boosting | Computer Vision | Decision TreesEmployee volunteering | Medical coverage | Subsidised accommodation | Training and development | Wellness programsSenior-level Contract Full TimeCapital Tower, Singapore1d ago
-
Apache Spark | Azure | Computer Vision | Decision Tree | Deep learningEmployee volunteerism | Medical coverage | Subsidised accommodation rates | Training and development | Wellness programmesSenior-level Contract Full TimeCapital Tower, Singapore1d ago
-
Entry-level Full TimeSingapore, Singapore, Singapore1d ago
-
Algorithm Engineering | Computer Vision | Federated Learning | Graph computing | High PerformanceEntry-level Full TimeSingapore, Singapore2d ago
-
Backend Development | Build process | C plus plus | Code review | ConcurrencySenior-level Full TimeSingapore, Central, Singapore2d ago
-
Agent planning | Architecture Design | Deep learning | Graph Neural Networks | Language ModelsEntry-level Full TimeSingapore, Singapore2d ago
-
Data Processing | Distributed Training | Heterogeneous hardware | High Availability | Inference accelerationEntry-level Full TimeSingapore, Singapore2d ago
-
Applied Scientist Graduate - Business Integrity - Global Tech Research Program - 2027 Start (PhD) SGD 72K-81KAdversarial Learning | Deep learning | Language Models | Language Processing | Large Language ModelsEntry-level Full TimeSingapore, Singapore2d ago
-
Business Engineer - Business AI SGD 83K-130KAgent Orchestration | Agile | Bias Mitigation | Ethical AI | JavaTravel up to 20 percentSenior-level Full TimeSingapore2d ago
-
Senior Software Engineer, Enterprise Data Protection SGD 134K-143KAccess Management | Artificial Intelligence | C++ | CSS | CybersecuritySenior-level Full TimeSingapore2d ago
-
AI Engineer SGD 138K-139KArtificial Intelligence | Data Preprocessing | Debugging | Deep learning | Language ModelsMid-level Full TimeSingapore2d ago
-
AI Developer SGD 90K-133KAzure | Big Data | Big data processing | Data Modeling | Data ProcessingFlexible work environment | Hybrid work arrangement | Well-being and inclusionMid-level Full TimeManulife Tower, Manulife (Singapore) Pte Ltd2d ago
-
T&T Senior Consultant - Artificial Intelligence & Data (Data and Cloud Platform Engineer) - SG SGD 100K-130KAccess Control | Cloud Composer | Cloud platform | Conversational BI | Data CatalogSenior-level Full TimeSingapore, Singapore, SG2d ago
-
Machine Learning Engineer Intern SGD 70K-70KDeep learning | Hadoop | Language Models | Language Processing | Large Language ModelsFinancial security support | Healthcare coverage | Mental health resources | Paid time offEntry-level Full Time InternshipSGP - Central Singapore - Corp …2d ago
-
Principal Solutions Engineer – Artificial Intelligence SGD 100K-130KAWS | Apache Iceberg | Artificial Intelligence | Azure | Big DataCareer development | Employee resource groups | Flexible WFH policy | Generous PTO | Internet reimbursementSenior-level Full TimeSingapore-Remote R2d ago
-
Applied AI Engineer SGD 136K-171KAgent workflows | Deep learning | Inference | JAX | LLM orchestrationSenior-level Full TimeSingapore3d ago
-
Software Engineering, Machine Learning (Singapore) SGD 60K-108KAgent Orchestration | Artificial Intelligence | Bias Mitigation | Data Mining | JavaScriptEntry-level Full TimeSingapore3d ago
-
C++ | Data Structures | Data Structures and Algorithms | Generative AI | Language ProcessingMid-level Full TimeSingapore3d ago