Software Engineer, AI i18n and Evaluations
Tasks
- Build metrics and evaluation pipelines
- Craft evaluation datasets
- Create auto-raters
- Develop roadmaps to scale country and language capabilities
- Ensure metrics consistency
- Establish evaluation benchmarks
- Evaluate and optimize model behavior across languages locales and hardware
- Improve reliability scalability and efficiency of model evaluation processes
- Integrate new models and use cases into evaluations and benchmarks
- Interface with cross functional teams to influence priorities and roadmap
- Lead research and development team
- Mentor team and remove bottlenecks
Perks/Benefits
- N/A
Skills/Tech-stack
AI toolchain | Android | Android Development | Data Management | Data Processing | Debugging | Evaluation metrics | Fine Tuning | Generative AI | Language Model | Language Processing | Large Language Model | Machine Learning | Mobile algorithms | Model Deployment | Model Evaluation | Natural Language | Natural Language Processing | On-device Machine Learning | Reinforcement Learning | Speech Processing
Education
Roles
Related jobs
-
AI Governance | AI Risk | AI Search | AI risk management | Agent systemsCoaching | Continuous learning | Flexible working arrangementsEntry-level Full TimeSG, 04858318h ago
-
AI Prompt Engineer SGD 74K-74KAI Governance | Anthropic API | Chain-of-Thought | DeepEval | Gemini APISenior-level Full TimeSingapore18h ago
-
Entry-level Full TimeSINGAPORE, Singapore18h ago
-
Computer Vision | Data Mining | Deep learning | Graph Neural Networks | Language ProcessingEntry-level Full TimeSingapore, Singapore1d ago
-
Software Engineer, Machine Learning, Payments SGD 138K-148KC# | C++ | Data Processing | Debugging | GoMid-level Full TimeSingapore1d ago
-
Artificial Intelligence | Container Orchestration | Distributed Computing | High Performance | High-Performance ComputingMid-level Full TimeSingapore1d ago
-
Senior-level Full TimeSingapore1d ago
-
Senior-level Full TimeSingapore, Singapore1d ago
-
Data Analytics Engineer/Data Scientist SGD 150K-214KAirflow | Amazon Redshift | BigQuery | DBT | Data BlendingSenior-level Full TimeSingapore - Technology Centre1d ago
-
AI Engineer 2 (Data and Analytics Department) SGD 74K-74KAutomated retraining | CI/CD | Continuous Deployment | Continuous Training | Data DriftSenior-level Full TimeEMA HQ, Singapore1d ago
-
Software Engineer (Embedded Systems) SGD 60K-100KAI Assisted Development | Agile | Debugging | Device Drivers | Embedded CMid-level Full TimeSINGAPORE, Singapore1d ago
-
AI Agents | AI Search | Azure AI | Azure AI Search | Azure OpenAISenior-level Full TimeNTU Main Campus, Singapore1d ago
-
M09 - Full Stack Engineer SGD 60K-108KAWS | Anomaly Detection | Azure | Data Anomaly | Data Anomaly DetectionEntry-level Full TimeSingapore2d ago
-
Computer Vision | Generative AI | Information Retrieval | Language Models | Language ProcessingSenior-level Full TimeSingapore, Singapore2d ago
-
Backend Development | High Availability | Inference Optimization | Machine Learning | Model InferenceSenior-level Full TimeSingapore, Singapore2d ago
-
Machine Learning Operations Manager (Safety Model Operations) - AI Data Service & Operations SGD 99K-139KActive Learning | Alerting | CI/CD | Data Drift | Data IngestionMid-level Full TimeSingapore, Singapore2d ago
-
Deep learning | Distributed Systems | Inference Optimization | Information Retrieval | JavaSenior-level Full TimeSingapore, Singapore2d ago
-
C++ | Deep learning | Distributed Systems | Docker | ElasticsearchMid-level Full TimeSingapore, Singapore2d ago
-
Backend Development | Cloud infrastructure | Data Processing | Debugging | Distributed SystemsMid-level Full TimeSingapore, Singapore2d ago
-
Automation | C# | C++ | Cloud Networking | Code debuggingOn-call rotation | Travel up to 15 percent in regionSenior-level Full TimeSingapore2d ago
-
Robotics Engineer USD 137K-187KBenchmarks | Calibration | Computer Vision | Data logging | Data synchronizationEntry-level Full TimeSF Bay Area, CA, Remote, International, … R2d ago
-
Clustering | Data Lake | Data Modeling | Data Transformation | Data WarehousingInterpersonal support | Knowledge transfer sessions | Training and consultancyExecutive-level Full TimeITE-HQ (Headquarters), Singapore3d ago
-
Mid-level Full TimeSingapore3d ago
-
Senior Specialist, AI Engineer SGD 92K-170KAWS | Agentic AI | Audit trails | Azure | Azure DatabricksSenior-level Full TimeSG-Collyer Quay, Singapore3d ago
-
Intern - AI / Data Science Engineering SGD 54K-66KAnomaly Detection | Data Engineering | Data Visualization | Hypothesis Testing | Machine LearningEntry-level Full Time InternshipFab 10N/X, Singapore3d ago