#EG AI / LLM Specialist
Tasks
- Build and maintain LLM evaluation harnesses and benchmark suites
- Create automated regression suites with CI integration
- Design and optimize prompts and prompt chains for production
- Integrate foundation models via APIs and gateways
- Maintain prompt version documentation and evaluation reporting
- Measure hallucination bias and drift with defensible metrics
- Perform red teaming with adversarial prompting and jailbreak testing
- Prototype prompts and model integrations for POC and POV
- Run model benchmarking for accuracy latency and cost
- Set up quality safety and monitoring for production LLM systems
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | Amazon Bedrock | Azure OpenAI | B testing | DeepEval | GitHub Actions | GitLab CI | Hugging Face | Hugging Face Transformers | Jupyter | Langchain | Litellm | Llamaindex | LoRA | OpenAI API | PEFT | Pandas | Prompt engineering | Promptfoo | Python | Ragas | SQL | TruLens | Vertex AI
Education
N/A
Roles
AI | AI/LLM Engineer | Engineer | LLM Engineer | Prompt Engineer
Related jobs
-
#EG Senior Data Engineer SGD 162K-225KAI Search | AWS | Access Control | Airflow | Azure AICareer development pathways | Continuous learning opportunities | Diversity and inclusion | Supportive work environmentSenior-level Full TimeSingapore, Singapore23h ago
-
Senior-level Full TimeSingapore, Singapore1d ago
-
.NET | Azure | Azure DevOps | Azure Functions | Azure OpenAIMid-level Full TimeSingapore, Singapore1d ago
-
Distributed Systems | Go | Kubeflow | Linux | Machine LearningEntry-level Full TimeSingapore, Singapore1d ago
-
Data Engineer SGD 60K-108KAWS Glue | Amazon Redshift | Amazon Web Services | Automated testing | C SharpMid-level Full TimeSingapore1d ago
-
#EG AI Engineer SGD 162K-270KAI Foundry | AWS Bedrock | AWS Strands | Azure AI | Azure AI FoundryCollaborative team environment | Enterprise client exposure | Professional development supportMid-level Full TimeSingapore, Singapore1d ago
-
Data Engineer (Content Processing) SGD 60K-108KCI/CD | Computer Vision | Docker | ELT | ETLMission-driven work | Opportunities for professional growth | Work-life balanceEntry-level Full TimeSingapore, Singapore1d ago
-
Mid-level Full TimeSingapore, Singapore, Singapore1d ago
-
AI Evaluation | Acceptance Testing | Accuracy testing | Bias Testing | Browser testingSenior-level Contract Full TimeHealth Promotion Board, Singapore1d ago
-
AI Solution Architect SGD 150K-199KAWS Bedrock | Agentic Workflows | Air gapped deployment | Air-gapped | Anthropic ClaudeSenior-level Full TimeSingapore - Marina One1d ago
-
Senior Software Engineer, Perception (Robotics) SGD 140K-190KAction models | BEV | Bayesian Filtering | C++ | Camera CalibrationSenior-level Full TimeSingapore, Singapore2d ago
-
APIs | AWS | Agent systems | Agentic AI | AutogenCollaboration with research institutes | Hybrid work | Knowledge sharing sessions | MentorshipEntry-level InternshipSingapore, 01, SG, 2399202d ago
-
AVP/VP, AI Engineer, Technology Group SGD 180K-250KAWS | AWS Lambda | Agents SDK | Amazon Bedrock | Amazon DynamoDBFlexible work schedule | In person collaboration days per week | Mentorship and career growth | Work from home flexibilityExecutive-level Full TimeSingapore, SG R2d ago
-
Access Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksExecutive-level Full TimeITE-HQ (Headquarters), Singapore2d ago
-
AWS | Apache Airflow | Azure | CI/CD | DBTSenior-level Full TimeLTA BCO (MAIN), Singapore2d ago
-
Senior-level Full TimeYEA Singapore Office2d ago
-
AI Engineer (AIEH) SGD 60K-108KAWS | CI/CD | Cloud platform | Computer Vision | Data pipelineMentorship opportunity | Professional developmentMid-level Full TimeNTU Main Campus, Singapore2d ago
-
Machine Learning Engineer - Global Payment - Singapore SGD 159K-240KApache Hive | Apache Spark | Deep learning | Java | Machine LearningSenior-level Full TimeSingapore, Singapore3d ago
-
Alerting | Automated rollback | C++ | CI/CD | Canary DeploymentSenior-level Full TimeSingapore, Singapore3d ago
-
A/B | A/B Testing | Autonomous Agents | B testing | Data MiningMid-level Full TimeSingapore, Singapore3d ago
-
AI Solution Architect - BytePlus SGD 149K-207KAgentic AI | Apache Flink | Apache Spark | Docker | FastAPISenior-level Full TimeSingapore, Singapore3d ago
-
Algorithm Engineer Graduate (Global E-Commerce, Supply Chain and Logistics) - 2026 Start (PhD) SGD 84K-91KDeep learning | Java | Knowledge graphs | LLM | Language ProcessingEntry-level Full TimeSingapore, Singapore3d ago
-
Machine Learning Engineer Graduate (Global E-Commerce, Risk Control) - 2026 Start (PhD) SGD 84K-108KData pipeline | Fraud Detection | Machine Learning | PyTorch | PythonEntry-level Full TimeSingapore, Singapore3d ago
-
Apache Flink | Apache FlinkDataStream | Apache HBase | Apache Spark | Apache YARNMid-level Full TimeSingapore, Singapore3d ago
-
C++ | Fine Tuning | Graph Algorithms | Human Feedback | Inference OptimizationSenior-level Full TimeSingapore, Singapore3d ago