Applied AI Engineer – Prompting & Evaluation
Johannesburg, SA, ZA | Stellenbosch, SA, ZA
ZAR 360K-480K (estimate) Mid-level Full Time
Tasks
- Build evaluation frameworks for AI outputs
- Collaborate with product managers and subject matter experts
- Design prompts and context strategies
- Develop retrieval augmented generation features
- Implement error handling and fallbacks
- Integrate Large Language Model APIs
- Manage latency token cost logging and monitoring
- Prototype and ship AI features end to end
- Test LLM outputs against real business cases
Perks/Benefits
Skills/Tech-stack
.NET | C# | Context engineering | Cost Management | Embeddings | Error Handling | Evaluation Frameworks | LLM APIs | Language Models | Large Language Models | Latency management | Logging | Monitoring | Prompt engineering | Retrieval-Augmented Generation | Structured outputs | Token Cost | Token Cost Management | Vector Search
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Senior Applied AI Engineer – Prompting & Evaluation ZAR 450K-650KAgentic Workflows | Azure OpenAI | Context design | Embeddings | GitHub CopilotCoaching and mentoring culture | Community of Practice | Hybrid work policy | Travel between UK and South Africa officesSenior-level Full TimeJohannesburg, SA, ZA | Stellenbosch, SA, …1d ago
-
Mid-level ContractJohannesburg, South Africa2d ago
-
Senior Machine Learning Engineer ZAR 745K-900KAI Platform | AWS SageMaker | Apache Airflow | Azure ML | Computer VisionSenior-level Full TimeJohannesburg, South Africa2d ago
-
Junior Software Analytics Engineer ZAR 216K-264KAPI Integration | Alerting | Android | Authentication | AuthorizationGreat work environment | Total remuneration flexibilityEntry-level Full TimeCape Town3d ago
-
Agentic pipelines | DPO | Deep learning | Direct Preference Optimization | Distributed TrainingContinuous learning opportunities | English language learning discounts | Fully remote | Health support budget | Home-office allowanceSenior-level Full TimeSouth Africa R4d ago
-
AI Applications | AI Automation | AI workflows | APIs | Artificial IntelligenceClient facing travel | Technical mentorship | Training workshops facilitationEntry-level Full TimeRosebank, Johannesburg, Gauteng9d ago
-
Principal Prompt Engineer ZAR 498K-600KAI Evaluation | AI Governance | AI Quality Assurance | AI quality | Generative AISenior-level Full TimeWC, South Africa10d ago
-
Automated data quality | Batch Processing | Big Data | CI/CD | Cloud StorageCross training | Hybrid work | Mentorship | Standby rotation participationSenior-level Full TimeCape Town, Western Cape, South Africa13d ago
-
AWS | Computer Vision | Entity recognition | FFmpeg | Generative AISenior-level Full TimeCape Town, Western Cape, South Africa15d ago
-
AI Technology and Innovation Engineer ZAR 840K-1100KAPI Development | Amazon Web Services | Artificial Intelligence | Azure | Cloud ComputingHybrid workSenior-level Full TimeJohannesburg, South Africa17d ago
-
Machine Learning Engineer ZAR 264K-360KAutocomplete | Classification | Cloud platform | Embeddings | Google CloudMid-level Full TimeJohannesburg, Gauteng, South Africa20d ago
-
Access Control | Airflow | Amazon Redshift | Authentication | BigQueryFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R20d ago
-
AI Implementation Expert ZAR 745K-860KAPI Integration | Azure Machine Learning | Azure OpenAI | ChatGPT | Copilot StudioSenior-level Full TimeSouth Africa22d ago
-
AI Implementation Expert ZAR 745K-860KAPI Integration | Azure AI | Azure Machine Learning | Azure OpenAI | ChatGPTSenior-level Full TimeSouth Africa22d ago
-
Senior-level Full TimeSandton - 1 Discovery Place, GP, …26d ago
-
Mid-level Full TimeSouth Africa29d ago
-
AI Engineer ZAR 360K-480KAI Foundry | API Integration | Agent Framework | Azure AI | Azure AI FoundryMid-level Full TimeSouth Africa29d ago
-
A/B | A/B Testing | API Design | AWS ECS | AWS EKSSenior-level Full TimeCape Town1mo ago
-
Machine Learning Architect ZAR 840K-1200KAI Agents | AWS | Apache Airflow | Apache Spark | Automated retrainingSenior-level Full TimeSouth Africa - Remote R1mo ago
-
AWS | Azure | Embeddings | GCP | Hugging FaceFlexible work environment | Fully remote | Growth opportunities | Remote distributed team experienceSenior-level Full TimeSouth Africa - Remote R1mo ago
-
Senior Data Platform Engineer ZAR 700K-860KAI Search | Apache Airflow | BigQuery | Cloud Composer | Cloud DataflowCommunity groups | Employee resource groups | Flexible wellbeing supportSenior-level Full TimeCape Town, Western Cape, South Africa1mo ago