Senior Applied AI Engineer – Prompting & Evaluation
Johannesburg, SA, ZA | Stellenbosch, SA, ZA
ZAR 450K-650K (estimate) Senior-level Full Time
Tasks
- Build agentic workflows
- Build and refine prompt patterns
- Build evaluation harnesses
- Coach engineers with pairing and workshops
- Design and refine prompts
- Design context strategies
- Develop evaluation standards
- Ensure safety accuracy and data handling
- Implement retrieval-augmented generation
- Measure AI output quality
- Run community of practice
- Select AI models and providers
- Share measurable results with engineering leadership
- Test prompts against business cases at scale
Perks/Benefits
- Coaching and mentoring culture
- Community of Practice
- Hybrid work policy
- Travel between UK and South Africa offices
Skills/Tech-stack
Agentic Workflows | Azure OpenAI | Context design | Embeddings | GitHub Copilot | LLM Evaluation | Langchain | Language Models | Large Language Models | Prompt engineering | Python | RAG | Retrieval-Augmented Generation | Semantic Kernel | Test automation | Vector Search
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Regions
Countries
States
Related jobs
-
Apache Airflow | Apache Atlas | Apache NiFi | Azure Data | Azure Data FactoryMid-level Full TimeJohannesburg, South Africa1d ago
-
Mid-level Full TimeBellville, South Africa3d ago
-
Senior-level Full TimeCape Town, South Africa3d ago
-
Senior-level Full TimeNetcare Head Office, South Africa3d ago
-
Airflow | Amazon Redshift | BigQuery | CI/CD | ChromaDBFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R3d ago
-
Mid-level Full TimeMidrand, Gauteng3d ago
-
AI machine learning | AWS | Access Controls | Access Management | AsanaCareer growth opportunities | Competitive compensation | Hybrid flexibility | Remote workSenior-level Full TimeArgentina - Buenos Aires4d ago
-
Application Monitoring | Data Analysis | Data Quality | Data pipeline | ETLSenior-level Full TimePretoria, South Africa4d ago
-
Benchmarking | Big Data | Cloud Computing | Databases | Distributed SystemsSenior-level Full TimeJohannesburg, South Africa4d ago
-
Senior-level Full TimeJohannesburg, South Africa4d ago
-
AWS Architect | AWS Architect Associate | AWS Architect Professional | AWS Cloud | AWS Cloud PractitionerSenior-level ContractPretoria, South Africa4d ago
-
Mid-level Full TimePretoria, South Africa4d ago
-
Data Engineer ZAR 300K-420KAWS | Azure | Data Architecture | Data Lakehouse | Data PipelinesHybrid work policyMid-level Full TimeJohannesburg, SA, ZA4d ago
-
Data Engineer ZAR 300K-420KAWS | Azure | Data Lakehouse | Data Modeling | Data Pipeline MonitoringHybrid work policy | Remote work daysMid-level Full TimeJohannesburg, SA, ZA4d ago
-
Senior-level Full TimeJohannesburg, South Africa4d ago
-
(1731) Data Scientist and AI Engineer - BSTD ZAR 720K-780KAPI Development | Amazon Web Services | Apache Hadoop | Apache Spark | DB2Senior-level Full TimePretoria, South Africa4d ago
-
Senior-level Full TimeWC, South Africa4d ago
-
Senior-level Full TimeWC, South Africa4d ago
-
Senior Generative AI Engineer ZAR 603K-650KAI Governance | AI Security | AWS | Azure | Cloud PlatformsContinuous learning and development | Mentorship and team growthSenior-level Full TimeWC, South Africa4d ago
-
AI Chatbot Tester ZAR 420K-576KAcceptance Testing | Chatbot testing | Conversational AI | Defect Reporting | Generative AISenior-level Full TimeWC, South Africa4d ago
-
Senior AI Prompt Engineer ZAR 498K-576KA/B | A/B Testing | B testing | Generative AI | Information RetrievalCareer growth opportunities | Continuous learning and developmentSenior-level Full TimeWC, South Africa4d ago
-
AI Prompt Engineer ZAR 498K-576KAI Evaluation | Content Optimization | Conversational AI | Documentation | Generative AISenior-level Full TimeWC, South Africa4d ago
-
AI / Machine Learning Engineer ZAR 360K-440KCI/CD | Cloud Computing | Computer Vision | Data Governance | Data PipelinesMid-level Full TimeWC, South Africa4d ago
-
Senior RAG Engineer ZAR 450K-650KAPI Development | Chroma | Distributed Systems | Embeddings | Enterprise SearchSenior-level Full TimeWC, South Africa4d ago
-
Senior-level Full TimeWC, South Africa4d ago