Data Engineering Lead – Data Science and AI
ZAR 1000K-1200K (estimate) Senior-level Contract Full Time
Tasks
- Build generative AI and agentic AI ingestion chunking indexing
- Create curated datasets and transformation frameworks
- Define target data engineering architecture for data science and AI
- Design AWS to Azure data integration patterns
- Ensure data and AI governance privacy responsible AI security data quality
- Establish production grade MLOps and LLMOps
- Implement feature store capabilities lineage versioning monitoring
- Own data engineering delivery and build reusable pipelines
- Provide technical leadership to data engineers
- Set up monitoring incident management and cost optimization
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | Azure Data | Azure Data Factory | Azure Functions | Azure Machine Learning | Azure Storage | CI/CD | Data Factory | Data Governance | Data Quality | Data orchestration | Databricks | Feature Store | Git | Infrastructure as Code | LLMOps | MLOps | Machine Learning | Microsoft Fabric | Python | SQL | Synapse Analytics | Vector Databases | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Architect | Data Architect | Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Senior-level Full TimePinelands, South Africa2d ago
-
Data Engineering Lead – Data Science and AI ZAR 1000K-1200KAWS | AWS Athena | AWS Glue | AWS Lambda | AWS RedshiftSenior-level Contract Full TimeCape Town, Western Cape, South Africa2d ago
-
Senior-level Full TimeAbsa Towers West, South Africa5d ago
-
Mid-level Full TimeSandton - 1 Discovery Place, GP, …5d ago
-
AI Engineering Lead EUR 54K-72KAPI Integration | Analytics | Artificial Intelligence | Automation engineering | Data platformsCareer growth | Health insurance | Housing | Mentorship | Regular feedbackSenior-level Full TimeEurope7d ago
-
AI Solutions Lead - Marketing & Content ZAR 600K-720KAI platforms | API Development | AWS | Data Privacy | Enterprise AIRemote work opportunity | Work-life balanceSenior-level Full TimeJohannesburg, Gauteng R10d ago
-
AI architecture | AWS | Cloud platform | Data Governance | Data PrivacyRemote work | Work-life balanceSenior-level Full TimeJohannesburg, Gauteng R10d ago
-
AI Agents | Access Control | Artificial Intelligence | Cybersecurity | Dashboard DevelopmentRegular national travel | Relocation supportSenior-level Full TimeDurban, South Africa10d ago
-
AWS | Amazon Redshift | Apache Airflow | Apache Spark | BigQueryFlexible hours US time zones | Growth opportunities | Remote workSenior-level Full TimeSouth Africa - Cape Town R21d ago
-
Senior Data Architect ZAR 745K-920KAnalytics Integration | Data Compliance | Data Governance | Data Migration | Data ModelingSenior-level ContractCape Town, South Africa22d ago
-
BigQuery | Cloud Composer | Cloud Functions | Cloud Storage | Cloud platformContract extension possibility | Hybrid work model | Opportunity for immediate startSenior-level Full TimeJohannesburg, South Africa R23d ago
-
Lead AI Solutions Architect, Customer Success ZAR 660K-780KAI Solution | AI Solution Architecture | AWS | Azure | By DesignAugust Free Fridays | Education support | Flexible work arrangements | Leadership development programs | Mentorship programsSenior-level Full TimeJohannesburg (Flexible), South Africa30d ago
-
Data/AI Architect (Databricks) ZAR 875K-1170KAI gateway | Access Controls | Apache Spark | Automated testing | CI/CDSenior-level ContractJohannesburg, South Africa1mo ago
-
Senior-level Full TimeCape Town1mo ago
-
Senior-level ContractJohannesburg, South Africa1mo ago
-
Senior-level Full TimeStellenbosch, South Africa1mo ago
-
AWS | Airflow | Data Architecture | Data Governance | Data PipelinesSenior-level Full TimeSandton, South Africa1mo ago