Data Engineering Lead – Data Science and AI
ZAR 1000K-1200K (estimate) Senior-level Contract Full Time
Tasks
- Build governed data pipelines
- Coordinate engineering delivery and roadmap planning
- Create curated datasets and frameworks for ingestion and orchestration
- Define target data engineering architecture
- Deliver production MLOps and LLMOps capabilities
- Deploy and monitor machine learning models
- Design AWS to Azure integration patterns
- Develop reusable pipelines and transformations
- Ensure data and AI governance and privacy standards
- Establish data lineage versioning and monitoring
- Implement LLM ingestion chunking indexing governance
- Implement feature store capabilities
- Optimize cloud costs and FinOps practices
- Provide technical leadership to data engineering team
- Set up monitoring operational support and incident management
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Athena | AWS Glue | AWS Lambda | AWS Redshift | AWS S3 | AWS SageMaker | Azure Data | Azure Data Factory | Azure Functions | Azure Machine Learning | Azure Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | Containerization | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Transformation | Databricks | Feature Store | Git | Incident Management | Information security | Infrastructure as Code | LLMOps | MLOps | Machine Learning | Microsoft Azure | Microsoft Fabric | Model Deployment | Model Monitoring | Orchestration | Python | SQL | Synapse Analytics | Vector Databases | Version control | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Architect | Data Architect | Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Senior-level Full TimePinelands, South Africa2d ago
-
Data Engineering Lead – Data Science and AI ZAR 1000K-1200KAWS | Azure | Azure Data | Azure Data Factory | Azure FunctionsSenior-level Contract Full TimeCape Town, Western Cape, South Africa2d ago
-
Senior-level Full TimeAbsa Towers West, South Africa5d ago
-
Mid-level Full TimeSandton - 1 Discovery Place, GP, …5d ago
-
AI Engineering Lead EUR 54K-72KAPI Integration | Analytics | Artificial Intelligence | Automation engineering | Data platformsCareer growth | Health insurance | Housing | Mentorship | Regular feedbackSenior-level Full TimeEurope7d ago
-
AI Solutions Lead - Marketing & Content ZAR 600K-720KAI platforms | API Development | AWS | Data Privacy | Enterprise AIRemote work opportunity | Work-life balanceSenior-level Full TimeJohannesburg, Gauteng R10d ago
-
AI architecture | AWS | Cloud platform | Data Governance | Data PrivacyRemote work | Work-life balanceSenior-level Full TimeJohannesburg, Gauteng R10d ago
-
AI Agents | Access Control | Artificial Intelligence | Cybersecurity | Dashboard DevelopmentRegular national travel | Relocation supportSenior-level Full TimeDurban, South Africa10d ago
-
AWS | Amazon Redshift | Apache Airflow | Apache Spark | BigQueryFlexible hours US time zones | Growth opportunities | Remote workSenior-level Full TimeSouth Africa - Cape Town R21d ago
-
Senior Data Architect ZAR 745K-920KAnalytics Integration | Data Compliance | Data Governance | Data Migration | Data ModelingSenior-level ContractCape Town, South Africa22d ago
-
BigQuery | Cloud Composer | Cloud Functions | Cloud Storage | Cloud platformContract extension possibility | Hybrid work model | Opportunity for immediate startSenior-level Full TimeJohannesburg, South Africa R23d ago
-
Lead AI Solutions Architect, Customer Success ZAR 660K-780KAI Solution | AI Solution Architecture | AWS | Azure | By DesignAugust Free Fridays | Education support | Flexible work arrangements | Leadership development programs | Mentorship programsSenior-level Full TimeJohannesburg (Flexible), South Africa30d ago
-
Data/AI Architect (Databricks) ZAR 875K-1170KAI gateway | Access Controls | Apache Spark | Automated testing | CI/CDSenior-level ContractJohannesburg, South Africa1mo ago
-
Senior-level Full TimeCape Town1mo ago
-
Senior-level ContractJohannesburg, South Africa1mo ago
-
Senior-level Full TimeStellenbosch, South Africa1mo ago
-
AWS | Airflow | Data Architecture | Data Governance | Data PipelinesSenior-level Full TimeSandton, South Africa1mo ago