Lead Data Engineer
Cape Town, South Africa
A ZAR 840K-1200K (estimate) Senior-level Full Time
Tasks
- Collaborate with stakeholders on scalable solutions
- Design enterprise data platforms
- Develop and optimize data pipelines
- Develop scalable data models
- Ensure data quality reliability performance governance
- Implement data integration frameworks
- Integrate SAP with data platforms
- Mentor data engineering teams
- Rebuild ETL ELT processes
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS | Apache Spark | Azure | Azure Data | Azure Data Factory | CI/CD | Data Factory | Data Lakes | Data Modeling | Data Warehousing | Databricks | ELT | ETL | Git | Kafka | Microsoft Fabric | Power BI | PySpark | Python | SAP | SQL | Synapse Analytics | Terraform
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Agile | Artificial Intelligence | Data Architecture | Data Engineering | Data GovernanceHybrid work environment | Mentorship | Training and development | Work from home daysEntry-level Full TimeMidrand, GP, South Africa R15h ago
-
AI Data | AI data pipelines | AWS | Access Management | AzureCompetitive pay | Growth opportunities | Remote work flexibilitySenior-level Full TimeHonduras - Tegucigalpa3d ago
-
AI readiness | AI workflows | AWS | Access Control | Access ManagementRemote work | US time zone collaboration | Video interview requirementSenior-level Full TimeArgentina - Buenos Aires3d ago
-
AWS | Amazon Redshift | Apache Airflow | Apache Spark | AzureCompetitive pay | Growth opportunities | Mentoring | Remote workSenior-level Full TimeSouth Africa - Cape Town3d ago
-
AI Observability | AWS | Azure | CI/CD | Cloud ArchitectureCareer advancement | Client exposure | Fully remote | Leadership opportunities | Professional developmentSenior-level Full TimeSouth Africa R3d ago
-
Lead Data Scientist, Fraud Modelling ZAR 600K-780KA/B | A/B Testing | Anomaly Detection | B testing | Behavioral clusteringFlexible working | Free Coursera subscription | Gym reimbursement | Health and wellness benefits | Home internet allowanceSenior-level Full TimeCape Town3d ago
-
Senior Applied AI Engineer – Prompting & Evaluation ZAR 450K-650KAgentic Workflows | Azure OpenAI | Context design | Embeddings | GitHub CopilotCoaching and mentoring culture | Community of Practice | Hybrid work policy | Travel between UK and South Africa officesSenior-level Full TimeJohannesburg, SA, ZA | Stellenbosch, SA, …3d ago
-
Combinatorics | Graph theory | MATLAB | NumPy | Number theoryProject-based assignmentsSenior-level FreelanceSouth Africa - Remote R4d ago
-
Data Development Manager ZAR 464K-480KAutomation | Data Warehouse | Data pipeline | Database Design | ETLMid-level Full TimeJohannesburg, ZA4d ago
-
Mid-level ContractJohannesburg, South Africa4d ago
-
Machine Learning Engineer ZAR 420K-480KAutomation | Azure Machine Learning | Data analytics | Databricks | Machine LearningMid-level Full TimeSandton - 1 Discovery Place, GP, …5d ago
-
Senior Machine Learning Engineer ZAR 745K-900KAI Platform | AWS SageMaker | Apache Airflow | Azure ML | Computer VisionSenior-level Full TimeJohannesburg, South Africa5d ago
-
Data Engineering Lead ZAR 720K-840KAPI Development | AWS | CloudFormation | Data Architecture | Data GovernanceSenior-level Full TimeJohannesburg, South Africa5d ago
-
Head: Data Engineering ZAR 660K-750KABAC | Apache Airflow | Apache Hudi | Apache Iceberg | Apache SparkExecutive-level Full TimeAbsa 270 Republic Road, South Africa5d ago
-
Azure | CI/CD | Data Governance | Data Lineage | Data PipelinesSenior-level ContractSandton, South Africa5d ago
-
Data Engineer ZAR 348K-420KAWS | AWS CDK | Azure | Azure Data | Azure Data FactoryGrowth opportunities | Hybrid work environment | Learning opportunities | Medical aid | Provident fundMid-level Full TimeJohannesburg, ZA6d ago
-
Senior-level Full TimeJohannesburg, South Africa6d ago
-
Senior-level Full TimeCape Town, South Africa6d ago
-
Senior-level Full TimeDurban, South Africa6d ago
-
AWS | AWS S3 | Agile | Apache Airflow | Apache DataprocCareer growth | Collaborative Agile environment | Flexible working arrangements | International large scale projects | Ongoing training and mentoringSenior-level Full TimeSouth Africa6d ago
-
Computer Vision | Deep learning | Diffusers | Diffusion Models | IP AdaptersAnnual vacation | Corporate discounts for English language learning programs | Fully remote | Health allowance | Professional development reimbursementSenior-level Full TimeSouth Africa R6d ago
-
Agentic pipelines | DPO | Deep learning | Direct Preference Optimization | Distributed TrainingContinuous learning opportunities | English language learning discounts | Fully remote | Health support budget | Home-office allowanceSenior-level Full TimeSouth Africa R6d ago
-
Senior-level Full TimeStellenbosch, ZA8d ago
-
Senior-level Full TimeStellenbosch, ZA11d ago
-
Machine Learning Engineer ZAR 700K-1200KAgent systems | Language Processing | MLOps | Machine Learning | Model TrainingSenior-level Full TimeDurban, South Africa11d ago