Lead Data Engineer (Data Platform and Cloud)
Tasks
- Architect data engineering platform
- Build ELT pipelines
- Build data warehouse
- Evaluate and recommend cloud services
- Implement data governance security
- Implement dimensional modeling
- Implement medallion modeling
- Mentor and lead data engineering team
- Migrate on premise data to cloud native platform
- Optimize indexing partitioning stored procedures
- Optimize pipeline compute and storage cost
- Orchestrate monitor data pipelines
- Rebuild data warehouse using ELT
- Track data lineage
- Tune SQL performance
Perks/Benefits
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Migration | Data Factory | Data Governance | Data Lineage | Data Warehousing | Dimensional Modeling | ELT | ETL | Git | Infrastructure as Code | Medallion Architecture | OLAP | Python | SQL | Snowflake Schema | Star Schema | Stored Procedures | Synapse Analytics | “as-code”
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior AI Engineer ZAR 900K-1200KAI Agents | API Development | AWS | Apache Spark | AzureHybrid work | Remote work | Sponsorship for technical events | Training and developmentSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa1d ago
-
Senior AI Engineer ZAR 900K-1200KAI Agents | API Development | AWS | Apache Spark | AzureHybrid work | Remote work | Training sponsorship for technical eventsSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa1d ago
-
AI monitoring | Azure AI | Azure Cloud | GPU Computing | HTTPComprehensive benefits package | Inclusive workplace culture | International team collaboration | Professional growth opportunities | Remote work flexibilitySenior-level Full TimeSouth Africa2d ago
-
AWS | Azure | Cloud Computing | Continuous Testing | Data AnalysisAutonomy | Collaborative fast moving team | Continuous learning | Flexible working hours | Fully remote workMid-level Full TimeSouth Africa R2d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Entrepreneurial team | Flexible, hands-off management | Friendly laid-back atmosphere | Remote friendly distributed workMid-level Full TimeCape Town, South Africa2d ago
-
Senior-level Full TimePinelands, South Africa2d ago
-
Senior Specialist: Strategic Network Optimization ZAR 450K-624K2G | 3G | 3GPP | 4G | 5G-NRCell phone benefits | Data benefits | Fibre connection discounts | Medical aid benefits | Retirement benefitsSenior-level Full TimeMidrand, ZA2d ago
-
AI machine learning | AWS | Access Controls | Access Management | AsanaRemote workSenior-level Full TimeArgentina - Buenos Aires2d ago
-
API Connect | API Governance | API Security | AWS | Ab InitioRotational standby supportMid-level Full TimeJohannesburg, South Africa2d ago
-
AWS AppFlow | AWS DMS | AWS Glue | AWS Lambda | AWS Step FunctionsFlexible working environment | Fully remote work | Home office support | International team collaboration | Professional growth opportunitiesSenior-level Full TimeSouth Africa R3d ago
-
Data pipeline | Deep learning | GPU | JAX | Latency optimizationCareer growth | Flexible working hours | Fully remote | High autonomy | Professional developmentSenior-level Full TimeSouth Africa R3d ago
-
Senior-level Full TimePretoria, South Africa3d ago
-
Agile | Apache Kafka | Avro | CI/CD | Confluent PlatformCollaborate with global engineering teams | Continuous learning and professional development | Exposure to large-scale distributed systems | Flexible hybrid working model | Modern Agile development environmentSenior-level Full TimePretoria, South Africa3d ago
-
Machine Learning Engineer UAH 1377K-1549KData Preparation | GPU Computing | JAX | Machine Learning | Machine Learning EngineeringSenior-level Full TimeEurope3d ago
-
Intermediate Analytics Engineer ZAR 300K-420KData Architecture | Data Contracts | Data Governance | Data Lineage | Data ModelingMid-level Full TimeJohannesburg, ZA4d ago
-
Junior Analytics Engineer ZAR 216K-240KAPIs | Compliance | Data Architecture | Data Contracts | Data GovernanceEntry-level Full TimeJohannesburg, ZA4d ago
-
Data Engineer ZAR 745K-900KADLS Gen 2 | API Development | Anonymization | Apache Airflow | Apache SparkSenior-level Full TimeJohannesburg, ZA4d ago
-
Senior-level Full TimeCape Town7d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeJohannesburg, South Africa7d ago
-
Entry-level Full TimeStellenbosch, ZA7d ago
-
Data Analytics Technical Specialist ZAR 780K-900KAccess Management | Analysis Services | Azure DevOps | Azure SQL | Azure SQL DatabaseFlexible working | Hybrid workingSenior-level Full TimeCape Town, South Africa8d ago
-
AI Solutions Engineer ZAR 400K-464KAI Agents | API Integration | Azure AI | Chatbots | Data AnalysisMid-level Full TimeCape Town, South Africa Office8d ago
-
Senior Machine Learning Engineer ZAR 745K-860KAWS SageMaker | AWS Sagemaker Endpoints | Agile | Amazon Web Services | Big DataBirthday leave | Confidential counselling | Financial guidance | Free parking | Legal supportSenior-level Full TimeSouth Africa8d ago
-
Senior Machine Learning Engineer ZAR 745K-860KAWS | Agile | Big Data | BigQuery | Cloud platformBirthday leave | Confidential counselling | Financial guidance | Free parking | Free subscription takealotMORESenior-level Full TimeSouth Africa8d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure EventMid-level ContractSandton, South Africa9d ago