Senior Data Engineer (Databricks & Cloud Data Platforms)
Johannesburg, Gauteng, South Africa
ZAR 875K-1100K (estimate) Senior-level Contract Full Time
Tasks
- Build batch and streaming ETL/ELT pipelines
- Build orchestration solutions for data workflows
- Collaborate with stakeholders on solution requirements
- Design scalable Databricks based data platforms
- Develop high-performance data processing solutions
- Implement Delta Lake and Unity Catalog
- Implement governance frameworks
- Lead data migration to cloud lakehouse architectures
- Mentor junior engineers
- Optimize Spark workloads for performance and cost
- Produce technical documentation and architecture artifacts
Perks/Benefits
Skills/Tech-stack
AWS Glue | Airflow | Amazon Redshift | Amazon S3 | Azure | Azure Data | Azure Data Factory | Azure Purview | Azure Synapse | Azure Synapse Analytics | Data Factory | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | Lakehouse Architecture | Medallion Architecture | OneLake | PySpark | Python | SQL | Spark | Synapse Analytics | Unity Catalog
Education
Roles
Related jobs
-
GenAI Engineer - Product Marketing & Adoption ZAR 456K-540KAdapter-Tuning | Apache Spark | Function Calling | Generative AI | Google CloudCasual work environment | Flexible work hours | Internet allowance | Medical aid | Provident fundEntry-level Full TimeCapetown1d ago
-
Lead AI Engineer - Financial Inclusion GBP 60K-100KIdentity automation | Langchain | MCP | Python | ScriptingCareer growth opportunities | Coaching partnerships | Family-friendly policies | Flexible working arrangements | Fully remoteSenior-level Full TimeNairobi R2d ago
-
Apache Airflow | BigQuery | Cloud platform | DBT | DataflowAnnual off-site events | Co-working space allowance | Equity participation | Flexible asynchronous schedule | Fully remoteSenior-level Full TimeSouth Africa R2d ago
-
Mid-level Full TimeJohannesburg, South Africa2d ago
-
Mid-level Full TimeJohannesburg,Gauteng,South Africa2d ago
-
Alerting | Batch Processing | BigQuery | CI/CD | Cloud RunCollaborative supportive international team | Continuous learning | Flexible working arrangements | Fully remote | High autonomy and ownershipSenior-level Full TimeSouth Africa R3d ago
-
AWS | Airflow | Data Architecture | Data Governance | Data PipelinesSenior-level Full TimeSandton, South Africa3d ago
-
Data Engineer (OVA5687) ZAR 360K-420KAb Initio | Data Modeling | Data Pipelines | Metadata governance | Quality AssuranceContract employmentMid-level Full TimeJohannesburg, South Africa3d ago
-
Strong Intermediate Data Engineer ZAR 420K-480KCloud | Data Pipelines | Data Quality | Data integration | ETLOn site visit during go live | Remote work optionMid-level ContractJohannesburg, South Africa4d ago
-
BIOS | Bootloader | Buildroot | C# | C++Employee assistance program | Generous annual leave | International travel | Learning budget | Parental leaveSenior-level Full TimeSouth Africa5d ago
-
AI readiness | AI workflows | AWS | Access Control | AutomationGrowth opportunities | Remote work | US time zone collaborationSenior-level Full TimeArgentina - Buenos Aires5d ago
-
AWS | Access Management | Azure | Cloud platform | Data ClassificationRemote workSenior-level Full TimeHonduras - Tegucigalpa5d ago
-
Junior - Intermediate Data Engineer ZAR 240K-360KData Transformation | Database Views | Grafana | Microsoft Excel | Microsoft SQLRolling contractEntry-level ContractJohannesburg, South Africa5d ago
-
Analytics Engineer (Data Platform) ZAR 400K-420KAgile | Algorithms | BigQuery | CI/CD | Cube designBirthday leave | Confidential counseling | Financial guidance | Flexible equipment setup | Free parkingMid-level Full TimeCape Town6d ago
-
Analytics Engineer (Data Platform) ZAR 400K-420KAgile | Algorithms | BigQuery | CI/CD | Data ModelingBirthday leave | Confidential counselling | Financial guidance | Free parking | Hybrid work modelMid-level Full TimeCape Town6d ago
-
AI Enablement Analyst ZAR 900K-1000KAI Foundry | API Integration | Acceptance Testing | Agentic AI | AgileMid-level Full TimeJohannesburg, ZA6d ago
-
Entry-level Full TimeSandton - 1 Discovery Place, GP, …6d ago
-
Senior-level Full TimeSouth Africa6d ago
-
Senior-level Full TimePretoria, South Africa6d ago
-
Principal Data Engineer ZAR 400K-464KData Engineering | Data Modeling | Database Design | Databricks | Declarative PipelinesMid-level Full TimeCape Town, Western Cape, South Africa7d ago
-
Senior-level Full TimeJohannesburg, South Africa7d ago
-
Senior-level Full TimeJohannesburg, South Africa7d ago
-
Data Engineer (D) ZAR 464K-720KAnomaly Detection | Azure | Batch Processing | By Design | Data DriftMid-level Full TimeJohannesburg, South Africa7d ago
-
Artificial Intelligence | Azure | Azure Data | Azure Data Factory | Batch ProcessingMid-level Full TimeCape Town, South Africa8d ago
-
CRM Integration | Claude API | Docker | Event Driven | Event-driven architectureSenior-level Full TimeCape Town, South Africa9d ago