Senior Data Engineer (Databricks & Cloud Data Platforms)
Johannesburg, Gauteng, South Africa
ZAR 875K-1100K (estimate) Senior-level Contract Full Time
Tasks
- Build batch and streaming ETL/ELT pipelines
- Build orchestration solutions for data workflows
- Collaborate with stakeholders on solution requirements
- Design scalable Databricks based data platforms
- Develop high-performance data processing solutions
- Implement Delta Lake and Unity Catalog
- Implement governance frameworks
- Lead data migration to cloud lakehouse architectures
- Mentor junior engineers
- Optimize Spark workloads for performance and cost
- Produce technical documentation and architecture artifacts
Perks/Benefits
Skills/Tech-stack
AWS Glue | Airflow | Amazon Redshift | Amazon S3 | Azure | Azure Data | Azure Data Factory | Azure Purview | Azure Synapse | Azure Synapse Analytics | Data Factory | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | Lakehouse Architecture | Medallion Architecture | OneLake | PySpark | Python | SQL | Spark | Synapse Analytics | Unity Catalog
Education
Roles
Related jobs
-
AWS | Amazon Redshift | Amazon S3 | Bitbucket | ConfluenceRotational training programEntry-level Contract Full TimeJohannesburg, GP, South Africa11h ago
-
AI Engineer (Data Scientist) ZAR 700K-860KAI Foundry | AML | AWS Bedrock | AWS Bedrock Agents | Agentic AIAI practitioner community participation | Mentoring junior data scientists | Responsible AI governance forum involvementSenior-level Full Time15 Alice Lane, South Africa20h ago
-
Senior Data Engineer (Databricks & Cloud Data Platforms) ZAR 875K-1100KAWS Glue | Amazon Redshift | Amazon S3 | Apache Spark | AzureMentorship | Professional development | Sponsored events | Technical communitySenior-level Contract Full TimeJohannesburg, Gauteng, South Africa1d ago
-
AWS | Azure | CI/CD | Data Governance | Data LakesConference access | Fully remote work | High-impact projects | International collaboration | Modern work equipmentMid-level Full TimeSouth Africa R1d ago
-
AWS | Access Management | Azure | Cloud platform | Data ClassificationCompetitive pay | Growth opportunities | Remote work | US time zone supportSenior-level Full TimeHonduras - Tegucigalpa2d ago
-
AI workflows | AWS | Access Control | Asana | AzureCompetitive pay | Growth opportunities | Remote work | Video interview processSenior-level Full TimeArgentina - Buenos Aires2d ago
-
ATS platforms | Application Management | Data Engineering | Data Pipelines | ETLContractor workforce support experience | Global delivery exposure | Managed service experience | Mentoring opportunitiesMid-level ContractJohannesburg, South Africa2d ago
-
Senior Full Stack Engineer (NLP) ZAR 600K-800KAPI Integration | CSS | Database Schema | Database Schema Design | DjangoAnnual leave | Education stipend | Employee assistance program | Internet benefits | Laptop providedSenior-level Full TimeRemote, South Africa R2d ago
-
Cloud Operations Engineer (DevOps) ZAR 360K-372KARM | Application Insights | Application Programming | Application Programming Interfaces | Azure DevOpsCollaborative team environment | Exposure to enterprise cloud and DevOps platforms | Global fast paced retail environment | Learning and development opportunitiesMid-level Full TimeMidrand, South Africa2d ago
-
Bash | Data Ingestion | Data Ingestion Pipelines | Data Processing | DockerMid-level Full TimeJohannesburg, South Africa2d ago
-
Specialist Support Engineer: DataOps ZAR 464K-600KApache Spark | Data Modeling | Data Streaming | Database Design | HDFSMid-level Full Time15 Alice Lane, South Africa2d ago
-
Senior-level Full TimeSandton - 1 Discovery Place, GP, …2d ago
-
Digital Analytics Engineer (Instrumentation) ZAR 660K-840KA/B | A/B Testing | B testing | BigQuery | Consent ModeSenior-level Full TimeBellville, Western Cape, ZA4d ago
-
Data Engineer (MLOps / Analytics Focus) ZAR 384K-420KAPI Integration | API Monitoring | Azure DevOps | CI/CD | Data GovernanceMid-level ContractJohannesburg, South Africa5d ago
-
API Integration | AWS | Analytics | Dashboard Development | Data ArchitectureMid-level Full TimeCape Town, South Africa5d ago
-
Mid-level Full TimeSouth Africa5d ago
-
AI Engineer ZAR 360K-480KAI Foundry | API Integration | Agent Framework | Azure AI | Azure AI FoundryMid-level Full TimeSouth Africa5d ago
-
Data Engineer ZAR 480K-540KAWS | Amazon Redshift | Apache Airflow | Apache Kafka | CI/CDCollaborative teams | Documentation and transparency | On-call rotation | Professional growth and learning | Remote-first environmentMid-level Full TimeNigeria or South Africa R5d ago
-
Mid-level Full TimeCape Town, Western Cape, South Africa6d ago
-
Data Engineer - L3 ZAR 464K-464KApp Service | Azure App | Azure App Service | Azure Data | Azure Data FactoryFlexible working hours | Hybrid working | Remote work flexibilityMid-level Full TimeCape Town, South Africa6d ago
-
Analytics Engineer III, Marketing & Product ZAR 510K-650KDBT | Data Integrity | Data Mining | Data Modeling | Data PipelinesEmployee assistance program | Sports leave | Study leave | Volunteer time offSenior-level Full TimeCape Town, South Africa7d ago
-
ACM | API Development | API Gateway | AWS API | AWS API GatewaySenior-level ContractPretoria, South Africa7d ago
-
Senior Data Engineer ZAR 840K-1170KAWS | Agile | Apache Beam | Apache Flink | Apache SparkCommunity initiatives | Connected team culture | Flexible ways of working | Generous parental leave | Long weekendsSenior-level Full TimeJohannesburg, South Africa7d ago
-
Mid-level Full TimeCape Town, South Africa R8d ago
-
API Security | Access Control | Airflow | Amazon Redshift | AuthenticationFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R8d ago