Senior Data Engineer (Native Databricks Preferred)
Cape Town, South Africa
A ZAR 792K-1200K (estimate) Senior-level Full Time
Tasks
- Apply data governance and security on Databricks
- Architect scalable data platforms in Databricks
- Build ETL processes
- Build and optimize data pipelines in Databricks
- Collaborate on data strategy with stakeholders
- Develop automation frameworks
- Develop data models
- Implement data integration and transformation
- Integrate Databricks with cloud data platforms
- Lead SAP to Databricks migration
- Mentor technical teams on Databricks architecture
- Optimize performance on Databricks
Perks/Benefits
- N/A
Skills/Tech-stack
AWS S3 | Azure | Cloud Integration | Data Governance | Data Lineage | Data Modeling | Data Warehousing | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | GCP Storage | PySpark | SQL | Security
Education
N/A
Related jobs
-
Lead Data Engineer (Data Platform and Cloud) ZAR 663K-663KAzure | Azure Data | Azure Data Factory | Azure Databricks | Azure SynapseHybrid work modelSenior-level Full TimeMidrand, Gauteng, ZA1d ago
-
Senior AI Engineer ZAR 900K-1200KAI Agents | API Development | AWS | Apache Spark | AzureHybrid work | Remote work | Sponsorship for technical events | Training and developmentSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa2d ago
-
Senior AI Engineer ZAR 900K-1200KAI Agents | API Development | AWS | Apache Spark | AzureHybrid work | Remote work | Training sponsorship for technical eventsSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa2d ago
-
Senior Machine Learning Engineer ZAR 660K-780KAccess Control | Airflow | Authentication | Authorization | Bias detectionSenior-level Full TimeAbsa Towers West, South Africa2d ago
-
Lead AI Solutions Architect, Customer Success ZAR 660K-780KAI Solution | AI Solution Architecture | AWS | Azure | By DesignAugust Free Fridays | Education support | Flexible work arrangements | Leadership development programs | Mentorship programsSenior-level Full TimeJohannesburg (Flexible), South Africa2d ago
-
AWS | Azure | Cloud Computing | Continuous Testing | Data AnalysisAutonomy | Collaborative fast moving team | Continuous learning | Flexible working hours | Fully remote workMid-level Full TimeSouth Africa R3d ago
-
AI machine learning | AWS | Access Controls | Access Management | AsanaRemote workSenior-level Full TimeArgentina - Buenos Aires4d ago
-
API Connect | API Governance | API Security | AWS | Ab InitioRotational standby supportMid-level Full TimeJohannesburg, South Africa4d ago
-
AWS AppFlow | AWS DMS | AWS Glue | AWS Lambda | AWS Step FunctionsFlexible working environment | Fully remote work | Home office support | International team collaboration | Professional growth opportunitiesSenior-level Full TimeSouth Africa R4d ago
-
Senior-level Full TimePretoria, South Africa5d ago
-
Agile | Apache Kafka | Avro | CI/CD | Confluent PlatformCollaborate with global engineering teams | Continuous learning and professional development | Exposure to large-scale distributed systems | Flexible hybrid working model | Modern Agile development environmentSenior-level Full TimePretoria, South Africa5d ago
-
Intermediate Analytics Engineer ZAR 300K-420KData Architecture | Data Contracts | Data Governance | Data Lineage | Data ModelingMid-level Full TimeJohannesburg, ZA5d ago
-
Junior Analytics Engineer ZAR 216K-240KAPIs | Compliance | Data Architecture | Data Contracts | Data GovernanceEntry-level Full TimeJohannesburg, ZA5d ago
-
Data Engineer ZAR 745K-900KADLS Gen 2 | API Development | Anonymization | Apache Airflow | Apache SparkSenior-level Full TimeJohannesburg, ZA5d ago
-
Senior-level Full TimeCape Town8d ago
-
Entry-level Full TimeStellenbosch, ZA8d ago
-
Data Analytics Technical Specialist ZAR 780K-900KAccess Management | Analysis Services | Azure DevOps | Azure SQL | Azure SQL DatabaseFlexible working | Hybrid workingSenior-level Full TimeCape Town, South Africa9d ago
-
AI Solutions Engineer ZAR 400K-464KAI Agents | API Integration | Azure AI | Chatbots | Data AnalysisMid-level Full TimeCape Town, South Africa Office9d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure EventMid-level ContractSandton, South Africa10d ago
-
Senior Data Scientist (Azure Data Engineering & MLOps) ZAR 900K-1200KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Contract Full TimeCape Town, Western Cape, South Africa10d ago
-
Senior Data Scientist (Azure Data Engineering & MLOps) ZAR 900K-1200KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Contract Full TimeCape Town, Western Cape, South Africa10d ago
-
Data/AI Architect (Databricks) ZAR 875K-1170KAI gateway | Access Controls | Apache Spark | Automated testing | CI/CDSenior-level ContractJohannesburg, South Africa11d ago
-
Technology/Domain Specialist II - Kafka (OVA5718) ZAR 360K-420KACLs | Ansible | Apache Kafka | Azure | Azure MonitorMid-level Full TimeJohannesburg, South Africa11d ago
-
Senior Data Engineer ZAR 1100K-1200KAPI | Apache Flink | Apache Spark | Apache Spark Streaming | Azure DataSenior-level Full TimeSouth Africa15d ago
-
Data Engineer ZAR 300K-420KAWS | Apache Airflow | Azure | Azure Data | Azure Data LakeFlexible team culture | Inclusive and diverse workplace | Support for employment equityMid-level Full TimeCenturion, GP, South Africa15d ago