Senior Data Engineer (Native Databricks Preferred)
Cape Town, South Africa
A ZAR 792K-1200K (estimate) Senior-level Full Time
Tasks
- Apply data governance and security on Databricks
- Architect scalable data platforms in Databricks
- Build ETL processes
- Build and optimize data pipelines in Databricks
- Collaborate on data strategy with stakeholders
- Develop automation frameworks
- Develop data models
- Implement data integration and transformation
- Integrate Databricks with cloud data platforms
- Lead SAP to Databricks migration
- Mentor technical teams on Databricks architecture
- Optimize performance on Databricks
Perks/Benefits
- N/A
Skills/Tech-stack
AWS S3 | Azure | Cloud Integration | Data Governance | Data Lineage | Data Modeling | Data Warehousing | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | GCP Storage | PySpark | SQL | Security
Education
N/A
Related jobs
-
Application Monitoring | Data Analysis | Data Quality | Data pipeline | ETLSenior-level Full TimePretoria, South Africa4h ago
-
Benchmarking | Big Data | Cloud Computing | Databases | Distributed SystemsSenior-level Full TimeJohannesburg, South Africa4h ago
-
Senior-level Full TimeJohannesburg, South Africa4h ago
-
Analytics tools | Cloud Computing | Data platforms | Incident Management | LoggingSenior-level Full TimeJohannesburg, South Africa4h ago
-
AWS Architect | AWS Architect Associate | AWS Architect Professional | AWS Cloud | AWS Cloud PractitionerSenior-level ContractPretoria, South Africa4h ago
-
Mid-level Full TimePretoria, South Africa4h ago
-
Senior-level ContractJohannesburg, South Africa4h ago
-
Mid-level Full TimeJohannesburg, South Africa4h ago
-
API Design | Change Control | Cloud infrastructure | Compliance Management | CybersecuritySenior-level Full TimeJohannesburg, South Africa4h ago
-
(1731) Data Scientist and AI Engineer - BSTD ZAR 720K-780KAPI Development | Amazon Web Services | Apache Hadoop | Apache Spark | DB2Senior-level Full TimePretoria, South Africa8h ago
-
(1728) Data Engineer - BSTD ZAR 745K-900KAnalytics enablement | Apache Spark | Application Programming | Application Programming Interfaces | C SharpSenior-level Full TimePretoria, South Africa9h ago
-
Associate Staff Engineer (Graph Data Engineer) ZAR 464K-500KAKS | API Development | Access Control | Active Directory | AutoscalingMid-level Full TimeJohannesburg, South Africa1d ago
-
Senior Machine Learning Engineer ZAR 540K-720KAWS | AWS CodePipeline | Azure | CI/CD | Cloud platformSenior-level Full TimeBrackenfell, ZA1d ago
-
Product Engineer – Data Quality ZAR 396K-420KAgile | Ataccama | Business Analysis | Business Rules | CRMMid-level Full TimeAbsa Towers East, South Africa1d ago
-
GenAI Engineer - Product Marketing & Adoption ZAR 456K-540KAdapter-Tuning | Apache Spark | Function Calling | Generative AI | Google CloudCasual work environment | Flexible work hours | Internet allowance | Medical aid | Provident fundEntry-level Full TimeCapetown2d ago
-
Senior-level Full TimeAbsa Towers North, South Africa2d ago
-
Apache Airflow | BigQuery | Cloud platform | DBT | DataflowAnnual off-site events | Co-working space allowance | Equity participation | Flexible asynchronous schedule | Fully remoteSenior-level Full TimeSouth Africa R3d ago
-
Mid-level Full TimeJohannesburg, South Africa3d ago
-
Mid-level Full TimeJohannesburg,Gauteng,South Africa3d ago
-
Alerting | Batch Processing | BigQuery | CI/CD | Cloud RunCollaborative supportive international team | Continuous learning | Flexible working arrangements | Fully remote | High autonomy and ownershipSenior-level Full TimeSouth Africa R3d ago
-
AWS | Airflow | Data Architecture | Data Governance | Data PipelinesSenior-level Full TimeSandton, South Africa4d ago
-
Data Engineer (OVA5687) ZAR 360K-420KAb Initio | Data Modeling | Data Pipelines | Metadata governance | Quality AssuranceContract employmentMid-level Full TimeJohannesburg, South Africa4d ago
-
Strong Intermediate Data Engineer ZAR 420K-480KCloud | Data Pipelines | Data Quality | Data integration | ETLOn site visit during go live | Remote work optionMid-level ContractJohannesburg, South Africa5d ago
-
AI readiness | AI workflows | AWS | Access Control | AutomationGrowth opportunities | Remote work | US time zone collaborationSenior-level Full TimeArgentina - Buenos Aires5d ago
-
AWS | Access Management | Azure | Cloud platform | Data ClassificationRemote workSenior-level Full TimeHonduras - Tegucigalpa5d ago