Principal Data Engineer
Cape Town, Western Cape, South Africa
ZAR 400K-464K (estimate) Mid-level Full Time
Tasks
- Build semantic layer for reporting
- Coach and mentor engineers
- Define and maintain business metrics
- Design and build production data pipelines
- Implement data quality improvements
- Integrate data from business systems
- Manage storage and table layout
- Optimize platform performance and cost
- Partner with business stakeholders
- Review engineering work
- Set engineering standards for code testing documentation CI/CD data governance
- Tune compute jobs and queries
Perks/Benefits
- N/A
Skills/Tech-stack
Data Engineering | Data Modeling | Database Design | Databricks | Declarative Pipelines | Fivetran | HVR | Metric Views | Power BI | Python | Query Optimization | SAP S4HANA | SQL | Spark | Spark Declarative Pipelines
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Mid-level Full TimeMidrand, Gauteng23h ago
-
AI readiness | AWS | Access Management | Architecture | AsanaCareer growth opportunities | Customer facing exposure | Remote workSenior-level Full TimeHonduras - Tegucigalpa1d ago
-
AWS | Access Control | Access Management | Azure | Cloud hybridRemote workSenior-level Full TimeArgentina - Buenos Aires1d ago
-
Agile | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache IcebergRemote workMid-level Full TimeSouth Africa - Cape Town1d ago
-
Amazon Web Services | Apache Storm | Automation | Bash | Business IntelligenceSenior-level ContractCape Town, South Africa1d ago
-
Ab Initio | Apache Spark | Azure Data | Azure Data Factory | Azure EventEntry-level ContractJohannesburg, South Africa1d ago
-
Technology/Domain Specialist II - Kafka (OVA5718) ZAR 360K-420KACLs | Ansible | Apache Kafka | Azure | Azure MonitorMid-level Full TimeJohannesburg, South Africa1d ago
-
Azure Bot | Azure Bot Service | Azure Cognitive | Azure Cognitive Services | Azure Machine LearningMid-level Full TimeMidrand, South Africa2d ago
-
Alerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Anomaly DetectionContinuous improvement opportunities | Cross-functional collaboration | Fully remote work | Ownership over data reliability strategySenior-level Full TimeSouth Africa R2d ago
-
AI Engineering - Master Specialist ZAR 780K-920KApache Kafka | Apache Spark | C++ | CUDA | Cloud ComputingSenior-level Full TimeJohannesburg, ZA2d ago
-
Senior Data Engineer ZAR 1100K-1200KAPI | Apache Flink | Apache Spark | Apache Spark Streaming | Azure DataSenior-level Full TimeSouth Africa5d ago
-
Data Engineer ZAR 300K-420KAWS | Apache Airflow | Azure | Azure Data | Azure Data LakeFlexible team culture | Inclusive and diverse workplace | Support for employment equityMid-level Full TimeCenturion, GP, South Africa5d ago
-
Specialist - Data Engineer.MTN Software Solutions ZAR 464K-480KApache Hadoop | Apache Kafka | Apache Spark | Data Modeling | Data PipelinesMid-level Full TimeRoodepoort, Gauteng, South Africa6d ago
-
Blue-Green Deployment | Blue/green | CI/CD | CUDA | CUDA optimizationFully remote | Remote work flexibilitySenior-level Full TimeSouth Africa R6d ago
-
Cloud Data Engineers (OVA5720) ZAR 348K-420KAPI Integration | Apache Spark | Azure Data | Azure Data Factory | Azure EventHybrid work modelMid-level Full TimeJohannesburg, South Africa6d ago
-
Asana | Google Workspace | LLM | Prompt engineering | PythonFlexible time zone collaboration | Remote workMid-level Full TimeArgentina - Buenos Aires8d ago
-
Senior-level Full TimeCape Town8d ago
-
Data Engineer ZAR 396K-456KAPI Development | AWS | Apache Spark | Automation | CI/CDCareer development opportunities | Employee discounts | Hybrid working | Paid sabbaticals | Paid time offSenior-level Full TimeCape Town, Western Cape, South Africa R8d ago
-
Data Engineer ZAR 780K-920K.NET | Analysis Services | Apache Storm | Azure Data Factory | BashHybrid workSenior-level Full TimeJohannesburg, South Africa8d ago
-
Apache Airflow | Apache Atlas | Apache NiFi | Azure Data | Azure Data FactoryMid-level Full TimeJohannesburg, South Africa10d ago
-
Principal Clinical Data Engineer - based in South Africa ZAR 663K-663K21 CFR | 21 CFR Part 11 | CFR Part 11 | Cause analysis | Clinical dataSenior-level Full TimeSouth Africa-Bloemfontein-Remote R11d ago
-
Mid-level Full TimeBellville, South Africa12d ago
-
Senior-level Full TimeCape Town, South Africa12d ago
-
Airflow | Amazon Redshift | BigQuery | CI/CD | ChromaDBFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R12d ago
-
Analytics | Cut Off | Cut off grade | Cut off grade analysis | Data AnalysisFlexible working arrangements | Mentorship | Professional development reimbursement | Work-life balanceSenior-level Full TimeCenturion, 0157, South Africa12d ago