Data Engineer
Sandton - 1 Discovery Place, GP, ZA, 2196
ZAR 840K-1170K (estimate) Senior-level Full Time
Tasks
- Build ELT ETL transformations
- Create dimensional and curated data models
- Design data platform architecture
- Develop Data Lakehouse solutions
- Develop orchestration scheduling and retries
- Develop validation rules and reconciliation checks
- Establish data quality, lineage, governance
- Implement Medallion Architecture patterns
- Implement incremental loads and change processing
- Optimize data pipelines for performance
- Perform unit testing and defect fixes
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Synapse | Azure Synapse Analytics | CDC | CI/CD | Change Data Capture | Data Capture | Data Governance | Data Lakehouse | Data Lineage | Data Modeling | Data Pipelines | Data Quality | Dataflows Gen2 | Dimensional Modeling | Documentation | ELT | ETL | Git | Incremental loads | Least Privilege | Microsoft Fabric | Notebooks | Partitioning | Performance Tuning | Query Optimization | RBAC | SCD Type 1 | SCD Type-2 | SDLC | SQL | Snowflake Schema | Spark | Star Schema | Synapse Analytics | T-SQL | Type 1 | Type 2) | Unit Testing | Watermarking
Education
Roles
Related jobs
-
Senior Data Engineer (Azure) ZAR 840K-1200KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Cloud ArchitectureRemote work | Stakeholder engagementSenior-level ContractJohannesburg, South Africa11h ago
-
Mid-level Full Time4 Merchant Place, 1 Fredman Drive, …1d ago
-
Optimization Engineer ZAR 480K-540K5G-NR | Actix | Air interface | Atoll | Drive testGlobal team collaboration | Knowledge sharing | Mentorship | On-call supportMid-level Full TimeJohannesburg,Gauteng,South Africa1d ago
-
Junior Specialist: Analytics & Data Science ZAR 240K-288KAI | Agile | Dashboard Development | Data Cleansing | Data MiningEntry-level Full TimeAbsa Towers West, South Africa2d ago
-
Access Control | Airflow | Amazon Redshift | Authentication | BigQueryFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R3d ago
-
Data Architect Engineer ZAR 840K-1100KAWS Glue | AWS Lake Formation | Amazon Redshift | Amazon S3 | AtScaleSenior-level Full TimeRoodepoort, GP, South Africa4d ago
-
Mid-level ContractJohannesburg, South Africa4d ago
-
Senior-level Full TimeSandton, South Africa4d ago
-
AI Implementation Expert ZAR 745K-860KAPI Integration | Azure Machine Learning | Azure OpenAI | ChatGPT | Copilot StudioSenior-level Full TimeSouth Africa4d ago
-
AI Implementation Expert ZAR 745K-860KAPI Integration | Azure AI | Azure Machine Learning | Azure OpenAI | ChatGPTSenior-level Full TimeSouth Africa4d ago
-
Airflow | Apache Superset | BigQuery | Cloud Migration | Cloud platformAnnual vacation | English language discounts | Fully remote | Health reimbursement | International engineering cultureSenior-level Full TimeSouth Africa R4d ago
-
AI/ML | AWS | Access Control | Asana | AzureRemote work | Video interview requirementSenior-level Full TimeArgentina - Buenos Aires5d ago
-
AWS | Amazon Redshift | Apache Airflow | Apache Spark | BigQueryFlexible time zones | Remote workMid-level Full TimeSouth Africa - Cape Town5d ago
-
Senior Quantitative Analyst ZAR 745K-840KAgile | Azure Databricks | CDC | Data Governance | Data LineageSenior-level Full TimeJohannesburg, ZA6d ago
-
AWS | Apache Spark | BigQuery | C++ | CI/CDSenior-level Full TimePretoria, South Africa6d ago
-
A/B | A/B Testing | AWS | Amazon Athena | B testingCareer development | Collaborative & Inclusive Culture | Cross-functional collaboration | Flexible working environment | Learning and professional growthSenior-level Full TimeSouth Africa6d ago
-
AWS | Amazon Redshift | Amazon S3 | Bitbucket | ConfluenceRotational training programEntry-level Contract Full TimeJohannesburg, GP, South Africa6d ago
-
AI Engineer (Data Scientist) ZAR 700K-860KAI Foundry | AML | AWS Bedrock | AWS Bedrock Agents | Agentic AIAI practitioner community participation | Mentoring junior data scientists | Responsible AI governance forum involvementSenior-level Full Time15 Alice Lane, South Africa7d ago
-
Senior Data Engineer (Databricks & Cloud Data Platforms) ZAR 875K-1100KAWS Glue | Amazon Redshift | Amazon S3 | Apache Spark | AzureMentorship | Professional development | Sponsored events | Technical communitySenior-level Contract Full TimeJohannesburg, Gauteng, South Africa7d ago
-
Senior Data Engineer (Databricks & Cloud Data Platforms) ZAR 875K-1100KAWS Glue | Airflow | Amazon Redshift | Amazon S3 | AzureMentorship | Ongoing professional development | Sponsored events | Technical communitiesSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa7d ago
-
AWS | Azure | CI/CD | Data Governance | Data LakesConference access | Fully remote work | High-impact projects | International collaboration | Modern work equipmentMid-level Full TimeSouth Africa R7d ago
-
ATS platforms | Application Management | Data Engineering | Data Pipelines | ETLContractor workforce support experience | Global delivery exposure | Managed service experience | Mentoring opportunitiesMid-level ContractJohannesburg, South Africa8d ago
-
Senior-level Full TimeSandton - 1 Discovery Place, GP, …9d ago
-
Digital Analytics Engineer (Instrumentation) ZAR 660K-840KA/B | A/B Testing | B testing | BigQuery | Consent ModeSenior-level Full TimeBellville, Western Cape, ZA10d ago
-
Data Engineer (MLOps / Analytics Focus) ZAR 384K-420KAPI Integration | API Monitoring | Azure DevOps | CI/CD | Data GovernanceMid-level ContractJohannesburg, South Africa11d ago