Mid-Level Data Engineer
Johannesburg, GP, South Africa
ZAR 400K-464K (estimate) Mid-level Full Time
Tasks
- Apply access controls and secure data handling
- Build ETL ELT pipelines for batch and real time processing
- Build automated data quality tests and validation rules
- Create semantic layer for business metrics and definitions
- Create technical documentation for pipelines and data models
- Design build and maintain cloud data platforms
- Develop and optimize data warehouse and lakehouse schemas partitioning and clustering
- Implement medallion data architecture
- Implement monitoring, alerting, and logging for data pipelines
- Maintain version control and CI CD pipelines for data workflows
- Prepare AI ready trusted feature ready datasets
- Troubleshoot data incidents and perform root cause analysis
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Airflow | Apache Spark | CI/CD | Cloud Security | DBT | Data Architecture | Data Governance | Data Observability | Data Quality | Data Testing | Data Warehousing | Dimensional Modeling | ELT | ETL | Git | Google BigQuery | Lakehouse | Looker | Medallion data architecture | Microsoft Fabric | Power BI | Python | SQL | Semantic layer
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Data Science | Bachelor of Science in Engineering | Bachelor of Science in Information Systems | Bachelor of Science in Mathematics
Roles
Related jobs
-
Automation | Availability Monitoring | Capacity Planning | Code control | Concurrency ControlSenior-level Full TimeCape Town, South Africa9h ago
-
Azure Data Engineer ZAR 396K-420KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageHybrid workingMid-level ContractJohannesburg, South Africa1d ago
-
APIs | Cloud Computing | Data Architecture | Data Governance | Data LineageSenior-level ContractSandton, South Africa1d ago
-
Analytics Engineer (OVA5693) ZAR 384K-420KAPI Development | Cloud Platforms | Cost Optimization | Data Architecture | Data ContractsHybrid work | Independent contractMid-level Full TimeJohannesburg, South Africa1d ago
-
AI code generation | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFully remote | Remote flexibility | Work autonomySenior-level Contract Full TimeSouth Africa R1d ago
-
APIs | AWS Lambda | AWS S3 | Amazon RDS | Amazon SNSAutonomy | Collaborative team environment | Fully remote | Ownership | Professional development focusSenior-level Full TimeSouth Africa R1d ago
-
Mid-level Full TimeCape Town, Western Cape, South Africa1d ago
-
Data Scientist: AI Engineer ZAR 360K-444KAPIs | CI/CD | Cloud Computing | Data Engineering | DockerMid-level Full TimeJohannesburg, South Africa1d ago
-
Data Engineer ZAR 464K-540KAPI Development | Azure Data | Azure Data Lake | Azure SQL | Azure SynapseMid-level Full TimeJohannesburg, South Africa1d ago
-
Data Engineer ZAR 420K-464KAPI | Artificial Intelligence | DBT | Data Compliance | Data GovernanceCollaborative culture | Employee wellness programs | Hybrid work | Modern tooling | Professional developmentMid-level Full TimeCape Town, South Africa R2d ago
-
Senior-level ContractJohannesburg, South Africa2d ago
-
Access Control | Access Control Lists | Ansible | Apache Kafka | AutomationSenior-level ContractJohannesburg, South Africa2d ago
-
Data Engineer ZAR 745K-860K.NET | Apache Storm | Automation | Azure Data | Azure Data FactoryHybrid workingSenior-level Full TimeJohannesburg, South Africa2d ago
-
AWS | Autogen | Azure | Claude | Cloud platformBackup power required | Fixed internet required | Public holiday compensation | Remote workSenior-level Full TimeSouth Africa - Remote R2d ago
-
Analytics Engineer II ZAR 576K-720KApache Airflow | CI/CD | Cloud Data | Cloud Data Platforms | Data GovernanceSenior-level Full TimeStellenbosch, ZA2d ago
-
AI Platform Engineer (Cloud) ZAR 660K-780KAWS | AWS CDK | Access Control | Attribute-Based Access Control | Attribute-based accessSenior-level Full Time15 Alice Lane, South Africa3d ago
-
Senior Specialist: Cloud Data Engineer ZAR 660K-720KAPI Gateway | AWS | Agile | Apache Flink | Apache HiveCell phone benefits | Data benefits | Fibre connection discounts | Medical aid benefits | Retirement fundsSenior-level Full TimeMidrand, ZA3d ago
-
AI Evaluation | API Integration | AWS | Access Control | Agent OrchestrationFlexible work hours | Fully remoteSenior-level Full TimeEgypt R4d ago
-
Backpressure handling | Chunking | Cloud platform | Cloudflare Queues | Cloudflare WorkersCompetitive pay | Growth opportunities | Remote workSenior-level Full TimeSouth Africa - Cape Town R7d ago
-
Lead Data and AI Integration Specialist ZAR 540K-720KAWS | Anomaly Detection | Authentication | Automation | AzureEqual opportunity workplace | Hybrid working model | Travel to primary office as requiredSenior-level Full Time15 Alice Lane, South Africa R7d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Glue Catalog | AWS LakeAgile collaboration | Flexible work location | Fully remote | Technical autonomySenior-level Contract Full TimeSouth Africa R8d ago
-
Mid-level Full TimeJohannesburg, South Africa9d ago
-
Analytics Engineer (Data Platform) ZAR 464K-500KAgile | Algorithms | BI reporting | BigQuery | CI/CDBirthday leave | Confidential counselling | Financial guidance | Flexible total remuneration package | Free counsellingMid-level Full TimeCape Town10d ago
-
Analytics Engineer (Data Platform) ZAR 464K-500KAgile | Algorithms | BigQuery | CI/CD | Data CleansingBirthday leave | Confidential counselling | Financial guidance | Free parking | Hybrid working modelMid-level Full TimeCape Town10d ago
-
AI Solution Engineer ZAR 600K-720KAutomation workflows | Azure AI | Copilot Studio | Data Processing | GitHub CopilotMid-level Full TimeCape Town, South Africa Office10d ago