Data Engineer
Johannesburg, South Africa
A ZAR 464K-480K (estimate) Entry-level Contract
Tasks
- Architect and develop batch and real time data pipelines
- Build data quality validation reconciliation and auditing frameworks
- Collaborate with data scientists architects analysts and software engineers
- Design and optimize Azure based data platforms
- Develop APIs and services for secure real time data access
- Enforce governance and security best practices
- Implement DataOps automation orchestration testing and CI CD
- Implement infrastructure-as-code
- Improve platform performance scalability reliability and observability
- Ingest transform and deliver structured semi structured and unstructured data
- Manage data lineage and metadata
- Own end-to-end data lifecycle
- Participate in agile ceremonies
- Profile data and perform root cause analysis
- Support complex production issues
Perks/Benefits
- N/A
Skills/Tech-stack
Ab Initio | Apache Spark | Azure Data | Azure Data Factory | Azure Event | Azure Event Hub | Azure Synapse | CI/CD | Data Factory | Data Lakes | Data Lineage | Data Modelling | Data Warehousing | DataOps | Databricks | ELT | ETL | Event Hub | Infrastructure as Code | Kafka | Microsoft Azure | Microsoft Fabric | PySpark | Python | SQL | “as-code”
Education
Roles
Related jobs
-
Amazon Web Services | Apache Storm | Automation | Bash | Business IntelligenceSenior-level ContractCape Town, South Africa4h ago
-
Azure Bot | Azure Bot Service | Azure Cognitive | Azure Cognitive Services | Azure Machine LearningMid-level Full TimeMidrand, South Africa1d ago
-
Alerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Anomaly DetectionContinuous improvement opportunities | Cross-functional collaboration | Fully remote work | Ownership over data reliability strategySenior-level Full TimeSouth Africa R1d ago
-
AI Engineering - Master Specialist ZAR 780K-920KApache Kafka | Apache Spark | C++ | CUDA | Cloud ComputingSenior-level Full TimeJohannesburg, ZA1d ago
-
AI machine learning | AWS | Access Control | Asana | AzureHybrid customer facing opportunities | Remote workSenior-level Full TimeArgentina - Buenos Aires3d ago
-
Senior Data Engineer ZAR 1100K-1200KAPI | Apache Flink | Apache Spark | Apache Spark Streaming | Azure DataSenior-level Full TimeSouth Africa4d ago
-
Data Engineer ZAR 300K-420KAWS | Apache Airflow | Azure | Azure Data | Azure Data LakeFlexible team culture | Inclusive and diverse workplace | Support for employment equityMid-level Full TimeCenturion, GP, South Africa4d ago
-
Specialist - Data Engineer.MTN Software Solutions ZAR 464K-480KApache Hadoop | Apache Kafka | Apache Spark | Data Modeling | Data PipelinesMid-level Full TimeRoodepoort, Gauteng, South Africa5d ago
-
Blue-Green Deployment | Blue/green | CI/CD | CUDA | CUDA optimizationFully remote | Remote work flexibilitySenior-level Full TimeSouth Africa R5d ago
-
Cloud Data Engineers (OVA5720) ZAR 348K-420KAPI Integration | Apache Spark | Azure Data | Azure Data Factory | Azure EventHybrid work modelMid-level Full TimeJohannesburg, South Africa5d ago
-
Asana | Google Workspace | LLM | Prompt engineering | PythonFlexible time zone collaboration | Remote workMid-level Full TimeArgentina - Buenos Aires6d ago
-
Senior-level Full TimeCape Town7d ago
-
Data Engineer ZAR 396K-456KAPI Development | AWS | Apache Spark | Automation | CI/CDCareer development opportunities | Employee discounts | Hybrid working | Paid sabbaticals | Paid time offSenior-level Full TimeCape Town, Western Cape, South Africa R7d ago
-
Data Engineer ZAR 780K-920K.NET | Analysis Services | Apache Storm | Azure Data Factory | BashHybrid workSenior-level Full TimeJohannesburg, South Africa7d ago
-
Apache Airflow | Apache Atlas | Apache NiFi | Azure Data | Azure Data FactoryMid-level Full TimeJohannesburg, South Africa9d ago
-
Principal Clinical Data Engineer - based in South Africa ZAR 663K-663K21 CFR | 21 CFR Part 11 | CFR Part 11 | Cause analysis | Clinical dataSenior-level Full TimeSouth Africa-Bloemfontein-Remote R10d ago
-
Mid-level Full TimeBellville, South Africa11d ago
-
Senior-level Full TimeCape Town, South Africa11d ago
-
Airflow | Amazon Redshift | BigQuery | CI/CD | ChromaDBFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R11d ago
-
AWS S3 | Azure | Cloud Integration | Data Governance | Data LineageSenior-level Full TimeCape Town, South Africa12d ago
-
Application Monitoring | Data Analysis | Data Quality | Data pipeline | ETLSenior-level Full TimePretoria, South Africa12d ago
-
Mid-level Full TimePretoria, South Africa12d ago
-
Data Engineer ZAR 300K-420KAWS | Azure | Cloud Computing | Data Architecture | Data LakeHybrid work policyMid-level Full TimeJohannesburg, SA, ZA12d ago
-
Senior-level Full TimeJohannesburg, South Africa12d ago
-
(1731) Data Scientist and AI Engineer - BSTD ZAR 720K-780KAPI Development | Amazon Web Services | Apache Hadoop | Apache Spark | DB2Senior-level Full TimePretoria, South Africa12d ago