Data Platform Engineer
Johannesburg, South Africa
A ZAR 300K-420K (estimate) Mid-level Full Time
Tasks
- Architect and deploy data platform solutions on Azure
- Automate infrastructure provisioning
- Build batch and real-time ingestion pipelines
- Collaborate with cross-functional teams
- Design big data platforms
- Develop CI/CD pipelines
- Implement data governance privacy compliance
- Implement monitoring solutions
- Implement security controls encryption access controls audit logging
- Maintain data lakes and data warehouses
- Participate in agile sprints
- Perform system administration performance tuning
- Provide production L2 L3 support
- Translate business requirements into scalable solutions
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Atlas | Apache NiFi | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | Collibra | Data Factory | Data Lake Storage | Databricks | Delta Lake | Docker | ELK Stack | Git | Grafana | Hadoop | Hive | Java | Jenkins | Kafka | Kafka Streams | Kubernetes | Microsoft Azure | Prometheus | Python | SQL | Scala | Spark | Synapse Analytics | Terraform
Education
Roles
Data Platform | Data Platform Engineer | Engineer | Platform Engineer
Related jobs
-
Principal Clinical Data Engineer - based in South Africa ZAR 663K-663K21 CFR | 21 CFR Part 11 | CFR Part 11 | Cause analysis | Clinical dataSenior-level Full TimeSouth Africa-Bloemfontein-Remote R2d ago
-
Mid-level Full TimeBellville, South Africa3d ago
-
Senior-level Full TimeCape Town, South Africa3d ago
-
Senior-level Full TimeNetcare Head Office, South Africa3d ago
-
Airflow | Amazon Redshift | BigQuery | CI/CD | ChromaDBFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R3d ago
-
AI machine learning | AWS | Access Controls | Access Management | AsanaCareer growth opportunities | Competitive compensation | Hybrid flexibility | Remote workSenior-level Full TimeArgentina - Buenos Aires4d ago
-
AWS S3 | Azure | Cloud Integration | Data Governance | Data LineageSenior-level Full TimeCape Town, South Africa4d ago
-
Application Monitoring | Data Analysis | Data Quality | Data pipeline | ETLSenior-level Full TimePretoria, South Africa4d ago
-
Benchmarking | Big Data | Cloud Computing | Databases | Distributed SystemsSenior-level Full TimeJohannesburg, South Africa4d ago
-
Senior-level Full TimeJohannesburg, South Africa4d ago
-
Analytics tools | Cloud Computing | Data platforms | Incident Management | LoggingSenior-level Full TimeJohannesburg, South Africa4d ago
-
AWS Architect | AWS Architect Associate | AWS Architect Professional | AWS Cloud | AWS Cloud PractitionerSenior-level ContractPretoria, South Africa4d ago
-
Mid-level Full TimePretoria, South Africa4d ago
-
Mid-level Full TimeJohannesburg, South Africa4d ago
-
Data Engineer ZAR 300K-420KAWS | Azure | Data Architecture | Data Lakehouse | Data PipelinesHybrid work policyMid-level Full TimeJohannesburg, SA, ZA4d ago
-
Data Engineer ZAR 300K-420KAWS | Azure | Data Lakehouse | Data Modeling | Data Pipeline MonitoringHybrid work policy | Remote work daysMid-level Full TimeJohannesburg, SA, ZA4d ago
-
Senior-level Full TimeJohannesburg, South Africa4d ago
-
(1731) Data Scientist and AI Engineer - BSTD ZAR 720K-780KAPI Development | Amazon Web Services | Apache Hadoop | Apache Spark | DB2Senior-level Full TimePretoria, South Africa4d ago
-
(1728) Data Engineer - BSTD ZAR 745K-900KAnalytics enablement | Apache Spark | Application Programming | Application Programming Interfaces | C SharpSenior-level Full TimePretoria, South Africa4d ago
-
Senior-level Full TimeWC, South Africa4d ago
-
Senior-level Full TimeWC, South Africa4d ago
-
Senior Generative AI Engineer ZAR 603K-650KAI Governance | AI Security | AWS | Azure | Cloud PlatformsContinuous learning and development | Mentorship and team growthSenior-level Full TimeWC, South Africa4d ago
-
AI Prompt Engineer ZAR 498K-576KAI Evaluation | Content Optimization | Conversational AI | Documentation | Generative AISenior-level Full TimeWC, South Africa4d ago
-
AI / Machine Learning Engineer ZAR 360K-440KCI/CD | Cloud Computing | Computer Vision | Data Governance | Data PipelinesMid-level Full TimeWC, South Africa4d ago
-
Senior RAG Engineer ZAR 450K-650KAPI Development | Chroma | Distributed Systems | Embeddings | Enterprise SearchSenior-level Full TimeWC, South Africa4d ago