Azure Databricks DevOps Engineer
Centurion, South Africa
A ZAR 360K-480K (estimate) Mid-level Full Time
Tasks
- Automate cloud infrastructure provisioning
- Build and manage CI/CD pipelines
- Deploy and maintain Azure Databricks environments
- Implement security governance and compliance
- Maintain technical documentation and best practices
- Optimize ETL pipelines
- Set up monitoring and logging
- Troubleshoot Databricks and AKS incidents
Perks/Benefits
- N/A
Skills/Tech-stack
Active Directory | Apache Spark | Application Insights | Azure Active Directory | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Kubernetes | Azure Kubernetes Service | Azure Monitor | Azure Networking | Azure Resource | Azure Resource Manager | Azure Service | Azure Service Bus | Azure Synapse | Azure Synapse Analytics | Bicep | Data Factory | Delta Lake | Docker | Event Hubs | GitHub Actions | Grafana | Jenkins | Kafka | Kubernetes | Kubernetes Service | Log Analytics | MLOps | Powershell | Prometheus | Python | RBAC | Resource manager | Scala | Service Bus | Synapse Analytics | Terraform
Education
Related jobs
-
Quantitative Data Engineer ZAR 600K-730KAzure DevOps | Cloud Data | Cloud Data Services | Continuous Deployment | Continuous integrationSenior-level Full TimeSandton, Gauteng, ZA23h ago
-
ARM | Active Directory | Agile | Apache Spark | AuthenticationSenior-level Full TimeJohannesburg, South Africa1d ago
-
Senior Data Engineer ZAR 700K-840KAWS | Agile | Apache Spark | Azure | CI/CD25 days annual leave | 30 days annual leave after each year | Cycle to work scheme | Discounted gym membership | Employee-led clubs and eventsSenior-level Full TimeNewcastle2d ago
-
Data Engineer III ZAR 504K-609KAWS Lambda | Agent2Agent Protocols | Amazon RDS | Amazon Redshift | Amazon S3Adoption benefits | Family benefits | Flexible working hours | Medical aid | Retirement planSenior-level Full TimeSouth Africa - Cape Town2d ago
-
Data Engineer III ZAR 504K-609KAWS Lambda | Agentic AI | Amazon RDS | Amazon Redshift | Amazon S3Flexible hours | Medical aid | Modern family benefits | Retirement plan | SabbaticalSenior-level Full TimeSouth Africa - Cape Town2d ago
-
Senior Data Engineer ZAR 745K-860KAWS | Agile | Azure | Python | SQLEmployee Share Purchase Plan ESPP | Employee Stock Options Grant | Flexible working hours | Growth and development opportunities | Health benefits planSenior-level Full TimeJohannesburg or Cape Town, South Africa2d ago
-
AWS Data Engineer – Consultant ZAR 360K-420KAWS | AWS Athena | AWS DMS | AWS Glue | Amazon DynamoDBMid-level Full TimeJohannesburg, Gauteng, South Africa2d ago
-
Mid-level Full TimeSandton, South Africa3d ago
-
Technical Specialist Power BI ZAR 660K-780KAWS | Admin APIs | Azure | Azure DevOps | Azure Key VaultSenior-level Full TimeFNB Building, 1 Enterprise Road, Fairland, …4d ago
-
AWS | Access Control | Azure | Bash | BigQueryHybrid work model | On-call rotationSenior-level Full TimeCape Town, Western Cape, South Africa4d ago
-
Staff Engineer (Data Analyst) ZAR 700K-920KAI/ML | Data Analysis | Data Modeling | Data Pipelines | Data VisualizationSenior-level Full TimeJohannesburg, SA (Hybrid), South Africa R4d ago
-
Machine Learning Engineer ZAR 660K-780KAWS | Amazon ECS | Amazon EKS | Amazon SageMaker | Artificial IntelligenceContinuous learning culture | MentorshipSenior-level Full TimeBellville, Western Cape, ZA7d ago
-
Airflow | Amazon Redshift | Amazon SageMaker | BigQuery | CI/CDFlexible hours | Remote workSenior-level Full TimeSouth Africa - Remote R9d ago
-
C# | Combinatorics | Graph theory | MATLAB | NumPyProject-based freelanceSenior-level FreelanceSouth Africa - Remote R10d ago
-
Data Engineer ZAR 700K-860KApache Storm | Azure Data Factory | Bash | Cassandra | Data FactoryDiversity and inclusion | Hybrid workingSenior-level Full TimeJohannesburg, South Africa10d ago
-
Senior-level Full TimeCape Town, Western Cape, South Africa11d ago
-
Lead Data Engineer ZAR 504K-609KAWS | Agile | Apache Spark | Azure | CI/CDAnnual leave | Cycle to work scheme | Discounted gym membership | Employer pension scheme | Generous family leaveSenior-level Full TimeNewcastle12d ago
-
Machine Learning Engineer (Remote in South Africa) ZAR 441K-576KAWS | AWS Lambda | Amazon SageMaker | Apache Spark | CI/CDAdoption Assistance | Certification completion bonus | Certification reimbursement | Tuition reimbursementMid-level Full TimeCape Town, South Africa R15d ago
-
Data Engineer ZAR 348K-420KAWS | Azure | Cloud Architecture | Data Lake | Data LakehouseHybrid work policyMid-level Full TimeJohannesburg, SA, ZA15d ago
-
Data Engineer: Ingestions (Group Data Platform) ZAR 400K-480KAccess Control | Access Management | Active Directory | Containerization | Data IngestionCollaborative work environment | Continuous learning culture | Ownership mindsetMid-level Full TimeBellville, Western Cape, ZA16d ago
-
Senior Data Engineer ZAR 540K-675KAWS | Airflow | Amazon Redshift | Apache Flink | Apache SparkFlexible work practices | Remote-firstSenior-level Full TimePortugal; South Africa R18d ago
-
Data Engineer III ZAR 504K-609KAWS | Amazon Redshift | Automated testing | Azure | Cloud servicesFlexible working hours | Sabbatical | Shared parental leave | Study assistance | Wellbeing initiativesSenior-level Full TimeSouth Africa - Johannesburg18d ago
-
Data Engineer III ZAR 504K-609KAWS | Amazon Redshift | Azure | Cloud Computing | Data ModelingFlexible working hours | Sabbatical | Shared parental leave | Study assistance | Wellbeing initiativesSenior-level Full TimeSouth Africa - Johannesburg18d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQLMid-level Full TimePretoria, GP, South Africa19d ago
-
AWS | Apache Spark | Data Governance | Data Lake | Data PrivacyContract employment | Remote workMid-level Full TimeCape Town, WC, South Africa19d ago