Azure Databricks DevOps Engineer
A ZAR 360K-480K (estimate) Mid-level Full Time
Tasks
- Automate cloud infrastructure provisioning
- Build and manage CI/CD pipelines
- Deploy and maintain Azure Databricks environments
- Implement security governance and compliance
- Maintain technical documentation and best practices
- Optimize ETL pipelines
- Set up monitoring and logging
- Troubleshoot Databricks and AKS incidents
Perks/Benefits
- N/A
Skills/Tech-stack
Active Directory | Apache Spark | Application Insights | Azure Active Directory | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Kubernetes | Azure Kubernetes Service | Azure Monitor | Azure Networking | Azure Resource | Azure Resource Manager | Azure Service | Azure Service Bus | Azure Synapse | Azure Synapse Analytics | Bicep | Data Factory | Delta Lake | Docker | Event Hubs | GitHub Actions | Grafana | Jenkins | Kafka | Kubernetes | Kubernetes Service | Log Analytics | MLOps | Powershell | Prometheus | Python | RBAC | Resource manager | Scala | Service Bus | Synapse Analytics | Terraform
Education
Related jobs
-
NumPy | Pandas | Python | SciPy | SymPyPart-time work | Project based workSenior-level FreelanceSouth Africa - Remote R20h ago
-
API Integration | Generative AI | Language Models | Large Language Models | Machine LearningAutonomy | Rapid iteration culture | Remote workSenior-level Full TimeCape Town, Western Cape, South Africa1d ago
-
Ab Initio | Azure | Data Governance | Data Modeling | Data SecuritySenior-level Full TimeSandton, South Africa1d ago
-
Advanced Excel | Azure Synapse | Azure Synapse Analytics | Data Analysis | Data GovernanceSenior-level Full TimeJohannesburg, GP, South Africa1d ago
-
AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2 | Amazon S3Senior-level Full TimeCape Town, Western Cape, South Africa1d ago
-
APIs | Data Engineering | Data Pipelines | Data Streams | JSONSenior-level Full TimeCape Town, WC, South Africa1d ago
-
A/B | A/B Testing | AWS | Amazon SageMaker | AutomlSenior-level Full TimeJohannesburg, South Africa1d ago
-
Analytics | Apache Kafka | Big Data | Cluster tuning | ContainerizationRemote workSenior-level Full TimeJohannesburg, GP, South Africa R1d ago
-
Senior-level Full TimeDurban North, KZN, South Africa1d ago
-
API Development | AWS | Amazon SageMaker | Apache Spark | AzureSenior-level Full TimeJohannesburg, South Africa1d ago
-
API Development | AWS | Amazon SageMaker | Apache Spark | CI/CDSenior-level Full TimeCape Town, Western Cape, South Africa1d ago
-
Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeJohannesburg, GP, South Africa1d ago
-
Azure | Data Engineering | Data Lake | Data Lineage | Data ModelingSenior-level Full TimeRandburg, GP, South Africa1d ago
-
Apache Airflow | Apache Spark | Cloud infrastructure | Data Architecture | Data GovernanceSenior-level Full TimeCape Town, WC, South Africa1d ago
-
AWS | Apache Spark | Azure Synapse | Azure Synapse Analytics | Cloud ComputingSenior-level Full TimeJohannesburg, GP, South Africa1d ago
-
API Development | AWS SageMaker | Amazon Web Services | Apache Spark | CI/CDSenior-level Full TimePort Elizabeth, South Africa1d ago
-
Senior-level Full TimeJohannesburg, South Africa1d ago
-
Azure | Data Lake | Data Lineage | Data Modeling | Data PipelinesSenior-level Full TimeJohannesburg, GP, South Africa1d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure DevOpsSenior-level Full TimeJohannesburg, GP, South Africa1d ago
-
Senior-level Full TimeJohannesburg, GP, South Africa1d ago
-
Automation | C++ | CI/CD | Continuous Delivery | Continuous integrationKnowledge transfer | TrainingSenior-level Full TimeJohannesburg, GP, South Africa1d ago
-
Mid-level Full TimeJohannesburg, GP, South Africa1d ago
-
AWS | Automation | CI/CD | Cloud Computing | ContainerizationConsulting | Knowledge sharing | MentoringSenior-level Full TimeJohannesburg, GP, South Africa1d ago
-
Data Architecture | Data Modeling | ETL | Looker | MySQLEntry-level Full TimeCape Town, WC, South Africa1d ago
-
Data Architecture | Data Modeling | Database performance | Database performance tuning | ETLTeam collaborationEntry-level Full TimeCape Town, WC, South Africa1d ago