Data Engineer (MLOps / Analytics Focus)
Johannesburg, South Africa
ZAR 384K-420K (estimate) Mid-level Contract
Tasks
- Analyze model performance and business impact
- Design data pipelines in Databricks
- Develop Databricks notebooks
- Develop Power BI dashboards
- Ensure data consistency
- Implement and maintain Delta Tables
- Manage Git-based workflows
- Monitor API integrations and data sends
- Monitor and improve data pipeline governance
- Optimize and maintain scalable data pipelines
- Perform data validation and data quality checks
- Resolve merge conflicts
- Support analytics and reporting for data driven decisions
- Support model lifecycle management and deployment best practices
- Train deploy and monitor machine learning models with MLflow
- Troubleshoot integration failures
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | API Monitoring | Azure DevOps | CI/CD | Data Governance | Data Quality | Data pipeline | Data pipeline optimization | Databricks | Databricks Notebooks | Delta Tables | Git | MLflow | Pipeline Optimization | Power BI | PySpark | Python | SQL | Spark
Education
N/A
Related jobs
-
Junior - Intermediate Data Engineer ZAR 240K-360KData Transformation | Database Views | Grafana | Microsoft Excel | Microsoft SQLRolling contractEntry-level ContractJohannesburg, South Africa17h ago
-
Analytics Engineer (Data Platform) ZAR 400K-420KAgile | Algorithms | BigQuery | CI/CD | Cube designBirthday leave | Confidential counseling | Financial guidance | Flexible equipment setup | Free parkingMid-level Full TimeCape Town22h ago
-
Senior-level Full TimePretoria, South Africa1d ago
-
Principal Data Engineer ZAR 400K-464KData Engineering | Data Modeling | Database Design | Databricks | Declarative PipelinesMid-level Full TimeCape Town, Western Cape, South Africa2d ago
-
Senior-level Full TimeJohannesburg, South Africa2d ago
-
Senior-level Full TimeJohannesburg, South Africa2d ago
-
Data Engineer (D) ZAR 464K-720KAnomaly Detection | Azure | Batch Processing | By Design | Data DriftMid-level Full TimeJohannesburg, South Africa2d ago
-
Artificial Intelligence | Azure | Azure Data | Azure Data Factory | Batch ProcessingMid-level Full TimeCape Town, South Africa3d ago
-
AI/ML | AWS | Access Control | Access Management | AsanaRemote collaboration tools | Remote workSenior-level Full TimeArgentina - Buenos Aires4d ago
-
AWS | Amazon Redshift | Apache Airflow | Apache Spark | AzureRemote workMid-level Full TimeSouth Africa - Cape Town4d ago
-
CRM Integration | Claude API | Docker | Event Driven | Event-driven architectureSenior-level Full TimeCape Town, South Africa4d ago
-
Access Control | Compliance | Data Governance | Data Lineage | Data ModelingAgile team collaborationMid-level Full TimeCape Town, South Africa4d ago
-
Senior Data Engineer (Azure) ZAR 875K-1170KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data FactoryIndependent work environment | Remote work | Stakeholder engagementSenior-level ContractJohannesburg, South Africa4d ago
-
Data Modeling | Distributed Systems | Embeddings | Kubernetes | LLM InferenceAccess to technical leadership | Collaborative culture | Flexible schedule | High autonomy | High ownershipEntry-level Full TimeSouth Africa R4d ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Friendly atmosphere | Hands-off management | Remote distributed settingMid-level Full TimeCape Town, South Africa5d ago
-
Tupande AI Engineering Lead EUR 66K-85KAPI Integration | Analytics | Artificial Intelligence | Automation | Data platformsCareer Reviews | Comprehensive benefits | Health insurance | Housing | MentorshipSenior-level Full TimeFlexible: Poland, Spain, Portugal, Estonia, Romania, …5d ago
-
BI Data Analyst II ZAR 660K-720KAPI Development | Acceptance criteria | Cloud Computing | Cost Optimization | Data Acceptance CriteriaSenior-level Full TimeJohannesburg, ZA5d ago
-
Senior-level Full TimeStellenbosch, ZA5d ago
-
Process Automation Engineer (AI/ML) ZAR 450K-580KAPI Integration | Anomaly Detection | Classification | Lean Six Sigma | Machine LearningMid-level Full TimeJohannesburg, South Africa8d ago
-
Data Engineer II ZAR 300K-420KAnalysis Services | Apache Hive | Apache Kafka | Apache Spark | Control-MMid-level Full Time2 First Place, Cnr Simmonds & …8d ago
-
Senior-level Full TimeEgypt R8d ago
-
Senior Data Scientist (OVA5666) ZAR 780K-1200KApache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure KubernetesSenior-level Full TimeJohannesburg, South Africa8d ago
-
Data Engineer ZAR 660K-780KAPI Development | Ab Initio | Agile delivery | Azure Data | Azure Data FactorySenior-level Full TimeJohannesburg, ZA9d ago
-
Senior Machine Learning Engineer ZAR 660K-840KAWS EC2 | AWS IAM | AWS KMS | AWS S3 | Amazon CloudWatchCell phone allowance | Data benefits | Fibre connection discount | Health insurance | Retirement benefitsSenior-level Full TimeMidrand, ZA9d ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPMid-level Full TimeJohannesburg, South Africa9d ago