(1710) Data Engineer - BSTD
Pretoria, South Africa
ZAR 660K-840K (estimate) Senior-level Full Time
Tasks
- Build BI data pipelines
- Collaborate with stakeholders on data requirements
- Design modular scalable pipelines
- Ensure data governance compliance
- Ensure security compliance
- Implement data sharing services
- Implement permanent fixes
- Ingest semi structured data
- Ingest structured data
- Ingest unstructured data
- Maintain BI data pipelines
- Maintain SLA adherence
- Manage risks for data services
- Monitor data pipeline availability
- Optimize data marts and warehouses
- Optimize data pipeline performance
- Perform root cause analysis
- Recommend data service improvements
- Resolve data issues
- Support releases and deployments
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | CI/CD | Cause analysis | Containers | Dask | Data Governance | Data Operations | Data Quality | DevOps | Docker | Druid | GCP | IBM DB2 | InfluxDB | Java | Matplotlib | Microsoft SQL | Microsoft SQL Server | MySQL | Neo4j | NoSQL | NumPy | Oracle Database | Pandas | PostgreSQL | Python | Release Management | Root Cause Analysis | Root cause | SQL Server | Scala | Security operations | Software development | Spark | Time Series
Education
Roles
Related jobs
-
Junior - Intermediate Data Engineer ZAR 240K-360KData Transformation | Database Views | Grafana | Microsoft Excel | Microsoft SQLRolling contractEntry-level ContractJohannesburg, South Africa5h ago
-
Principal Data Engineer ZAR 400K-464KData Engineering | Data Modeling | Database Design | Databricks | Declarative PipelinesMid-level Full TimeCape Town, Western Cape, South Africa1d ago
-
Senior-level Full TimeJohannesburg, South Africa2d ago
-
Senior-level Full TimeJohannesburg, South Africa2d ago
-
Data Engineer (D) ZAR 464K-720KAnomaly Detection | Azure | Batch Processing | By Design | Data DriftMid-level Full TimeJohannesburg, South Africa2d ago
-
Artificial Intelligence | Azure | Azure Data | Azure Data Factory | Batch ProcessingMid-level Full TimeCape Town, South Africa3d ago
-
AI/ML | AWS | Access Control | Access Management | AsanaRemote collaboration tools | Remote workSenior-level Full TimeArgentina - Buenos Aires3d ago
-
AWS | Amazon Redshift | Apache Airflow | Apache Spark | AzureRemote workMid-level Full TimeSouth Africa - Cape Town4d ago
-
CRM Integration | Claude API | Docker | Event Driven | Event-driven architectureSenior-level Full TimeCape Town, South Africa4d ago
-
Access Control | Compliance | Data Governance | Data Lineage | Data ModelingAgile team collaborationMid-level Full TimeCape Town, South Africa4d ago
-
Data Modeling | Distributed Systems | Embeddings | Kubernetes | LLM InferenceAccess to technical leadership | Collaborative culture | Flexible schedule | High autonomy | High ownershipEntry-level Full TimeSouth Africa R4d ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Friendly atmosphere | Hands-off management | Remote distributed settingMid-level Full TimeCape Town, South Africa4d ago
-
BI Data Analyst II ZAR 660K-720KAPI Development | Acceptance criteria | Cloud Computing | Cost Optimization | Data Acceptance CriteriaSenior-level Full TimeJohannesburg, ZA4d ago
-
Senior-level Full TimeStellenbosch, ZA4d ago
-
Process Automation Engineer (AI/ML) ZAR 450K-580KAPI Integration | Anomaly Detection | Classification | Lean Six Sigma | Machine LearningMid-level Full TimeJohannesburg, South Africa7d ago
-
Data Engineer II ZAR 300K-420KAnalysis Services | Apache Hive | Apache Kafka | Apache Spark | Control-MMid-level Full Time2 First Place, Cnr Simmonds & …7d ago
-
Senior-level Full TimeEgypt R7d ago
-
Senior Data Scientist (OVA5666) ZAR 780K-1200KApache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure KubernetesSenior-level Full TimeJohannesburg, South Africa8d ago
-
Data Engineer ZAR 660K-780KAPI Development | Ab Initio | Agile delivery | Azure Data | Azure Data FactorySenior-level Full TimeJohannesburg, ZA8d ago
-
Senior Machine Learning Engineer ZAR 660K-840KAWS EC2 | AWS IAM | AWS KMS | AWS S3 | Amazon CloudWatchCell phone allowance | Data benefits | Fibre connection discount | Health insurance | Retirement benefitsSenior-level Full TimeMidrand, ZA8d ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPMid-level Full TimeJohannesburg, South Africa9d ago
-
DevOps Engineer ZAR 360K-384KApplication Gateway | Application Insights | Azure DevOps | Azure Monitor | Azure NetworkingCollaborative team environment | Global fast paced environment | Learning and development opportunitiesMid-level Full TimeMidrand, South Africa9d ago
-
Machine Learning Engineer ZAR 780K-860KAI Agents | AI Services | Azure AI | Azure AI Services | Azure OpenAISenior-level Full TimeSandton - 1 Discovery Place, GP, …9d ago
-
Embedded Software Development Engineer ZAR 420K-504KARM | C# | Electronic schematics | Embedded System | Embedded System ArchitectureDisability programs | Hybrid work | Life insurance | Private medical care | Tailored financial programsMid-level Full TimeZA-Century City-Cape Town-The Matrix 2G and …9d ago
-
Senior Data Platform Consultant ZAR 600K-730KAWS | Azure | CI/CD | Classification | Data EngineeringHybrid workSenior-level Full TimeCape Town, South Africa R10d ago