Senior Data Engineer
Pretoria, South Africa
A ZAR 745K-1170K (estimate) Senior-level Full Time
Tasks
- Architect end-to-end data solutions
- Build ETL ELT pipelines and workflows
- Collaborate with data scientists analysts and product and engineering teams
- Define data modelling and engineering best practices
- Deliver curated datasets for analytics and BI
- Design scalable secure high-performance data platforms
- Ensure data quality through validation reconciliation and testing
- Implement observability with logs lineage and metrics
- Integrate data from APIs streaming platforms and third party systems
- Lead batch and real time pipeline development
- Manage orchestration scheduling and performance tuning
- Mentor and guide data engineers
- Own production pipeline monitoring and incident resolution
- Support automated deployments and post release validation
- Translate business needs into scalable technical solutions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Alerting | Amazon Kinesis | Azure | Azure Data | Azure Data Factory | Batch Processing | CI/CD | Cloud Pub/Sub | Cloud Security | Data Factory | Data Governance | Data Modelling | Data Quality | Data Reconciliation | Data Validation | ELT | ETL | Google Cloud | Google Cloud Pub/Sub | Infrastructure as Code | Kafka | Microsoft Fabric | Monitoring | Observability | Orchestration | Power BI | Pub/Sub | Real Time | Real-time Processing | SQL | Testing | Time processing | “as-code”
Education
N/A
Roles
Related jobs
-
API Gateway | AWS Lambda | Access Control | Agent systems | Amazon APISenior-level ContractJohannesburg, South Africa1d ago
-
AWS | Azure | Embeddings | GCP | Hugging FaceFlexible work environment | Fully remote | Growth opportunities | Remote distributed team experienceSenior-level Full TimeSouth Africa - Remote R1d ago
-
Data Engineer ZAR 420K-500KApache Airflow | Apache Spark | Data Governance | Data Modeling | DockerCredit and Criminal Record Check | Curro School Fees Benefit | Employee assistance programme | Financial Services Assistance | Free Sleep CoachingMid-level Full TimeCape Town, South Africa1d ago
-
AWS Lambda | Amazon CloudWatch | Amazon EKS | Amazon Redshift | Amazon SageMakerOn-call rotationSenior-level Full TimeCape Town, Western Cape, South Africa4d ago
-
API Security | Access Control | Airflow | Amazon Redshift | AuthenticationFlexible schedule | Remote workSenior-level Full TimeSouth Africa - Remote R4d ago
-
Application Support Engineer ZAR 300K-420KAgile | Ataccama | Cause analysis | Change Management | CollibraMid-level Full Time15 Alice Lane, South Africa4d ago
-
Principal Specialist VodaPay Insights and Analytics ZAR 540K-720KA/B | A/B Testing | B testing | CVM Analytics | Customer SegmentationCell phone benefits | Data benefits | Fibre connection discounts | Medical aid | Retirement benefitsSenior-level Full TimeMidrand, ZA4d ago
-
AWS | AWS Bedrock | AWS SageMaker | Cloud Computing | Computer VisionFlexible scheduling | Fully remote | Paid training | Stable internet freedomMid-level Full TimeSouth Africa R5d ago
-
Machine Learning Engineer ZAR 420K-600KAirflow | Amazon SageMaker | CI/CD | Docker | Feature EngineeringAgile environment | Collaborative culture | Feedback and empathy | Freedom and responsibility | Self-organizationMid-level Full TimeSouth Africa - Remote R5d ago
-
Data Engineer ZAR 420K-480KAPI | Amazon Redshift | Amazon Web Services | Amazon Web Services (AWS) | Apache SparkMid-level Full TimePinelands, South Africa5d ago
-
Senior Cloud Data Engineer ZAR 780K-920KApache Airflow | Apache Beam | Apache Spark | Cloud platform | Data GovernanceIn-office workSenior-level Full TimeCape Town, Western Cape, South Africa6d ago
-
Intermediate Data Engineer ZAR 396K-480KApache Airflow | Azure Data | Azure Data Factory | Azure DevOps | Azure FunctionsHybrid work modelMid-level Full TimeSandton, GP, South Africa6d ago
-
Senior-level Full TimeSouth Africa - Remote R6d ago
-
AI Lead (SAMY backbone) ZAR 500K-600KAPIs | Agent systems | Data Governance | Data Modeling | Data integrationCareer growth opportunities | Cool Gadgets Provided | Entrepreneurial Ecosystem | Flexible working hours | Global Referral ProgramSenior-level Full TimeCape Town, Western Cape, South Africa7d ago
-
Head Modelling & Analytics ZAR 750K-840KALM | Cash Flow | Cash flow modeling | Classification | Data AnalysisExecutive-level Full Time15 Alice Lane, South Africa7d ago
-
Mid-level Full TimeJohannesburg, South Africa7d ago
-
AI Engineer-2 ZAR 396K-480KAWS | Agentic Systems | Cloud platform | Conversational AI | Copilot StudioChallenging work | Culture of innovation and continuous learning | Ethical AI focus | Inclusive development culture | Opportunities to network and collaborateMid-level Full TimeFNB Building, 1 Enterprise Road, Fairland, …7d ago
-
Senior Data Engineer I ZAR 500K-600KAWS | Airflow | Apache Spark | Azure | C#Flexible working hours | Medical aid | Modern family benefits | Retirement plan | SabbaticalSenior-level Full TimeSouth Africa - Durban7d ago
-
Senior Data Engineer I ZAR 500K-600KAWS | Apache Airflow | Apache Kafka | Azure | C#Flexible working hours | Medical aid | Modern family benefits | Retirement plan | SabbaticalSenior-level Full TimeSouth Africa - Durban7d ago
-
Data Engineer ZAR 420K-500KApache Airflow | Apache Spark | Cloud Platforms | Data Governance | Data ModelingEmployee assistance programme | Financial Services Assistance | Free daily meals | Free massages on-site | Free on-site gymMid-level Full TimeCape Town, South Africa7d ago
-
Senior QA Engineer (AI Solutions) ZAR 700K-860KAPI Testing | AWS | Accessibility testing | Azure | Azure DevOpsEmployee Share Purchase Plan ESPP | Employee Stock Options Grant | Flexible working hours | Growth and development opportunities | Health benefits planSenior-level Full TimeCape Town or Johannesburg, South Africa8d ago
-
AWS | Agent Framework | Apache Kafka | Apache Spark | Application IntegrationSenior-level ContractPretoria, South Africa8d ago
-
Data Warehouse Engineer ZAR 396K-480KAgile | Data Modeling | Data Warehouse | Database normalization | Development LifecycleHybrid workMid-level Full TimeJohannesburg, South Africa8d ago
-
API Integration | Airflow | Anomaly Detection | Dashboarding | Data LineageFlexible working hours | Fully remote | Global collaboration | Modern tools and technologies | Ownership & autonomySenior-level Full TimeSouth Africa R8d ago
-
Senior Analytics Engineer ZAR 480K-650KAWS | Agile | Automated testing | Data Modeling | Data MonitoringSenior-level Full TimeBrackenfell, ZA8d ago