Senior Data Engineer
Tasks
- Build API integrations
- Build end-to-end data pipelines
- Collaborate with data scientists
- Create data marts
- Define data assets and ETL jobs
- Design data integrations
- Design data lineage frameworks
- Design data models
- Develop data pipelines
- Document engineering work
- Evaluate data lineage tools
- Implement data quality monitoring
- Mentor junior engineers and lead code reviews
- Set up CI/CD pipelines
- Support BI and analytics
- Troubleshoot data issues
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Agile | Amazon Web Services | Apache Spark | Azure | CI/CD | Data Lineage | Data Modeling | Data Quality | Data Warehouse | Data Warehouse Architecture | Dimensional data | Dimensional data modeling | ETL | Kafka | Microsoft Fabric | Microsoft SQL | Microsoft SQL Server | PostgreSQL | Power BI | Python | SQL | SQL Server | SSIS | Schema Design | Warehouse Architecture | Web Services
Education
Roles
Related jobs
-
Machine Learning Engineer ZAR 660K-780KAWS | Amazon ECS | Amazon EKS | Amazon SageMaker | Artificial IntelligenceContinuous learning culture | MentorshipSenior-level Full TimeBellville, Western Cape, ZA11h ago
-
Amazon Redshift | Analytics engineering | DBT | Data Modeling | Data QualityChildcare support | Fully remote | Healthcare coverage | Home office equipment allowance | Learning and development budgetSenior-level Full TimeSouth Africa R1d ago
-
Airflow | Amazon Redshift | Amazon SageMaker | BigQuery | CI/CDFlexible hours | Remote workSenior-level Full TimeSouth Africa - Remote R1d ago
-
AI Automation | API Integration | Airtable | CRM | GoHighLevelCareer growth | Fully remote | Ongoing support | Peer communitySenior-level Full TimeSouth Africa - Remote R1d ago
-
SD Engineer (Data & BI) ZAR 900K-1000KCube | Data Governance | Data Management | Data Mart | Data ModelingDedicated account manager | Team get-togethers | Up-skilling | Workation tripsMid-level Full TimeGauteng, Johannesburg, South Africa2d ago
-
Paid Media Lead (Growth & Analytics) ZAR 420K-456KA/B | A/B Testing | Attribution Modeling | B testing | Behavior analyticsHybrid work | Part time coding bootcamp enrollment | Remote work optionSenior-level Full TimeCape Town | Hybrid (South Africa) R2d ago
-
Data Engineer ZAR 745K-900KAPI Integration | Big Data | Cause analysis | Data Performance Optimization | Data PipelinesSenior-level Full TimeRoodepoort, GP, South Africa2d ago
-
C# | Combinatorics | Graph theory | MATLAB | NumPyProject-based freelanceSenior-level FreelanceSouth Africa - Remote R2d ago
-
Data Engineer ZAR 700K-860KApache Storm | Azure Data Factory | Bash | Cassandra | Data FactoryDiversity and inclusion | Hybrid workingSenior-level Full TimeJohannesburg, South Africa2d ago
-
Data Engineer ZAR 360K-420KAb Initio | Data Warehousing | ETL | Hadoop | SASChallenging work | Innovation opportunities | Networking opportunitiesMid-level Full Time5 Merchant Place, 9 Fredman Drive, …2d ago
-
Analytics Engineer ZAR 745K-900KAirflow | CI/CD | Cloud Data | Cloud data platform | Data GovernanceSenior-level Full TimeSandton, ZA2d ago
-
Data Warehouse Developer Mr Price Group ZAR 360K-600KAutomation | Data Modeling | Data Transformation | Data Vault | Data Vault 2.0Senior-level Full TimeDurban, Kwazulu Natal, South Africa3d ago
-
Senior Data Engineer ZAR 700K-860KAWS | Agile | Apache Spark | Azure | CI/CDAnnual leave | Cycle to work scheme | Discounted gym membership | Employer pension scheme | Family leave policiesSenior-level Full TimeNewcastle3d ago
-
Senior-level Full TimeCape Town, Western Cape, South Africa4d ago
-
Lead Data Engineer ZAR 504K-609KAWS | Agile | Apache Spark | Azure | CI/CDAnnual leave | Cycle to work scheme | Discounted gym membership | Employer pension scheme | Generous family leaveSenior-level Full TimeNewcastle4d ago
-
Machine Learning Engineer (Remote in South Africa) ZAR 441K-576KAWS | AWS Lambda | Amazon SageMaker | Apache Spark | CI/CDAdoption Assistance | Certification completion bonus | Certification reimbursement | Tuition reimbursementMid-level Full TimeCape Town, South Africa R8d ago
-
Data Engineer ZAR 348K-420KAWS | Azure | Cloud Architecture | Data Lake | Data LakehouseHybrid work policyMid-level Full TimeJohannesburg, SA, ZA8d ago
-
AIX | Amazon Web Services | Azure | Backup and Recovery | Brocade SANSenior-level Full TimeRivonia, South Africa9d ago
-
Data Modeling | Microsoft Excel | PostgreSQL | Power BI | PythonBig data analytics industry exposure | Collaborative small team culture | Full-time permanent positionEntry-level Full TimeKnysna, South Africa9d ago
-
Data Engineer: Ingestions (Group Data Platform) ZAR 400K-480KAccess Control | Access Management | Active Directory | Containerization | Data IngestionCollaborative work environment | Continuous learning culture | Ownership mindsetMid-level Full TimeBellville, Western Cape, ZA9d ago
-
Senior Data Engineer ZAR 540K-675KAWS | Airflow | Amazon Redshift | Apache Flink | Apache SparkFlexible work practices | Remote-firstSenior-level Full TimePortugal; South Africa R10d ago
-
Data Engineer III ZAR 504K-609KAWS | Amazon Redshift | Automated testing | Azure | Cloud servicesFlexible working hours | Sabbatical | Shared parental leave | Study assistance | Wellbeing initiativesSenior-level Full TimeSouth Africa - Johannesburg10d ago
-
Data Engineer-3 ZAR 530K-670KAbinitio | Abinitio architecture | Abinitio graph development | Agile | Code reviewMid-level Full TimeFNB Building, 1 Enterprise Road, Fairland, …10d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time project workSenior-level Full TimeSouth Africa - Remote R10d ago
-
Data Engineer III ZAR 504K-609KAWS | Amazon Redshift | Azure | Cloud Computing | Data ModelingFlexible working hours | Sabbatical | Shared parental leave | Study assistance | Wellbeing initiativesSenior-level Full TimeSouth Africa - Johannesburg10d ago