Data Engineer
4 Merchant Place, 1 Fredman Drive, Sandton, Johannesburg, 2196, South Africa
ZAR 420K-609K (estimate) Mid-level Full Time
Tasks
- Assemble large datasets from source systems
- Build and optimize data pipeline architecture
- Design and maintain logical and physical data models
- Develop ETL pipelines and ETL routines
- Implement data extraction, transformation, and loading
- Implement data governance and access security
- Maintain improve and validate data quality
- Monitor performance and tune queries
- Perform data cleaning and manipulation in operational databases
- Run data migrations across databases and servers
- Support analytics and business intelligence delivery
- Troubleshoot data issues and perform root cause analysis
- Write SQL scripts stored procedures functions and views
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Automated testing | Azkaban | Backup | C++ | Cassandra | Continuous Deployment | Data Governance | Data Modeling | Data Quality | Data Warehousing | Disaster Recovery | Domo | EC2 | EMR | ETL | Hadoop | Java | Kafka | Luigi | Metadata Management | MySQL | NoSQL | Oracle | Performance Tuning | PostgreSQL | Python | Query Performance Tuning | Query performance | RDS | Redshift | SQL | SSIS | Scala | Shell | Spark | Storm | T-SQL | Tableau
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Machine Learning Engineer (Remote in South Africa) ZAR 441K-576KAWS | AWS Lambda | Amazon SageMaker | Apache Spark | CI/CDAdoption Assistance | Certification completion bonus | Certification reimbursement | Tuition reimbursementMid-level Full TimeCape Town, South Africa R1d ago
-
Data Engineer ZAR 348K-420KAWS | Azure | Cloud Architecture | Data Lake | Data LakehouseHybrid work policyMid-level Full TimeJohannesburg, SA, ZA1d ago
-
AIX | Amazon Web Services | Azure | Backup and Recovery | Brocade SANSenior-level Full TimeRivonia, South Africa2d ago
-
Data Modeling | Microsoft Excel | PostgreSQL | Power BI | PythonBig data analytics industry exposure | Collaborative small team culture | Full-time permanent positionEntry-level Full TimeKnysna, South Africa2d ago
-
Data Engineer: Ingestions (Group Data Platform) ZAR 400K-480KAccess Control | Access Management | Active Directory | Containerization | Data IngestionCollaborative work environment | Continuous learning culture | Ownership mindsetMid-level Full TimeBellville, Western Cape, ZA2d ago
-
Data Engineer II ZAR 360K-451KAbinitio | Automated Deployment | Control-M | Data Governance | Data MartsMid-level Full Time5 Merchant Place, 9 Fredman Drive, …2d ago
-
Senior Data Engineer ZAR 540K-675KAWS | Airflow | Amazon Redshift | Apache Flink | Apache SparkFlexible work practices | Remote-firstSenior-level Full TimePortugal; South Africa R3d ago
-
Mid-level Full TimeBrackenfell, ZA3d ago
-
Data Engineer III ZAR 504K-609KAWS | Amazon Redshift | Automated testing | Azure | Cloud servicesFlexible working hours | Sabbatical | Shared parental leave | Study assistance | Wellbeing initiativesSenior-level Full TimeSouth Africa - Johannesburg3d ago
-
Data Engineer-3 ZAR 530K-670KAbinitio | Abinitio architecture | Abinitio graph development | Agile | Code reviewMid-level Full TimeFNB Building, 1 Enterprise Road, Fairland, …3d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time project workSenior-level Full TimeSouth Africa - Remote R3d ago
-
Data Engineer III ZAR 504K-609KAWS | Amazon Redshift | Azure | Cloud Computing | Data ModelingFlexible working hours | Sabbatical | Shared parental leave | Study assistance | Wellbeing initiativesSenior-level Full TimeSouth Africa - Johannesburg3d ago
-
AWS | Amazon Redshift | BigQuery | CI/CD | Cloud PlatformsSenior-level Full TimeJohannesburg, South Africa4d ago
-
Data Testing | Data Warehousing | Data integration | Data pipeline | Database DesignMid-level Full TimeRandburg, GP, South Africa5d ago
-
Senior-level Full TimeSandton, South Africa5d ago
-
AWS | Cloud Computing | Data Architecture | Data Transformation | Data WarehousingMid-level Full TimeStellenbosch, WC, South Africa5d ago
-
Ab Initio | Adobe MarTech | Business Intelligence | Data Cleansing | Data GovernanceMid-level Full TimeSandton, GP, South Africa5d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQLMid-level Full TimePretoria, GP, South Africa5d ago
-
Entry-level Full TimeJohannesburg, GP, South Africa5d ago
-
Ab Initio | Change Management | Data APIs | Data Governance | Data ModelingSenior-level Full TimeSandton, South Africa5d ago
-
AWS | Apache Spark | Data Governance | Data Lake | Data PrivacyContract employment | Remote workMid-level Full TimeCape Town, WC, South Africa5d ago
-
Senior-level Full TimeJohannesburg, GP, South Africa5d ago
-
Mid-level Full TimeJohannesburg, GP, South Africa5d ago
-
API Integration | Big Data | Cause analysis | Data Governance | Data ModelingSenior-level Full TimeJohannesburg, GP, South Africa5d ago
-
NumPy | Pandas | Python | SciPy | SymPyPart-time work | Project based workSenior-level FreelanceSouth Africa - Remote R6d ago