Data Engineer
Tasks
- Build ETL processes
- Collaborate with data scientists and analysts
- Design, develop, and maintain scalable data pipelines
- Develop and maintain data integration workflows
- Ensure data quality and integrity testing and validation
- Implement strategic data architecture for business
- Manage data delivery roadmap
- Monitor and troubleshoot data pipeline performance and reliability
- Stay up to date with data engineering industry trends
- Write SQL queries for data extraction and transformation
Perks/Benefits
Skills/Tech-stack
AWS | Azure | Cloud Architecture | Data Lake | Data Lakehouse | Data Quality | Data Warehousing | Data integration | Data pipeline | Databricks | ETL | Graph Databases | Java | NoSQL | Oracle | Python | SQL | Scala | Streaming Data | Vector Databases
Education
Roles
Related jobs
-
Machine Learning Engineer (Remote in South Africa) ZAR 441K-576KAWS | AWS Lambda | Amazon SageMaker | Apache Spark | CI/CDAdoption Assistance | Certification completion bonus | Certification reimbursement | Tuition reimbursementMid-level Full TimeCape Town, South Africa R1d ago
-
Mid-level Full Time4 Merchant Place, 1 Fredman Drive, …1d ago
-
AIX | Amazon Web Services | Azure | Backup and Recovery | Brocade SANSenior-level Full TimeRivonia, South Africa2d ago
-
Data Modeling | Microsoft Excel | PostgreSQL | Power BI | PythonBig data analytics industry exposure | Collaborative small team culture | Full-time permanent positionEntry-level Full TimeKnysna, South Africa2d ago
-
Data Engineer: Ingestions (Group Data Platform) ZAR 400K-480KAccess Control | Access Management | Active Directory | Containerization | Data IngestionCollaborative work environment | Continuous learning culture | Ownership mindsetMid-level Full TimeBellville, Western Cape, ZA2d ago
-
Data Engineer II ZAR 360K-451KAbinitio | Automated Deployment | Control-M | Data Governance | Data MartsMid-level Full Time5 Merchant Place, 9 Fredman Drive, …2d ago
-
Senior Data Engineer ZAR 540K-675KAWS | Airflow | Amazon Redshift | Apache Flink | Apache SparkFlexible work practices | Remote-firstSenior-level Full TimePortugal; South Africa R3d ago
-
Mid-level Full TimeBrackenfell, ZA3d ago
-
Data Engineer III ZAR 504K-609KAWS | Amazon Redshift | Automated testing | Azure | Cloud servicesFlexible working hours | Sabbatical | Shared parental leave | Study assistance | Wellbeing initiativesSenior-level Full TimeSouth Africa - Johannesburg3d ago
-
Data Engineer-3 ZAR 530K-670KAbinitio | Abinitio architecture | Abinitio graph development | Agile | Code reviewMid-level Full TimeFNB Building, 1 Enterprise Road, Fairland, …3d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time project workSenior-level Full TimeSouth Africa - Remote R3d ago
-
Data Engineer III ZAR 504K-609KAWS | Amazon Redshift | Azure | Cloud Computing | Data ModelingFlexible working hours | Sabbatical | Shared parental leave | Study assistance | Wellbeing initiativesSenior-level Full TimeSouth Africa - Johannesburg3d ago
-
AWS | Amazon Redshift | BigQuery | CI/CD | Cloud PlatformsSenior-level Full TimeJohannesburg, South Africa4d ago
-
Data Testing | Data Warehousing | Data integration | Data pipeline | Database DesignMid-level Full TimeRandburg, GP, South Africa5d ago
-
Senior-level Full TimeSandton, South Africa5d ago
-
AWS | Cloud Computing | Data Architecture | Data Transformation | Data WarehousingMid-level Full TimeStellenbosch, WC, South Africa5d ago
-
Ab Initio | Adobe MarTech | Business Intelligence | Data Cleansing | Data GovernanceMid-level Full TimeSandton, GP, South Africa5d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQLMid-level Full TimePretoria, GP, South Africa5d ago
-
Entry-level Full TimeJohannesburg, GP, South Africa5d ago
-
Ab Initio | Change Management | Data APIs | Data Governance | Data ModelingSenior-level Full TimeSandton, South Africa5d ago
-
AWS | Apache Spark | Data Governance | Data Lake | Data PrivacyContract employment | Remote workMid-level Full TimeCape Town, WC, South Africa5d ago
-
Senior-level Full TimeJohannesburg, GP, South Africa5d ago
-
Mid-level Full TimeJohannesburg, GP, South Africa5d ago
-
API Integration | Big Data | Cause analysis | Data Governance | Data ModelingSenior-level Full TimeJohannesburg, GP, South Africa5d ago
-
NumPy | Pandas | Python | SciPy | SymPyPart-time work | Project based workSenior-level FreelanceSouth Africa - Remote R6d ago