Data Engineer
A ZAR 480K-600K (estimate) Mid-level Full Time
Tasks
- Collaborate with data architects and business stakeholders to define data requirements and models
- Continuously improve data environment design and efficiencies
- Deliver business benefits from advanced analytics
- Design and optimize data schemas tables and indexes
- Develop ETL and ELT processes
- Develop data pipelines data lakes and data warehouses
- Develop end to end data solutions on data platform
- Ensure scalability of data solutions
- Implement CI CD pipelines for data solution deployments
- Implement data integration solutions
- Implement data security and privacy measures
- Monitor and troubleshoot data pipelines
- Perform data profiling data cleansing and data quality assessments
- Provide recommendations for continuous improvement
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Cleansing | Data Factory | Data Lake Storage | Data Lakes | Data Modeling | Data Pipelines | Data Privacy | Data Quality | Data Security | Data Warehousing | Data integration | Data profiling | ELT | ETL | Microsoft Azure | POPIA | Project Management | Python | SQL | SQL Database | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Roles
Related jobs
-
AWS | Amazon Redshift | BigQuery | CI/CD | Cloud PlatformsSenior-level Full TimeJohannesburg, South Africa9h ago
-
Data Testing | Data Warehousing | Data integration | Data pipeline | Database DesignMid-level Full TimeRandburg, GP, South Africa1d ago
-
Senior-level Full TimeSandton, South Africa1d ago
-
AWS | Cloud Computing | Data Architecture | Data Transformation | Data WarehousingMid-level Full TimeStellenbosch, WC, South Africa1d ago
-
Ab Initio | Adobe MarTech | Business Intelligence | Data Cleansing | Data GovernanceMid-level Full TimeSandton, GP, South Africa1d ago
-
Entry-level Full TimeJohannesburg, GP, South Africa1d ago
-
Ab Initio | Change Management | Data APIs | Data Governance | Data ModelingSenior-level Full TimeSandton, South Africa1d ago
-
AWS | Apache Spark | Data Governance | Data Lake | Data PrivacyContract employment | Remote workMid-level Full TimeCape Town, WC, South Africa1d ago
-
Senior-level Full TimeJohannesburg, GP, South Africa1d ago
-
Mid-level Full TimeJohannesburg, GP, South Africa1d ago
-
API Integration | Big Data | Cause analysis | Data Governance | Data ModelingSenior-level Full TimeJohannesburg, GP, South Africa1d ago
-
NumPy | Pandas | Python | SciPy | SymPyPart-time work | Project based workSenior-level FreelanceSouth Africa - Remote R2d ago
-
API Integration | Generative AI | Language Models | Large Language Models | Machine LearningAutonomy | Rapid iteration culture | Remote workSenior-level Full TimeCape Town, Western Cape, South Africa3d ago
-
Canonical Data Modelling | Data Management | Data Modelling | Data Normalization | Data QualityMid-level Full TimeStellenbosch, WC, South Africa3d ago
-
Ab Initio | Azure | Data Governance | Data Modeling | Data SecuritySenior-level Full TimeSandton, South Africa3d ago
-
Advanced Excel | Azure Synapse | Azure Synapse Analytics | Data Analysis | Data GovernanceSenior-level Full TimeJohannesburg, GP, South Africa3d ago
-
AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2 | Amazon S3Senior-level Full TimeCape Town, Western Cape, South Africa3d ago
-
APIs | Data Engineering | Data Pipelines | Data Streams | JSONSenior-level Full TimeCape Town, WC, South Africa3d ago
-
Automation | Credit Risk | Credit Scoring | Credit Underwriting | Credit risk modelingSenior-level Full TimeJohannesburg, GP, South Africa3d ago
-
A/B | A/B Testing | AWS | Amazon SageMaker | AutomlSenior-level Full TimeJohannesburg, South Africa3d ago
-
Analytics | Apache Kafka | Big Data | Cluster tuning | ContainerizationRemote workSenior-level Full TimeJohannesburg, GP, South Africa R3d ago
-
Senior-level Full TimeDurban North, KZN, South Africa3d ago
-
API Development | AWS | Amazon SageMaker | Apache Spark | AzureSenior-level Full TimeJohannesburg, South Africa3d ago
-
API Development | AWS | Amazon SageMaker | Apache Spark | CI/CDSenior-level Full TimeCape Town, Western Cape, South Africa3d ago
-
Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeJohannesburg, GP, South Africa3d ago