Data Engineer (Mid-Senior)
Cape Town, Western Cape, South Africa
A ZAR 840K-960K (estimate) Senior-level Full Time
Tasks
- Analyze client requirements
- Build data integration frameworks
- Build infrastructure for data pipelines
- Collaborate with product team and stakeholders
- Conduct peer code reviews
- Create and maintain technical documentation
- Design data layers for big data
- Develop and test data pipelines
- Ensure data integrity and accuracy
- Ensure data pipeline quality
- Follow software development life cycle
- Log change requests
- Manage GCP costs
- Manage standby rotation
- Perform data extraction transformation loading
- Provide status updates
- Support existing data solutions
Perks/Benefits
Skills/Tech-stack
Automated data quality | Batch Processing | Big Data | CI/CD | Cloud Storage | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Data Security | Data integration | Data pipeline | DevOps | ELT | ETL | Event Streaming | GCP | Infrastructure as Code | Monitoring | Performance Monitoring | Python | Real Time | Real-time Processing | SQL | Time processing | “as-code”
Education
N/A
Roles
Related jobs
-
Azure / AWS Cloud Engineer for Data Science ZAR 840K-1100KAmazon EC2 | Amazon Web Services | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa R3d ago
-
Azure / AWS Cloud Engineer for Data Science ZAR 840K-1100KARM | Amazon EC2 | Amazon Route 53 | Amazon Web Services | Azure Key VaultSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa R3d ago
-
AWS | Computer Vision | Entity recognition | FFmpeg | Generative AISenior-level Full TimeCape Town, Western Cape, South Africa3d ago
-
Senior-level Full TimeCape Town, Western Cape, South Africa4d ago
-
AI LLM Solutions Architect ZAR 720K-800KAWS | Agile | Architecture Documentation | Architecture governance | AzureSenior-level Full TimeCape Town, Western Cape, South Africa4d ago
-
Data Scientist (Senior) ZAR 840K-960KAWS Redshift | Amazon S3 | Apache Airflow | Azure Data | Azure Data FactorySenior-level Full TimeBellville, South Africa5d ago
-
Senior-level Full TimeBellville, South Africa5d ago
-
AI Technology and Innovation Engineer ZAR 840K-1100KAPI Development | Amazon Web Services | Artificial Intelligence | Azure | Cloud ComputingHybrid workSenior-level Full TimeJohannesburg, South Africa6d ago
-
Junior Database Engineer ZAR 216K-264KAmazon Web Services | Apache Airflow | Cloud platform | ETL | Google CloudDiscounted groceries | Financial wellness support | Gym or wellness benefits | Health insurance | Mental health counselingEntry-level Full TimeUmhlanga, KwaZulu-Natal, South Africa6d ago
-
C# | C++ | Language Models | Large Language Models | Machine LearningFully remote | Work during US business hoursMid-level Full TimeEgypt R6d ago
-
Airbyte | Amazon Redshift | BigQuery | CTEs | DBTFlexible schedule | Remote workMid-level Full TimeEgypt R6d ago
-
Senior Data Engineer (Azure) ZAR 840K-1200KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Cloud ArchitectureRemote work | Stakeholder engagementSenior-level ContractJohannesburg, South Africa6d ago
-
CI/CD | Cloud Storage | Data Pipelines | Data orchestration | Distributed SystemsAsynchronous collaboration | Career growth | Conference stipend | Hardware stipend | Professional learning stipendSenior-level Full TimeSouth Africa R6d ago
-
Senior Data Engineer ZAR 550K-675KAWS | Data Architecture | Data Compliance | Data Engineering | Data GovernanceBirthday leave | Community initiatives | Generous paid annual leave | Group risk insurance | Healthy breakfastSenior-level Full TimeCape Town6d ago
-
Optimization Engineer ZAR 480K-540K5G-NR | Actix | Air interface | Atoll | Drive testGlobal team collaboration | Knowledge sharing | Mentorship | On-call supportMid-level Full TimeJohannesburg,Gauteng,South Africa7d ago
-
Data Engineer ZAR 840K-1170KAzure Synapse | Azure Synapse Analytics | CDC | CI/CD | Change Data CaptureSenior-level Full TimeSandton - 1 Discovery Place, GP, …8d ago
-
Machine Learning Engineer ZAR 264K-360KAutocomplete | Classification | Cloud platform | Embeddings | Google CloudMid-level Full TimeJohannesburg, Gauteng, South Africa8d ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Remote or distributed workMid-level Full TimeCape Town, South Africa9d ago
-
Access Control | Airflow | Amazon Redshift | Authentication | BigQueryFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R9d ago
-
Data Architect Engineer ZAR 840K-1100KAWS Glue | AWS Lake Formation | Amazon Redshift | Amazon S3 | AtScaleSenior-level Full TimeRoodepoort, GP, South Africa10d ago
-
Mid-level ContractJohannesburg, South Africa10d ago
-
Senior-level Full TimeSandton, South Africa10d ago
-
AI Implementation Expert ZAR 745K-860KAPI Integration | Azure Machine Learning | Azure OpenAI | ChatGPT | Copilot StudioSenior-level Full TimeSouth Africa10d ago
-
AI Implementation Expert ZAR 745K-860KAPI Integration | Azure AI | Azure Machine Learning | Azure OpenAI | ChatGPTSenior-level Full TimeSouth Africa10d ago
-
AI/ML | AWS | Access Control | Asana | AzureRemote work | Video interview requirementSenior-level Full TimeArgentina - Buenos Aires11d ago