Data Engineer
Cape Town, South Africa
ZAR 420K-500K (estimate) Mid-level Full Time
Tasks
- Develop data pipelines for real-time and batch processing
- Document data workflows and provide support for data issues
- Ensure data quality and reliability across pipelines
- Implement data streaming solutions with Kafka or RabbitMQ
- Integrate data from multiple sources into centralized systems
- Monitor and troubleshoot data pipelines for performance
- Support ETL ELT workflows for data integration and transformation
- Write and optimize SQL queries, stored procedures, and scripts
Perks/Benefits
- Employee assistance programme
- Financial Services Assistance
- Free daily meals
- Free massages on-site
- Free on-site gym
- Group Life Cover
- Leadership training
- Learning and development programmes
- Medical aid subsidy
- On-site barista
- Referral bonus
- Team socials
Skills/Tech-stack
Apache Airflow | Apache Spark | Cloud Platforms | Data Governance | Data Modeling | Data Streaming | Docker | ELT | ETL | Hadoop | JSON | Java | Kafka | Parquet | Python | RabbitMQ | SQL
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Data Engineer (Azure) ZAR 840K-1200KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Cloud ArchitectureRemote work | Stakeholder engagementSenior-level ContractJohannesburg, South Africa16h ago
-
Mid-level Full Time4 Merchant Place, 1 Fredman Drive, …1d ago
-
Optimization Engineer ZAR 480K-540K5G-NR | Actix | Air interface | Atoll | Drive testGlobal team collaboration | Knowledge sharing | Mentorship | On-call supportMid-level Full TimeJohannesburg,Gauteng,South Africa1d ago
-
Data Engineer ZAR 840K-1170KAzure Synapse | Azure Synapse Analytics | CDC | CI/CD | Change Data CaptureSenior-level Full TimeSandton - 1 Discovery Place, GP, …2d ago
-
Junior Specialist: Analytics & Data Science ZAR 240K-288KAI | Agile | Dashboard Development | Data Cleansing | Data MiningEntry-level Full TimeAbsa Towers West, South Africa2d ago
-
Machine Learning Engineer ZAR 264K-360KAutocomplete | Classification | Cloud platform | Embeddings | Google CloudMid-level Full TimeJohannesburg, Gauteng, South Africa3d ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Remote or distributed workMid-level Full TimeCape Town, South Africa3d ago
-
Access Control | Airflow | Amazon Redshift | Authentication | BigQueryFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R3d ago
-
Data Architect Engineer ZAR 840K-1100KAWS Glue | AWS Lake Formation | Amazon Redshift | Amazon S3 | AtScaleSenior-level Full TimeRoodepoort, GP, South Africa4d ago
-
Mid-level ContractJohannesburg, South Africa4d ago
-
Senior-level Full TimeSandton, South Africa4d ago
-
AI Implementation Expert ZAR 745K-860KAPI Integration | Azure Machine Learning | Azure OpenAI | ChatGPT | Copilot StudioSenior-level Full TimeSouth Africa4d ago
-
AI Implementation Expert ZAR 745K-860KAPI Integration | Azure AI | Azure Machine Learning | Azure OpenAI | ChatGPTSenior-level Full TimeSouth Africa4d ago
-
Airflow | Apache Superset | BigQuery | Cloud Migration | Cloud platformAnnual vacation | English language discounts | Fully remote | Health reimbursement | International engineering cultureSenior-level Full TimeSouth Africa R4d ago
-
AI/ML | AWS | Access Control | Asana | AzureRemote work | Video interview requirementSenior-level Full TimeArgentina - Buenos Aires5d ago
-
AWS | Amazon Redshift | Apache Airflow | Apache Spark | BigQueryFlexible time zones | Remote workMid-level Full TimeSouth Africa - Cape Town5d ago
-
Senior Quantitative Analyst ZAR 745K-840KAgile | Azure Databricks | CDC | Data Governance | Data LineageSenior-level Full TimeJohannesburg, ZA6d ago
-
AWS | Apache Spark | BigQuery | C++ | CI/CDSenior-level Full TimePretoria, South Africa6d ago
-
A/B | A/B Testing | AWS | Amazon Athena | B testingCareer development | Collaborative & Inclusive Culture | Cross-functional collaboration | Flexible working environment | Learning and professional growthSenior-level Full TimeSouth Africa6d ago
-
AWS | Amazon Redshift | Amazon S3 | Bitbucket | ConfluenceRotational training programEntry-level Contract Full TimeJohannesburg, GP, South Africa6d ago
-
AI Engineer (Data Scientist) ZAR 700K-860KAI Foundry | AML | AWS Bedrock | AWS Bedrock Agents | Agentic AIAI practitioner community participation | Mentoring junior data scientists | Responsible AI governance forum involvementSenior-level Full Time15 Alice Lane, South Africa7d ago
-
Senior Data Engineer (Databricks & Cloud Data Platforms) ZAR 875K-1100KAWS Glue | Amazon Redshift | Amazon S3 | Apache Spark | AzureMentorship | Professional development | Sponsored events | Technical communitySenior-level Contract Full TimeJohannesburg, Gauteng, South Africa7d ago
-
Senior Data Engineer (Databricks & Cloud Data Platforms) ZAR 875K-1100KAWS Glue | Airflow | Amazon Redshift | Amazon S3 | AzureMentorship | Ongoing professional development | Sponsored events | Technical communitiesSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa7d ago
-
AWS | Azure | CI/CD | Data Governance | Data LakesConference access | Fully remote work | High-impact projects | International collaboration | Modern work equipmentMid-level Full TimeSouth Africa R7d ago
-
ATS platforms | Application Management | Data Engineering | Data Pipelines | ETLContractor workforce support experience | Global delivery exposure | Managed service experience | Mentoring opportunitiesMid-level ContractJohannesburg, South Africa8d ago