Data Engineer
Tasks
- Build data integration workflows
- Collaborate with data scientists and analysts
- Deliver data for business performance
- Design data pipelines
- Develop ETL processes
- Develop data lake solutions
- Ensure data quality and integrity
- Implement data architecture
- Manage data delivery roadmap
- Monitor data pipeline performance
- Stay updated on data engineering trends
- Test and validate data
- Troubleshoot pipeline reliability
- Write SQL queries
Perks/Benefits
Skills/Tech-stack
AWS | Azure | Cloud Computing | Data Architecture | Data Lake | Data Lakehouse | Data Pipelines | Data Quality | Data Warehousing | Data integration | Databricks | ETL | Graph Databases | Java | Multi-tenant | Multi-tenant architecture | NoSQL | Oracle | Oracle Cloud | Orchestration | Python | SQL | Scala | Streaming Analytics | Tenant architecture | Vector Databases
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Roles
Related jobs
-
AI machine learning | AWS | Access Control | Asana | AzureHybrid customer facing opportunities | Remote workSenior-level Full TimeArgentina - Buenos Aires2d ago
-
Senior Data Engineer ZAR 1100K-1200KAPI | Apache Flink | Apache Spark | Apache Spark Streaming | Azure DataSenior-level Full TimeSouth Africa3d ago
-
Data Engineer ZAR 300K-420KAWS | Apache Airflow | Azure | Azure Data | Azure Data LakeFlexible team culture | Inclusive and diverse workplace | Support for employment equityMid-level Full TimeCenturion, GP, South Africa3d ago
-
Specialist - Data Engineer.MTN Software Solutions ZAR 464K-480KApache Hadoop | Apache Kafka | Apache Spark | Data Modeling | Data PipelinesMid-level Full TimeRoodepoort, Gauteng, South Africa4d ago
-
Blue-Green Deployment | Blue/green | CI/CD | CUDA | CUDA optimizationFully remote | Remote work flexibilitySenior-level Full TimeSouth Africa R4d ago
-
Cloud Data Engineers (OVA5720) ZAR 348K-420KAPI Integration | Apache Spark | Azure Data | Azure Data Factory | Azure EventHybrid work modelMid-level Full TimeJohannesburg, South Africa4d ago
-
Asana | Google Workspace | LLM | Prompt engineering | PythonFlexible time zone collaboration | Remote workMid-level Full TimeArgentina - Buenos Aires5d ago
-
Senior-level Full TimeCape Town6d ago
-
Data Engineer ZAR 396K-456KAPI Development | AWS | Apache Spark | Automation | CI/CDCareer development opportunities | Employee discounts | Hybrid working | Paid sabbaticals | Paid time offSenior-level Full TimeCape Town, Western Cape, South Africa R6d ago
-
Data Engineer ZAR 780K-920K.NET | Analysis Services | Apache Storm | Azure Data Factory | BashHybrid workSenior-level Full TimeJohannesburg, South Africa6d ago
-
IDM Data Engineer ZAR 420K-420KData Analysis | Data Pipelines | Governance Risk | Governance Risk and Controls | Metadata governanceMid-level Full TimeJohannesburg, ZA7d ago
-
Apache Airflow | Apache Atlas | Apache NiFi | Azure Data | Azure Data FactoryMid-level Full TimeJohannesburg, South Africa8d ago
-
Principal Clinical Data Engineer - based in South Africa ZAR 663K-663K21 CFR | 21 CFR Part 11 | CFR Part 11 | Cause analysis | Clinical dataSenior-level Full TimeSouth Africa-Bloemfontein-Remote R9d ago
-
Mid-level Full TimeBellville, South Africa10d ago
-
Senior-level Full TimeCape Town, South Africa10d ago
-
Airflow | Amazon Redshift | BigQuery | CI/CD | ChromaDBFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R10d ago
-
AWS S3 | Azure | Cloud Integration | Data Governance | Data LineageSenior-level Full TimeCape Town, South Africa11d ago
-
Application Monitoring | Data Analysis | Data Quality | Data pipeline | ETLSenior-level Full TimePretoria, South Africa11d ago
-
Mid-level Full TimePretoria, South Africa11d ago
-
Senior-level Full TimeJohannesburg, South Africa11d ago
-
(1731) Data Scientist and AI Engineer - BSTD ZAR 720K-780KAPI Development | Amazon Web Services | Apache Hadoop | Apache Spark | DB2Senior-level Full TimePretoria, South Africa11d ago
-
(1728) Data Engineer - BSTD ZAR 745K-900KAnalytics enablement | Apache Spark | Application Programming | Application Programming Interfaces | C SharpSenior-level Full TimePretoria, South Africa11d ago
-
Senior-level Full TimeWC, South Africa11d ago
-
Senior-level Full TimeWC, South Africa11d ago
-
Senior Generative AI Engineer ZAR 603K-650KAI Governance | AI Security | AWS | Azure | Cloud PlatformsContinuous learning and development | Mentorship and team growthSenior-level Full TimeWC, South Africa11d ago