Senior Data Engineer
Tasks
- Collaborate with client data owners and enterprise architects on integrations
- Define canonical data models and transformation logic
- Design and build data ingestion pipelines
- Ensure data quality lineage observability and pipeline reliability
- Establish ingestion and modelling patterns and standards
- Implement governance and security measures
- Mentor and review mid level and junior data engineers
Perks/Benefits
- N/A
Skills/Tech-stack
API | Apache Flink | Apache Spark | Apache Spark Streaming | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Governance | Data Lake Storage | Data Lineage | Data Modeling | Data Quality | Kafka | Lakehouse | Microsoft Azure | Mqtt | Observability | Python | SFTP | SQL | Spark Streaming | Streaming | Synapse Analytics
Education
N/A
Roles
Related jobs
-
AI machine learning | AWS | Access Control | Asana | AzureHybrid customer facing opportunities | Remote workSenior-level Full TimeArgentina - Buenos Aires2d ago
-
Data Engineer ZAR 300K-420KAWS | Apache Airflow | Azure | Azure Data | Azure Data LakeFlexible team culture | Inclusive and diverse workplace | Support for employment equityMid-level Full TimeCenturion, GP, South Africa3d ago
-
Specialist - Data Engineer.MTN Software Solutions ZAR 464K-480KApache Hadoop | Apache Kafka | Apache Spark | Data Modeling | Data PipelinesMid-level Full TimeRoodepoort, Gauteng, South Africa4d ago
-
Blue-Green Deployment | Blue/green | CI/CD | CUDA | CUDA optimizationFully remote | Remote work flexibilitySenior-level Full TimeSouth Africa R4d ago
-
Cloud Data Engineers (OVA5720) ZAR 348K-420KAPI Integration | Apache Spark | Azure Data | Azure Data Factory | Azure EventHybrid work modelMid-level Full TimeJohannesburg, South Africa4d ago
-
Asana | Google Workspace | LLM | Prompt engineering | PythonFlexible time zone collaboration | Remote workMid-level Full TimeArgentina - Buenos Aires5d ago
-
Senior-level Full TimeCape Town6d ago
-
Data Engineer ZAR 396K-456KAPI Development | AWS | Apache Spark | Automation | CI/CDCareer development opportunities | Employee discounts | Hybrid working | Paid sabbaticals | Paid time offSenior-level Full TimeCape Town, Western Cape, South Africa R6d ago
-
Data Engineer ZAR 780K-920K.NET | Analysis Services | Apache Storm | Azure Data Factory | BashHybrid workSenior-level Full TimeJohannesburg, South Africa6d ago
-
IDM Data Engineer ZAR 420K-420KData Analysis | Data Pipelines | Governance Risk | Governance Risk and Controls | Metadata governanceMid-level Full TimeJohannesburg, ZA7d ago
-
Apache Airflow | Apache Atlas | Apache NiFi | Azure Data | Azure Data FactoryMid-level Full TimeJohannesburg, South Africa8d ago
-
Principal Clinical Data Engineer - based in South Africa ZAR 663K-663K21 CFR | 21 CFR Part 11 | CFR Part 11 | Cause analysis | Clinical dataSenior-level Full TimeSouth Africa-Bloemfontein-Remote R9d ago
-
Mid-level Full TimeBellville, South Africa10d ago
-
Senior-level Full TimeCape Town, South Africa10d ago
-
Airflow | Amazon Redshift | BigQuery | CI/CD | ChromaDBFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R10d ago
-
AWS S3 | Azure | Cloud Integration | Data Governance | Data LineageSenior-level Full TimeCape Town, South Africa11d ago
-
Application Monitoring | Data Analysis | Data Quality | Data pipeline | ETLSenior-level Full TimePretoria, South Africa11d ago
-
Mid-level Full TimePretoria, South Africa11d ago
-
Data Engineer ZAR 300K-420KAWS | Azure | Cloud Computing | Data Architecture | Data LakeHybrid work policyMid-level Full TimeJohannesburg, SA, ZA11d ago
-
Senior-level Full TimeJohannesburg, South Africa11d ago
-
(1731) Data Scientist and AI Engineer - BSTD ZAR 720K-780KAPI Development | Amazon Web Services | Apache Hadoop | Apache Spark | DB2Senior-level Full TimePretoria, South Africa11d ago
-
(1728) Data Engineer - BSTD ZAR 745K-900KAnalytics enablement | Apache Spark | Application Programming | Application Programming Interfaces | C SharpSenior-level Full TimePretoria, South Africa11d ago
-
Senior-level Full TimeWC, South Africa11d ago
-
Senior-level Full TimeWC, South Africa11d ago
-
Senior Generative AI Engineer ZAR 603K-650KAI Governance | AI Security | AWS | Azure | Cloud PlatformsContinuous learning and development | Mentorship and team growthSenior-level Full TimeWC, South Africa11d ago