Senior Data Engineer
Tasks
- Collaborate with client data owners and enterprise architects on integrations
- Define canonical data models and transformation logic
- Design and build data ingestion pipelines
- Ensure data quality lineage observability and pipeline reliability
- Establish ingestion and modelling patterns and standards
- Implement governance and security measures
- Mentor and review mid level and junior data engineers
Perks/Benefits
- N/A
Skills/Tech-stack
API | Apache Flink | Apache Spark | Apache Spark Streaming | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Governance | Data Lake Storage | Data Lineage | Data Modeling | Data Quality | Kafka | Lakehouse | Microsoft Azure | Mqtt | Observability | Python | SFTP | SQL | Spark Streaming | Streaming | Synapse Analytics
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeMidrand, Gauteng3d ago
-
Lead Data and AI Integration Specialist ZAR 540K-720KAWS | Anomaly Detection | Authentication | Automation | AzureEqual opportunity workplace | Hybrid working model | Travel to primary office as requiredSenior-level Full Time15 Alice Lane, South Africa R3d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Glue Catalog | AWS LakeAgile collaboration | Flexible work location | Fully remote | Technical autonomySenior-level Contract Full TimeSouth Africa R3d ago
-
Mid-level Full TimeJohannesburg, South Africa4d ago
-
AI RMF | API Security | ART | AWS Bedrock | Access GovernanceSenior-level Full TimeAbsa 270 Republic Road, South Africa5d ago
-
Analytics Engineer (Data Platform) ZAR 464K-500KAgile | Algorithms | BI reporting | BigQuery | CI/CDBirthday leave | Confidential counselling | Financial guidance | Flexible total remuneration package | Free counsellingMid-level Full TimeCape Town5d ago
-
Analytics Engineer (Data Platform) ZAR 464K-500KAgile | Algorithms | BigQuery | CI/CD | Data CleansingBirthday leave | Confidential counselling | Financial guidance | Free parking | Hybrid working modelMid-level Full TimeCape Town5d ago
-
APIs | Access Control | Agentic AI | Audit Logging | CI/CDAnnual offsite gatherings | Coworking allowance | Dependent coverage support | Employee equity | Flexible, asynchronous workMid-level Full TimeSouth Africa R5d ago
-
Big Data Support Engineer ZAR 300K-396KApache Spark | Data Modeling | Database Design | HDFS | HadoopEntry-level Full Time15 Alice Lane, South Africa6d ago
-
AI Solution Engineer ZAR 600K-720KAutomation workflows | Azure AI | Copilot Studio | Data Processing | GitHub CopilotMid-level Full TimeCape Town, South Africa Office6d ago
-
API Management | AWS Lambda | Amazon Web Services | Git | Language ModelsAgile working model methodology | Flexible working hours | Global team collaboration | High work life balance | Modern officesMid-level Full TimePretoria, South Africa6d ago
-
AWS | Apache Spark | Azure | Business Intelligence | CI/CDSenior-level Full TimeCape Town, South Africa6d ago
-
API Integration | Apache Spark | Big Data | Cause analysis | Data ArchitectureSenior-level Full TimeJohannesburg, GP, South Africa6d ago
-
Senior AI Engineer ZAR 900K-1200KAI Agents | API Development | AWS | Apache Spark | AzureHybrid work | Remote work | Sponsorship for technical events | Training and developmentSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa10d ago
-
Senior AI Engineer ZAR 900K-1200KAI Agents | API Development | AWS | Apache Spark | AzureHybrid work | Remote work | Training sponsorship for technical eventsSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa10d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Entrepreneurial team | Flexible, hands-off management | Friendly laid-back atmosphere | Remote friendly distributed workMid-level Full TimeCape Town, South Africa11d ago
-
AI machine learning | AWS | Access Controls | Access Management | AsanaRemote workSenior-level Full TimeArgentina - Buenos Aires12d ago
-
API Connect | API Governance | API Security | AWS | Ab InitioRotational standby supportMid-level Full TimeJohannesburg, South Africa12d ago
-
Senior-level Full TimePretoria, South Africa13d ago
-
Agile | Apache Kafka | Avro | CI/CD | Confluent PlatformCollaborate with global engineering teams | Continuous learning and professional development | Exposure to large-scale distributed systems | Flexible hybrid working model | Modern Agile development environmentSenior-level Full TimePretoria, South Africa13d ago
-
Machine Learning Engineer UAH 1377K-1549KData Preparation | GPU Computing | JAX | Machine Learning | Machine Learning EngineeringSenior-level Full TimeEurope13d ago
-
Senior-level Full TimeCape Town16d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeJohannesburg, South Africa16d ago
-
Entry-level Full TimeStellenbosch, ZA17d ago
-
Data Analytics Technical Specialist ZAR 780K-900KAccess Management | Analysis Services | Azure DevOps | Azure SQL | Azure SQL DatabaseFlexible working | Hybrid workingSenior-level Full TimeCape Town, South Africa17d ago