Senior Data Engineer
Tasks
- Build and maintain data pipelines
- Collaborate with product and analytics teams
- Define data requirements with stakeholders
- Design and maintain data architectures
- Develop and maintain data models
- Develop data applications
- Drive improvements in data engineering tools and workflows
- Ensure AI ML readiness with high quality datasets
- Ensure data quality, integrity, and availability
- Identify and implement automation opportunities
- Implement data governance, security, and compliance
- Maintain documentation for data pipelines
- Mentor junior data engineers
- Monitor and troubleshoot data issues
- Optimize data storage and processing performance
- Support business intelligence and analytics
- Support system upgrades and migrations
Perks/Benefits
- Birthday leave
- Community initiatives
- Generous paid annual leave
- Group risk insurance
- Healthy breakfast
- Healthy lunches
- Healthy snacks
- Learning and development opportunities
- Medical aid subsidy
- Mentorship programme
- Monthly team connects
- On-site barista
- Quarterly team building
Skills/Tech-stack
AWS | Data Architecture | Data Compliance | Data Engineering | Data Governance | Data Modeling | Data Quality | Data Security | Data Warehousing | Data pipeline | Databricks | Python | SQL | Streaming
Education
N/A
Roles
Related jobs
-
C# | C++ | Language Models | Large Language Models | Machine LearningFully remote | Work during US business hoursMid-level Full TimeEgypt R14h ago
-
Airbyte | Amazon Redshift | BigQuery | CTEs | DBTFlexible schedule | Remote workMid-level Full TimeEgypt R19h ago
-
Senior Data Engineer (Azure) ZAR 840K-1200KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Cloud ArchitectureRemote work | Stakeholder engagementSenior-level ContractJohannesburg, South Africa21h ago
-
Junior Software Analytics Engineer ZAR 216K-264KAPI Integration | Alerting | Android | Authentication | AuthorizationEntry-level Full TimeCape Town22h ago
-
Junior Software Analytics Engineer ZAR 216K-264KAPIs | Alerting | Android | Android apps | AuthenticationDirect feedback culture | Flexible total remuneration package | Great work environment | Professional developmentEntry-level Full TimeCape Town22h ago
-
CI/CD | Cloud Storage | Data Pipelines | Data orchestration | Distributed SystemsAsynchronous collaboration | Career growth | Conference stipend | Hardware stipend | Professional learning stipendSenior-level Full TimeSouth Africa R23h ago
-
Mid-level Full Time4 Merchant Place, 1 Fredman Drive, …1d ago
-
Optimization Engineer ZAR 480K-540K5G-NR | Actix | Air interface | Atoll | Drive testGlobal team collaboration | Knowledge sharing | Mentorship | On-call supportMid-level Full TimeJohannesburg,Gauteng,South Africa2d ago
-
Data Engineer ZAR 840K-1170KAzure Synapse | Azure Synapse Analytics | CDC | CI/CD | Change Data CaptureSenior-level Full TimeSandton - 1 Discovery Place, GP, …2d ago
-
Junior Specialist: Analytics & Data Science ZAR 240K-288KAI | Agile | Dashboard Development | Data Cleansing | Data MiningEntry-level Full TimeAbsa Towers West, South Africa2d ago
-
Machine Learning Engineer ZAR 264K-360KAutocomplete | Classification | Cloud platform | Embeddings | Google CloudMid-level Full TimeJohannesburg, Gauteng, South Africa3d ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Remote or distributed workMid-level Full TimeCape Town, South Africa3d ago
-
Access Control | Airflow | Amazon Redshift | Authentication | BigQueryFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R3d ago
-
Data Architect Engineer ZAR 840K-1100KAWS Glue | AWS Lake Formation | Amazon Redshift | Amazon S3 | AtScaleSenior-level Full TimeRoodepoort, GP, South Africa4d ago
-
Mid-level ContractJohannesburg, South Africa4d ago
-
Senior-level Full TimeSandton, South Africa4d ago
-
AI Implementation Expert ZAR 745K-860KAPI Integration | Azure Machine Learning | Azure OpenAI | ChatGPT | Copilot StudioSenior-level Full TimeSouth Africa5d ago
-
AI Implementation Expert ZAR 745K-860KAPI Integration | Azure AI | Azure Machine Learning | Azure OpenAI | ChatGPTSenior-level Full TimeSouth Africa5d ago
-
Airflow | Apache Superset | BigQuery | Cloud Migration | Cloud platformAnnual vacation | English language discounts | Fully remote | Health reimbursement | International engineering cultureSenior-level Full TimeSouth Africa R5d ago
-
AI/ML | AWS | Access Control | Asana | AzureRemote work | Video interview requirementSenior-level Full TimeArgentina - Buenos Aires5d ago
-
AWS | Amazon Redshift | Apache Airflow | Apache Spark | BigQueryFlexible time zones | Remote workMid-level Full TimeSouth Africa - Cape Town5d ago
-
Senior Quantitative Analyst ZAR 745K-840KAgile | Azure Databricks | CDC | Data Governance | Data LineageSenior-level Full TimeJohannesburg, ZA6d ago
-
AWS | Apache Spark | BigQuery | C++ | CI/CDSenior-level Full TimePretoria, South Africa6d ago
-
Amazon Web Services | Artificial Intelligence | Automation | Cloud Computing | Cloud platformLearning and development | Mentorship | Practical project experience | Rotational programEntry-level Contract Full TimeJohannesburg, GP, South Africa6d ago
-
A/B | A/B Testing | AWS | Amazon Athena | B testingCareer development | Collaborative & Inclusive Culture | Cross-functional collaboration | Flexible working environment | Learning and professional growthSenior-level Full TimeSouth Africa7d ago