Senior Data Engineer
Tasks
- Build and maintain data pipelines
- Collaborate with product and analytics teams
- Define data requirements with stakeholders
- Design and maintain data architectures
- Develop and maintain data models
- Develop data applications
- Drive improvements in data engineering tools and workflows
- Ensure AI ML readiness with high quality datasets
- Ensure data quality, integrity, and availability
- Identify and implement automation opportunities
- Implement data governance, security, and compliance
- Maintain documentation for data pipelines
- Mentor junior data engineers
- Monitor and troubleshoot data issues
- Optimize data storage and processing performance
- Support business intelligence and analytics
- Support system upgrades and migrations
Perks/Benefits
- Birthday leave
- Community initiatives
- Generous paid annual leave
- Group risk insurance
- Healthy breakfast
- Healthy lunches
- Healthy snacks
- Learning and development opportunities
- Medical aid subsidy
- Mentorship programme
- Monthly team connects
- On-site barista
- Quarterly team building
Skills/Tech-stack
AWS | Data Architecture | Data Compliance | Data Engineering | Data Governance | Data Modeling | Data Quality | Data Security | Data Warehousing | Data pipeline | Databricks | Python | SQL | Streaming
Education
N/A
Roles
Related jobs
-
Apache Airflow | Apache Atlas | Apache NiFi | Azure Data | Azure Data FactoryMid-level Full TimeJohannesburg, South Africa1d ago
-
Principal Clinical Data Engineer - based in South Africa ZAR 663K-663K21 CFR | 21 CFR Part 11 | CFR Part 11 | Cause analysis | Clinical dataSenior-level Full TimeSouth Africa-Bloemfontein-Remote R3d ago
-
Mid-level Full TimeBellville, South Africa3d ago
-
Senior-level Full TimeCape Town, South Africa3d ago
-
Senior-level Full TimeNetcare Head Office, South Africa4d ago
-
Airflow | Amazon Redshift | BigQuery | CI/CD | ChromaDBFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R4d ago
-
AI machine learning | AWS | Access Controls | Access Management | AsanaCareer growth opportunities | Competitive compensation | Hybrid flexibility | Remote workSenior-level Full TimeArgentina - Buenos Aires4d ago
-
AWS S3 | Azure | Cloud Integration | Data Governance | Data LineageSenior-level Full TimeCape Town, South Africa4d ago
-
Application Monitoring | Data Analysis | Data Quality | Data pipeline | ETLSenior-level Full TimePretoria, South Africa4d ago
-
Benchmarking | Big Data | Cloud Computing | Databases | Distributed SystemsSenior-level Full TimeJohannesburg, South Africa4d ago
-
Senior-level Full TimeJohannesburg, South Africa4d ago
-
Analytics tools | Cloud Computing | Data platforms | Incident Management | LoggingSenior-level Full TimeJohannesburg, South Africa4d ago
-
Mid-level Full TimePretoria, South Africa4d ago
-
Mid-level Full TimeJohannesburg, South Africa4d ago
-
Data Engineer ZAR 300K-420KAWS | Azure | Data Architecture | Data Lakehouse | Data PipelinesHybrid work policyMid-level Full TimeJohannesburg, SA, ZA4d ago
-
Data Engineer ZAR 300K-420KAWS | Azure | Data Lakehouse | Data Modeling | Data Pipeline MonitoringHybrid work policy | Remote work daysMid-level Full TimeJohannesburg, SA, ZA4d ago
-
Senior-level Full TimeJohannesburg, South Africa4d ago
-
(1731) Data Scientist and AI Engineer - BSTD ZAR 720K-780KAPI Development | Amazon Web Services | Apache Hadoop | Apache Spark | DB2Senior-level Full TimePretoria, South Africa4d ago
-
(1728) Data Engineer - BSTD ZAR 745K-900KAnalytics enablement | Apache Spark | Application Programming | Application Programming Interfaces | C SharpSenior-level Full TimePretoria, South Africa4d ago
-
Senior-level Full TimeWC, South Africa5d ago
-
Senior-level Full TimeWC, South Africa5d ago
-
Senior Generative AI Engineer ZAR 603K-650KAI Governance | AI Security | AWS | Azure | Cloud PlatformsContinuous learning and development | Mentorship and team growthSenior-level Full TimeWC, South Africa5d ago
-
AI Prompt Engineer ZAR 498K-576KAI Evaluation | Content Optimization | Conversational AI | Documentation | Generative AISenior-level Full TimeWC, South Africa5d ago
-
AI / Machine Learning Engineer ZAR 360K-440KCI/CD | Cloud Computing | Computer Vision | Data Governance | Data PipelinesMid-level Full TimeWC, South Africa5d ago
-
Senior RAG Engineer ZAR 450K-650KAPI Development | Chroma | Distributed Systems | Embeddings | Enterprise SearchSenior-level Full TimeWC, South Africa5d ago