Data Engineer
Nigeria or South Africa
R
ZAR 480K-540K (estimate) Mid-level Full Time
Tasks
- Build data lake processing jobs
- Collaborate with data scientists and analysts
- Design data pipelines
- Develop real time streaming data processing
- Implement ETL and ELT workflows
- Implement continuous integration and deployment pipelines
- Maintain data process documentation
- Manage Kafka connectors
- Monitor production data systems
- Orchestrate data workflows with Apache Airflow
- Perform unit and integration testing
- Provision infrastructure with Infrastructure-as-Code
- Schedule and maintain data processing
- Support incident response during on call
Perks/Benefits
- Collaborative teams
- Documentation and transparency
- On-call rotation
- Professional growth and learning
- Remote-first environment
Skills/Tech-stack
AWS | Amazon Redshift | Apache Airflow | Apache Kafka | CI/CD | Debezium | ELT | ETL | Google BigQuery | Helm | Integration Testing | JavaScript | Kafka | Kafka Connect | Kubernetes | MongoDB | MySQL | NoSQL | PostgreSQL | Python | Relational databases | SQL | Scala | SingleStore | Terraform | Unit Testing
Roles
Related jobs
-
Data Modeling | Distributed Systems | Embeddings | Kubernetes | LLM InferenceAccess to technical leadership | Collaborative culture | Flexible schedule | High autonomy | High ownershipEntry-level Full TimeSouth Africa R2d ago
-
Senior-level Full TimeEgypt R6d ago
-
Senior Data Platform Consultant ZAR 600K-730KAWS | Azure | CI/CD | Classification | Data EngineeringHybrid workSenior-level Full TimeCape Town, South Africa R9d ago
-
AWS | Amazon Redshift | Apache Airflow | Azure | BigQueryCareer growth opportunities | Collaborative culture | Continuous learning | Flexible working arrangements | Fully remoteSenior-level Full TimeSouth Africa - Remote R9d ago
-
Database Engineer / Database Administrator ZAR 464K-504KAWS Aurora | AWS RDS | Agile | Automation | Database AdministrationAdvancement opportunities | Annual tutoring stipend for children | Employee development program stipend | Fertility/adoption assistance | Mentorship programMid-level Full TimeRemote, South Africa R21d ago
-
Access Control | Airflow | Amazon Redshift | Authentication | BigQueryFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R1mo ago
-
Senior Full Stack Engineer (NLP) ZAR 600K-800KAPI Integration | CSS | Database Schema | Database Schema Design | DjangoAnnual leave | Education stipend | Employee assistance program | Internet benefits | Laptop providedSenior-level Full TimeRemote, South Africa R1mo ago
-
AWS | Amazon Redshift | Apache Airflow | CI/CD | DebeziumHybrid work | On-call rotation | Remote-first environmentMid-level Full TimeLagos, Nigeria R1mo ago
-
AWS | Airbyte | Amazon Redshift | Apache Airflow | CI/CDHybrid work | On-call rotation | Remote-first workMid-level Full TimeCape Town, Western Cape, South Africa R1mo ago
-
Machine Learning Architect ZAR 840K-1200KAI Agents | AWS | Apache Airflow | Apache Spark | Automated retrainingSenior-level Full TimeSouth Africa - Remote R1mo ago
-
AWS | Airbyte | Amazon Redshift | Apache Airflow | CI/CDOn-call rotation | Remote-first environmentMid-level Full TimeLagos R1mo ago
-
AWS | Azure | Embeddings | GCP | Hugging FaceFlexible work environment | Fully remote | Growth opportunities | Remote distributed team experienceSenior-level Full TimeSouth Africa - Remote R1mo ago
-
Machine Learning Engineer NGN 7200K-8400KAnomaly Detection | Apache Airflow | Apache Spark | Cloud Storage | Data DriftBirthday day off | Collaborative team | Employee interest groups | Flexible work style | Group life insuranceSenior-level Full TimeNigeria - Remote R1mo ago