Data Engineer
Nigeria or South Africa
R
ZAR 480K-540K (estimate) Mid-level Full Time
Tasks
- Build data lake processing jobs
- Collaborate with data scientists and analysts
- Design data pipelines
- Develop real time streaming data processing
- Implement ETL and ELT workflows
- Implement continuous integration and deployment pipelines
- Maintain data process documentation
- Manage Kafka connectors
- Monitor production data systems
- Orchestrate data workflows with Apache Airflow
- Perform unit and integration testing
- Provision infrastructure with Infrastructure-as-Code
- Schedule and maintain data processing
- Support incident response during on call
Perks/Benefits
- Collaborative teams
- Documentation and transparency
- On-call rotation
- Professional growth and learning
- Remote-first environment
Skills/Tech-stack
AWS | Amazon Redshift | Apache Airflow | Apache Kafka | CI/CD | Debezium | ELT | ETL | Google BigQuery | Helm | Integration Testing | JavaScript | Kafka | Kafka Connect | Kubernetes | MongoDB | MySQL | NoSQL | PostgreSQL | Python | Relational databases | SQL | Scala | SingleStore | Terraform | Unit Testing
Roles
Related jobs
-
Mid-level Full TimeCape Town, South Africa R3d ago
-
API Security | Access Control | Airflow | Amazon Redshift | AuthenticationFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R3d ago
-
AWS | Amazon Redshift | Apache Airflow | CI/CD | DebeziumHybrid work | On-call rotation | Remote-first environmentMid-level Full TimeLagos, Nigeria R3d ago
-
MATLAB | NumPy | Pandas | Python | RFreelance opportunities | Part-time opportunities | Project based workSenior-level FreelanceSouth Africa - Remote R4d ago
-
API | Agent architecture | Benchmarking | Bundlers | CLIAnnual off-site gatherings | Co working membership allowance | Equity participation ESOP | Flexible work culture | Fully remoteSenior-level Full TimeSouth Africa R4d ago
-
AWS | Airbyte | Amazon Redshift | Apache Airflow | CI/CDHybrid work | On-call rotation | Remote-first workMid-level Full TimeCape Town, Western Cape, South Africa R4d ago
-
Full-Stack Data Engineer (Remote) ZAR 420K-480KApache Airflow | Apache Beam | Automl | Bash | BigQueryRemote workMid-level Full TimeSouth Africa, South Africa - Remote R8d ago
-
API Integration | Automation | Claude | Data Modeling | IndexingCollaborative engineering culture | Flexible/remote location | Fully remote work | High-ownership environmentSenior-level Full TimeSouth Africa R9d ago
-
Machine Learning Architect ZAR 840K-1200KAI Agents | AWS | Apache Airflow | Apache Spark | Automated retrainingSenior-level Full TimeSouth Africa - Remote R9d ago
-
Senior Analytics Engineer ZAR 840K-1200KBigQuery | Data Modeling | GCP | JavaScript | Looker StudioSenior-level Full TimeSouth Africa - Remote R9d ago
-
AWS | Airbyte | Amazon Redshift | Apache Airflow | CI/CDOn-call rotation | Remote-first environmentMid-level Full TimeLagos R9d ago
-
AWS | Azure | Embeddings | GCP | Hugging FaceFlexible work environment | Fully remote | Growth opportunities | Remote distributed team experienceSenior-level Full TimeSouth Africa - Remote R11d ago
-
Machine Learning Engineer NGN 7200K-8400KAnomaly Detection | Apache Airflow | Apache Spark | Cloud Storage | Data DriftBirthday day off | Collaborative team | Employee interest groups | Flexible work style | Group life insuranceSenior-level Full TimeNigeria - Remote R14d ago
-
Machine Learning Engineer ZAR 420K-600KAirflow | Amazon SageMaker | CI/CD | Docker | Feature EngineeringAgile environment | Collaborative culture | Feedback and empathy | Freedom and responsibility | Self-organizationMid-level Full TimeSouth Africa - Remote R15d ago
-
Junior Data Engineer ZAR 228K-264KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Flink | Apache KafkaAutonomy | Flexible work practices | Learning and development support | Remote-firstEntry-level Full TimePortugal; South Africa R21d ago
-
Data Engineer ZAR 450K-500KAWS | Airflow | Amazon Redshift | Apache Flink | Apache SparkFlexible work practices | Learning and development | Mentorship | Remote workMid-level Full TimePortugal; South Africa R21d ago
-
Senior Data Engineer ZAR 505K-510KAWS | Airflow | Amazon EC2 | Amazon EKS | Amazon RDSCompany wide festive season break | Employee assistance program | Sports leave | Study leave | Time off for non profit volunteeringSenior-level Full TimeCape Town, South Africa; Remote - … R27d ago
-
Ai Developer ZAR 240K-360KComputer Vision | Data Analysis | Data Preprocessing | Deep learning | Feature EngineeringFlexible working hours | Remote workMid-level Full TimeSouth Africa - Remote R30d ago
-
Machine Learning Engineer NGN 3600K-3600KA/B | A/B Testing | Airflow | B testing | Causal InferenceAnnual bonus | Collaborative work culture | Health insurance | Internal technical talks | Knowledge sharingSenior-level Full TimeRemote, Nigeria R1mo ago
-
Analytics | Apache Kafka | Big Data | Cluster tuning | ContainerizationRemote workSenior-level Full TimeJohannesburg, GP, South Africa R1mo ago