Data Engineer
Nigeria or South Africa
R
ZAR 480K-540K (estimate) Mid-level Full Time
Tasks
- Build data lake processing jobs
- Collaborate with data scientists and analysts
- Design data pipelines
- Develop real time streaming data processing
- Implement ETL and ELT workflows
- Implement continuous integration and deployment pipelines
- Maintain data process documentation
- Manage Kafka connectors
- Monitor production data systems
- Orchestrate data workflows with Apache Airflow
- Perform unit and integration testing
- Provision infrastructure with Infrastructure-as-Code
- Schedule and maintain data processing
- Support incident response during on call
Perks/Benefits
- Collaborative teams
- Documentation and transparency
- On-call rotation
- Professional growth and learning
- Remote-first environment
Skills/Tech-stack
AWS | Amazon Redshift | Apache Airflow | Apache Kafka | CI/CD | Debezium | ELT | ETL | Google BigQuery | Helm | Integration Testing | JavaScript | Kafka | Kafka Connect | Kubernetes | MongoDB | MySQL | NoSQL | PostgreSQL | Python | Relational databases | SQL | Scala | SingleStore | Terraform | Unit Testing
Roles
Related jobs
-
Database Engineer / Database Administrator ZAR 464K-504KAWS Aurora | AWS RDS | Agile | Automation | Database AdministrationAdvancement opportunities | Annual tutoring stipend for children | Employee development program stipend | Fertility/adoption assistance | Mentorship programMid-level Full TimeRemote, South Africa R22h ago
-
A/B | A/B Testing | AI Agents | B testing | Data PipelinesFully remote | Home office stipend | International company retreats | Learning and development budget | Medical coverageSenior-level Full TimeSouth Africa R2d ago
-
AI Agents | API Integration | Automation tools | Code platforms | Language ModelsAccess to cutting-edge technologies | Fast-learning culture | Fully remote | High autonomy | Location flexibilityMid-level Full TimeSouth Africa R3d ago
-
Azure / AWS Cloud Engineer for Data Science ZAR 840K-1100KAmazon EC2 | Amazon Web Services | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa R6d ago
-
Azure / AWS Cloud Engineer for Data Science ZAR 840K-1100KARM | Amazon EC2 | Amazon Route 53 | Amazon Web Services | Azure Key VaultSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa R6d ago
-
C# | C++ | Language Models | Large Language Models | Machine LearningFully remote | Work during US business hoursMid-level Full TimeEgypt R8d ago
-
Airbyte | Amazon Redshift | BigQuery | CTEs | DBTFlexible schedule | Remote workMid-level Full TimeEgypt R8d ago
-
Access Control | Airflow | Amazon Redshift | Authentication | BigQueryFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R11d ago
-
Senior Full Stack Engineer (NLP) ZAR 600K-800KAPI Integration | CSS | Database Schema | Database Schema Design | DjangoAnnual leave | Education stipend | Employee assistance program | Internet benefits | Laptop providedSenior-level Full TimeRemote, South Africa R17d ago
-
AWS | Amazon Redshift | Apache Airflow | CI/CD | DebeziumHybrid work | On-call rotation | Remote-first environmentMid-level Full TimeLagos, Nigeria R24d ago
-
AWS | Airbyte | Amazon Redshift | Apache Airflow | CI/CDHybrid work | On-call rotation | Remote-first workMid-level Full TimeCape Town, Western Cape, South Africa R25d ago
-
Machine Learning Architect ZAR 840K-1200KAI Agents | AWS | Apache Airflow | Apache Spark | Automated retrainingSenior-level Full TimeSouth Africa - Remote R29d ago
-
AWS | Airbyte | Amazon Redshift | Apache Airflow | CI/CDOn-call rotation | Remote-first environmentMid-level Full TimeLagos R30d ago
-
AWS | Azure | Embeddings | GCP | Hugging FaceFlexible work environment | Fully remote | Growth opportunities | Remote distributed team experienceSenior-level Full TimeSouth Africa - Remote R1mo ago
-
Machine Learning Engineer NGN 7200K-8400KAnomaly Detection | Apache Airflow | Apache Spark | Cloud Storage | Data DriftBirthday day off | Collaborative team | Employee interest groups | Flexible work style | Group life insuranceSenior-level Full TimeNigeria - Remote R1mo ago
-
Junior Data Engineer ZAR 228K-264KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Flink | Apache KafkaAutonomy | Flexible work practices | Learning and development support | Remote-firstEntry-level Full TimePortugal; South Africa R1mo ago
-
Data Engineer ZAR 450K-500KAWS | Airflow | Amazon Redshift | Apache Flink | Apache SparkFlexible work practices | Learning and development | Mentorship | Remote workMid-level Full TimePortugal; South Africa R1mo ago
-
Ai Developer ZAR 240K-360KComputer Vision | Data Analysis | Data Preprocessing | Deep learning | Feature EngineeringFlexible working hours | Remote workMid-level Full TimeSouth Africa - Remote R1mo ago