Data Engineer
Tasks
- Apply data governance and data protection controls
- Build data pipelines
- Collaborate on source system changes and data dependencies
- Conduct root cause analysis for pipeline failures
- Document pipelines as code
- Enforce column level data minimization
- Implement client entity resolution components
- Implement encryption lineage retention and auditability
- Implement idempotent incremental loads
- Implement matching logic and survivorship rules
- Implement pipeline tests and data quality checks
- Investigate unresolved or conflicting entity matches
- Maintain data pipelines
- Monitor pipeline health performance and cost
- Perform code review and pairing for mentorship
- Respond to pipeline incidents within SLAs
Perks/Benefits
- Generous annual leave
- Health insurance
- Parental leave
- Provident fund
- Sabbatical options
- Staff Savings
Skills/Tech-stack
Airflow | Apache Spark | CI/CD | DBT | Dagster | Data Governance | Data Lineage | Data Quality | Docker | Encryption | Entity Resolution | Git | Idempotent Processing | Incremental loading | Kafka | Monitoring | Observability | PostgreSQL | Python | SQL | Testing
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
API | JSON | Java | JavaScript | PythonOpportunity to work on AI projects | Remote workMid-level ContractIndia; Pakistan; Nigeria; Kenya; Egypt; Ghana; … R2d ago
-
AWS | CNN | Convolutional Neural Networks | Data Integrity | Data QualityMid-level Full TimeNairobi R3d ago
-
Senior-level Full TimeNairobi, Kenya5d ago
-
Manager, Data Engineer, Data Innovation Office USD 126K-160KAWS | Azure | Batch Processing | CI/CD | Cloud platformMid-level Full TimeKenya-Nairobi10d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerEntrepreneurial team environment | Flexible asynchronous culture | Friendly laid-back atmosphere | Opportunity to make impact on learning accessibilityMid-level Full TimeNairobi, Kenya12d ago
-
Data Engineer USD 156K-201KDBT | Data Governance | Data Modeling | Data Normalization | Data QualityLife insurance | Medical coverage | Office snacks and lunch | Personal development | Team building eventsSenior-level Full TimeNairobi, Nairobi County, Kenya13d ago
-
Kenya - AI Domain architect 6916 INR 3250K-6250KAI Safety | Agentic Workflows | Data Governance | Data labeling | Data provenanceSenior-level Full TimeNairobi, Kenia, Kenya16d ago
-
AI Data Solution Engineer USD 90K-124K.NET | API Development | Anthropic | Async Programming | Cloud PlatformsFlexible working environmentSenior-level Full TimeNairobi, Kenya18d ago