Data Engineer
Tasks
- Architect data lake for analytics and reporting
- Build batch and real time ingestion frameworks
- Build reconciliation frameworks across processors wallets and settlement reports
- Design scalable data pipelines
- Design schemas for TPV revenue recognition settlement tracking partner reporting
- Enable BI dashboards for analytics and operations
- Enable lending and risk modeling with structured datasets
- Ensure compliance with fintech and data protection regulations
- Ensure payment and utility transaction integrity and reconciliation
- Implement data security encryption and access controls
- Implement monitoring for anomaly detection
- Maintain audit logs and data lineage
- Optimize database performance and uptime
- Support experimentation frameworks
- Translate business requirements into data solutions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Amazon Kinesis | Amazon Redshift | Apache Airflow | Audit Logging | BigQuery | Cloud platform | DBT | Dagster | Data Lake | Data Lineage | Data Security | Data Warehousing | Database optimization | ELT | ETL | Encryption | Google Cloud | Google Cloud Platform | Indexing | Kafka | Microsoft Azure | Partitioning | PostgreSQL | PubSub | Python | SQL | Snowflake | Streaming Data
Education
N/A
Roles
Related jobs
-
Access Control | Backup and Recovery | Business Continuity | Capacity Planning | CommvaultSenior-level Contractlagos, Nigeria1d ago
-
APIs | Apache Airflow | Apache Spark | Data Modeling | Data QualityHands-on experience | Hybrid work model | Internship allowance | MentorshipEntry-level Full Time InternshipLagos, Nigeria1d ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipelines | Data ProcessingAsynchronous culture | Friendly work environment | Opportunity for impactMid-level Full TimeLagos, Nigeria8d ago
-
Data Engineer ZAR 480K-540KAWS | Amazon Redshift | Apache Airflow | Apache Kafka | CI/CDCollaborative teams | Documentation and transparency | On-call rotation | Professional growth and learning | Remote-first environmentMid-level Full TimeNigeria or South Africa R12d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly and laid-back atmosphere | Handsoff management | Portfolio and LinkedIn submission opportunityMid-level Full TimeAbuja, Nigeria13d ago
-
AWS | Amazon Redshift | Apache Airflow | CI/CD | DebeziumHybrid work | On-call rotation | Remote-first environmentMid-level Full TimeLagos, Nigeria R15d ago
-
AWS | Airbyte | Amazon Redshift | Apache Airflow | CI/CDOn-call rotation | Remote-first environmentMid-level Full TimeLagos R21d ago
-
Deep learning | Language Processing | Machine Learning | NLP | Natural LanguageBirthday leave | Health and wellness programs | Paid Holidays | Paid time offMid-level Full TimeLagos, LA, Nigeria22d ago
-
AWS | Azure | Data Modeling | Data Warehousing | Data integrationFlexible work hours | Remote work options | Team events and outings | Training and developmentMid-level Full TimeLagos, LA, Nigeria22d ago
-
Machine Learning Engineer NGN 7200K-8400KAnomaly Detection | Apache Airflow | Apache Spark | Cloud Storage | Data DriftBirthday day off | Collaborative team | Employee interest groups | Flexible work style | Group life insuranceSenior-level Full TimeNigeria - Remote R26d ago
-
Cloud Computing | Data Pipelines | Experimentation | Language Processing | Machine LearningMid-level Full TimeLagos, Nigeria1mo ago
-
Computer Vision | Data Preprocessing | Deep learning | Docker | FastAPIFlexible work arrangement | Supportive international teamMid-level Full TimeLagos, Nigeria1mo ago