Data Engineer
Tasks
- Architect cloud data solutions
- Build batch and near real time data workflows
- Define data documentation lineage and metadata practices
- Deliver clean modeled datasets for analytics
- Design ETL/ELT pipelines
- Design and optimize data warehouses and analytical models
- Develop and maintain data services and APIs
- Enable feature engineering and training data generation
- Ensure data integrity traceability and auditability
- Implement data governance access controls and compliance
- Implement data ingestion transformation validation enrichment
- Implement storage and compute optimization
- Integrate machine learning outputs into production systems
- Participate in architectural decisions and system design
- Plan estimate and deliver data driven projects
- Prepare structure and optimize datasets for machine learning
- Provide technical guidance and mentorship
- Support BI and visualization tools
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS S3 | Amazon EMR | Amazon Redshift | Apache Airflow | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Cloud PubSub | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Validation | Data Warehousing | Django REST | Docker | ELT | ETL | FastAPI | Feature Engineering | Flask | Git | Google BigQuery | Google Cloud | Google Cloud PubSub | Google Dataflow | Hadoop | Kubernetes | Looker | Machine Learning | Power BI | Python | REST APIs | SQL
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Flexible work location | Fully remote | Large scale digital transformation exposure | Remote work autonomy and flexibility | Use AI powered engineering toolsSenior-level Contract Full TimeNigeria R1d ago
-
Senior-level Full TimeLekki, Lagos, Nigeria3d ago
-
AI Evaluation | API Integration | AWS | Access Control | Agent OrchestrationFlexible work hours | Fully remoteSenior-level Full TimeEgypt R4d ago
-
Senior Ai Engineer NGN 8100K-9300KAPI Development | Agent systems | Backend Services | CI/CD | DockerSenior-level Full TimeMAITAMA, Nigeria4d ago
-
Mid-level Full TimeMaitama, Abuja, Nigeria4d ago
-
Ai/Ml Engineer NGN 4800K-6000KAWS | Azure | CI/CD | Deep learning | GCPCareer advancement | Collaborative work environment | Dental insurance | Health insurance | Professional developmentMid-level Full TimeMaitama, Nigeria4d ago
-
Mid-level Full TimeLagos, Lagos10d ago
-
AWS | Cloud Computing | Data Exploration | Data Preprocessing | Google CloudAnnual paid vacation | Group life insurance | Health insurance | Pension | Performance bonusMid-level Full TimeLagos, Nigeria17d ago
-
Machine Learning Engineer UAH 1377K-1549KData Preparation | GPU Computing | JAX | Machine Learning | Machine Learning EngineeringSenior-level Full TimeEurope18d ago
-
AWS | Apache Airflow | Apache Spark | Azure | Data AnnotationCode review collaboration | Remote work environmentMid-level Full TimeLagos, Nigeria23d ago