Senior Data Engineer
Tasks
- Apply data governance
- Apply infrastructure as code
- Build API ingestion
- Build data models
- Build webhook ingestion
- Create data marts
- Deliver self service datasets
- Design data pipelines
- Handle PII data
- Implement CDC ingestion
- Implement CI/CD for data pipelines
- Implement data access controls
- Implement data lineage
- Implement data retention policies
- Implement data validation
- Ingest event streams
- Integrate third-party systems
- Maintain data pipelines
- Manage cloud resources costs
- Mentor junior engineers
- Optimize query performance
- Optimize storage layout
- Perform root cause analysis
- Process file ingestion
- Review designs and code
- Run data reconciliation
- Set up observability and alerting
- Support auditability
- Troubleshoot data incidents
- Tune orchestration schedules
- Use version control and automated testing
Perks/Benefits
- Career Growth & Development
- Collaborative inclusive work environment
- Opportunity to work on cutting-edge technology
- Passionate team
Skills/Tech-stack
AWS | Alerting | Apache Airflow | Apache Iceberg | Apache Kafka | Automated testing | Azure | Backfills | BigQuery | CDC | CI/CD | Cloud platform | DBT | Data Lineage | Data Modeling | Data Observability | Data Validation | Databricks | Delta Lake | Dimensional Modeling | Docker | ELT | ETL | Flink | Git | Google Cloud | Google Cloud Platform | Idempotency | Incremental Transformations | Infrastructure as Code | Kubernetes | Python | Query Optimization | REST API | Redshift | SQL | Snowflake | Spark | Terraform | Webhooks | Window Functions | “as-code”
Education
N/A
Roles
Related jobs
-
Data Analytics Engineer (Evening Shift) EUR 23K-23KAzure Databricks | CI/CD | Data Modeling | Data Quality | Data ReconciliationComprehensive health insurance | Employee assistance programme | Employee share plan | Flexible hours | Flexible work schemeMid-level Full TimeNew Cairo, Egypt; Cairo, CAIRO, Egypt; … R6d ago
-
Autodesk Revit | BIM | Computer Vision | Generative AI | Language ModelsMedical insurance | Social insuranceEntry-level Full TimeEgypt - Remote R11d ago
-
Jr AI Engineer EUR 12K-27KAI SDK | Azure | Azure Bot | Azure Bot Service | Bot FrameworkEmployee assistance program | Employee share plan | Flexible hours | Health insurance | Hybrid work modelEntry-level Full TimeNew Cairo, Egypt; Cairo, CAIRO, Egypt; … R13d ago
-
AWS | Ansible | Backpressure | Backup and Recovery | BashAutonomy and responsibility | Collaborative culture | Fun dynamic workplace | Top-tier health insuranceSenior-level Full TimeRemote-Egypt, Saudi Arabia R18d ago
-
Data Analytics Engineer - Supply Chain EUR 20K-20KDashboards | Data Modeling | Data Preparation | Data Quality | Data TransformationEmployee assistance program | Employee share plan | Flexible hours | Flexible work scheme | Gender neutral parental leaveMid-level Full TimeNew Cairo, Egypt; Cairo, CAIRO, Egypt; … R21d ago
-
Data Analytics Engineer EUR 30K-30KAnalysis Services | Azure Analysis | Azure Analysis Services | CI/CD | Data ModelingEmployee assistance program | Employee share plan | Flexible hours | Health insurance | Hybrid workMid-level Full TimeNew Cairo, Egypt; Cairo, CAIRO, Egypt; … R25d ago
-
SASE Automation Engineer USD 151K-237KAnsible | CI/CD | DevOps | Docker | NetskopeFlexible working hours | Hybrid work | Internal training sessions | Remote work | Training budgetMid-level Full TimeCairo, Egypt R1mo ago