Senior Data Engineer
Tasks
- Apply data governance
- Apply infrastructure as code
- Build API ingestion
- Build data models
- Build webhook ingestion
- Create data marts
- Deliver self service datasets
- Design data pipelines
- Handle PII data
- Implement CDC ingestion
- Implement CI/CD for data pipelines
- Implement data access controls
- Implement data lineage
- Implement data retention policies
- Implement data validation
- Ingest event streams
- Integrate third-party systems
- Maintain data pipelines
- Manage cloud resources costs
- Mentor junior engineers
- Optimize query performance
- Optimize storage layout
- Perform root cause analysis
- Process file ingestion
- Review designs and code
- Run data reconciliation
- Set up observability and alerting
- Support auditability
- Troubleshoot data incidents
- Tune orchestration schedules
- Use version control and automated testing
Perks/Benefits
- Career Growth & Development
- Collaborative inclusive work environment
- Opportunity to work on cutting-edge technology
- Passionate team
Skills/Tech-stack
AWS | Alerting | Apache Airflow | Apache Iceberg | Apache Kafka | Automated testing | Azure | Backfills | BigQuery | CDC | CI/CD | Cloud platform | DBT | Data Lineage | Data Modeling | Data Observability | Data Validation | Databricks | Delta Lake | Dimensional Modeling | Docker | ELT | ETL | Flink | Git | Google Cloud | Google Cloud Platform | Idempotency | Incremental Transformations | Infrastructure as Code | Kubernetes | Python | Query Optimization | REST API | Redshift | SQL | Snowflake | Spark | Terraform | Webhooks | Window Functions | “as-code”
Education
N/A
Roles
Related jobs
-
Jr AI Engineer EUR 12K-27KAI SDK | Azure | Azure Bot | Azure Bot Service | Bot FrameworkEmployee assistance program | Employee share plan | Flexible hours | Health insurance | Hybrid work modelEntry-level Full TimeNew Cairo, Egypt; Cairo, CAIRO, Egypt; … R2d ago
-
AWS | Ansible | Backpressure | Backup and Recovery | BashAutonomy and responsibility | Collaborative culture | Fun dynamic workplace | Top-tier health insuranceSenior-level Full TimeRemote-Egypt, Saudi Arabia R8d ago
-
Data Analytics Engineer - Supply Chain EUR 20K-20KDashboards | Data Modeling | Data Preparation | Data Quality | Data TransformationEmployee assistance program | Employee share plan | Flexible hours | Flexible work scheme | Gender neutral parental leaveMid-level Full TimeNew Cairo, Egypt; Cairo, CAIRO, Egypt; … R10d ago
-
Data Analytics Engineer EUR 30K-30KAnalysis Services | Azure Analysis | Azure Analysis Services | CI/CD | Data ModelingEmployee assistance program | Employee share plan | Flexible hours | Health insurance | Hybrid workMid-level Full TimeNew Cairo, Egypt; Cairo, CAIRO, Egypt; … R14d ago
-
Analytics & AI Architect - Freelance - Cairo USD 130K-190KAWS | Access Control | Airflow | Amazon Redshift | AzureHealth insurance | Work-life balanceSenior-level FreelanceCairo, Cairo Governorate, Egypt - Remote R22d ago
-
AI Engineer (Hybrid) USD 130K-180KAPI Development | Backend Development | Cloud Computing | Computer Vision | Deep learningHybrid work environmentSenior-level Full TimeGiza, El Omraniya, Egypt R1mo ago
-
SASE Automation Engineer USD 151K-237KAnsible | CI/CD | DevOps | Docker | NetskopeFlexible working hours | Hybrid work | Internal training sessions | Remote work | Training budgetMid-level Full TimeCairo, Egypt R1mo ago
-
Senior Applied ML Engineer (Speech & Audio) USD 140K-200KActivity Detection | Audio codecs | Audio preprocessing | Automatic Speech Recognition | ConformerAccommodation allowance | Career Development Programs | Career growth opportunities | Coffee | Daily DrinksSenior-level Full TimeEgypt - Remote R1mo ago
-
AI Agent Engineer & Team Lead INR 2000K-5000KAutogen | CI/CD | Computer Vision | CrewAI | DockerFlexible working hours | Fully remote | Work from anywhereSenior-level Full TimeCairo Governorate, Cairo, Egypt R1mo ago