Senior Lead Data Engineer - Databricks
Maadi, Al Qāhirah, Egypt
USD 180K-248K (estimate) Senior-level Full Time
Tasks
- Build batch and streaming data pipelines
- Design data warehouses and lakehouses
- Design scalable data engineering solutions
- Develop Delta Lake solutions
- Develop and maintain lakehouse architectures
- Establish CI/CD pipelines
- Implement ETL/ELT pipelines
- Implement data governance and security
- Implement devops practices
- Lead architecture and solution design
- Manage metadata using Purview
- Mentor junior data engineers
- Optimize Spark workloads
Perks/Benefits
- Career advancement opportunities
- Employment referral program
- English language development courses
- Interest-free loans
- Medical insurance
- Overtime program
- Social insurance
- Technical development courses
Skills/Tech-stack
ADLS Gen2 | Active Directory | Apache Spark | Azure | Azure Active Directory | Azure Data | Azure Data Factory | Azure DevOps | Azure Event | Azure Event Hubs | Azure Functions | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CI/CD | Caching | Data Factory | Data Governance | Databricks | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | ELT | ETL | Entra ID | Event Hubs | Git | Joins | Kafka | Key Vault | Lakehouse Architecture | Medallion Architecture | Microsoft Entra | Microsoft Entra ID | Microsoft Purview | Partitioning | Performance optimization | PySpark | Python | SQL | Snowflake | Spark Performance Optimization | Structured Streaming | Synapse Analytics | Unity Catalog
Education
Related jobs
-
Senior-level Full TimeOne Kattameya, Cairo2d ago
-
Junior Cyber Security Data Platform Engineer USD 65K-101KAWS | Agile | Ansible | Bash | CI/CD12 corporate holidays | Flexible time off | Group dental insurance | Group medical insurance | HSAEntry-level Full TimeAlexandria, VA2d ago
-
Data Engineer & Analytics Developer USD 83K-111KCI/CD | Data Modeling | Data Quality | Data Validation | Data WarehouseCareer development opportunities | Employee well-being benefits | Family-friendly work environmentMid-level Full TimeCairo, EG2d ago
-
Senior Embedded Application Development Lead CAD 116K-148KADA | C# | C++ | Code Reviews | Configuration ManagementSenior-level Full Time(RSBU) Cairo GTS, Egypt3d ago
-
AI engineer - Testing, AI4ALL EUR 39K-57KAI Evaluation | API Testing | CI/CD | End to End | End-to-End TestingMid-level Full TimeCAIRO - CAI1, Egypt3d ago
-
Senior-level Full TimeAlexandria, VA, MO; Chantilly, VA, MD, …3d ago
-
AI Engineer USD 120K-146KApache Spark | Bash | CI/CD | Data orchestration | ELTCareer growth | Inclusive workplace | Work-life balanceMid-level Full Timegiza, EG6d ago
-
Data Scientist "Senior/Lead" CAD 160K-170KDimensionality Reduction | Gradient boosting | Hadoop | Hive | ImpalaSenior-level Full TimeNew Cairo City, Cairo Governorate, Egypt8d ago
-
Agentic AI Engineer USD 127K-175KAPI Design | Agents SDK | Amazon Web Services | Artificial Intelligence | AutogenMid-level Full TimeEgypt8d ago
-
Database Administrator (DBA) EUR 63K-82KAccess Control | Backup and Recovery | Database Migration | Database monitoring | Database performanceOn-call rotationMid-level Full TimeEG Cairo - office, Egypt9d ago
-
Expert Machine Learning Engineer - VOIS GBP 70K-85KAWS | Apache Hadoop | Apache Spark | Automation | Big DataSenior-level Full Timecairo, Cairo, EG10d ago
-
ETIC, Resource Manager Operations – Senior Associate USD 129K-188KCause analysis | Code review | Data Ingestion | Data Modeling | Data PipelinesSenior-level Full TimeCairo - ETIC, Egypt10d ago
-
Mid-level Full TimeMaadi, Al Qāhirah, Egypt10d ago
-
Senior Software Developer – AI-First / Vibe Coding USD 119K-175KAI Foundry | ASP.Net Core | AWS Bedrock | Amazon Neptune | Azure AISenior-level Full TimeAl Giza, Egypt11d ago
-
Applied AI Engineer (AI-First / Vibe Coding) INR 1200K-2500KAI Agents | AWS | Amazon Neptune | Azure | CI/CDCollaborative work environment | Continuous learning opportunities | Professional growthMid-level Full TimeCairo, Egypt11d ago
-
Applied AI Engineer (AI-First / Vibe Coding) INR 1200K-2500KAI Agents | Amazon Neptune | Anthropic API | Azure OpenAI | CI/CDCollaborative environment | Continuous learning opportunities | Professional growthMid-level Full TimeCairo, Egypt11d ago
-
Data Platform Engineer III USD 165K-230KAWS | Apache Doris | Apache Hudi | Apache Iceberg | AzureAutonomy | Dynamic work environment | Flexible responsibility | Health insuranceSenior-level Full TimeCairo, Cairo Governorate, Egypt12d ago
-
AI Infrastructure Engineer III USD 152K-250KAWS | Ansible | Azure | Bash | CI/CDDynamic workplace | Flexible autonomy and trust | Fun and collaborative team | Top-tier health insuranceSenior-level Full TimeCairo, Cairo Governorate, Egypt12d ago
-
AI Search | AWS | Agentic AI | Agile | AutogenSenior-level Full TimeNew Cairo City, Cairo Governorate, Egypt13d ago
-
API Development | AWS Bedrock | Amazon SageMaker | Azure Kubernetes | Azure Kubernetes ServiceCareer growth opportunities | Health and wellness programs | Hybrid work environment | Ongoing learning and development programsSenior-level Full TimeCairo, Egypt13d ago
-
AWS Redshift | Amazon Web Services | Apache Airflow | Apache Beam | Apache HiveCareer growth and development | Health and wellness programs | Hybrid work environment | Ongoing learning and development programsSenior-level Full TimeCairo, Egypt13d ago
-
Lead Data Engineer USD 133K-200KAWS | Apache Flink | Cloud platform | Data Integrity | Data ModelingSenior-level Full Timemaadi, Cairo Governorate, Egypt15d ago
-
Principal Data Engineer USD 125K-167KC# | Data Governance | Data Mapping | Data Modelling | Data WarehousingSenior-level Full TimeEgypt-Giza-SMART VILLAGE BLDG. 317d ago
-
ETIC, Data Engineer, Associate USD 97K-202KAzure Data | Azure Data Catalog | Azure Data Factory | Azure Data Lake | Azure Data Lake AnalyticsMid-level Full TimeCairo - ETIC, Egypt18d ago
-
Executive-level Full TimeEgypt18d ago