Senior Lead Data Engineer - Databricks
Maadi, Al Qāhirah, Egypt
USD 180K-248K (estimate) Senior-level Full Time
Tasks
- Build batch and streaming data pipelines
- Design data warehouses and lakehouses
- Design scalable data engineering solutions
- Develop Delta Lake solutions
- Develop and maintain lakehouse architectures
- Establish CI/CD pipelines
- Implement ETL/ELT pipelines
- Implement data governance and security
- Implement devops practices
- Lead architecture and solution design
- Manage metadata using Purview
- Mentor junior data engineers
- Optimize Spark workloads
Perks/Benefits
- Career advancement opportunities
- Employment referral program
- English language development courses
- Interest-free loans
- Medical insurance
- Overtime program
- Social insurance
- Technical development courses
Skills/Tech-stack
ADLS Gen2 | Active Directory | Apache Spark | Azure | Azure Active Directory | Azure Data | Azure Data Factory | Azure DevOps | Azure Event | Azure Event Hubs | Azure Functions | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CI/CD | Caching | Data Factory | Data Governance | Databricks | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | ELT | ETL | Entra ID | Event Hubs | Git | Joins | Kafka | Key Vault | Lakehouse Architecture | Medallion Architecture | Microsoft Entra | Microsoft Entra ID | Microsoft Purview | Partitioning | Performance optimization | PySpark | Python | SQL | Snowflake | Spark Performance Optimization | Structured Streaming | Synapse Analytics | Unity Catalog
Education
Related jobs
-
Senior Software Developer – AI-First / Vibe Coding USD 119K-175KAI Foundry | ASP.Net Core | AWS Bedrock | Amazon Neptune | Azure AISenior-level Full TimeAl Giza, Egypt1d ago
-
Applied AI Engineer (AI-First / Vibe Coding) INR 1200K-2500KAI Agents | AWS | Amazon Neptune | Azure | CI/CDCollaborative work environment | Continuous learning opportunities | Professional growthMid-level Full TimeCairo, Egypt1d ago
-
Applied AI Engineer (AI-First / Vibe Coding) INR 1200K-2500KAI Agents | Amazon Neptune | Anthropic API | Azure OpenAI | CI/CDCollaborative environment | Continuous learning opportunities | Professional growthMid-level Full TimeCairo, Egypt1d ago
-
Data Platform Engineer III USD 165K-230KAWS | Apache Doris | Apache Hudi | Apache Iceberg | AzureAutonomy | Dynamic work environment | Flexible responsibility | Health insuranceSenior-level Full TimeCairo, Cairo Governorate, Egypt1d ago
-
AI Infrastructure Engineer III USD 152K-250KAWS | Ansible | Azure | Bash | CI/CDDynamic workplace | Flexible autonomy and trust | Fun and collaborative team | Top-tier health insuranceSenior-level Full TimeCairo, Cairo Governorate, Egypt1d ago
-
AI Search | AWS | Agentic AI | Agile | AutogenSenior-level Full TimeNew Cairo City, Cairo Governorate, Egypt2d ago
-
API Development | AWS Bedrock | Amazon SageMaker | Azure Kubernetes | Azure Kubernetes ServiceCareer growth opportunities | Health and wellness programs | Hybrid work environment | Ongoing learning and development programsSenior-level Full TimeCairo, Egypt3d ago
-
AWS Redshift | Amazon Web Services | Apache Airflow | Apache Beam | Apache HiveCareer growth and development | Health and wellness programs | Hybrid work environment | Ongoing learning and development programsSenior-level Full TimeCairo, Egypt3d ago
-
Senior Data Engineer USD 161K-204KAWS | AWS Glue | AWS Lambda | Airflow | Amazon AthenaPTO | Remote workSenior-level Full TimeEgypt R4d ago
-
Lead Data Engineer USD 133K-200KAWS | Apache Flink | Cloud platform | Data Integrity | Data ModelingSenior-level Full Timemaadi, Cairo Governorate, Egypt5d ago
-
Data Platform Engineer III USD 163K-232KAWS | Apache Doris | Apache Flink | Apache Spark | BashAutonomy | Health insurance | Open source contributions support N/A | Remote Work N/A | Training N/ASenior-level Full TimeCairo, Cairo Governorate, Egypt5d ago
-
AI Infrastructure Engineer III USD 152K-273KAWS | Ansible | Autoscaling | Azure | BashAutonomy | Dynamic workplace | Health insurance | High responsibilitySenior-level Full TimeCairo, Cairo Governorate, Egypt5d ago
-
Data and Infrastructure Engineer USD 108K-158KAPI Integration | Amazon Web Services | Automation | Cloud platform | ContainersMid-level Full TimeCairo, Egypt6d ago
-
Data Engineer USD 107K-165KChange Data Capture | Data Capture | Data Governance | Data Modeling | Data QualityPrivate health insurance | Training and developmentSenior-level Full TimeCairo, Cairo Governorate, Egypt6d ago
-
Agile | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache IcebergRemote workMid-level Full TimeSouth Africa - Cape Town7d ago
-
Principal Data Engineer USD 125K-167KC# | Data Governance | Data Mapping | Data Modelling | Data WarehousingSenior-level Full TimeEgypt-Giza-SMART VILLAGE BLDG. 37d ago
-
ETIC, Data Engineer, Associate USD 97K-202KAzure Data | Azure Data Catalog | Azure Data Factory | Azure Data Lake | Azure Data Lake AnalyticsMid-level Full TimeCairo - ETIC, Egypt7d ago
-
Data analytics associate manager USD 92K-140KAmazon Athena | Amazon QuickSight | Data Tagging | Dimensional Modeling | ETLMid-level Full TimeCairo, EG7d ago
-
Executive-level Full TimeEgypt8d ago
-
Data Scientist - Artificial Intelligence INR 5000K-6000KAI Agents | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkCollaborative inclusive work environment | Private health insurance | Professional growth | Training and developmentSenior-level Full TimeCairo, Cairo Governorate, Egypt8d ago
-
Data Engineer - Data Platforms (Databricks) USD 180K-247KApache Spark | Automation | Cloud Platforms | Data Governance | Data LakeSenior-level Full TimeCairo, Cairo Governorate, Egypt8d ago
-
Senior-level Full TimeCairo9d ago
-
ETIC, Data Engineer, Senior Associate USD 130K-172KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeCairo - ETIC, Egypt9d ago
-
Storage Lead Engineer USD 100K-105KAWS S3 | Azure Blob | Azure Blob Storage | Backups | Blob StorageCareer advancement opportunities | Employment referral program | English language development courses | Interest-free loans | Medical insuranceSenior-level Full TimeCairo, Cairo Governorate, Egypt9d ago
-
Senior DevOps Engineer, AI4ALL USD 148K-234KAmazon Web Services | Automated testing | Bash | CI/CD | ClickHouseSenior-level Full TimeCAIRO - CAI1, Egypt9d ago