Senior Lead Data Engineer - Databricks
Maadi, Al Qāhirah, Egypt
USD 180K-248K (estimate) Senior-level Full Time
Tasks
- Build batch and streaming data pipelines
- Design data warehouses and lakehouses
- Design scalable data engineering solutions
- Develop Delta Lake solutions
- Develop and maintain lakehouse architectures
- Establish CI/CD pipelines
- Implement ETL/ELT pipelines
- Implement data governance and security
- Implement devops practices
- Lead architecture and solution design
- Manage metadata using Purview
- Mentor junior data engineers
- Optimize Spark workloads
Perks/Benefits
- Career advancement opportunities
- Employment referral program
- English language development courses
- Interest-free loans
- Medical insurance
- Overtime program
- Social insurance
- Technical development courses
Skills/Tech-stack
ADLS Gen2 | Active Directory | Apache Spark | Azure | Azure Active Directory | Azure Data | Azure Data Factory | Azure DevOps | Azure Event | Azure Event Hubs | Azure Functions | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CI/CD | Caching | Data Factory | Data Governance | Databricks | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | ELT | ETL | Entra ID | Event Hubs | Git | Joins | Kafka | Key Vault | Lakehouse Architecture | Medallion Architecture | Microsoft Entra | Microsoft Entra ID | Microsoft Purview | Partitioning | Performance optimization | PySpark | Python | SQL | Snowflake | Spark Performance Optimization | Structured Streaming | Synapse Analytics | Unity Catalog
Education
Related jobs
-
C# | C++ | Cloud Integration | Communication Protocols | DebuggingPrivate medical insurance | Professional development | Social insuranceMid-level Full TimeDokki, Giza Governorate, Egypt23h ago
-
Senior Site Reliability Engineer USD 172K-240KAWS | Ansible | Azure | Cause analysis | Cloud platformDynamic workplace | Health insurance | High-trust culture | On call responsibility autonomySenior-level Full TimeCairo, Cairo Governorate, Egypt - Remote R23h ago
-
Data and Infrastructure Engineer USD 112K-160KAPI Integration | Amazon Web Services | Automation | Change Management | Cloud ComputingOn-call rotationMid-level Full TimeCairo, Egypt1d ago
-
Backend Engineer II INR 1000K-1600KApplication Security | Automated testing | Continuous integration | Database optimization | DjangoAgile environment | Process improvementsEntry-level Full TimeMaadi, Al Qāhirah, Egypt1d ago
-
Senior-level Full TimeCairo, Cairo Governorate, Egypt1d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataMid-level Full TimeCairo, Egypt4d ago
-
Data Engineer (Finance) USD 119K-161KAPI Integration | Azure DevOps | DAX | Data Factory | Data ReconciliationPaid time off | Private health insurance | Social insurance | Training and developmentMid-level Full TimeGiza, Giza Governorate, Egypt4d ago
-
AI Search | AWS SageMaker | Amazon Web Services | Apache Spark | Artificial IntelligenceCareer advancement opportunities | Employee parking | Employment referral program | English language development courses | Flexible work scheduleSenior-level Full TimeCairo, Cairo, Egypt4d ago
-
Senior-level Full TimeCairo, Egypt5d ago
-
Senior Embedded Software Test Engineer USD 124K-176KAUTOSAR | Automation frameworks | Automotive Software | Automotive software architecture | CANSenior-level Full TimeCairo, EG5d ago
-
Senior-level Full TimeCairo, EG5d ago
-
Program Manager, 3P External Fulfillment USD 82K-137KDMAIC | Data Analysis | Lean | Microsoft Access | Microsoft ExcelFlexible scheduleMid-level Full TimeCairo, EGY5d ago
-
Data Scientist Lead CAD 114K-164KExperiment design | LightGBM | Machine Learning | Model Evaluation | Model ValidationSenior-level Full TimeGiza, El Omraniya, Egypt6d ago
-
Mid-level Full TimeOne Kattameya, Cairo6d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure DevOps | Azure SynapseMid-level Full TimeCairo, Cairo Governorate, Egypt6d ago
-
AI Evaluation | API Integration | AWS | Access Control | Agent OrchestrationFlexible work hours | Fully remoteSenior-level Full TimeEgypt R7d ago
-
SASE Operations and Support Engineer USD 81K-110KAPI tokens | AWS | Active Directory | Azure | Azure Publisher401k | Dental insurance | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeAlexandria, VA, United States R7d ago
-
Lead Storage Engineer USD 100K-150KAnsible | Backups | Bash | Ceph | Cluster administrationCareer advancement opportunities | Employee referral program | English language courses | Interest-free loans | Medical insuranceSenior-level Full TimeCairo, Cairo Governorate, Egypt7d ago
-
Forward Deployed Ai Engineer USD 151K-200KAPIs | Agentic AI | Data Mining | Language Processing | Machine LearningMid-level Full TimeCairo, EG7d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly work environmentMid-level Full TimeAlexandria, VA, USA9d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Hand off management | Remote-friendly, distributed teamMid-level Full TimeAlexandria, Egypt9d ago
-
Backpressure handling | Chunking | Cloud platform | Cloudflare Queues | Cloudflare WorkersCompetitive pay | Growth opportunities | Remote workSenior-level Full TimeSouth Africa - Cape Town R10d ago
-
AI/ML Engineer USD 60K-140KAI Search | AWS SageMaker | Azure AI | Azure AI Search | EmbeddingsFlexible work accommodations | Hybrid workSenior-level Full TimeCairo, Cairo Governorate, Egypt10d ago
-
AWS | Amazon Redshift | Apache Airflow | Apache Spark | BigQueryFlexible hours US time zones | Growth opportunities | Remote workSenior-level Full TimeSouth Africa - Cape Town R10d ago
-
Senior-level Full TimeOne Kattameya, Cairo11d ago