Sr. Data Engineer - PySpark, Python & Cloudera (CDP)
Dubai, Dubai, United Arab Emirates
AED 210K-270K (estimate) Senior-level Full Time
Tasks
- Build batch and distributed data processing solutions
- Conduct code reviews
- Create technical documentation
- Design data pipelines
- Develop ETL and ELT pipelines
- Develop data ingestion frameworks
- Ensure data quality and governance
- Monitor and troubleshoot production data pipelines
- Optimize Spark jobs
- Participate in agile scrum ceremonies
- Perform data profiling and validation
- Support continuous improvement
Perks/Benefits
- N/A
Skills/Tech-stack
CI/CD | Cloudera Data Platform | Data Governance | Data Modeling | Data Quality | Data Transformation | Data Validation | Data platform | Distributed Systems | ELT | ETL | Git | Hadoop | PySpark | Python | REST APIs | SQL | Spark
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeDubai, Dubai, United Arab Emirates1d ago
-
Senior BI Engineer - (Tableau Developer) AED 240K-313KCalculated Fields | Dashboard actions | Dashboard performance | Dashboard performance optimization | Data BlendingSenior-level Full TimeDubai, Dubai, United Arab Emirates1d ago
-
Lead AI Engineer AED 286K-360KAWS | Agentic AI | Azure | Continuous Deployment | Continuous integrationDental insurance | Flexible time off program | Global Employee Assistance Program EAP | Medical insurance | Paid HolidaysSenior-level Full TimeRemote Dubai, United Arab Emirates R1d ago
-
Senior-level Full TimeAbu Dhabi, AE2d ago
-
Mid-level Full TimeDubai, Dubai, United Arab Emirates2d ago
-
AI Engineer / Agentic AI Developer AED 120K-120KAI monitoring | Agent Orchestration | Agent systems | Autogen | CI/CDMid-level Full TimeDubai, Dubai, United Arab Emirates2d ago
-
Senior Software Engineer, Applied AI (United Kingdom) GBP 132K-170KAI Agents | API Design | AWS | Audit trails | C#Company retreats | Wellness programSenior-level Full TimeRemote - International R2d ago
-
Senior Software Engineer, Applied AI (Netherlands) EUR 143K-184KAI Agents | API Design | AWS | Access patterns | Audit trailsCasual environment | Company retreats | Wellness programSenior-level Full TimeRemote - International R2d ago
-
Algorithm Optimization | Computational Efficiency | Data Science | Development Life Cycle | Machine LearningEntry-level InternshipDubai, Dubai, United Arab Emirates3d ago
-
Senior-level Full TimeAbu Dhabi, AE3d ago
-
Enterprise Services AI Agent Engineer Graduate (Corporate Service System - Global Travel) - 2027 Start AED 108K-108KCode review | Profiling | Python | REST | System PerformanceEntry-level Full TimeDubai, Dubai, United Arab Emirates4d ago
-
Enterprise Services AI Agent Engineer Graduate (Corporate Service System - Workplace Service) - 2027 Start AED 108K-132KAI | API Integration | Agent runtime | Backend Services | Code reviewEntry-level Full TimeDubai, Dubai, United Arab Emirates4d ago
-
Artificial Intelligence | Automation | Data Analysis | Data Preprocessing | Data PrivacyMid-level Full TimeDubai, United Arab Emirates4d ago
-
Forward Deployed AI Engineer AED 295K-349KAPI Integration | AWS | Agent-based | Agent-based systems | AzureFlexible working models | Great benefits | Health and well-being | Learning opportunitiesSenior-level Full TimeDubai, Dubai, AE, 1183534d ago
-
Forward Deployed Data Scientist Expert AED 295K-386KAnomaly Detection | Causal Inference | Causal analysis | Classification | ClusteringContinuous learning | Flexible working models | Health and wellbeing benefits | Professional developmentSenior-level Full TimeDubai, Dubai, AE, 1183534d ago
-
Forward Deployed Application/ML Engineering Expert AED 295K-349KAPI Integration | Agentic AI | Architecture | Cloud Native | Data PipelinesContinuous learning and skill growth | Flexible working models | Health and well-being benefitsSenior-level Full TimeDubai, Dubai, AE, 1183534d ago
-
Azure Data Engineer AED 90K-108KApache Hadoop | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeDubai, Dubai, United Arab Emirates5d ago
-
Software Engineer, Data Infrastructure & Acquisition - Abu Dhabi, United Arab Emirates AED 144K-180KBash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Entrepreneurial environment | Flexible management approach | Friendly laid-back atmosphere | Impact on learning accessibility productMid-level Full TimeAbu Dhabi, United Arab Emirates5d ago
-
Senior-level Full TimeNew York8d ago
-
Apache Airflow | Apache Spark | CI/CD | Data Cleansing | Data IngestionSenior-level Full TimeAbu Dhabi, United Arab Emirates8d ago
-
Azure Data Engineer AED 90K-108KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeDubai, Dubai, United Arab Emirates9d ago
-
Blueprint | Data Pipelines | Diffusion Models | Diffusion Transformers | Distributed TrainingProfessional development | Real-world impact | Research collaborationMid-level Full TimeAbu Dhabi9d ago
-
Sr. MongoDB Database Engineer (Open Source DBA) AED 180K-240KAgile | Ansible | Backup and Restore | Bash | Database MigrationSenior-level Full TimeDubai, Dubai, United Arab Emirates10d ago
-
Data Engineer, Information System, Dubai AED 84K-96KBig Data | Data Engineering | Data Modeling | Data Warehousing | Distributed SystemsMid-level Full TimeDubai, Dubai, United Arab Emirates12d ago
-
Dell AI Infrastructure & MLOps Engineer - (6 Month Only) AED 156K-192KAI Stack | Apache Spark | Best practices | Dell PowerScale | Dell R570Mid-level Full TimeDubai, Dubai, United Arab Emirates12d ago