Sr. Data Engineer - PySpark, Python & Cloudera (CDP)
Dubai, Dubai, United Arab Emirates
AED 210K-270K (estimate) Senior-level Full Time
Tasks
- Build batch and distributed data processing solutions
- Conduct code reviews
- Create technical documentation
- Design data pipelines
- Develop ETL and ELT pipelines
- Develop data ingestion frameworks
- Ensure data quality and governance
- Monitor and troubleshoot production data pipelines
- Optimize Spark jobs
- Participate in agile scrum ceremonies
- Perform data profiling and validation
- Support continuous improvement
Perks/Benefits
- N/A
Skills/Tech-stack
CI/CD | Cloudera Data Platform | Data Governance | Data Modeling | Data Quality | Data Transformation | Data Validation | Data platform | Distributed Systems | ELT | ETL | Git | Hadoop | PySpark | Python | REST APIs | SQL | Spark
Education
N/A
Roles
Related jobs
-
Access Control | Anomaly Detection | CI/CD | Classification | Data GovernanceRemote work modelSenior-level Full TimeUnited Arab Emirates2d ago
-
AI Security | API Development | Agent systems | Claude API | Enterprise ArchitectureContract engagement | Fully remote work model | International technology focused environmentSenior-level Full TimeUnited Arab Emirates R2d ago
-
Senior-level Full TimeDubai, United Arab Emirates2d ago
-
Principal Core Infrastructure Engineer AED 264K-360KAnsible | CI/CD | CentOS | Continuous Deployment | Continuous MonitoringFlexible medical insurance | Life insurance | Retirement options | Volunteer programsSenior-level Full TimeUnited Arab Emirates3d ago
-
AI Agent | Documents | Emails | Evaluation | GitAsync work | Flexible hours | Fully remote | Revision roundEntry-level ContractInternational R4d ago
-
🌍 MCP Expert AED 216K-300KAlgorithms | C++ | Code Refactoring | Data Structures | DebuggingContract work | Flexible schedule | Remote workSenior-level ContractInternational R4d ago
-
🌎 AI Engineer, Remote - Contract AED 168K-228KAlgorithms | C++ | Code Refactoring | Data Structures | DebuggingFlexible schedule | Remote workSenior-level ContractInternational R4d ago
-
Applied Scientist - AI/ML AED 240K-300KComputer Vision | Deep learning | Error Analysis | Experiment design | Feature EngineeringSenior-level Full TimeDubai, Dubai, United Arab Emirates4d ago
-
Mid-level Full TimeDubai, Dubai, United Arab Emirates4d ago
-
🌎 DevOps Engineer, Remote - Contract AED 132K-150KAWS | Ansible | Azure | Bash | CI/CDContract employment | Flexible schedule | Remote workMid-level ContractInternational R5d ago
-
AWS SageMaker | Airflow | Azure ML | C++ | Cloud platformMid-level Full TimeDubai, United Arab Emirates6d ago
-
CI/CD | ETL | Embeddings | Fine Tuning | Hugging FaceMid-level Full TimeDubai, United Arab Emirates6d ago
-
Senior-level Full TimeDubai, United Arab Emirates7d ago
-
AI Foundry | AWS Bedrock | AWS SageMaker | Agentic AI | Azure AI401k match | Career development resources | Flexible work arrangements | Health savings account options | Internal mobility supportSenior-level Full TimeUnited Arab Emirates7d ago
-
Automation | Azure Data | Azure Data Explorer | CSV | Data ExplorerCross-functional collaboration | Professional growth | Remote workMid-level Full TimeUnited Arab Emirates R8d ago
-
Data Engineer - ETL/PySpark (Banking Domain) AED 156K-216KApache Hadoop | Apache Hive | Apache Spark | CI/CD | Data TestingMid-level Full TimeDubai, Dubai, United Arab Emirates8d ago
-
AI Software Engineer AED 120K-150KAI Agents | AI Foundry | Anomaly Detection | Azure AI | Azure AI FoundryMid-level Full TimeDubai, Dubai9d ago
-
Senior Data Engineer AED 240K-300KAmazon Web Services | Apache Airflow | Cloud platform | DBT | DagsterSenior-level Full TimeDubai, United Arab Emirates R9d ago
-
Data Engineer, Information System, Dubai AED 156K-216KApache Flink | Apache Kafka | Apache Spark | ClickHouse | Data IngestionEntry-level Full TimeDubai, Dubai, United Arab Emirates10d ago
-
Artificial Intelligence | Data Analysis | Data Science | Machine Learning | PythonCareer growth | Exposure to real world AI projects | Healthcare industry domain experienceEntry-level Full TimeAbu Dhabi, United Arab Emirates10d ago
-
Airflow | Apache Flink | Apache Kafka | Apache Spark | Data ModelingAnnual Flight Allowance | Annual leave | Hybrid working | Learning and conference budget | Medical insuranceMid-level Full TimeDubai, United Arab Emirates R10d ago
-
Applied AI Engineer AED 360K-441KArtificial Intelligence | Cost Optimization | Data Governance | Debugging | Information RetrievalHybrid work model | Reasonable accommodations for applicants | Relocation assistanceMid-level Full TimeAbu Dhabi, UAE R10d ago
-
Embedded Camera Developer AED 132K-186KAgile | Android | C# | C++ | CI/CDAccommodation during hiring process | Chat rooms | Inclusive work culture | Online social events | Work-life balanceMid-level Full TimeDubai - Dubai10d ago
-
AWS | Artificial Intelligence | Azure | Data Science | DatabricksMid-level Full TimeAbu Dhabi, United Arab Emirates11d ago
-
Data Enablement & AdTech Engineer AED 200K-240KAWS | Apache NiFi | Audience Segmentation | Azure | Clean roomsSenior-level Full TimeDubai, United Arab Emirates11d ago