Senior Data Engineer Pyspark with data modelling
Tasks
- Automate and orchestrate data workflows
- Design develop maintain scalable ETL pipelines
- Implement data ingestion processes
- Implement data quality checks and validation
- Monitor pipeline performance and troubleshoot issues
- Process cleanse and transform large datasets
- Tune PySpark and Cloudera performance
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Oozie | Cloudera Data Platform | Data Ingestion | Data Lake | Data Quality | Data Transformation | Data Validation | Data Warehouse | Data platform | ETL | Performance Tuning | PySpark
Education
N/A
Roles
Related jobs
-
Senior Data Engineer Pyspark with Data modelling AED 240K-360KApache Airflow | Apache Oozie | Apache Spark | CDP | Cloudera Data PlatformSenior-level Full TimeAE-DU-Dubai1d ago
-
Senior Data Engineer Pyspark with Data modelling AED 240K-360KApache Airflow | Apache Oozie | Cloudera Data Platform | Data Ingestion | Data ModelingSenior-level Full TimeAE-DU-Dubai1d ago
-
Data/ Oracle Engineer AED 180K-216KBackup & Recovery | Cloud infrastructure | Data Governance | Data Modeling | Data integrationSenior-level Full TimeAbu Dhabi, Abu Dhabi, United Arab …3d ago
-
Lead Data Engineer AED 264K-323KAPI | Azure | Azure Synapse | CI/CD | Data BricksCareer growth opportunities | Collaborative culture | Inclusive environmentSenior-level Full TimeDubai, United Arab Emirates4d ago
-
Senior-level Full TimeAE-DU-Dubai7d ago
-
Data Engineer AED 240K-300KAWS | Azure | Cloud Platforms | Data Lakehouse | Data ModelingCareer advancement | Flexible working | Health insurance | Professional development supportSenior-level Full TimeAbu Dhabi, Abu Dhabi, United Arab …10d ago
-
Data Modelling | Data Validation | Data Warehousing | ETL | Power AutomateSenior-level Full TimeDubai - United Arab Emirates, United …11d ago
-
Big Data Engineer AED 100K-120KApache Spark | Cloud Platforms | Data Storage | ETL | HadoopAir Tickets | Career growth opportunities | Family benefits | VisaMid-level Full TimeDubai, Dubai, United Arab Emirates16d ago
-
Google Cloud Data Engineer AED 120K-144KCloud Dataflow | Cloud Pub/Sub | Data Architecture | Data Governance | Data ModelingAir Tickets | Family benefits | VisaMid-level Full TimeDubai, Dubai, United Arab Emirates17d ago
-
API Development | AWS SageMaker | Airflow | Azure ML | C++Mid-level Full TimeDubai, United Arab Emirates25d ago
-
C++ | CI/CD | ETL | Embeddings | Fine TuningMid-level Full TimeDubai, United Arab Emirates25d ago
-
Senior-level Full TimeDubai, Dubai, United Arab Emirates26d ago
-
Cloud Platforms | Data Architecture | Data Governance | Data Modeling | Data PipelinesFamily medical insurance | Flexible days off | Hybrid work | Social insuranceSenior-level Full TimeDubai, Dubai, United Arab Emirates27d ago
-
Associate Staff Engineer (Data Engineer - Python) AED 105K-120KAirflow | Big Data | Big data architectures | Cloud Platforms | DBTMid-level Full TimeAbu Dhabi (Onsite), United Arab Emirates28d ago
-
CI/CD | Cloud Platforms | Cloudera Data Platform | Data Modeling | Data WarehousingMid-level Full TimeDubai, Dubai, United Arab Emirates29d ago
-
QA & Application Testing & Automation Engineer AED 240K-323KAI Safety | AI/ML | AWS | Automation | AzureCareer growth | Certification support | Diversity & inclusion | Healthcare | Professional development supportSenior-level Contract Full TimeAbu Dhabi, Abu Dhabi, United Arab …30d ago