Senior Data Engineer Pyspark with Data modelling
Tasks
- Automate data workflows
- Design ETL pipelines
- Develop PySpark jobs
- Implement data ingestion
- Implement data quality checks
- Maintain data pipelines
- Monitor pipeline performance
- Optimize Cloudera components
- Orchestrate ETL with Airflow
- Transform cleanse and process datasets
- Tune PySpark performance
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Oozie | Apache Spark | CDP | Cloudera Data Platform | Data Ingestion | Data Lake | Data Modeling | Data Quality | Data Validation | Data Warehouse | Data platform | ETL | Performance Tuning | PySpark
Education
N/A
Roles
Related jobs
-
Senior Data Engineer Pyspark with data modelling AED 295K-360KApache Airflow | Apache Oozie | Cloudera Data Platform | Data Ingestion | Data LakeSenior-level Full TimeAE-DU-Dubai1d ago
-
Senior Data Engineer Pyspark with Data modelling AED 240K-360KApache Airflow | Apache Oozie | Cloudera Data Platform | Data Ingestion | Data ModelingSenior-level Full TimeAE-DU-Dubai1d ago
-
Sr. Data Scientist, Algorithms, GenAI AED 312K-386KA/B | A/B Testing | Airflow | Artificial Intelligence | B testingSenior-level Full TimeDubai, Dubai, United Arab Emirates3d ago
-
Data/ Oracle Engineer AED 180K-216KBackup & Recovery | Cloud infrastructure | Data Governance | Data Modeling | Data integrationSenior-level Full TimeAbu Dhabi, Abu Dhabi, United Arab …3d ago
-
Lead Data Engineer AED 264K-323KAPI | Azure | Azure Synapse | CI/CD | Data BricksCareer growth opportunities | Collaborative culture | Inclusive environmentSenior-level Full TimeDubai, United Arab Emirates4d ago
-
Senior-level Full TimeAE-DU-Dubai7d ago
-
Data Engineer AED 240K-300KAWS | Azure | Cloud Platforms | Data Lakehouse | Data ModelingCareer advancement | Flexible working | Health insurance | Professional development supportSenior-level Full TimeAbu Dhabi, Abu Dhabi, United Arab …10d ago
-
Data Modelling | Data Validation | Data Warehousing | ETL | Power AutomateSenior-level Full TimeDubai - United Arab Emirates, United …11d ago
-
Big Data Engineer AED 100K-120KApache Spark | Cloud Platforms | Data Storage | ETL | HadoopAir Tickets | Career growth opportunities | Family benefits | VisaMid-level Full TimeDubai, Dubai, United Arab Emirates16d ago
-
Google Cloud Data Engineer AED 120K-144KCloud Dataflow | Cloud Pub/Sub | Data Architecture | Data Governance | Data ModelingAir Tickets | Family benefits | VisaMid-level Full TimeDubai, Dubai, United Arab Emirates17d ago
-
Analytical Skills | Communication | Dashboard creation | Data Analysis | Data AutomationMid-level Full TimeDubai, ARE22d ago
-
API Development | AWS SageMaker | Airflow | Azure ML | C++Mid-level Full TimeDubai, United Arab Emirates25d ago
-
C++ | CI/CD | ETL | Embeddings | Fine TuningMid-level Full TimeDubai, United Arab Emirates25d ago
-
Senior-level Full TimeDubai, Dubai, United Arab Emirates26d ago
-
Cloud Platforms | Data Architecture | Data Governance | Data Modeling | Data PipelinesFamily medical insurance | Flexible days off | Hybrid work | Social insuranceSenior-level Full TimeDubai, Dubai, United Arab Emirates27d ago
-
Associate Staff Engineer (Data Engineer - Python) AED 105K-120KAirflow | Big Data | Big data architectures | Cloud Platforms | DBTMid-level Full TimeAbu Dhabi (Onsite), United Arab Emirates28d ago
-
CI/CD | Cloud Platforms | Cloudera Data Platform | Data Modeling | Data WarehousingMid-level Full TimeDubai, Dubai, United Arab Emirates29d ago
-
QA & Application Testing & Automation Engineer AED 240K-323KAI Safety | AI/ML | AWS | Automation | AzureCareer growth | Certification support | Diversity & inclusion | Healthcare | Professional development supportSenior-level Contract Full TimeAbu Dhabi, Abu Dhabi, United Arab …30d ago