Data Engineer (PySpark)
Abu Dhabi, United Arab Emirates
A AED 156K-192K (estimate) Senior-level Full Time
Tasks
- Automate workflows
- Build data pipelines
- Conduct exploratory data analysis
- Deploy production data pipelines
- Design data pipelines
- Implement feature engineering pipelines
- Manage source code and CI/CD
- Optimize Spark jobs
- Perform data cleansing
- Perform data ingestion
- Perform data transformation
- Validate data quality
- Write unit tests
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Spark | CI/CD | Data Cleansing | Data Ingestion | Data Transformation | Data Validation | Data pipeline | Data pipeline optimization | Feature Engineering | Git | GitHub Actions | Jenkins | Jupyter Notebooks | NoSQL | Performance Tuning | Pipeline Optimization | PySpark | Python | SQL | Spark performance tuning
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Azure Data Engineer AED 90K-108KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeDubai, Dubai, United Arab Emirates20h ago
-
Algorithms | Computational optimization | Data analytics | Machine Learning | PythonEntry-level InternshipDubai, Dubai, United Arab Emirates1d ago
-
API Integration | Azure | Azure AI | Database Integration | GPU ComputingComprehensive benefits package | Inclusive workplace culture | Professional growth opportunities | Remote work flexibilitySenior-level Full TimeUnited Arab Emirates1d ago
-
AWS | Azure | Cloud Platforms | Data Analysis | Data PreprocessingAutonomy | Flexible work environment | Fully remote work | Professional growth and continuous learning | Work-life balanceMid-level Full TimeUnited Arab Emirates R1d ago
-
GenAI Software Engineer - Node.js & LLMs AED 228K-240KAWS Bedrock | Agile | Amazon Web Services | Azure OpenAI | CI/CDSenior-level Full TimeDubai, Dubai, United Arab Emirates2d ago
-
Sr. MongoDB Database Engineer (Open Source DBA) AED 180K-240KAgile | Ansible | Backup and Restore | Bash | Database MigrationSenior-level Full TimeDubai, Dubai, United Arab Emirates2d ago
-
Senior-level Full TimeAbu Dhabi, Abu Dhabi, United Arab …3d ago
-
Dell AI Infrastructure & MLOps Engineer - (6 Month Only) AED 156K-192KAI Stack | Apache Spark | Best practices | Dell PowerScale | Dell R570Mid-level Full TimeDubai, Dubai, United Arab Emirates3d ago
-
Generative AI / Azure AI Engineering Lead AED 192K-234KAI Foundry | AI Search | Active Directory | Agent systems | Agentic AISenior-level Full TimeDubai, Arenco Tower, United Arab Emirates4d ago
-
Attention Mechanisms | Batching | CUDA | Compute Graphs | Distributed SystemsDirect product impact | Engineering focused culture | Equity participation | Flexible remote work environment | High ownershipSenior-level Full TimeUnited Arab Emirates6d ago
-
Sr. Data Engineer - PySpark (Banking) AED 150K-228KAgile | Apache Spark | CI/CD | Data Mart | Data TransformationSenior-level Full TimeDubai, Dubai, United Arab Emirates7d ago
-
Senior Full Stack Engineer - GenAI AED 216K-240KAI Agents | AWS | Agent Frameworks | Anthropic | App integrationsSenior-level Full TimeDubai, Dubai, United Arab Emirates7d ago
-
Data Intelligence Machine Learning Engineer AED 144K-162KAWS | Active Learning | Azure ML | DVC | Data GenerationMid-level Full TimeUnited Arab Emirates - Dubai Office7d ago
-
Senior Data Intelligence Machine Learning Engineer AED 192K-240KAWS | Active Learning | Azure | Azure ML | DVCSenior-level Full TimeUnited Arab Emirates - Dubai Office7d ago
-
Lead Data Intelligence Machine Learning Engineer AED 174K-240KAWS | Active Learning | Azure ML | Computer Vision | DVCSenior-level Full TimeUnited Arab Emirates - Dubai Office7d ago
-
Data Intelligence MLOps Engineer AED 240K-312KAWS SageMaker | Airflow | Azure Machine Learning | Bash | CI/CDSenior-level Full TimeUnited Arab Emirates - Dubai Office7d ago
-
Senior-level Full TimeUnited Arab Emirates - Dubai Office7d ago
-
Lead Connectivity Engineer AED 156K-240KAI machine learning | Agile | Embedded Systems | Integration Testing | Internet of ThingsSenior-level Full TimeUnited Arab Emirates - Dubai Office7d ago
-
Senior-level Full TimeDubai, Arenco Tower, United Arab Emirates7d ago
-
Engineer, Data & Agentic AI AED 120K-144KData Engineering | Data Modeling | ETL | Language Processing | MLOpsCareer development | Performance-based culture | Training opportunitiesMid-level Full TimeAbu Dhabi, United Arab Emirates7d ago
-
Data Insights & Analytics Lead USD 120K-180KAmplitude | Blockchain Analytics | Contract analytics | Data Visualization | Dune AnalyticsCollaborative work culture | Dental insurance | Global team | Health insurance | Professional developmentSenior-level Full TimeCayman R8d ago
-
Access Control | Data Governance | Data Lineage | Data Pipelines | Data QualitySenior-level Full TimeDubai, Dubai, United Arab Emirates8d ago
-
APIs | AWS Lambda | AWS RDS | AWS S3 | AWS SNSContinuous learning | Flexible work environment | High autonomy | Professional growthSenior-level Full TimeUnited Arab Emirates8d ago
-
Senior Software Engineer - AI Agents & GenAI AED 180K-228KAPI Keys | CI/CD | Function Calling | Git | GuardrailsSenior-level Full TimeDubai, Dubai, United Arab Emirates9d ago
-
Engineer, Data & Agentic AI AED 120K-144KCloud Computing | Data Pipelines | Deep learning | ETL | Language ProcessingTraining and developmentMid-level Full TimeAbu Dhabi, United Arab Emirates9d ago