Sr. Data Engineer - PySpark (Banking)
Dubai, Dubai, United Arab Emirates
AED 150K-228K (estimate) Senior-level Full Time
Tasks
- Build data transformation pipelines
- Collaborate with cross-functional teams
- Conduct code reviews
- Debug PySpark code
- Deploy to production
- Design ETL pipelines
- Develop PySpark data processing
- Develop data mart solutions
- Ensure data quality and integrity
- Implement CI/CD for deployments
- Maintain technical documentation
- Optimize pipeline performance
- Perform SDLC activities
- Perform post-production support
- Support UAT and bug fixing
- Troubleshoot production issues
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Spark | CI/CD | Data Mart | Data Transformation | Data Warehousing | ETL | Git | Hadoop | Hive | Informatica BDM | Jupyter Notebook | MapReduce | NoSQL | Oracle SQL | Pandas | PySpark | Python | SQL
Education
N/A
Roles
Related jobs
-
Senior Full Stack Engineer - GenAI AED 216K-240KAI Agents | AWS | Agent Frameworks | Anthropic | App integrationsSenior-level Full TimeDubai, Dubai, United Arab Emirates1d ago
-
Data Intelligence Machine Learning Engineer AED 144K-162KAWS | Active Learning | Azure ML | DVC | Data GenerationMid-level Full TimeUnited Arab Emirates - Dubai Office1d ago
-
Senior Data Intelligence Machine Learning Engineer AED 192K-240KAWS | Active Learning | Azure | Azure ML | DVCSenior-level Full TimeUnited Arab Emirates - Dubai Office1d ago
-
Lead Data Intelligence Machine Learning Engineer AED 174K-240KAWS | Active Learning | Azure ML | Computer Vision | DVCSenior-level Full TimeUnited Arab Emirates - Dubai Office1d ago
-
Data Intelligence MLOps Engineer AED 240K-312KAWS SageMaker | Airflow | Azure Machine Learning | Bash | CI/CDSenior-level Full TimeUnited Arab Emirates - Dubai Office1d ago
-
Senior-level Full TimeUnited Arab Emirates - Dubai Office1d ago
-
Lead Connectivity Engineer AED 156K-240KAI machine learning | Agile | Embedded Systems | Integration Testing | Internet of ThingsSenior-level Full TimeUnited Arab Emirates - Dubai Office1d ago
-
Engineer, Data & Agentic AI AED 120K-144KData Engineering | Data Modeling | ETL | Language Processing | MLOpsCareer development | Performance-based culture | Training opportunitiesMid-level Full TimeAbu Dhabi, United Arab Emirates1d ago
-
Data Insights & Analytics Lead USD 120K-180KAmplitude | Blockchain Analytics | Contract analytics | Data Visualization | Dune AnalyticsCollaborative work culture | Dental insurance | Global team | Health insurance | Professional developmentSenior-level Full TimeCayman R2d ago
-
Access Control | Data Governance | Data Lineage | Data Pipelines | Data QualitySenior-level Full TimeDubai, Dubai, United Arab Emirates2d ago
-
Data Mining | KPI Reporting | Language Processing | Machine Learning | Natural LanguageMid-level Full TimeDubai, ARE2d ago
-
AI Deployment | Algorithm Design | Computational Efficiency | Data Science | Machine LearningInternshipEntry-level InternshipDubai, Dubai, United Arab Emirates2d ago
-
APIs | AWS Lambda | AWS RDS | AWS S3 | AWS SNSContinuous learning | Flexible work environment | High autonomy | Professional growthSenior-level Full TimeUnited Arab Emirates2d ago
-
Senior Software Engineer - AI Agents & GenAI AED 180K-228KAPI Keys | CI/CD | Function Calling | Git | GuardrailsSenior-level Full TimeDubai, Dubai, United Arab Emirates3d ago
-
Applied AI Specialist AED 216K-300KAPI | Anomaly Detection | Cloud Architecture | Computer Vision | Data GovernanceContinued career development support | Employee resource groups | Flexible work-from-home policy | Generous paid time off | Paid volunteer timeSenior-level Full TimeUAE-Dubai, United Arab Emirates R3d ago
-
Artificial Intelligence | Automation | Data Analysis | Data Mining | Machine LearningMid-level Full TimeDubai, ARE3d ago
-
Engineer, Data & Agentic AI AED 120K-144KCloud Computing | Data Pipelines | Deep learning | ETL | Language ProcessingTraining and developmentMid-level Full TimeAbu Dhabi, United Arab Emirates3d ago
-
Senior-level Full TimeDubai, Dubai, United Arab Emirates4d ago
-
Data Architect - Treasury AED 240K-323KAccess Control | Amazon Web Services | Azure Synapse | Azure Synapse Analytics | Batch Data IntegrationCareer advancement | Certification support | Employee incentive program | Health insurance | Professional development supportSenior-level Contract Full TimeDubai, Dubai, United Arab Emirates4d ago
-
Agentic DevOps Lead – Data & AI AED 264K-323KAWS | Autogen | CI/CD | Cloud Architecture | Cloud platformCareer progression | Competitive rewards | Continuous coaching | Flexible work arrangements | Travel as neededSenior-level Full TimeDubai, Arenco Tower, United Arab Emirates4d ago
-
Mid-level Full TimeDubai, United Arab Emirates4d ago
-
Deep learning | Generative AI | Language Models | Language Processing | Large Language ModelsMid-level Full TimeAbu Dhabi, United Arab Emirates4d ago
-
Alerting | Amazon Redshift | Batch Processing | CI/CD | Cause analysisCollaboration with cross-functional teams | Fully remote work | Ownership over data reliability strategy | Remote opportunitySenior-level Full TimeUnited Arab Emirates R4d ago
-
Generative AI / Azure AI Engineering Lead AED 192K-234KACL | AI Foundry | AI Search | API Security | Agent systemsSenior-level Full TimeDubai, Arenco Tower, United Arab Emirates5d ago
-
API Integration | Agile | Artificial Intelligence | Automation platforms | Business ProcessCareer growth opportunities | Exposure to enterprise AI projects | Onsite work | Performance incentives | Relocation to DubaiMid-level Full TimeDubai, United Arab Emirates5d ago