Data Engineer
Tasks
- Apply partitioning strategies
- Automate deployments with CI/CD
- Build cloud data storage and orchestration
- Build data pipelines with Spark
- Capture change data using CDC
- Collaborate with cross-functional teams
- Design data pipelines
- Develop streaming data processing
- Implement data lakehouse architectures
- Implement producers consumers and topics
- Integrate Kafka based messaging
- Manage infrastructure as code
- Optimize data pipeline performance
- Perform SQL based data manipulation
- Transform CDC events for downstream
- Use Delta Lake for data management
- Use version control with git
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS | AWS | AWS Glue | Airflow | Apache Kafka | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Event | Azure Event Hub | CDC | CI/CD | Confluent Cloud | DBX | DLT | Data Factory | Data Lakehouse | Databricks | Debezium | Delta Lake | Event Hub | Git | Infrastructure as Code | Java | Oracle | Python | RabbitMQ | S3 | SQL | SQL Server | Scala | “as-code”
Education
N/A
Roles
Related jobs
-
Algorithms | Artificial Intelligence | C# | Cloud platform | CpluspluplusSenior-level Full TimeDubai - United Arab Emirates3h ago
-
APIs | Backend Development | CRM Integration | HubSpot | JavaScriptCareer growth | Continuous learning | Fully remoteMid-level Full TimeUnited Arab Emirates R5d ago
-
Mid-level Full TimeDubai, United Arab Emirates5d ago
-
Cloud Data | Cloud Data Governance | Cloud Data Governance and Catalog | Data Governance | Data LakeSenior-level Full TimeDubai, Dubai6d ago
-
Cloud Computing | Data Engineering | Data Governance | Data Lakes | Data PipelinesAccommodation | Air ticket | Family Status Benefits | Health insuranceSenior-level Full TimeAbu Dhabi, United Arab Emirates8d ago
-
API | Automation | Generative AI | Langchain | Language ModelsMid-level Full TimeDubai, United Arab Emirates11d ago
-
API Integration | Automation | Data Pipelines | Forecasting | LLMMid-level Full TimeDubai, United Arab Emirates11d ago
-
Analysis Services | Apache Airflow | Azure | Azure Blob | Azure Blob StorageCareer progression | Flexible working model | Work-life balanceSenior-level Full TimeDubai, Dubai, United Arab Emirates11d ago
-
API Security | AWS | Apache Atlas | Apache Flink | Apache HadoopMid-level Full TimeDubai, Dubai, United Arab Emirates11d ago
-
AI Deployment Strategist - MENA AED 240K-264KAPI Integration | APIs | Artificial Intelligence | Fine Tuning | Frontend IntegrationClient site work | Travel 30 to 60 percentSenior-level Full TimeAbu Dhabi15d ago
-
C++ | Control Systems | Flight Dynamics | GNSS | HILSenior-level Full TimeAbu Dhabi, AE15d ago
-
Data Engineer AED 84K-96KApache Airflow | Apache Kafka | Apache Spark | Azure Data | Azure Data FactoryLearning opportunities | Leisure support | Psychological support | Sports support | Supportive work environmentMid-level Full TimeDubai, Dubai, United Arab Emirates18d ago
-
Apache Airflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StoragePaid time off | Training and developmentSenior-level Full TimeDubai, Dubai, United Arab Emirates18d ago
-
Senior Data Platform Engineer AED 228K-306KAWS | Apache Airflow | Azure | Azure Data | Azure Data FactoryPaid time off | Performance bonus | Training and developmentSenior-level Full TimeDubai, Dubai, United Arab Emirates18d ago
-
AI Engineer (Applied) AED 204K-240KAWS | Anomaly Detection | Azure | Context window | Context window managementPaid time off | Performance bonus | Training and developmentSenior-level Full TimeDubai, Dubai, United Arab Emirates18d ago
-
Data Engineer II AED 90K-120KAmazon Web Services | Apache Airflow | Apache Kafka | BigQuery | CI/CDLearning culture | Mentorship | Training budgetMid-level Full TimeDubai, Dubai, United Arab Emirates19d ago
-
Agentic DevOps Lead – Data & AI AED 264K-349KAWS | Agent systems | Artificial Intelligence | Autogen | CI/CDCompetitive rewards | Continuous coaching | Flexible work arrangements | State-of-the-art technology | Travel availabilitySenior-level Full TimeDubai, Arenco Tower, United Arab Emirates20d ago
-
Machine Learning Engineer AED 312K-386KAPIs | Airflow | CI/CD | Classification | ClusteringContinuous learning | Flexible working models | Health and well-being | Skill growthSenior-level Full TimeDubai, Dubai, AE, 11835320d ago
-
Senior Machine Learning Engineer AED 312K-386KAgent workflows | CI/CD | Cloud Native | Deep learning | Distributed TrainingFlexible working models | Health and well-being benefits | Learning opportunities | Skill growthSenior-level Full TimeDubai, Dubai, AE, 11835320d ago
-
Senior-level Full TimeDubai, Dubai, AE, 11835320d ago
-
Senior-level Full TimeAE-DU-Dubai22d ago
-
Lead Data Intelligence Machine Learning Engineer AED 153K-234KAWS | Active Learning | Azure Machine Learning | DVC | Data CleansingSenior-level Full TimeUnited Arab Emirates - Dubai Office22d ago
-
AWS SageMaker | Attention Mechanisms | Azure AI | CLIP | CNNSenior-level Full TimeAbu Dhabi, United Arab Emirates23d ago
-
Generative AI Solutions Engineer AED 120K-120KAWS | Agent Design | Agent design patterns | Agile | Artificial IntelligenceDiverse supportive work culture | Global opportunities | Inclusive onboarding | Mentorship culture | Wellness programMid-level Full TimeDubai, Dubai, United Arab Emirates25d ago
-
Sr. Data Scientist (AI & ML) AED 312K-386KApache Airflow | Artificial Intelligence | BigQuery | CatBoost | Causal InferenceSenior-level Full TimeDubai, Dubai, United Arab Emirates26d ago