Data Engineer
Tasks
- Apply partitioning strategies
- Automate deployments with CI/CD
- Build cloud data storage and orchestration
- Build data pipelines with Spark
- Capture change data using CDC
- Collaborate with cross-functional teams
- Design data pipelines
- Develop streaming data processing
- Implement data lakehouse architectures
- Implement producers consumers and topics
- Integrate Kafka based messaging
- Manage infrastructure as code
- Optimize data pipeline performance
- Perform SQL based data manipulation
- Transform CDC events for downstream
- Use Delta Lake for data management
- Use version control with git
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS | AWS | AWS Glue | Airflow | Apache Kafka | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Event | Azure Event Hub | CDC | CI/CD | Confluent Cloud | DBX | DLT | Data Factory | Data Lakehouse | Databricks | Debezium | Delta Lake | Event Hub | Git | Infrastructure as Code | Java | Oracle | Python | RabbitMQ | S3 | SQL | SQL Server | Scala | “as-code”
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeAE-DU-Dubai8h ago
-
Lead Data Intelligence Machine Learning Engineer AED 153K-234KAWS | Active Learning | Azure Machine Learning | DVC | Data CleansingSenior-level Full TimeUnited Arab Emirates - Dubai Office21h ago
-
AWS SageMaker | Attention Mechanisms | Azure AI | CLIP | CNNSenior-level Full TimeAbu Dhabi, United Arab Emirates1d ago
-
Generative AI Solutions Engineer AED 120K-120KAWS | Agent Design | Agent design patterns | Agile | Artificial IntelligenceDiverse supportive work culture | Global opportunities | Inclusive onboarding | Mentorship culture | Wellness programMid-level Full TimeDubai, Dubai, United Arab Emirates3d ago
-
Sr. Data Scientist (AI & ML) AED 312K-386KApache Airflow | Artificial Intelligence | BigQuery | CatBoost | Causal InferenceSenior-level Full TimeDubai, Dubai, United Arab Emirates4d ago
-
Entry-level Full TimeAbu Dhabi, AE4d ago
-
Authentication | C# | Cryptography | Key Management | LinuxEntry-level Full TimeAbu Dhabi, AE4d ago
-
C# | C++ | Continuous integration | Embedded Systems | IP NetworkingMentorshipEntry-level Full TimeAbu Dhabi, AE4d ago
-
Entry-level Full TimeAbu Dhabi, AE4d ago
-
C++ | Computer Networking | Error rate | Error rate analysis | LatencyEntry-level Full TimeAbu Dhabi, AE4d ago
-
Senior-level Full TimeAbu Dhabi, Abu Dhabi, United Arab …4d ago
-
Junior Robotic System Engineer AED 72K-84KC++ | Industrial fieldbus | Kinematics | LabVIEW | Motion ControlEntry-level Full TimeDubai, United Arab Emirates5d ago
-
Senior-level Full TimeUnited Arab Emirates6d ago
-
Senior Data Engineer AED 255K-306KAirflow | Apache Spark | Cloud Computing | Data Pipeline Development | Data WarehousingSenior-level Full TimeDubai, Dubai, United Arab Emirates6d ago
-
Senior-level Full TimeDubai, Dubai, United Arab Emirates6d ago
-
Mid-level Full TimeDubai, Dubai, United Arab Emirates6d ago
-
API Integration | AutoGPT | Chatbots | Cloud Computing | JavaScriptCareer growth | Flexible work schedule | Remote workSenior-level Full TimeDubai, United Arab Emirates R10d ago
-
AWS | Airflow | BigQuery | Cloud platform | DockerSenior-level Full TimeAbu Dhabi, United Arab Emirates10d ago
-
Senior-level Full TimeAE-Dubai10d ago
-
Data Science and Database Engineer AED 280K-308KData Mining | ETL | Machine Learning | MySQL | OracleMid-level Full TimeDubai, Dubai, United Arab Emirates10d ago
-
Senior Software Engineer II - ML Platform AED 132K-144KAWS | CI/CD | Embeddings | Fine Tuning | GCPMid-level Full TimeDubai, United Arab Emirates10d ago
-
Staff AI Engineer - AI Creator USD 135K-185KAgentic Workflows | Experimentation | LLM integration | Language Models | Large Language ModelsFlexible working hours | Home office equipment budget | International retreats | Learning budgetSenior-level Full TimeBelgium; Dubai; Portugal; United Kingdom; United …11d ago
-
Staff AI Engineer - AI Creator USD 135K-185KAgentic Workflows | Experiment design | Language Models | Large Language Models | Model EvaluationCompetitive compensation | Flexible working hours | IT equipment budget | International company retreats | Learning budgetSenior-level Full TimeBelgium; Dubai; Portugal; United Kingdom; United …11d ago
-
Staff AI Engineer - AI Creator USD 135K-185KAgentic Workflows | Experimentation | LLM integration | Language Models | Large Language ModelsFlexible working hours | Global Company Retreats | IT equipment budget | Learning budgetSenior-level Full TimeBelgium; Dubai; Portugal; United Kingdom; United …11d ago
-
Staff AI Engineer - AI Creator USD 135K-185KAgentic Workflows | Experimentation | Language Models | Large Language Models | Machine LearningConference and training access | Flexible working hours | Global retreats | IT equipment budget | International team collaborationSenior-level Full TimeBelgium; Dubai; Portugal; United Kingdom; United …11d ago