Senior Data Engineer
Tasks
- Automate deployment and maintenance
- Build data processing pipelines
- Collaborate with data stakeholders
- Configure query engines
- Design data lake platform
- Enforce data governance and security
- Implement data ingestion pipelines
- Implement metadata management
- Lead cloud native data lake architecture
- Maintain and upgrade data lake components
- Manage infrastructure as code
- Monitor and troubleshoot data workloads
- Optimize ingestion pipeline performance
- Tune analytics and reporting queries
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon S3 | Ansible | Apache Atlas | Apache Flink | Apache Hive | Apache Hudi | Apache Kafka | Apache NiFi | Apache Spark | Apache Superset | ArgoCD | Avro | CI/CD | CSV | Cloud Storage | Cloud infrastructure | CloudFormation | Delta Lake | Docker | Encryption | IAM | Iceberg | Infrastructure as Code | Java | Kubernetes | Metabase | Network Security | ORC | Oracle Cloud | Oracle Cloud Infrastructure | Parquet | Presto | PySpark | Python | SparkSQL | Terraform | Trino | “as-code”
Education
N/A
Roles
Related jobs
-
Data Engineer, Information System, Dubai AED 72K-96KApache Kafka | Apache Spark | ETL | Python | SQLMid-level Full TimeDubai, Dubai, United Arab Emirates1d ago
-
Sr. Software Engineer - GenAI/Full Stack AED 156K-180KAWS | Asynchronous programming | Authentication | Authorization | AzureSenior-level Full TimeDubai, Dubai, United Arab Emirates1d ago
-
Adversarial Robustness | Adversarial Robustness Toolbox | Adversarial Testing | CleverHans | Data PrivacyMid-level Full TimeDubai, United Arab Emirates2d ago
-
Senior-level Full TimeAbu Dhabi, United Arab Emirates4d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeMid-level Full TimeDubai, United Arab Emirates4d ago
-
AI Product Owner AED 286K-349KAmazon Web Services | Azure | Azure Machine Learning | Cloud platform | Deep learningHybrid work | Remote work not fully possible | Stakeholder engagementSenior-level Full TimeAbu Dhabi, AE R4d ago
-
Generative AI Solutions Engineer AED 100K-110KAWS | Agile | Azure | CI/CD | GitDiversity and inclusion | Global opportunities | Inclusive onboarding | Wellness program | Work-life balanceMid-level Full TimeDubai, Dubai, United Arab Emirates5d ago
-
Senior Consultant - AI Software Engineer- AI Hub - Dubai AED 216K-240KAKS | Automated testing | Azure | Azure Container | Azure Container AppsCoaching and Mentorship | Continuous learning | Flexible work arrangements | Inclusive collaborative culture | Professional developmentSenior-level Full TimeDubai, AE, 92675d ago
-
AI Engineer Lead AED 90K-108KAPI Integration | Cloud Computing | Deep learning | Generative AI | Language ProcessingSenior-level Full TimeDubai, United Arab Emirates6d ago
-
Senior Data Engineer (Python) AED 264K-323KAPI Integration | Apache Airflow | Azure Data | Azure Data Factory | Data FactoryMedical insurance | Multicultural communitySenior-level Full TimeDubai, Dubai, United Arab Emirates (Hybrid) R6d ago
-
API Integration | Automation | Data Modeling | Indexing | JSONCollaborative fast-paced culture | Flexible location | Fully remote work | High-ownership environmentSenior-level Full TimeUnited Arab Emirates R6d ago
-
Sr. Data Scientist (AI & ML) AED 312K-420KA/B | A/B Testing | Airflow | Artificial Intelligence | B testingSenior-level Full TimeDubai, Dubai, United Arab Emirates7d ago
-
Lead Data Scientist/AI Engineer AED 192K-234KA/B | A/B Testing | B testing | CI/CD | Cross-validationSenior-level Full TimeAbu Dhabi, United Arab Emirates7d ago
-
Anomaly Detection | Data Modeling | Data Pipelines | Docker | Machine LearningAutonomy | Career growth opportunities | Collaborative team culture | Flexible work environment | Global collaborationMid-level Full TimeUnited Arab Emirates R7d ago
-
Consultant/Senior Consultant - Tech Consulting - Cybersecurity - GenAI Engineer - Abu Dhabi AED 286K-323KAPI Integration | CI/CD | CSPM | EDR | Fine TuningCoaching and Mentorship | Continuous learning | Diverse and inclusive culture | Travel opportunitiesSenior-level Full TimeAbu Dhabi, AE, 1367d ago
-
Data & Search Engineer - Immediate joiners AED 264K-312KAI Document Intelligence | AI Search | Azure AI | Azure AI Document Intelligence | Azure AI SearchSenior-level Full TimeAbu Dhabi7d ago
-
Senior-level Full TimeDubai, Dubai, United Arab Emirates7d ago
-
Accelerate | Data Analysis | Deep learning | Diffusers | Distributed SystemsAutonomy and ownership | Career growth opportunities | Continuous learning | Flexible globally distributed environment | Fully remote workMid-level Full TimeUnited Arab Emirates R8d ago
-
Deep learning | Distributed machine learning | GPU Training | JAX | Machine LearningAccess to high performance GPU clusters | Flexible work from anywhere | Fully remote | Professional growth opportunitiesSenior-level Full TimeUnited Arab Emirates R8d ago
-
Senior-level Full TimeAbu Dhabi, AE11d ago
-
Apache Kafka | Apache Spark | Cloud Data | Cloud data warehousing | Data ModelingSenior-level Full TimeAbu Dhabi, AE11d ago
-
Lead Data Engineer AED 264K-349KAWS Glue | AWS Lambda | Amazon EC2 | Amazon EMR | Amazon S3Hybrid workSenior-level Full TimeAbu Dhabi, AE11d ago
-
Senior-level Full TimeAbu Dhabi, AE11d ago
-
Senior-level Full TimeAbu Dhabi, AE11d ago
-
Senior-level Full TimeAbu Dhabi, AE11d ago