Senior Data Engineer
Tasks
- Automate deployment and maintenance
- Build data processing pipelines
- Collaborate with data stakeholders
- Configure query engines
- Design data lake platform
- Enforce data governance and security
- Implement data ingestion pipelines
- Implement metadata management
- Lead cloud native data lake architecture
- Maintain and upgrade data lake components
- Manage infrastructure as code
- Monitor and troubleshoot data workloads
- Optimize ingestion pipeline performance
- Tune analytics and reporting queries
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon S3 | Ansible | Apache Atlas | Apache Flink | Apache Hive | Apache Hudi | Apache Kafka | Apache NiFi | Apache Spark | Apache Superset | ArgoCD | Avro | CI/CD | CSV | Cloud Storage | Cloud infrastructure | CloudFormation | Delta Lake | Docker | Encryption | IAM | Iceberg | Infrastructure as Code | Java | Kubernetes | Metabase | Network Security | ORC | Oracle Cloud | Oracle Cloud Infrastructure | Parquet | Presto | PySpark | Python | SparkSQL | Terraform | Trino | “as-code”
Education
N/A
Roles
Related jobs
-
Software Engineer, Data Infrastructure & Acquisition - Abu Dhabi, United Arab Emirates AED 180K-200KBash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Friendly laid-back atmosphere | Portfolio and LinkedIn support for applicationMid-level Full TimeAbu Dhabi, United Arab Emirates3d ago
-
AI Engineer AED 264K-323KAI Foundry | AWS Lambda | AWS SageMaker | Agent systems | Artificial IntelligenceCareer advancement opportunities | Certification support | Health insurance | Professional development support | Visa sponsorshipSenior-level Contract Full TimeAbu Dhabi, Abu Dhabi, United Arab …3d ago
-
Senior-level Full TimeAbu Dhabi, Abu Dhabi3d ago
-
AWS Glue Data Engineer AED 120K-144KAWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaCareer advancement | Certification support | Competitive compensation N/A | Flexible working arrangements | Health insuranceMid-level Full TimeDubai, Dubai, United Arab Emirates4d ago
-
API Integration | Algorithms | Data Structures | Generative AI | Language ModelsEntry-level Full TimeDubai, United Arab Emirates5d ago
-
API Development | Cloud Storage | Cloud infrastructure | Containerization | Data FormatsAsynchronous collaboration | Career growth | Conference stipend | Hardware stipend | Mentoring opportunitiesSenior-level Full TimeUnited Arab Emirates R6d ago
-
Senior Data Engineer AED 192K-234KAWS Data | AWS Data Services | Apache Spark | Azure Data | Azure Data PlatformSenior-level Full TimeDubai, Dubai, United Arab Emirates6d ago
-
Data Engineer Lead AED 156K-240KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeUnited Arab Emirates - Dubai - …6d ago
-
Automation | Data Analysis | Data Monitoring | Data cleaning | Exploratory Data AnalysisCorporate hardware provision | Flexible working arrangements | In-person events | Private research computing cluster access | Remote-firstMid-level Full TimeUnited Arab Emirates7d ago
-
AI Engineer (UAE) AED 108K-144KDeep learning | GPU Training | Generative AI | High Performance | High-Performance ComputingDaily meals provided | Health insuranceMid-level Full TimeAbu Dhabi7d ago
-
ASIC | C++ | CPU architecture | Debugging | Deep learningInsurance | Relocation assistance | Visa sponsorshipMid-level Full TimeDubai15d ago
-
Quantitative Developer, Systematic Equities AED 180K-228KAlgorithms | C# | C++ | CI/CD | Column-storesSenior-level Full TimeDubai, United Arab Emirates18d ago
-
Data Engineer - PySpark & Informatica AED 150K-156KCI/CD | Cloud Architecture | Cloud Deployments | Continuous Deployment | Continuous integrationMid-level Full TimeDubai, Dubai, United Arab Emirates20d ago
-
Data Engineer, Information System, Dubai AED 72K-96KApache Kafka | Apache Spark | ETL | Python | SQLMid-level Full TimeDubai, Dubai, United Arab Emirates21d ago
-
Sr. Software Engineer - GenAI/Full Stack AED 156K-180KAWS | Asynchronous programming | Authentication | Authorization | AzureSenior-level Full TimeDubai, Dubai, United Arab Emirates21d ago
-
Adversarial Robustness | Adversarial Robustness Toolbox | Adversarial Testing | CleverHans | Data PrivacyMid-level Full TimeDubai, United Arab Emirates22d ago
-
Senior Consultant - AI Software Engineer- AI Hub - Dubai AED 216K-240KAKS | Automated testing | Azure | Azure Container | Azure Container AppsCoaching and Mentorship | Continuous learning | Flexible work arrangements | Inclusive collaborative culture | Professional developmentSenior-level Full TimeDubai, AE, 926725d ago
-
Senior Data Engineer (Python) AED 264K-323KAPI Integration | Apache Airflow | Azure Data | Azure Data Factory | Data FactoryMedical insurance | Multicultural communitySenior-level Full TimeDubai, Dubai, United Arab Emirates (Hybrid) R26d ago
-
Sr. Data Scientist (AI & ML) AED 312K-420KA/B | A/B Testing | Airflow | Artificial Intelligence | B testingSenior-level Full TimeDubai, Dubai, United Arab Emirates27d ago
-
Lead Data Scientist/AI Engineer AED 192K-234KA/B | A/B Testing | B testing | CI/CD | Cross-validationSenior-level Full TimeAbu Dhabi, United Arab Emirates27d ago
-
Senior-level Full TimeDubai, Dubai, United Arab Emirates27d ago
-
Apache Kafka | Apache Spark | Cloud Data | Cloud data warehousing | Data ModelingSenior-level Full TimeAbu Dhabi, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago