Data Engineer - PySpark & Informatica
Dubai, Dubai, United Arab Emirates
AED 150K-156K (estimate) Mid-level Full Time
Tasks
- Build and model Raw Data Vault structures
- Collaborate on data engineering principles and governance standards
- Create data exchange standards
- Define data archival retention and purging standards
- Define data retention and partitioning strategies
- Define enterprise data architecture standards
- Design scalable data engineering solutions
- Develop Informatica platform solutions
- Develop PySpark pipelines
- Ensure data quality, governance, and security compliance
- Identify and document critical data elements
- Implement CI CD enabled data engineering deployments
- Implement data reusability and performance optimizations
- Support large-scale data transformations
Perks/Benefits
- N/A
Skills/Tech-stack
CI/CD | Cloud Architecture | Cloud Deployments | Continuous Deployment | Continuous integration | Data Architecture | Data Archival | Data Governance | Data Management | Data Modeling | Data Quality | Data Security | Data Vault | Data Warehousing | Data profiling | Dimensional Modeling | Informatica | Informatica PowerCenter | Metadata Management | PySpark | Slowly Changing Dimensions | Snowflake Schema | Star Schema
Roles
Related jobs
-
AI Engineer AED 264K-323KAI Foundry | AWS Lambda | AWS SageMaker | Agent systems | Artificial IntelligenceCareer advancement opportunities | Certification support | Health insurance | Professional development support | Visa sponsorshipSenior-level Contract Full TimeAbu Dhabi, Abu Dhabi, United Arab …4d ago
-
Senior-level Full TimeAbu Dhabi, Abu Dhabi4d ago
-
AWS Glue Data Engineer AED 120K-144KAWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaCareer advancement | Certification support | Competitive compensation N/A | Flexible working arrangements | Health insuranceMid-level Full TimeDubai, Dubai, United Arab Emirates5d ago
-
Senior Data Engineer AED 192K-234KAWS Data | AWS Data Services | Apache Spark | Azure Data | Azure Data PlatformSenior-level Full TimeDubai, Dubai, United Arab Emirates7d ago
-
Data Engineer Lead AED 156K-240KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeUnited Arab Emirates - Dubai - …7d ago
-
Quantitative Developer, Systematic Equities AED 180K-228KAlgorithms | C# | C++ | CI/CD | Column-storesSenior-level Full TimeDubai, United Arab Emirates19d ago
-
Sr. Software Engineer - GenAI/Full Stack AED 156K-180KAWS | Asynchronous programming | Authentication | Authorization | AzureSenior-level Full TimeDubai, Dubai, United Arab Emirates22d ago
-
Senior Consultant - AI Software Engineer- AI Hub - Dubai AED 216K-240KAKS | Automated testing | Azure | Azure Container | Azure Container AppsCoaching and Mentorship | Continuous learning | Flexible work arrangements | Inclusive collaborative culture | Professional developmentSenior-level Full TimeDubai, AE, 926726d ago
-
Sr. Data Scientist (AI & ML) AED 312K-420KA/B | A/B Testing | Airflow | Artificial Intelligence | B testingSenior-level Full TimeDubai, Dubai, United Arab Emirates28d ago
-
Lead Data Scientist/AI Engineer AED 192K-234KA/B | A/B Testing | B testing | CI/CD | Cross-validationSenior-level Full TimeAbu Dhabi, United Arab Emirates28d ago
-
Senior-level Full TimeDubai, Dubai, United Arab Emirates28d ago
-
Apache Kafka | Apache Spark | Cloud Data | Cloud data warehousing | Data ModelingSenior-level Full TimeAbu Dhabi, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago
-
Cloud Data | Cloud Data Platforms | Data Engineering | Data Governance | Data QualitySenior-level Full TimeDubai, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago
-
Apache Airflow | Apache Kafka | Cloud Computing | Data Modeling | Data QualitySenior-level Full TimeDubai, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago
-
Senior-level Full TimeDubai, AE1mo ago