Data Quality Engineer (Databricks)
Tasks
- Build data quality rule factory
- Compute quality metrics and reporting
- Configure monitoring and alerting
- Deploy quality rules as jobs
- Design Data Quality Framework
- Develop data cleansing and remediation pipelines
- Develop predictive risk scoring models
- Implement profiling notebooks
- Integrate quality gates into pipelines
- Maintain governance audit trails
- Manage exception handling and reprocessing
- Support root cause analysis and remediation
Perks/Benefits
- N/A
Skills/Tech-stack
Anomaly Detection | Data Catalog | Data Cleansing | Data Deduplication | Data Governance | Data Validation | Data profiling | Databricks | Databricks Jobs | Databricks SQL | Databricks Workflows | Delta Lake | MLflow | Machine Learning | Power BI | PySpark | Quarantine Tables | Schema drift | Unity Catalog
Education
N/A
Roles
Data Quality | Data Quality Engineer | Engineer | Quality Engineer
Related jobs
-
[UAE] Data Science & AI (UAE National) AED 200K-200KData Analysis | Data Modeling | Data Science | Data Visualization | Language ProcessingCareer development | Diversity & inclusion | Employee wellbeing | Learning opportunities | MentorshipEntry-level Full TimeAbu Dhabi, United Arab Emirates14h ago
-
Analysis Services | Apache Hive | Apache Pig | Apache Spark | Azure AnalysisSenior-level Full TimeUnited Arab Emirates1d ago
-
Data Engineer AED 96K-96KAWS Glue | Amazon S3 | Analytics engineering | Data Governance | Data ModelingCoaching | Hybrid work policy | Learning and development | Work from homeMid-level Full TimeDubai1d ago
-
AI Agents | API Development | Artificial Intelligence | Automation tools | Code platformsAccess to cutting-edge technologies | Career growth | Fully remote | High autonomy | Location flexibilityMid-level Full TimeUnited Arab Emirates R2d ago
-
Senior Managing Consultant, Advisors & Consulting Services - GenAI Strategy & Deployment AED 216K-300KAI Governance | AI ethics | Agile | Card issuing | Change ManagementSenior-level Full TimeDubai, United Arab Emirates3d ago
-
AI Engineer AED 264K-323KAI Foundry | AWS Lambda | AWS SageMaker | Agent systems | Artificial IntelligenceCareer advancement opportunities | Certification support | Health insurance | Professional development support | Visa sponsorshipSenior-level Contract Full TimeAbu Dhabi, Abu Dhabi, United Arab …6d ago
-
Senior-level Full TimeAbu Dhabi, Abu Dhabi6d ago
-
AWS Glue Data Engineer AED 120K-144KAWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaCareer advancement | Certification support | Competitive compensation N/A | Flexible working arrangements | Health insuranceMid-level Full TimeDubai, Dubai, United Arab Emirates7d ago
-
Senior Data Engineer AED 192K-234KAWS Data | AWS Data Services | Apache Spark | Azure Data | Azure Data PlatformSenior-level Full TimeDubai, Dubai, United Arab Emirates9d ago
-
Data Engineer Lead AED 156K-240KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeUnited Arab Emirates - Dubai - …9d ago
-
AI Engineer (UAE) AED 108K-144KDeep learning | GPU Training | Generative AI | High Performance | High-Performance ComputingDaily meals provided | Health insuranceMid-level Full TimeAbu Dhabi9d ago
-
ASIC | C++ | CPU architecture | Debugging | Deep learningInsurance | Relocation assistance | Visa sponsorshipMid-level Full TimeDubai17d ago
-
Research Engineer in the Center for Interdisciplinary Data Science and Artificial Intelligence (CIDSAI) - Dr. Pierre Youssef AED 180K-200KAPI Integration | Backend Development | Cloud Computing | Data Visualization | Data collectionEducational subsidies | Housing subsidyEntry-level Full TimeAbu Dhabi, UAE19d ago
-
Data Engineer - PySpark & Informatica AED 150K-156KCI/CD | Cloud Architecture | Cloud Deployments | Continuous Deployment | Continuous integrationMid-level Full TimeDubai, Dubai, United Arab Emirates23d ago
-
Adversarial Robustness | Adversarial Robustness Toolbox | Adversarial Testing | CleverHans | Data PrivacyMid-level Full TimeDubai, United Arab Emirates24d ago
-
Computer Vision | Data Preprocessing | Data Privacy | Data Visualization | Feature EngineeringSenior-level Full TimeDubai, Dubai, United Arab Emirates29d ago
-
Sr. Data Scientist (AI & ML) AED 312K-420KA/B | A/B Testing | Airflow | Artificial Intelligence | B testingSenior-level Full TimeDubai, Dubai, United Arab Emirates29d ago
-
Lead Data Scientist/AI Engineer AED 192K-234KA/B | A/B Testing | B testing | CI/CD | Cross-validationSenior-level Full TimeAbu Dhabi, United Arab Emirates29d ago
-
Senior-level Full TimeDubai, Dubai, United Arab Emirates30d ago
-
Senior-level Full TimeAbu Dhabi, AE1mo ago
-
AI Document Intelligence | AI Search | AKS | Access Control | Agentic WorkflowsSenior-level Full TimeDubai, AE1mo ago
-
Deep learning | Language Models | Language Processing | Large Language Models | Machine LearningSenior-level Full TimeAbu Dhabi, AE1mo ago
-
Tax & Legal Services - Senior AI Engineer (Dubai) AED 295K-386KAI Document Intelligence | AI Search | AKS | Access Control | App ServiceCollaborative environment | Continuous learning | Digital upskilling | Mentorship | Well-being programsSenior-level Full TimeDubai, AE1mo ago
-
Mid-level Full TimeAbu Dhabi, United Arab Emirates1mo ago
-
Data Intelligence Machine Learning Engineer AED 144K-144KAWS | Active Learning | Azure ML | DVC | Data VisualizationMid-level Full TimeUnited Arab Emirates - Dubai Office1mo ago