Data Quality Engineer (Databricks)
Chennai, Tamil Nadu
INR 1600K-2500K (estimate) Senior-level Full Time
Tasks
- Build data cleansing and remediation pipelines
- Build predictive quality risk scoring models
- Configure Databricks data quality environment
- Configure monitoring and alerting
- Create data quality metrics and reporting feeds
- Deploy quality gates
- Design Data Quality Framework
- Develop profiling notebooks
- Develop reprocessing workflows
- Execute data quality rules
- Implement quality rule factory
- Integrate quality controls into Delta Lake pipelines
- Maintain audit trails and documentation
- Manage quarantine failed record register
- Perform root cause analysis
Perks/Benefits
Skills/Tech-stack
Anomaly Detection | Azure Monitor | Data Governance | Databricks | Databricks Jobs | Databricks SQL | Databricks Workflows | Delta Lake | Delta Tables | Fuzzy Matching | MLflow | Machine Learning | Metadata Management | Power BI | PySpark | Unity Catalog
Education
N/A
Roles
Data Quality | Data Quality Engineer | Engineer | Quality Engineer
Related jobs
-
Mid-level Full TimeIndia8h ago
-
AWS Glue | AWS Lambda | Amazon EMR | Amazon Kinesis | Amazon RedshiftCareer progression | Collaborative culture | Continuous learning | Innovation-focused culture | International organizationMid-level Full TimeIndia8h ago
-
Senior AI and Machine Learning Engineer INR 2500K-4500KCalculus | Convolutional Neural Networks | Data Mining | Data Visualization | Decision TreesCareer Development Programs | Flexible work arrangements | Health and wellbeing benefitsSenior-level Full TimeBengaluru, Karnātaka, India14h ago
-
Senior AI and Machine Learning Engineer INR 2500K-4500KConvolutional Neural Networks | Data Mining | Data Preprocessing | Decision Trees | Deep learningHealth and wellbeing | Professional developmentSenior-level Full TimeBengaluru, Karnātaka, India14h ago
-
Custom Software Engineer INR 2500K-3500KBusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data QualitySenior-level Full TimeKolkata, KDC1A, India14h ago
-
Custom Software Engineer INR 2500K-3500KBusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data QualitySenior-level Full TimeBengaluru, BDC11A, India14h ago
-
Custom Software Engineer INR 2500K-3500KAutomation | Batch Data Processing | Batch data | BusinessObjects Data Services | Data GovernanceSenior-level Full TimePune, PDC2C, India14h ago
-
Custom Software Engineer INR 2500K-3500KAnomaly Detection | Batch Processing | BusinessObjects Data Services | Data Governance | Data LineageSenior-level Full TimeBengaluru, BDC11A, India14h ago
-
Mid-level Full TimeBangalore, KA, IN14h ago
-
Mid-level Full TimeBangalore, KA, IN14h ago
-
Mid-level Full TimeBangalore, KA, IN14h ago
-
Z2_Sr. Data Engineer|Data Science INR 3000K-3900KAzure | Azure Databricks | CI/CD | DAX | Data GovernanceSenior-level Full TimeBangalore, KA, IN14h ago
-
Senior Engineer - Databricks INR 2800K-4000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexible working hours | Paid parental leave | Paid training and development programs | Remote or mobile workingSenior-level Full TimeBangalore RMZ-ECO WORLD, India14h ago
-
Associate Engineer - AI services INR 1000K-1000KAPI product | API product development | AWS | Agile | AlgorithmsDiversity and inclusion | Hybrid working | Opportunities for growthMid-level Full TimeIND, Emerio, Chennai, India14h ago
-
Mid-level Full TimeBangalore, KA, IN14h ago
-
AL Research Scientist - Algorithm INR 2475K-3465KData Engineering | Deep learning | Generative AI | Human Feedback | Language ModelsMid-level Full TimeChennai,IND, India14h ago
-
Data Engineer INR 2600K-3880KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | DAXSenior-level Full TimeBangalore, KA, IN14h ago
-
Data Engineer I INR 900K-900KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure DatabricksEntry-level Full TimeBangalore, India Office14h ago
-
AI/Data Solutioning Engineer INR 2000K-4600K.NET | AI Foundry | Agent Orchestration | Apache Spark | Application InsightsSenior-level Full TimeHyderabad, Telangana, India - Remote R14h ago
-
Senior-level Full TimeHyderabad (SEZ), India14h ago
-
Senior Member Of Technical Staff- Machine Learning INR 3000K-4500KAWS | Amazon EKS | Computer Vision | Deep learning | Generative AIBook clubs | Collaborative workspaces | Commuter support | Employee assistance program | Employee resource groupsSenior-level Full TimePune India14h ago
-
Engr, Algorithm (P2) INR 2400K-2500KData Interpretation | Data analytics | Deep learning | Machine Learning | Model DeploymentFamily-friendly benefits | Inclusive work environmentNone Full TimeIND-Tamil Nadu-Chennai-KLA, India14h ago
-
Sr. Data Engineer INR 3000K-4000KAWS CodePipeline | AWS Glue | AWS Lambda | Amazon Athena | Amazon EMRSenior-level Full TimeHyderabad, Telangana, India15h ago
-
Principal AI Research Engineer INR 2500K-5000KAutomatic Speech Recognition | Deep learning | Distributed Training | Efficient Inference | Information RetrievalCompetitive compensation | Comprehensive benefits | Meaningful equitySenior-level Full TimeBangalore22h ago
-
Senior-level Full TimeGurgaon, India22h ago