Data Quality Engineer (Databricks)
Chennai, Tamil Nadu
INR 1600K-2500K (estimate) Senior-level Full Time
Tasks
- Build data cleansing and remediation pipelines
- Build predictive quality risk scoring models
- Configure Databricks data quality environment
- Configure monitoring and alerting
- Create data quality metrics and reporting feeds
- Deploy quality gates
- Design Data Quality Framework
- Develop profiling notebooks
- Develop reprocessing workflows
- Execute data quality rules
- Implement quality rule factory
- Integrate quality controls into Delta Lake pipelines
- Maintain audit trails and documentation
- Manage quarantine failed record register
- Perform root cause analysis
Perks/Benefits
Skills/Tech-stack
Anomaly Detection | Azure Monitor | Data Governance | Databricks | Databricks Jobs | Databricks SQL | Databricks Workflows | Delta Lake | Delta Tables | Fuzzy Matching | MLflow | Machine Learning | Metadata Management | Power BI | PySpark | Unity Catalog
Education
N/A
Roles
Data Quality | Data Quality Engineer | Engineer | Quality Engineer
Related jobs
-
Manager Software Engineer- ML + NLP+ ppl management INR 3200K-4800KAPIs | BERT | Data Mining | Data Science | Deep learningFlexible work arrangements | Hybrid work environmentSenior-level Full TimeGurgaon - Cyber Park, India8h ago
-
Principal Engineer, Storage Data Science and Analytics INR 3200K-4590KAIOps | Anomaly Detection | Apache Spark | C# | C++Career Development Programs | Flexible work arrangements | Health and wellbeing benefitsSenior-level Full TimeBengaluru, Karnātaka, India8h ago
-
AWS | Airflow | DBT | Fine Tuning | Language ModelsBonuses | Disability insurance | Life insurance | Paid parental leave | Paid time offSenior-level Full TimeRemote, India R14h ago
-
AI/ML engineer - Associate Research Scientist INR 1500K-2500KAIOps | API Development | AWS | Anomaly Detection | AutomationContinuous learning and professional development | Employee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India15h ago
-
Mid-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101315h ago
-
Efs Fcrm 169474 INR 1500K-2400KApache Spark | Azure DevOps | CI/CD | Data Partitioning | Data WarehousingMid-level Full TimeHyderabad, IND-TG, India15h ago
-
Planview Administration 169576 INR 1500K-2500KAlerting | Data Governance | Data Modeling | Data Validation | Data cleaningSenior-level Full TimeHyderabad, IND-TG, India15h ago
-
Snr AI INR 2500K-5000KAI Search | Amazon SageMaker | Azure AI | Azure AI Search | Azure Machine LearningSenior-level Full TimeIN-HR-Gurgaon20h ago
-
Azure Data Engineer INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseSenior-level Full TimePune, Maharashtra, India21h ago
-
Lead Software Engineer - Python Full Stack, AI/ML INR 4000K-5000KAWS | Agile | Angular | Application Resiliency | Automated testingSenior-level Full TimeMumbai, Maharashtra, India21h ago
-
Senior-level Full Timecoimbatore, India22h ago
-
Digital Marketing Analyst INR 2500K-3380KAWS | Azure | Cloud platform | Customer Analytics | Data GovernanceSenior-level Full TimeChennai, Tamil Nadu, India22h ago
-
Senior Staff Machine Learning Engineer (Java + LLM) INR 3000K-4401KAlgorithm Design | Code Tuning | Data Structures | Data Structures and Algorithms | Design PatternsFlexible work schedule | Health benefits | Paid time off | Remote work optionSenior-level Full TimeBangalore, Karnataka, India22h ago
-
Senior Staff Engineer, Data Migration Lead INR 3000K-4000KAccess Control | Audit Trail | Cutover planning | Data Governance | Data ManagementSenior-level Full TimeRemote, India R23h ago
-
Senior-level Full TimeMumbai, Maharashtra, India23h ago
-
Data Analyst Customer Success Engineer INR 2500K-4064KA/B | A/B Testing | AI workflows | API Integration | AmplitudeClient Customer Interactions | Health insurance | Learning aids | Meal vouchersSenior-level Full TimeHYDERABAD, Telangana, India23h ago
-
Staff Engineer, Data Migration Analyst INR 2600K-4000KAS400 | Acceptance Testing | Core Banking | Core Banking Deposits | Customer AccountSenior-level Full TimeRemote, India R23h ago
-
Staff Engineer, Data Migration Analyst INR 2000K-3000KAS400 | Access Control | CASA | Core Banking | Core DepositsSenior-level Full TimeRemote, India R1d ago
-
Senior-level Full TimeMumbai, India1d ago
-
Deputy Vice President - Data Scientist INR 3300K-4000KAmazon Web Services | Apache Spark | Data Visualization | Gradient boosting | HadoopAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Inclusive cultureExecutive-level Full TimeGurugram, India1d ago
-
Software Engineer III - Python Developer + AWS + LLM / Gen AI INR 3500K-5000KAWS | Agile | Azure | CI/CD | Data PipelinesSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Software Engineering - Data, Lakehouse and AI Data Platform Engineer-Hyderabad-Associate INR 1500K-2500KApache Iceberg | Apache Spark | Avro | CI/CD | Cause analysisMid-level Full TimeHyderabad, Telangana, India1d ago
-
Senior-level Full TimeBangalore, Karnataka, India1d ago
-
Senior Data Engineer INR 3000K-4000KCI/CD | Cloud Storage | Column-Level Security | DBT | Data GovernanceHybrid work environment | Mentorship and growth opportunitiesSenior-level Full TimeChennai, India1d ago
-
Senior Software Engineer – Data Platform (Tech Lead) INR 3000K-4000KAPI Design | Application Programming | Application Programming Interfaces | Automated testing | AzureFlexible working models | Sabbaticals | Training opportunitiesSenior-level Full TimeBengaluru, KA, India1d ago