Data Quality Engineer (Databricks)
Bengaluru, Karnataka
INR 1600K-2500K (estimate) Senior-level Full Time
Tasks
- Build data profiling notebooks
- Build predictive risk scoring models
- Configure Databricks environment
- Create data quality metrics and reporting feeds
- Deploy ML models with MLflow
- Deploy quality rules with jobs
- Design Data Quality Framework
- Develop data cleansing remediation pipelines
- Implement data quality rule factory
- Implement exception handling and quarantine tables
- Integrate quality gates into pipelines
- Perform root cause analysis
- Produce governance audit artifacts
- Set up monitoring and alerting
Perks/Benefits
- N/A
Skills/Tech-stack
Anomaly Detection | Azure Monitor | Data Governance | Databricks | Databricks Jobs | Databricks SQL | Databricks Workflows | Delta Lake | Delta Lake Tables | Fuzzy Matching | Lakehouse Architecture | MLflow | Machine Learning | Metadata Management | Power BI | PySpark | SQL | Unity Catalog
Education
N/A
Roles
Data Quality | Data Quality Engineer | Engineer | Quality Engineer
Related jobs
-
Senior-level Full TimeIN-AP-Hyderabad12h ago
-
GCP Data Engineer INR 1500K-2400KAlation | Amazon Redshift | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeIN-AP-Hyderabad12h ago
-
GCP Data Engineer INR 1500K-2400KAirflow | Alation | Amazon Redshift | Apache Spark | AzureBest practice development | Code reviews | MentoringSenior-level Full TimeIN-AP-Hyderabad12h ago
-
GCP Data Engineer INR 1500K-2400KAmazon Redshift | Apache Airflow | Apache Flink | Apache Spark | BigQuerySenior-level Full TimeIN-AP-Hyderabad12h ago
-
GCP Data Engineer INR 1500K-2400KAlation | Amazon Redshift | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeIN-AP-Hyderabad12h ago
-
Senior Software Engineer, AI/ML, Google Photos Reminiscing INR 2500K-4460KAudio signal processing | C plus plus | Data Processing | Distributed Systems | Information RetrievalSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
AI Adoption Customer Engineer INR 1800K-2800KAgent systems | Artificial Intelligence | Change Management | Cloud Architecture | Data GovernanceTravel 30 percentSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
Analytics Data science and IOT Lead INR 2500K-3500KProbability | PyTorch | Python | SQL | Scikit-learnSenior-level Full TimeIndia15h ago
-
Big Data Lead INR 1200K-2000KAzure Data | Azure Data Lake | Azure Data Lake Storage | CI/CD | Cloud StorageSenior-level Full TimeIndia15h ago
-
Big Data Lead INR 1500K-2000KABAC | AWS | Airflow | Amazon Kinesis | AzureCross-team collaboration | MentoringSenior-level Full TimeIndia15h ago
-
Big Data Lead INR 1500K-2000KABAC | Amazon Kinesis | Apache Airflow | Azure Data | Azure Data FactorySenior-level Full TimeIndia15h ago
-
Operations Automation Associate INR 2000K-3500KAPI Integration | Agent Orchestration | CI/CD | Data Governance | Data LineageSenior-level Full TimeMumbai, Maharashtra, India15h ago
-
JAVA Data Engineering/Associate Director Software Engineering INR 1400K-2200KApache Beam | Apache Flink | Apache Kafka | Apache Spark | Data PipelinesContinuous professional development | Flexible workingMid-level Full TimePune, Maharashtra, India R15h ago
-
Senior-level Full TimeIndia15h ago
-
Data Engineer (GCH) - Replacement INR 1500K-2000KAWS | AWS Data | AWS Data Build | Amazon Web Services | BashMid-level Full TimeIndia15h ago
-
Senior Software Engineer INR 2000K-3465KAgent Design | Artificial Intelligence | Automation | Azure AI | Azure DevOpsSenior-level Full TimeBengaluru, KA, IN15h ago
-
Senior - AWS Data Engineering INR 3000K-4000KAWS Glue | AWS Lambda | Amazon S3 | Amazon Web Services | Data ModelingSenior-level Full TimeBangalore, Karnataka, India16h ago
-
AI Engineer INR 1800K-2500KDeep learning | Language Models | Language Processing | Large Language Models | Machine LearningMid-level Full TimeGurugram, Haryana, India16h ago
-
Geospatial Data Steward INR 1000K-2400KAPI | ArcGIS Pro | ArcMap | Bounding Box | CVATAsynchronous collaboration | Remote work flexibilityMid-level Full TimeBangalore, Karnataka, IN17h ago
-
Mid-level Full TimeBangalore, Karnataka, India17h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAPIs | Agentic AI | Azure | Azure OpenAI | BERTMid-level Full TimeBangalore, Karnataka, India17h ago
-
Data Engineer INR 1500K-2000KApache Kafka | Apache Spark | BigQuery | Cloud Data | Cloud Data PlatformsMid-level Full TimeIndia18h ago
-
Mid-level Full TimeGurgaon, HR, India19h ago
-
DE&A - Core - Sr Azure Data Engineer INR 3000K-4200KAzure Data | Azure Data Factory | Azure Monitor | Data Factory | Logic AppsSenior-level Full TimePune, Maharashtra, India19h ago
-
Software Engineer III - Data Engineer, Databricks INR 2000K-2800KACID | AWS | Access Controls | Airflow | AlertingSenior-level Full TimeBengaluru, Karnataka, India20h ago