Data Quality Engineer, Enterprise Data Platform - Data Quality & Data governance) , AWS , SQL & Python , Cloud, Power BI
Tasks
- Build data quality validation frameworks
- Build governed semantic layer for BI and AI
- Collaborate to integrate LLM query interfaces
- Create data certification workflows
- Develop automated data quality tests
- Enable Power BI dashboards with certified KPIs
- Ensure LLM responses use certified datasets
- Integrate validation into Databricks and Iceberg pipelines
- Manage metadata lineage glossary and access control
- Monitor data drift and model reliability
- Prepare certified datasets for conversational analytics
- Provide feature ready datasets for ML in SageMaker Studio
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Glue Catalog | Amazon Athena | Amazon EMR | Amazon Redshift | Amazon S3 | Amazon SageMaker | Amazon SageMaker Studio | Apache Iceberg | Atlan | DAX | Databricks | Delta Lake | Delta Lake Time Travel | Delta Live Tables | Delta Live) | Dremio | Glue Catalog | Great Expectations | Power BI | Presto | PySpark | Pydeequ | Python | SQL | Sagemaker Studio | Schema evolution | Soda | Time Travel | Trino | Unity Catalog
Education
N/A
Related jobs
-
Data Governance | Data Modeling | Data Quality | Data Security | Data WarehousingCareer growth | Collaborative environment | Continuous learning | Flexible day shift | Fully remote workSenior-level Full TimeIndia R1d ago
-
API Security | Application Security | Automation | Bash | CI/CDMid-level ContractHyderabad, India1d ago
-
Mid-level Full TimeIN-MH-Mumbai1d ago
-
Pyspark Developer INR 800K-1500KData Modeling | Dimensional Modeling | PySpark | Relational databases | SQLMid-level Full TimeIN-TN-Chennai1d ago
-
AWS Data Engineer- Airflow INR 1500K-2400KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache HadoopSenior-level Full TimeIN-AP-Hyderabad1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Software Engineer - AI/ML with Python INR 2500K-3500KAWS | Airflow | Amazon SageMaker | Apache Airflow | Apache SparkAccess to cutting-edge technologies | Collaborative work environment | In office 5 days per week | Professional development | Training and education opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
MS Fabric / Azure Data Engineer ( 5- 7 yrs ) - Immediate Joiners INR 1500K-2500KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data ArchitectureImmediate JoinersSenior-level Full TimeBengaluru, KA, India1d ago
-
Staff Software Engineer, Analytics INR 2520K-4000KAlgorithms | Analysis and Design | Big Data | C++ | Data IngestionSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 1500K-2500KAPIs | Agent systems | Cloud platform | Data Pipelines | Google CloudMid-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India1d ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 1800K-2500KAPIs | Agent systems | Cloud platform | CrewAI | Data EngineeringMid-level Full TimeMumbai, Maharashtra, India; Gurgaon, Haryana, India1d ago
-
None Full TimeNoida, Uttar Pradesh, India1d ago
-
None Full TimeNoida, Uttar Pradesh, India1d ago
-
Senior Software Engineer(AI/ML), Trust INR 4500K-6500KA/B | A/B Testing | APIs | Algorithms | Anomaly DetectionSenior-level Full TimeBangalore, India1d ago
-
None Full TimeIndia2d ago
-
AI Software Engineer III - Platform INR 2000K-4000KAPI Gateway | APIs | AWS EC2 | AWS Lambda | Amazon APISenior-level Full TimeHyderabad, Telangana, India2d ago
-
Senior Big Data Engineer (R-19335) INR 2400K-3380KAccess Control | Apache Airflow | Apache Spark | Attribute-Based Access Control | Attribute-based accessSenior-level Full TimeHyderabad - India2d ago
-
Senior AI Engineer INR 1800K-2800KAWS | Algorithms | Anthropic API | Azure | CI/CDCareer Development Programs | Open source contribution support | Team knowledge sharingSenior-level Full TimeBangalore; Gurgaon, India2d ago
-
Senior-level Full TimeBangalore; Gurgaon, India2d ago
-
Azure Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseMid-level Full TimeIndia2d ago
-
Mid-level Full TimeBengaluru, Karnataka, India2d ago
-
Associate Process Manager INR 800K-1500KAWS | Apache Airflow | Apache Hadoop | Apache Spark | AzureMid-level Full TimePune, Maharashtra, India2d ago
-
Agile | Amazon Redshift | Batch Processing | BigQuery | CI PipelineCollaborative global work environment | Cross-functional collaboration | Flexible working arrangements | Fully remote friendly | Inclusive cultureSenior-level Full TimeIndia R2d ago
-
Python Data Engineer INR 1500K-2500KAirflow | Apache Beam | BigQuery | CI/CD | Cloud PubSubEmployee growth opportunities | Health insurance | Learning and development resourcesMid-level Full TimeNoida, Uttar Pradesh2d ago
-
Data Engineer INR 1753K-2250KAPI | Agile | Azure Automation | Azure Data | Azure Data FactoryHybrid workSenior-level Full TimeChennai, Tamil Nadu, India2d ago