Senior / Lead Data Engineer - Azure Databricks
Hyderabad, TS, India
INR 1500K-3000K (estimate) Senior-level Full Time
Tasks
- Apply security access control and governance best practices
- Build and maintain semantic layer and KPI model
- Create technical documentation and knowledge transfer
- Define and build KPIs with business logic
- Define conformed dimensions and market variations
- Design and build data integration and transformation pipelines
- Ensure data quality, validation, and monitoring
- Profile source data quality and reconciliation requirements
- Recommend production readiness and deploy solutions
- Support business ontology integration
- Translate KPI definitions into reusable data models
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Databricks | Azure DevOps | CI/CD | Conformed Dimensions | Data Lineage | Data Modeling | Data Quality | Data Reconciliation | Databricks Metric Views | ELT | ETL | Git | Medallion Architecture | Metric Views | Python | RBAC | SQL
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Microsoft Fabric Data Engineer INR 1100K-2600KData Governance | Data Ingestion | Data Pipelines | Data Quality | Data SecurityMid-level Full TimeHyderabad, India12h ago
-
Senior-level Full TimePune City, India13h ago
-
Entry-level Full TimePune, India13h ago
-
Senior AI Engineer/ Senior Associate Director, Tech SME INR 1860K-2800KAPIs | AWS | Agent Orchestration | Agent systems | AzureMid-level Full TimePune, Maharashtra, India R13h ago
-
Data Engineer INR 720K-720KAWS | Apache Airflow | Apache NiFi | Apache Superset | AzureChildcare support | Counseling sessions | Health insurance | Internet allowance | Learning SupportSenior-level Full TimeBangalore, India R14h ago
-
Junior Data Engineer INR 400K-700KAWS Glue | Amazon Redshift | Apache Airflow | Apache Spark | Azure DataEntry-level Full TimePune City, India14h ago
-
Senior AI Engineer INR 2500K-4500KAPI Development | Asynchronous programming | Azure | CI/CD | COMTRADESenior-level Full TimeBangalore - Karnataka - India14h ago
-
Senior-level Full TimeBangalore - Karnataka - India14h ago
-
Senior AI Engineer INR 2500K-4500KAsync Programming | Azure | CI/CD | Data Ingestion | Data Ingestion PipelineDiversity-focused workplace | Equity and inclusion | Learning opportunitiesSenior-level Full TimeBangalore - Karnataka - India14h ago
-
Senior AI Engineer INR 2500K-4500KAPI Development | Asynchronous programming | Azure | CI/CD | Dependency managementSenior-level Full TimeBangalore - Karnataka - India14h ago
-
Senior-level Full TimeBangalore - Karnataka - India14h ago
-
Senior-level Full TimeBangalore - Karnataka - India14h ago
-
Data Engineer ( 2 to 5 Years) INR 1500K-2100KAWS CDK | AWS CloudFormation | AWS Glue | AWS Lambda | Amazon AthenaContinuous learning | Flexible working | Hybrid working | Inclusive cultureMid-level Full TimeBangalore - Karnataka - India14h ago
-
AWS Lambda | Amazon DynamoDB | Amazon RDS | Amazon S3 | CI/CDHybrid workSenior-level ContractHyderabad, India R14h ago
-
Data Engineer INR 1500K-2700KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Noida/ Chennai, India15h ago
-
Researcher: AI/ML enhanced Computational Engineering for Scientific AI and Optimization INR 2500K-5000KAI Agents | Bayesian optimization | Cloud Computing | Dynamical systems | Evolutionary AlgorithmsSenior-level Full Timebengaluru, India15h ago
-
Backend Engineer (Cloud & AI Integration) INR 1500K-3000KAPI Integration | AWS | Agile | Asynchronous processing | DocumentationMid-level Contract Full TimeBengaluru, KA, India15h ago
-
Senior-level Full TimePune, Maharashtra, India16h ago
-
Mid-level Full TimePune, Maharashtra, India16h ago
-
Senior-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101316h ago
-
Senior Software Engineer, AI/ML GenAI, Google Ads INR 2000K-5000KC++ | Data Processing | Data Storage | Debugging | Distributed SystemsSenior-level Full TimeBangalore, Karnataka, India17h ago
-
Backend Engineer (Cloud & AI Integration) INR 1500K-3000KAPI Integration | AWS | Agile | Asynchronous processing | DocumentationMid-level Contract Full TimeBengaluru, KA, India17h ago
-
Senior Data Engineer (Python, SQL, Snowflake, Devops, Azure/ AWS, Co-pilot, Kubernetes, Docker) INR 3200K-4131KAWS | Airflow | Automated Lineage | Azure | Azure BicepEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Mentorship | Volunteer time offSenior-level Full TimeChennai, TN, India17h ago
-
Apache Airflow | Apache Beam | Apache Flink | Asynchronous Messaging | BigQueryFlexible working | Opportunities for growth | Professional developmentMid-level Full TimePune, Maharashtra, India R17h ago
-
Senior Data Engineer – Snowflake Developer INR 2800K-4000KAWS | Access Control | Airflow | Azure | Azure DataSenior-level Full TimePune, Maharashtra, India18h ago