Senior Data Engineer
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Apply data governance and access control
- Build Delta Lake data models
- Build Unity Catalog assets
- Configure governed external locations volumes
- Deliver projects using Agile
- Design ETL/ELT pipelines
- Enable cross cloud data movement
- Implement CI CD and code testing
- Implement data observability and lineage
- Ingest transform curate data
- Orchestrate workflows and automation
- Prepare analytics and AI ready datasets
- Troubleshoot data pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | Access Control | Asset bundles | Audit Tables | Auto Loader | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | CDC | CI/CD | DLT | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data Observability | Data Products | Data Quality | Data orchestration | Databricks (asset) | Databricks Asset Bundles | Databricks Jobs | Databricks Workflows | Declarative Pipelines | Delta Lake | Delta Sharing | Delta Tables | ELT | ETL | Embeddings | Feature Engineering | Feature Stores | Git | JDBC | Lakeflow | Liquid clustering | ML ready data products | Medallion Architecture | Operational Metadata | Optimize | PII | Partitioning | Power BI | PySpark | SQL | Spark | Structured Streaming | Tableau | Unity Catalog | Vector Search | Vector data | Z-ordering
Roles
Related jobs
-
Senior Software Engineer (ML, NLP) INR 2500K-4000KAPI Development | AWS | AWS Lambda | Amazon EKS | Amazon SageMakerFlexible work arrangement | Hybrid work environmentSenior-level Full TimeGurgaon - Cyber Park, India4h ago
-
AI Engineer - MDM INR 2500K-5000KAPI | Automation | Data Analysis | Data Cleansing | Data GovernanceSenior-level Full TimePune, Maharashtra, IND, 41101312h ago
-
Microsoft Fabric Data Engineer - India INR 1500K-2400KApache Spark | Azure Cognitive | Azure Cognitive Search | Azure Data | Azure Data FactoryMid-level Full TimeNew Delhi, India13h ago
-
Senior-level Full TimeIN-KA-Bangalore14h ago
-
Senior-level Full TimeIN-KA-Bangalore14h ago
-
Senior-level Full TimeIN-KA-Bangalore14h ago
-
Senior-level Full TimePune, MAHĀRĀSHTRA, India14h ago
-
DE&A - Core - Project Management - Project Management INR 3000K-4000KAWS | Apache Airflow | Apache Spark | Azure | CCPASenior-level Full TimePune, Maharashtra, India14h ago
-
Senior-level Full TimeGurugram, Haryana, India15h ago
-
Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Data Pipeline Performance TuningMid-level Full TimePune, Maharashtra, India R15h ago
-
Mid-level Full TimeBengaluru, Karnataka, India15h ago
-
Associate Consultant - Technology Solutions Delivery INR 800K-1000KActive Directory | Agile | Amazon Web Services | Artificial Intelligence | Automation24 7 systems escalation availabilityMid-level Full TimeNoida, Uttar Pradesh, India16h ago
-
Mid-level Full TimePune, Maharashtra, India18h ago
-
Senior Data Engineer - Managed Services INR 3000K-4000KARM Templates | Azure Cloud | Azure Cloud Adoption | Azure Cloud adoption framework | Azure DataOccasional out of hours support | Remote work flexibilitySenior-level Full TimePune, MH, India18h ago
-
Lead Engineer INR 4000K-5500KC++ | Deep learning | Ethics | Hadoop | Language ModelsDiscretionary bonuses or commissions | Equity awards | Family medical vision and dental coverage | Hybrid workSenior-level Full TimeBengaluru, Karnataka, India R18h ago
-
AWS | AWS Glue | AWS IAM | AWS Lambda | Amazon EMRMid-level Full TimeHyderabad, Telangana, India19h ago
-
Senior-level Full Timetelengana, India20h ago
-
Sr. Data Engineer INR 2700K-3900KAWS Lambda | AWS S3 | AWS SageMaker | AWS Step Functions | AlertingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Flexible benefits | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 56007620h ago
-
Staff Data and AI Engineer, Finance INR 2500K-3900KAnomaly Detection | Apache Spark | Business Intelligence | CI/CD | DashboardsSenior-level Full TimeBengaluru, India21h ago
-
Senior Data and AI Engineer - Finance INR 2000K-3584KAnomaly Detection | Apache Spark | CI/CD | Dashboards | Data ModelingSenior-level Full TimeBengaluru, India21h ago
-
Mid-level Full TimeBangalore, Karnataka, India21h ago
-
Assistant Manager - AWS Data Engineering INR 1500K-2541KAWS Data | AWS Data Pipeline | Amazon Web Services | Data Modeling | Data pipelineMid-level Full TimeHyderabad, Telangana, India21h ago
-
Lead Consultant_Python MachineLearning INR 1500K-2500KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureHybrid workSenior-level Full TimeBangalore, IN, 56006621h ago
-
Data Engineer INR 1500K-2500KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | CI/CDSenior-level Full TimeChennai, IN, 60003221h ago
-
Manager_Python Engineer L4 Expert INR 1500K-3500KAWS Glue | AWS Lambda | Agile | Amazon S3 | Apache AirflowSenior-level Full TimeThane, IN, 40060421h ago