Lead Cloud Data Engineer (Databricks) - Assistant Vice President
Tasks
- Build ETL/ELT pipelines
- Collaborate with architects and stakeholders
- Design data pipelines
- Develop data workflows
- Ensure data consistency
- Ensure data governance
- Ensure data quality
- Ensure data system reliability
- Maintain data pipelines
- Optimize ETL/ELT pipelines
- Optimize data workload cost
- Support production deployments
- Translate requirements into technical implementation
- Troubleshoot data pipeline issues
- Tune performance of data workloads
Perks/Benefits
- Employee networks
- Flexible work/life support
- Inclusive development opportunities
- Paid volunteer days
Skills/Tech-stack
AWS | Apache Spark | Azure | CI/CD | Data Governance | Data Lakehouse | Data Modeling | Data pipeline | Data pipeline design | Databricks | Delta Lake | Docker | ELT | ETL | Kafka | Kubernetes | Performance Tuning | Pipeline Design | Python | SQL | Scala | Scalability
Education
N/A
Roles
Related jobs
-
Database Engineer INR 500K-1500KCI/CD | DB2 | Data Warehousing | Database performance | Database performance tuningMid-level Full TimePune, MH, India4h ago
-
Principal Engineer, Data Analytics Engineering [ 8+ years ] INR 2500K-3584KAWS | Algorithms | Azure | Big Data | CI/CDSenior-level Full TimeBengaluru, KA, India4h ago
-
Lead Software Engineer - Java and AI/ML INR 3500K-5000KAI Agents | Agile | Automated testing | CI/CD | Code modernizationSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Databricks Developer INR 1500K-2400KACID | Batch Processing | CI/CD | Cluster management | Data IngestionWork from office 5 days per weekMid-level Full TimeGurugram, Haryana, India8h ago
-
Principal Data Scientist INR 3000K-4000KContainers | Continuous integration | Decoder Architecture | Deep learning | Design PatternsCar lease | Certification programs | Continuous learning programs | Corporate pension plan | Dental coverageSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Lead Assistant Manager - Azure Data Engineer INR 1500K-2500KAgile | Amazon Redshift | Apache Airflow | Apache Hadoop | Apache HiveSenior-level Full TimeNoida, Uttar Pradesh, India9h ago
-
Executive - Data Governance INR 600K-840KCI/CD | Data Cleansing | Data Denormalization | Data Modeling | Data NormalizationExecutive-level Full TimeBangalore, Karnataka, India9h ago
-
Sr Data Engineer, Python + Spark (Data Federation skillset - Data Lakehouse - Eg: Starburst) - Chennai INR 1500K-2500KAWS EMR | AWS Glue | AWS S3 | Apache Hudi | Apache Iceberg401k retirement plan | Dental insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeIndia9h ago
-
Data Science - Associate Director INR 1500K-2700KCI/CD | Caching | Cloud Run | Cloud SQL | Cloud StorageMid-level Full TimeHyderabad, Telangana, India10h ago
-
Assistant Manager- Python Gen AI Engineer INR 1200K-2500KAI Agents | API Development | Agile | Containerization | Data PipelinesWork from client office 5 days per weekMid-level Full TimeBangalore, Karnataka, India10h ago
-
Cloud DevOps - Consultant INR 1500K-3000KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeGurgaon, Haryana, India10h ago
-
Manager - Azure Data Engineer INR 1500K-2500KAgile | Amazon Redshift | Apache Airflow | Apache Hadoop | Apache HiveMid-level Full TimeNoida, Uttar Pradesh, India11h ago
-
AI Expert – Generative AI Solutions Developer INR 2000K-5000KAI Foundry | AI Search | AI Studio | AWS Bedrock | Amazon SageMakerSenior-level Full Time Part Timecoimbatore, India12h ago
-
Senior AI Engineer INR 3700K-5000KAPIs | Agentic AI | Azure | CI/CD | Cloud ComputingCollaborative workspaces | Employee resource groups | Flexible working arrangements | Global orientation program | Learning and developmentSenior-level Full TimeMumbai, MH, India12h ago
-
Senior-level Full TimeMumbai, India12h ago
-
Gen AI Security engineer INR 2500K-5000KAPI Security | AWS | Access Management | Adversarial Testing | Cloud ConfigurationsElder care | Health checks | Insurance with top-ups | New parent support | Partner coverageSenior-level Full TimeNoida, IN14h ago
-
Data Engineer - Generative AI & Vector Systems INR 2500K-5000KAWS Glue | AWS IAM | AWS Lambda | Amazon Athena | Amazon CloudWatchFlexible working hours | Online training accessSenior-level Full TimeChennai, Tamil Nadu, India16h ago
-
Principal Data Engineer INR 2520K-3880KApp Service | Azure | Azure App | Azure App Service | Azure CognitiveSenior-level Full TimeBengaluru Luxor North Tower, India16h ago
-
Data Governance - Technical Specialist INR 3000K-4000KAWS | Azure | Cloud infrastructure | Data Governance | Data LineageHealthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeIND-Bangalore-A, RMZ Infinity, India16h ago
-
Applications Development (MERN Stack + GenAI) INR 1400K-2525KAgile | JavaScript | Kubernetes | LLMs | MERN StackComprehensive benefits | Holidays | Hybrid work | Professional development | Shared TransportSenior-level Full TimeNoida - Sector 135, India16h ago
-
Senior Software Engineer (ML, NLP) INR 2500K-4000KAPI Development | AWS | AWS Lambda | Amazon EKS | Amazon SageMakerFlexible work arrangement | Hybrid work environmentSenior-level Full TimeGurgaon - Cyber Park, India17h ago
-
Lead Software Engineer- LLM, Gen AI, ML INR 3000K-4800KAWS | Anthropic | BERT | Cohere | Deep learningFlexible-hybrid work | Performance-based recognition | Training and developmentSenior-level Full TimeChennai - DLF IT Park, India17h ago
-
Principal Engineer, Data Analytics Engineering INR 2500K-4000KAgile | Batch Processing | CI/CD | GitOps | HadoopSenior-level Full TimeBengaluru, KA, India17h ago
-
Senior-level Full TimeIndia-Contractors1d ago
-
AI Agents | Authentication | Azure AI | C# | Copilot StudioClient project exposure | Continuous upskilling | Flexible collaboration | Fully remote work | Learning cultureMid-level Full TimeIndia R1d ago