Databricks Module Lead
Noida, UTTAR PRADESH, India
INR 2000K-2800K (estimate) Senior-level Full Time
Tasks
- Build data engineering solutions in Databricks
- Develop ETL ELT pipelines for batch and near real time
- Develop Pyspark jobs for data processing
- Implement dbt data modeling testing snapshots documentation
- Manage deployments with Azure DevOps Git CI CD
- Monitor and troubleshoot production data pipelines
- Orchestrate workflows with Apache Airflow
- Support structured streaming real time processing
- Write SQL for complex queries and tuning
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Azure DevOps | CI/CD | DBT | Data Governance | Data Lineage | Data Warehousing | Databricks | ELT | ETL | Git | PySpark | Python | SQL | Structured Streaming
Related jobs
-
Associate Lead Data Scientist INR 1800K-2500KAPI Design | AWS SageMaker | Airflow | Azure Machine Learning | CaptumMid-level Full TimeHyderabad, Andhra Pradesh, India23h ago
-
Senior-level Full TimeIN-MH-Pune23h ago
-
Agile | Agile delivery | CI/CD | Cloud platform | DashboardsMid-level Full TimePune, Maharashtra, India R1d ago
-
Data Devops lead/Associate Director, Data and Analytics INR 650K-1100KAI/ML | Agentic AI | Agile | Apache Airflow | Apache HadoopMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Lead Data Platform Engineer INR 3000K-4000KAWS Glue | AWS Lake Formation | AWS Lambda | AWS SageMaker | AWS SageMaker Unified StudioFamily wellbeing benefits | Health and wellbeing benefits | Hybrid work | Paid time offSenior-level Full TimeHyderabad, India1d ago
-
Data Engineering - Technical Lead INR 2200K-3465KAmazon Web Services | Apache Airflow | Apache Cassandra | Apache Flink | Apache KafkaSenior-level Full TimeNoida, Uttar Pradesh1d ago
-
Lead Data Scientist-(Multimodal AI ,CV, Deep Learning) INR 3264K-5000KCLIP | Computer Vision | Deep learning | DinoV3 | Distributed TrainingEmployee wellness programs | Flexible work options | Hybrid work options | Professional development supportSenior-level Full TimeMumbai, India1d ago
-
Technical Lead - Message Security Detection INR 3000K-4600KAWS | Amazon EKS | Apache Airflow | Apache Spark | Database performanceSenior-level Full TimeHybrid - Bangalore, India R1d ago
-
Lead AI Engineer INR 3000K-5000KAI Model Serving | AI model | API Design | API Versioning | AWSDisability programs | Flexible working hours | Life insurance | Private medical care | Wellbeing activitiesSenior-level Full TimeIN-KA-BANGALORE-NEON BUILDING WEST TOWER, India1d ago
-
Lead Data Platform Engineer (OpenSearch) INR 1500K-3000KAWS | Amazon MSK | Ansible | Apache Kafka | Data ModelingInnovative work environment | Professional development | Recognition and rewards | Work-life balanceSenior-level Full TimeAhmedabad, India1d ago
-
Senior-level Full TimeBangalore,India1d ago
-
R&D Data Engineering Lead INR 3000K-4000KAPI Gateway | API Integration | AWS Glue | AWS IAM | AWS LambdaHealth and wellbeing benefits | Prevention and wellness programsSenior-level Full TimeHyderabad, India1d ago
-
Agile | Alerts | Anomaly Detection | Azure | ClassificationCareer development opportunities | Comprehensive benefits | Inclusion-focused cultureSenior-level Full TimeGurgaon, Haryana, INDIA; Hyderabad, Telangana, INDIA; …1d ago
-
Senior Manager Data Engineering INR 2700K-4000KAWS | Agile | Azure | Data Governance | Data ManagementSenior-level Full TimeBangalore, India1d ago
-
Data Engineering Lead-AWS, Python, Spark, Pyspark INR 3000K-3500KAWS | Apache Spark | App Insights | Azure App | Azure App InsightsSenior-level Full TimePrimary location: Gurgaon, Haryana1d ago
-
Manager Data Engineering, ITC INR 2000K-2700KAWS | Alerting | Apache Airflow | Apache Spark | Automated testingMid-level Full TimeINDIA TECHNOLOGY CENTER, India1d ago
-
Director Software Engineering, ITC INR 3000K-6000KAWS | Amazon Kinesis | Apache Airflow | Apache Kafka | Apache SparkExecutive-level Full TimeINDIA TECHNOLOGY CENTER, India1d ago
-
Senior-level Full TimeINDIA TECHNOLOGY CENTER, India1d ago
-
Application Development Technical Lead Analyst - Vice President INR 2000K-3000KApache Flink | Apache Hadoop | Apache Kafka | Apache Spark | Data GovernanceSenior-level Full TimeLocation(s): Chennai, Tamil Nadu, India1d ago
-
Lead Data Engineer INR 2000K-3000KData Architecture | Data Engineering | Data Infrastructure | Data Modeling | Data QualitySenior-level Full TimeHyderabad, IN1d ago
-
AI code assistants | Alerting | BigQuery | CI/CD | Cloud RunAccess to knowledge sharing opportunities | Continuous learning | Flexible working arrangements | Fully remote | High autonomy and ownershipSenior-level Full TimeIndia R1d ago
-
Senior-level Full TimeKarnataka, Bengaluru, India1d ago
-
Data Engineer Manager INR 500K-1500KBI platforms | Business Intelligence | Data Migration | Data Pipelines | Data TransformationMid-level Full TimeIndia - Pune - Magarpatta2d ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India2d ago
-
Custom Software Engineer INR 1200K-1800KCloud Architecture | Data Modeling | Data Warehouse | ETL | SQLMid-level Full TimeBhubaneswar, BBDC1A, India3d ago