Senior Databricks Developer
Gurugram, Haryana, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Build data ingestion frameworks
- Design ETL/ELT pipelines
- Ensure data quality validation
- Implement Delta Lake architectures
- Implement data modeling and metadata management
- Manage Databricks clusters
- Monitor pipeline observability
- Optimize Databricks jobs notebooks
- Optimize data transformations
Perks/Benefits
Skills/Tech-stack
ACID | Batch Processing | CI/CD | Cluster management | Continuous integration | Data Ingestion | Data Modeling | Data Quality | Data Transformation | Data Validation | Databricks | Delta Lake | ELT | ETL | Git | Job Scheduling | Medallion Architecture | Metadata Management | Notebook | Observability | Performance Tuning | PySpark | Schema evolution | Spark SQL | Streaming | Version control
Education
N/A
Related jobs
-
Data Engineer, Cloud Supply Chain Data Engineering INR 1500K-2200KBigQuery | Data Governance | Data Monitoring | Data Pipelines | Data QualityCollaborative team environment | Mentoring opportunitiesMid-level Full TimeBengaluru, Karnataka, India3h ago
-
Senior Staff Software Engineer, Geo INR 2500K-3465KAnomaly Detection | C++ | Continuous Learning | Data Governance | Data InfrastructureSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Data Engineer INR 3000K-4000KData Ingestion | Data Pipelines | Data Quality | Data Transformation | Data ValidationSenior-level Full TimePune, Maharashtra, India3h ago
-
DE&A - AIML - Data Science - Machine Learning INR 2500K-5000KAI orchestration | AWS | Agentic AI | Azure | CI/CDSenior-level Full TimeIndia4h ago
-
Engineering-L2-Bengaluru-Associate-Software Engineering INR 1500K-2500KApache Spark | Avro | CI/CD | Cause analysis | ClusteringMid-level Full TimeBengaluru, Karnataka, India5h ago
-
Engineering-L2-Bengaluru-Analyst-Software Engineering INR 1500K-2500KApache Spark | CI/CD | Cause analysis | Clustering | Data ModellingEntry-level Full TimeBengaluru, Karnataka, India5h ago
-
Data Engineer I INR 1500K-2000KAWS | Apache Spark | Automated testing | Azure | Azure DataHybrid work | Inclusive work environment | Professional developmentMid-level Full TimeBangalore, Karnataka, IN6h ago
-
Data Engineer I INR 1500K-2000KApache Spark | Automated testing | Azure Data | Azure Data Factory | Azure DatabricksCareer development | Learning opportunitiesMid-level Full TimeBangalore, Karnataka, IN6h ago
-
Engineering-L2-Bengaluru-Associate-Software Engineering INR 1800K-3500KApache Spark | C++ | CI/CD | Continuous Delivery | Data CurationExposure to finance domain | Fast-paced environment | Global team collaborationMid-level Full TimeBengaluru, Karnataka, India6h ago
-
Cloud Data Engineer - AI/ML INR 4000K-5000KAmazon Web Services | Apache Spark | Batch Processing | Cassandra | Cloud platformSenior-level Full TimeBengaluru; Hyderabad6h ago
-
Data Analyst/ETL Engineer INR 1500K-2500KAWS Glue | BI tools | Data Flows | Data Transformations | ETLMid-level Full TimeChennai, India7h ago
-
Senior AI Engineer INR 2500K-5000KAWS | Azure | BM25 | CI/CD | ContainerizationFlexible work environment | Remote work options | Self-care supportSenior-level Full TimeHyderabad, India7h ago
-
Entry-level Full TimeHyderabad, Telangana, India8h ago
-
Lead Software Engineer - Python/Java, SRE INR 3000K-5000KAPIs | AWS | Automation | CI/CD | DatabricksSenior-level Full TimeHyderabad, Telangana, India8h ago
-
AI Agents | AWS Bedrock | Azure OpenAI | CI/CD | Claude CodeCareer growth | Continuous learning | Hybrid work | Remote work | Work-life balanceSenior-level Full TimeIndia8h ago
-
Senior Software Engineer II - Data Engineering and Platform INR 1500K-2000KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeBangalore, India8h ago
-
AWS | Agile | Automated testing | CI/CD | Cloud platformCareer growth | Professional development | Remote work | Work-life balanceSenior-level Full TimeIndia R8h ago
-
AWS | Azure | Cloud platform | Data Analysis | Data ManagementAutonomy | Collaborative team environment | Continuous learning | Exposure to modern machine learning technologies | Flexible work scheduleMid-level Full TimeIndia R8h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Friendly work environmentMid-level Full TimeGurgaon, India9h ago
-
Software Engineer II, Data Engineer INR 2520K-3880KAWS | Apache Airflow | Apache Spark | Azure | Cloud platformCareer growth | Learning & MentorshipSenior-level Full TimeBangalore, India9h ago
-
Senior Data Engineer - Supply Chain & Analytics Platforms INR 2800K-4200KAWS | Apache Airflow | Azure | CI/CD | Cloud StorageSenior-level Full TimeBengaluru, INDIA, India9h ago
-
AWS Glue | AWS IAM | AWS Lambda | Airflow | Amazon CloudWatchCollaborate with experienced engineering teams | Continuous learning and professional development | Remote work | Work on impactful business intelligence initiatives | Work on large scale cloud data transformation projectsMid-level Full TimeIndia10h ago
-
AI Foundry | AWS | Azure | Azure AI | Azure AI FoundryMid-level Full TimeBengaluru Millenia, India14h ago
-
ADLS Gen2 | AKS | Adaptive Query | Adaptive query execution | Apache SparkFlexibility programmes | Inclusive benefits | Mentorship | Mentorship programs | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India14h ago
-
IN_Sr Associate_ GenAI and Agentic AI_GCC_ Advisory_ Noida INR 2500K-5000KAPI Development | Agent safety | Async Programming | Autogen | CI/CDSenior-level Full TimeNoida, India14h ago