Data Engineer – Databricks
Pune IN (Office: 5th & 6th floors) (0D03), India
INR 1960K-2146K (estimate) Senior-level Full Time
Tasks
- Build Delta Lake medallion architecture
- Collaborate with cross-functional teams
- Design data pipelines
- Develop batch data pipelines
- Develop data pipelines
- Develop streaming data pipelines
- Gather requirements
- Implement Databricks Jobs
- Implement Databricks SQL
- Implement Databricks workflows
- Implement data governance
- Implement data quality
- Implement data security
- Ingest data into databricks
- Mentor junior engineers
- Migrate aws workloads to databricks
- Optimize data pipelines
- Optimize spark performance
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Amazon Redshift | Apache Airflow | Apache Spark | CI/CD | DBT | Databricks | Delta Lake | DevOps | PySpark | Python | SQL | Structured Streaming | Terraform | Unity Catalog
Education
N/A
Roles
Related jobs
-
Custom Software Engineer INR 1400K-1848KAirflow | CI/CD | Cause analysis | Change Management | Control-MRotational shifts | Stakeholder communicationMid-level Full TimeBengaluru, BDC7A, India5h ago
-
Senior-level Full TimeHyderabad, India15h ago
-
Agile | Confluence | Data Analysis | Jira | KanbanEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India16h ago
-
Senior-level Full TimeIN-KA-Bangalore16h ago
-
Senior Consultant INR 1900K-2600KAWS Lambda | Agile | Alerting | Amazon Web Services | Apache SparkGlobal team collaborationSenior-level Full TimeIN-KA-Bangalore16h ago
-
AI Engineer (Manager level) INR 1200K-1800KAI Search | Agile | Apache Spark | Azure AI | Azure AI SearchMid-level Full TimeHyderabad, India17h ago
-
ML Engineer (Data) INR 1500K-2000KAmazon SageMaker | Apache Spark | BERT | CI/CD | CachingCoaching | Hybrid work | Learning opportunities | Mentoring | Paid volunteer dayMid-level Full TimeBengaluru17h ago
-
Software Engineering INR 1500K-2000KApache Hadoop | Apache Kafka | Apache Spark | Azure | Azure ComputeMicrosoft cloud background check | On-call rotationMid-level Full TimeBengaluru, KA, IN18h ago
-
Software Engineer III - Python Developer + AWS + LLM / Gen AI INR 2000K-4000KAWS | Agile | Application Resiliency | Azure | CI/CDSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Senior Azure Data Engineer INR 2250K-3000KAzure Data | Azure Data Factory | Azure DevOps | Azure Functions | Azure SynapseSenior-level Full TimeThane, Maharashtra, India18h ago
-
AWS | Access Control | Alerting | Audit Logging | AzureSenior-level Full TimePune, MH, India19h ago
-
Security Engineer II - Java, AWS, AI/ML Security INR 1400K-2000KAI red teaming | API Security | AWS | Access Management | AzureContinuous learning cultureMid-level Full TimeBengaluru, Karnataka, India19h ago
-
Data Scientist- Air Quality INR 1400K-1800KAccess Control | Airflow | Ansible | Azure | CI/CDHealth safety wellbeing support | Hybrid work model | Mentoring and team collaboration | Professional development supportMid-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior-level Full TimeIndia22h ago
-
Senior Storage Engineer INR 2000K-4000KAIX | AIX SDDPCM | Access Management | At Rest Encryption | AutosysFlexible working hours | Growth pathway | On site collaboration with global teams | On-call rotationSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India22h ago
-
Python Pyspark with GCP INR 2400K-4000KCloud platform | Google Cloud | Google Cloud Platform | PySpark | PythonEntry-level Full TimeBangalore, Karnataka, India22h ago
-
Remote Senior Data Engineer (ETL Data Modeling) INR 2040K-3500KAPIs | AWS EMR | AWS Glue | AWS Lake Formation | Amazon RedshiftDynamic working environment | Flexible schedule | Flexible working hours | International work environment | Low hierarchySenior-level Full TimeKarnataka, Bengaluru, India R22h ago
-
Senior-level Full TimePune, Maharashtra, India22h ago
-
Software Engineer III - Data Engineer INR 2000K-3500KAWS | Airflow | Azure | Big Data | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India23h ago
-
Senior Data Engineer INR 2400K-3380KAzure | Azure Data | Azure Data Engineering | Azure Fabric | Cloud servicesSenior-level Full TimeGurgaon23h ago
-
Senior-level Full TimeIndia23h ago
-
Data Engineer - Global Research Modernization INR 1050K-1600KBeautifulSoup | Data Engineering | Data Governance | Data Quality | Data ValidationMid-level Full TimeMumbai, Maharashtra, India23h ago
-
AI/ML Engineer INR 2500K-4000KAI Foundry | AI Search | AWS Bedrock | App Service | Automated retrainingSenior-level Full Timetelengana, India23h ago
-
Artificial Intelligence | Data Governance | Data Quality | Data Science | LLMMid-level Full TimeMumbai, Maharashtra, India1d ago