Data Engineer – Databricks
Pune IN (Office: 5th & 6th floors) (0D03), India
INR 2000K-2400K (estimate) Senior-level Full Time
Tasks
- Build Delta Lake medallion architecture
- Collaborate with analytics and AI/ML teams
- Design data pipelines
- Develop batch data pipelines
- Develop data pipelines
- Develop streaming data pipelines
- Gather requirements
- Implement Databricks Jobs
- Implement Databricks workflows
- Implement data governance
- Implement data quality checks
- Implement data security practices
- Ingest data into databricks
- Mentor junior engineers
- Migrate aws data workloads to databricks
- Optimize Spark workloads
- Optimize data pipelines
- Use databricks sql
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Amazon Redshift | Apache Airflow | Apache Spark | CI/CD | DBT | Data Governance | Databricks | Delta Lake | DevOps | IaC | PySpark | Python | SQL | Structured Streaming | Terraform | Unity Catalog
Education
N/A
Roles
Related jobs
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KAI Agents | AI Assisted Development | CI/CD | Docker | GitHub ActionsBudget for education | Budget for wellness | Local connection meetups | Remote workSenior-level Full TimeChennai, India19h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Docker | GitHub Actions | Java | KubernetesLocal team connection | Remote workSenior-level Full TimePune City, India19h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KAutomated testing | CI/CD | Docker | GitHub Actions | JavaEducation budget | Local team meetups | Personal growth budget | Remote work | Secure local complianceSenior-level Full TimeAhmedabad, India19h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KAI Agents | CI/CD | Cloud Native | Docker | GitHubEducation budget | Local team connection | Periodic meetups | Personal growth budget | Remote workSenior-level Full TimeJalalabad, India19h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Docker | GitHub Actions | Java | JiraEducation budget | Local meetups | Personal growth budget | Remote work | Wellness budgetSenior-level Full TimeKolkata, India19h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Docker | GitHub Actions | Java | JavaScriptEducation budget | Local compliance | Local connection | Periodic meet ups | Remote workSenior-level Full TimeNoida, India19h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KAI Agents | CI/CD | Docker | GitHub Actions | JavaEducation budget | Local office connectivity | Periodic team meetups | Personal growth budget | Remote workSenior-level Full TimeJaipur, India19h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Docker | GitHub Actions | Java | JiraEducation budget | Legal compliance support for India | Personal growth budget | Remote work | Team meetupsSenior-level Full TimeTrivandrum, India19h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KAI-assisted coding | Assisted coding | CI/CD | Docker | GitHubEducation budget | Local meet-ups | Professional development budget | Remote work | Wellness budgetSenior-level Full TimeHyderabad, India19h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Docker | GitHub Actions | Java | KubernetesEducation budget | Local connection | Personal growth budget | Remote work | Wellness budgetSenior-level Full TimeKochi, India19h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Cloud Native | Docker | GitHub Actions | JavaEducation budget | Local connection | Personal growth budget | Remote work | Wellness budgetSenior-level Full TimeIndore, India19h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Docker | GitHub | Java | JiraLocal connection meetups | Remote workSenior-level Full TimeCoimbatore South, India19h ago
-
Data Science AI Engineer, Senior Professional INR 2500K-4500KAPI Development | AWS | Agentic AI | Apache Spark | AzureFully remoteSenior-level Full TimeBangalore, KA, IN, 560100 R1d ago
-
Manufacturing Data Analytics Technical Expert INR 1628K-2146KApache Hive | Apache Spark | Data Historian | Data analytics | Data integrationSenior-level Full TimeBangalore, Karnataka, IN, 5601001d ago
-
Principal Engineer - Generative AI Infra Capabilities INR 2000K-4600KApigee | Arize | Avi | CI/CD | CUDASenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Responsible AI Engineer INR 800K-1020KAI compliance | Data Analysis | Ethical AI | Python | Responsible AIMid-level Full TimeBengaluru, BDC11A, India1d ago
-
Responsible AI Engineer INR 880K-1250KData Analysis | Ethical AI | Python | Responsible AI | Risk AssessmentMid-level Full TimeGurugram, DDC1, India1d ago
-
Responsible AI Engineer INR 800K-1020KAI compliance | Data Analysis | Ethical AI | Python | Responsible AIMid-level Full TimeBengaluru, BDC11A, India1d ago
-
Mid-level Full TimeIndia1d ago
-
Lead Assistant Manager INR 500K-1500KAWS | Apache Airflow | Cloud platform | Data Governance | Data LakehouseSenior-level Full TimeIndia1d ago
-
Senior Data Engineer INR 1300K-2000KAPI Integration | API Security | Agile | Apigee | Asset ManagementSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Senior Consultant INR 1800K-2200KAmazon Aurora | Amazon Aurora PostgreSQL | Amazon Relational Database Service | Amazon Web Services | Aurora PostgreSQLSenior-level Full TimeIN-AP-Hyderabad1d ago
-
Associate, Data Analytics & AI INR 1000K-1800KAmazon SageMaker | Anthropic API | Azure Machine Learning | CRM | CrewAIWellness Fridays | Wellness resources | Work-life balance supportMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Data Analytics-Python Developer INR 2000K-3000KAgile | Dagster | Data Modeling | Dimensional Modeling | DockerMid-level Full TimeBengaluru, Karnataka, India1d ago