Data Engineer (Spark with Scala/ Python and Azure Databricks and Airflow)
Pune, MH, India
INR 2516K-3356K (estimate) Senior-level Full Time
Found 8h ago
Tasks
- Build data models into pipelines
- Design data infrastructure for cloud platforms
- Develop data extraction, transformation, loading processes
- Maintain data pipelines
- Optimize Spark code
- Transform large datasets
- Write documentation for data features
Perks/Benefits
Skills/Tech-stack
Airflow | Azure | CI/CD | Data Warehousing | Databricks | DevSecOps | Docker | Kubernetes | Python | SQL | Scala | Spark
Education
Roles
Language: en |
Views: 0 |
Clicks: 0
Related jobs
-
Assistant Manager, Data Engineer INR 1500K-2000KAPIs | Automation | Automation Testing | DAX | Data AnalysisAI certifications | Career growth opportunities | Global impact | Mentorship | Work in innovative environmentMid-level Full TimeIndia-Bangalore4h ago
-
Senior - Python+SQL INR 2500K-3380KCD pipelines | CI/CD | CI/CD pipelines | Data Analysis | Data DenormalizationFlexible working hours | Health insurance | Work from home optionsSenior-level Full TimeBangalore, Karnataka, India4h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
Senior-level Full TimeIN-AP-Hyderabad5h ago
-
Data Engineer INR 1500K-2000KData Modeling | Database optimization | PostgreSQL | SQL | Stored ProceduresMid-level Full TimeIN-TN-Chennai5h ago
-
Senior-level Full TimeIN-AP-Hyderabad5h ago
-
Data Engineer INR 1500K-2000KData Modeling | Database optimization | PostgreSQL | SQL | Stored ProceduresMid-level Full TimeIN-TN-Chennai5h ago
-
AI Engineer INR 2500K-4144KAI | AWS | Azure | CI/CD | Cloud PlatformsCareer growth opportunity | Flexible scheduleSenior-level Full TimeIN-AP-Hyderabad5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
AIML Tech Lead INR 2500K-3200KAI Stack | API Integration | Agent Builder | Context grounding | Event DrivenFlexible hours | Professional development support | Remote workSenior-level Full TimeIN-AP-Hyderabad5h ago
-
Senior-level Full TimeBangalore, Karnataka, India5h ago
-
Senior ML/AI Research Engineer INR 2500K-4500KArtificial Intelligence | DVC | Data Processing | Deep learning | DockerFlexible work hours | Global travel opportunitiesSenior-level Full TimePune, IN5h ago
-
Entry-level Full TimeBengaluru, KA, IN7h ago
-
Senior-level ContractKarnataka, Bengaluru, India7h ago
-
AI Engineer INR 2500K-3900KAI architecture | Azure AI | Azure Databricks | Azure DevOps | Azure Machine LearningSenior-level Full TimeHyderabad, TS, India7h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India7h ago
-
Software Engineer II - Python, PySpark, AWS INR 1500K-2500KAWS | Big Data | Hadoop | Jenkins | PySparkMid-level Full TimeHyderabad, Telangana, India8h ago
-
Software Engineer III - Java, AWS, PySpark INR 2000K-2200KAWS | Automation | Continuous Delivery | Data Serialization | Data ServicesSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Senior AI Engineer INR 2500K-4500KAgent Orchestration | Autogen | Cloud deployment | CrewAI | LangchainSenior-level Full TimePune, Maharashtra, India9h ago
-
Software Engineer III - Databricks, Cloud Data Engineer INR 2000K-2400KAWS EMR | Agile | Apache Spark | Application Security | Big DataSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Software Engineer III - Databricks, Cloud Data Engineer INR 2000K-2400KAWS EMR | Apache Spark | CI/CD | Databricks | Development Life CycleSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Senior Manager - Data Infrastructure INR 1685K-2000KAPIs | Big Data | ETL | Hadoop | HiveAnnual health checkup | Diversity and inclusion policy | Group term life insurance | Medical insurance | Personal accidental insuranceSenior-level Full TimeGurugram, India10h ago
-
Lead - Data Platform Engineering INR 2500K-3380KCloud | Cost Optimization | Data Engineering | Data Modeling | Data PipelinesSenior-level Full TimeHyderabad, India10h ago
-
Data Engineer - GCP INR 2000K-2040KAirflow | BigQuery | Cloud Dataflow | Cloud Functions | Data WarehousingSenior-level Full TimeIndia11h ago
-
Mid-level Full TimePune, IN, 41102612h ago