Data Engineer (Databrick + Pyspark)
India; India - Pune
INR 1200K-2000K (estimate) Senior-level Full Time
Tasks
- Design scalable ETL/ELT data pipelines
- Develop Databricks data solutions
- Develop and optimize PySpark jobs
- Ensure data quality, reliability, and performance
- Manage Spark workloads on EMR Serverless
- Orchestrate workflows with Apache Airflow
- Write SQL queries for data transformation
Perks/Benefits
Skills/Tech-stack
Amazon EMR | Amazon EMR Serverless | Amazon S3 | Apache Airflow | Apache Kafka | Apache Spark | CI/CD | Data Cataloging | Data Governance | Data Lake | Data Lineage | Databricks | Delta Lake | ELT | EMR Serverless | ETL | PySpark | SQL | Spark Structured Streaming | Structured Streaming
Education
N/A
Roles
Related jobs
-
Senior Software Engineer INR 1500K-2500KAccess Control | Agile | Anomaly Detection | Apache Spark | AzureSenior-level Full TimeBengaluru, KA, IN; Hyderabad, TS, IN3h ago
-
Software Engineering Specialist INR 355K-500KAPI Development | CI/CD | Data Engineering | Data Pipelines | Deep learningEntry-level Full TimeBengaluru, IN, 5601035h ago
-
Sr Specialist, Data Engineering INR 2400K-3380KApache Airflow | CI/CD | Cloud Build | Cloud Storage | Cloud platformRelocation assistance within countrySenior-level Full TimeMumbai, MH, IN6h ago
-
Sr Specialist, Data Engineering INR 2400K-3380KApache Airflow | CI/CD | Cloud Build | Cloud Storage | Cloud platformRelocation assistanceSenior-level Full TimeMumbai, MH, IN6h ago
-
Databricks - Assistant Manager INR 2000K-2500KApache Spark | Data Modeling | Data Warehousing | Data pipeline | DatabricksSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Software Engineer INR 2000K-3300KAKS | Angular | App Services | Azure | Azure AppEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India7h ago
-
API Development | AWS | Airflow | Azure | Data ModelingCareer growth | Continuous learning | Flexible work environment | Inclusive culture | Professional developmentSenior-level Full TimeIndia8h ago
-
GCP Data Engineer Lead INR 1500K-2500KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsSenior-level Full TimeHyderabad, TS, India8h ago
-
Senior-level Full Timecoimbatore, India9h ago
-
Staff Machine Learning Engineer L5 INR 2520K-3500KAWS | Algorithms | Apache Airflow | Azure | Data StructuresSenior-level Full TimeGurugram, India12h ago
-
Principal AI Engineer INR 2000K-4500KAPI Integration | AWS Bedrock | Agent Orchestration | CI/CD | Deep learningSenior-level Full TimeBangalore, KA, IN13h ago
-
IN_Specialist 2_Palantir_Data and Analytics_Advisory_Mumbai INR 1200K-1700KAmazon Web Services | Apache Airflow | Apache Hadoop | Azure Data | Azure Data FactoryMid-level Full TimeMumbai Shivaji Park, India13h ago
-
IN_Associate_Aws Devops_ Data and Analytics_Advisory_Kolkata INR 1400K-2000KAmazon Web Services | Apache Airflow | Apache Hadoop | Azure Data | Azure Data FactoryMid-level Full TimeKolkata DN 57, India13h ago
-
AWS | Apache Airflow | Apache Hadoop | Azure | Azure DataEqual employment opportunities | Flexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimePune, India13h ago
-
Senior-level Full TimeBangalore, KA, IN13h ago
-
Mid-level Full TimeIND-TS Hyderabad Nanakramguda, India13h ago
-
Cloudops INR 1500K-2800KAzure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN13h ago
-
Entry-level Full TimeBangalore, KA, IN13h ago
-
Entry-level Full TimeBangalore, KA, IN13h ago
-
Entry-level Full TimeBangalore, KA, IN13h ago
-
Senior-level Full TimeIndia - Hyderabad13h ago
-
Data Engineering Team Lead INR 3000K-4000KAgile | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru, Karnātaka, India13h ago
-
Mid-level Full TimeIndia - Hyderabad13h ago
-
Data Engineer INR 1500K-2500KAWS | Airflow | Amazon Kinesis | Automation | AzureHealth and wellbeing benefits | Hybrid work schedule | Professional development programsSenior-level Full TimeBengaluru, Karnātaka, India13h ago
-
Data Engineer INR 2800K-4000KAWS | Airflow | Azure | CloudFormation | DBTCareer Development Programs | Flexible work schedule | Health and wellbeing benefits | Inclusion and diversity programsSenior-level Full TimeBengaluru, Karnātaka, India13h ago