Data Engineer (Databrick + Pyspark)
India; India - Pune
INR 1200K-2000K (estimate) Senior-level Full Time
Tasks
- Design scalable ETL/ELT data pipelines
- Develop Databricks data solutions
- Develop and optimize PySpark jobs
- Ensure data quality, reliability, and performance
- Manage Spark workloads on EMR Serverless
- Orchestrate workflows with Apache Airflow
- Write SQL queries for data transformation
Perks/Benefits
Skills/Tech-stack
Amazon EMR | Amazon EMR Serverless | Amazon S3 | Apache Airflow | Apache Kafka | Apache Spark | CI/CD | Data Cataloging | Data Governance | Data Lake | Data Lineage | Databricks | Delta Lake | ELT | EMR Serverless | ETL | PySpark | SQL | Spark Structured Streaming | Structured Streaming
Education
N/A
Roles
Related jobs
-
APIs | Access Control | Amazon S3 | Anomaly Detection | Apache SparkFully remote work flexibilitySenior-level Full TimeIndia R18h ago
-
Senior DevOps Engineer INR 2000K-4000KAKS | Amazon Aurora | Amazon EMR | Amazon Redshift | Amazon S3Senior-level Full TimeBangalore, India19h ago
-
Technology Leader-Data Engineering-HO & SUPPORT-CVM CoE - Corporate Centre of Excellence INR 2000K-2600KAPI | CI/CD | Java | Jira | LinuxSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Senior-level Full TimeIN-MH-Pune20h ago
-
Deputy Manager-Data Engineering INR 1500K-2500KAmazon Web Services | Azure | CI/CD | Cloud platform | ContainerizationMid-level Full TimeNoida, UP, India21h ago
-
Senior Software Engineer, Server AI Foundations, Core INR 2000K-4500KAgentic Frameworks | Agents | Agile Development | CI/CD | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Assistant Manager - Cloud & AI Architect INR 2000K-3500KAI Foundry | Access Management | Active Directory | Agent Builder | Agent OrchestrationC level presentations | Client advisory | Mentoring junior resources | Professional developmentSenior-level Full TimeBangalore, Karnataka, India23h ago
-
Data Engineer - Senior INR 2000K-2800KAnomaly Detection | Apache Hive | Apache Kafka | Application Insights | AzureSenior-level Full TimePune, Maharashtra, India23h ago
-
AWS Data Engineer INR 1500K-2000KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeIndia23h ago
-
Senior-level Full TimePune, Maharashtra, India23h ago
-
Agile | Apache Spark | Data Architecture | Data Catalog | Data GovernanceSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Azure Data Engineer - Assistant Manager INR 1500K-2000KAnalysis Services | Apache Spark | Azure Analysis | Azure Analysis Services | Azure CosmosMid-level Full TimeBangalore, Karnataka, India23h ago
-
Azure Databricks INR 2400K-3900KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksClient Customer Interactions | Health insurance | Learning aids | Meal vouchers | Unlimited growth potentialSenior-level Full TimeHyderabad, Telangana, India23h ago
-
Data Engineer - Scala INR 2000K-2300KAPI Integration | Apache Spark | DB2 | Data Mining | Data ModelingSenior-level Full TimeIndia - Bengaluru1d ago
-
Senior Research Engineer - Applied AI/ML INR 2000K-4170KA/B | A/B Testing | AWS | Amazon SageMaker | Apache AirflowHybrid workSenior-level Full TimeGurugram, India1d ago
-
Senior-level Full TimeHyderabad, India1d ago
-
Applied AI /ML INR 950K-1250KAlgorithms | Amazon Web Services | Azure | Computer Vision | Data MiningMid-level Full TimeHyderabad, Telangana, India1d ago
-
Lead Assistant Manager INR 2000K-3000KANSI SQL | Agile | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimePune, Maharashtra, India1d ago
-
AES - DE - Generative AI Prompt Engineers INR 2000K-3000KAnthropic API | Azure OpenAI | CI/CD | Code Analysis | CypressHybrid work modelMid-level Full TimePune, Maharashtra, India1d ago
-
Snowflake Data Engineer- Consultant INR 1500K-2700KAWS Athena | AWS Data | AWS Data Pipeline | AWS Glue | AWS LambdaCorporate social responsibility programs | Maternity leave | Networking opportunities | Paternity leave | Product and service discountsMid-level Full TimeBangalore, Karnataka, India1d ago
-
Genetics Data Engineer INR 1500K-2500KAWS | Azure | BGEN | Bcftools | Biobank trusted research environmentsMid-level Full TimeBangalore, Karnataka, IN, 5600371d ago
-
Azure Data Engineer_Consultant INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeHyderabad, HYDERABAD, India1d ago
-
Lead Software Engineer - Applied AI Engineer (Agentic/ Gen AI) INR 2000K-3500KAPI Design | AWS | Accuracy Monitoring | Agentic architecture | CI/CDSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Java Spark Engineer INR 2000K-3500KAWS | Apache Spark | Azure | CI/CD | Cloud platformAgile team culture | Career growth opportunitiesSenior-level Full TimeIndia - Bengaluru1d ago
-
AI Engineer - Tieto Tech Consulting (m/f/d) INR 2200K-4200KAI Builder | AI Search | AI Solution | AI solution testing | Agent OrchestrationHybrid work model | Open culture | Professional growth | Work-life balanceMid-level Full TimeBangalore, India1d ago