Lead Pyspark Developer

Bengaluru - BCIT, India

INR 2520K-3380K (estimate) Senior-level Full Time

@ S...

Apply Save

Found 1mo ago

Tasks

Automate workflows using orchestration tools
Collaborate with stakeholders
Develop and maintain ETL pipelines on PySpark
Document data processes
Implement data ingestion processes from multiple sources
Optimize PySpark and cluster performance
Process cleanse and transform large datasets
Troubleshoot pipeline issues
Validate and monitor data quality

Perks/Benefits

Skills/Tech-stack

Apply Save

Language: en | Views: 0 | Clicks: 0 | Saves: 0

Related jobs

Data Engineer II INR 1500K-2000K

Apache Spark | Azure Data | Azure Data Explorer | Azure Data Factory | Azure Synapse

Mid-level Full Time

Hyderabad, TS, IN

9h ago
IN_Senior Associate_Azure Data Engineer_Digital Integration_Advisory_Gurgaon INR 2040K-3500K

Azure Databricks | CI/CD | Data Pipelines | Data integration | ETL

Senior-level Full Time

Gurugram 10 C, India

15h ago
IN_Senior Associate_Azure Data Engineer_Digital Integration_Advisory_Gurgaon INR 2040K-3500K

Azure Databricks | Data integration | ETL | Filtering | Joining

Senior-level Full Time

Gurugram 10 C, India

15h ago
Staff Engineer - Java,Scala,AWS INR 3000K-4000K

AWS S3 | Agile | Amazon ECS | Amazon EFS | Amazon EMR

Family wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Work-life balance

Senior-level Full Time

Hyderabad, India

1d ago
Senior Data Engineer INR 3000K-4000K

Apache Airflow | Apache Spark | Azure | Azure Databricks | CI/CD

Senior-level Full Time

Bengaluru, Karnataka, India

1d ago
Aws Etl INR 1500K-2000K

AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatch

Mid-level Full Time

IN-AP-Hyderabad

1d ago
Aws Etl INR 1500K-2000K

AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatch

Mid-level Full Time

IN-AP-Hyderabad

1d ago
Aws Etl INR 1500K-2000K

AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatch

Mid-level Full Time

IN-AP-Hyderabad

1d ago
Process Manager INR 1500K-2000K

Big Data | Data Modeling | Data pipeline | ETL | Hadoop

Mid-level Full Time

Mumbai, Maharashtra, India

1d ago
Manager - Python with Gen AI INR 1800K-3000K

Autogen | Claude | CrewAI | Data Pipelines | Event Driven

Mid-level Full Time

Bangalore, Karnataka, India

1d ago
Lead Software Engineer - Big Data INR 2040K-3380K

Amazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache Parquet

Senior-level Full Time

Mumbai, Maharashtra, India

1d ago
Assistant Manager- Python AI Developer INR 1800K-3000K

AWS | Autogen | Azure | Claude | CrewAI

Mid-level Full Time

Bangalore, Karnataka, India

1d ago
Consultant - Python Developer with Gen AI INR 2500K-4500K

AWS | Autogen | Azure | CrewAI | Docker

Senior-level Full Time

Bangalore, Karnataka, India

1d ago
Data Engineer INR 3000K-4000K

Apache Airflow | Apache Kafka | Apache Spark | Big Data | BigQuery

Senior-level Full Time

Gurgaon, Haryana, India

1d ago
Senior Data Engineer INR 3000K-4000K

AWS | Apache Airflow | CDC | Containerization | DBT

Senior-level Full Time

Bengaluru, India

1d ago
Senior Data Engineer INR 2800K-3880K

AWS | Apache Airflow | CDC | Containerization | DBT

Senior-level Full Time

Bengaluru, India

1d ago
Senior Data Engineer II INR 2800K-4000K

AWS | Airflow | CDC | CI/CD | Control-M

Comprehensive benefits package | Flexible working

Senior-level Full Time

FIL Bengaluru Office, India

1d ago
Sr. Data Engineer, Analytics Engineering INR 3000K-4000K

Airflow | Data Governance | Data Modeling | Data Pipelines | Data Quality

Senior-level Full Time

Mumbai, India

1d ago
Big Data Engineer - (Scala | Spark | Databricks | Cloud) INR 2000K-3000K

AWS EMR | Apache Flink | Apache Hadoop | Apache Hive | Apache Spark

Senior-level Full Time

IT BUILDING, RAMANUJAN IT SEZ,, India

1d ago
Lead Data Engineer- Graph INR 2100K-2755K

BigQuery | Cypher | Data Pipelines | Fine Tuning | GCP

Senior-level Full Time

111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …

1d ago
Profisee MDM Developer Senior Specialist (Databricks/AWS) INR 2755K-3380K

Data Governance | Data Management | Data Matching | Data Modeling | Data Quality

Employee stock purchase program | Flex day program | Flexible working schedule | Health insurance | Hybrid work model

Senior-level Full Time

Bangalore-Affluence, India

1d ago
Profisee MDM Developer Specialist (Databricks/AWS) INR 2755K-3380K

Data Governance | Data Management | Data Mapping | Data Matching | Data Modeling

Annual bonus | Flex day program | Flexible work schedule | Health insurance | Hybrid work

Senior-level Full Time

Bangalore-Affluence, India

1d ago
Senior Software Engineer - Gen AI INR 2000K-2800K

AJAX | AWS | Agile | Angular | Ansible

Continuous learning

Senior-level Full Time

110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India

1d ago
Senior Developer - Oracle SQL / PL SQL & Python PySpark- Assistant Vice President INR 2000K-3100K

AWS | Apache Airflow | Cloud platform | Control-M | Data Governance

Senior-level Full Time

PLOT NO-1, S.NO. 77, India

1d ago
SMTS/LMTS - AI ML Engineers INR 2000K-4500K

Cloud Native | Context engineering | Continuous Deployment | Continuous integration | Data Pipelines

1 to 1 coaching | Adoption Assistance | Fertility benefits | Generous parental leave | Health and well being reimbursement

Senior-level Full Time

India - Bangalore

1d ago

Lead Pyspark Developer

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs