Lead Pyspark Developer

Bengaluru - BCIT, India

INR 2520K-3380K (estimate) Senior-level Full Time

@ S...

Apply Save

Found 1mo ago

Tasks

Automate workflows using orchestration tools
Collaborate with stakeholders
Develop and maintain ETL pipelines on PySpark
Document data processes
Implement data ingestion processes from multiple sources
Optimize PySpark and cluster performance
Process cleanse and transform large datasets
Troubleshoot pipeline issues
Validate and monitor data quality

Perks/Benefits

Skills/Tech-stack

Apply Save

Language: en | Views: 0 | Clicks: 0 | Saves: 0

Related jobs

Lead AI Engineer INR 2500K-4000K

AI Search | Airflow | Azure AI | Azure AI Search | BERT

Senior-level Full Time

Pune City, India

5h ago
Palantir Data Engineer INR 2000K-2400K

AWS | AWS Glue | AWS Lambda | Agile | Amazon Athena

Senior-level Full Time

Pune, Maharashtra, India

5h ago
Senior Data Engineer INR 2516K-2829K

Airflow | Apache Spark | Azure | Azure Data | Azure Data Lake

Employee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time off

Senior-level Full Time

Chennai, TN, India

10h ago
Staff Engineer INR 2000K-3100K

AI | Agentic Workflows | BigQuery | Cloud platform | Data Modeling

Senior-level Full Time

Chennai, Tamil Nadu, India

12h ago
IN_Senior Associate_Java/Python Developer_Risk Analytics-GRC_Advisory_Gurgaon INR 2500K-4000K

CI/CD | Couchbase | Design Patterns | Docker | Guice

Senior-level Full Time

Gurugram 8 B, India

18h ago
Sr. Azure Data Engineer INR 1500K-2000K

AWS | Azure | Azure Data | Azure Data Factory | Azure Data Lake

Senior-level Full Time

INDIA - BENGALURU - HP, IN

18h ago
IN-Associate 2_Azure Data Engineer_OC D&A_Advisory_Bhubaneswar INR 1500K-2000K

Agile | Azure | Azure Data | Azure Data Factory | Azure Data Lake

Mid-level Full Time

Bhubaneswar - Ihub, India

18h ago
Data Engineer INR 2000K-2000K

API | API Integration | AWS | Apache Airflow | Apache Spark

Mid-level Full Time

India - Hyderabad

18h ago
Sr Data Engineer INR 2400K-2800K

API Integration | AWS | Apache Airflow | Apache Spark | CCPA

Senior-level Full Time

India - Hyderabad

18h ago
Data Engineer INR 2000K-2000K

API | AWS | Apache Airflow | Apache Spark | Caching

Mid-level Full Time

India - Hyderabad

18h ago
Data Engineer INR 2000K-2000K

API Integration | AWS | Apache Airflow | Apache Spark | Caching

Mid-level Full Time

India - Hyderabad

18h ago
Sr Data Engineer INR 2400K-2800K

APIs | AWS | Apache Airflow | Apache Spark | CCPA

Senior-level Full Time

India - Hyderabad

18h ago
Data Engineer INR 2000K-2000K

APIs | AWS | Apache Airflow | Apache Spark | CCPA

Mid-level Full Time

India - Hyderabad

18h ago
Azure Data Engineer INR 1500K-2000K

Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake

Mid-level Full Time

Bengaluru, Karnataka, India

18h ago
BIPM Engineer INR 1500K-1800K

ADF | ADLS | CI/CD | DAX | Data Governance

Mid-level Full Time

Goa Office, India

18h ago
Software Engineer II A - GBS IND INR 1000K-1500K

API | Alerting | Amazon S3 | Automation | Azure

Career development opportunities | Flexible work schedule | Health and wellness benefits | Paid time off

Mid-level Full Time

Gurugram Haryana, India

18h ago
Consultant - AI/ML - Bangalore INR 1500K-2800K

AWS | Airflow | CI/CD | CircleCI | Cloud platform

Mid-level Full Time

Bangalore, Karnataka, India

22h ago
Software Engineer Lead (Python + Snowflake) INR 2040K-3100K

Airflow | CI/CD | DBT | Dagster | Data Modeling

Senior-level Full Time

India (Noida)

1d ago
Lead Assistant Manager INR 2500K-3500K

Data cleaning | Feature Engineering | Gradient boosting | Model Monitoring | Model retraining

Senior-level Full Time

Gurugram, Haryana, India

1d ago
Data Engineer – GenAI + Python INR 2000K-2040K

Apache Spark | Deep learning | Hadoop | Hive | LLM

Senior-level Full Time

IN-MH-Pune

1d ago
Software Engineer III Data Engineer-Python, AWS INR 2050K-3500K

AWS | CI/CD | Databricks | ETL | PySpark

Senior-level Full Time

Bengaluru, Karnataka, India

1d ago
DTICI_Data - Quality Management and Emerging Tech#Senior Consultant_T8 INR 1500K-2200K

Azure Data | Azure Data Factory | Azure Data Lake | Dashboards | Data Cleansing

Senior-level Full Time

Bengaluru, Karnataka, India

1d ago
Azure Data Engineer INR 1500K-2000K

Azure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure Synapse

Mid-level Full Time

Chennai, Tamil Nadu, India

1d ago
Senior Big Data Engineer INR 2040K-2500K

Agile | Apache Airflow | Apache Flink | Apache Hive | Apache Kafka

Agile working opportunities | Birthday off | Flexible working hours | Work-life balance

Senior-level Full Time

Gurgaon

1d ago
Software Engineer INR 2040K-3500K

Agile | Airflow | Angular | Apache Kafka | Automated testing

Senior-level Full Time

Chennai, Tamil Nadu, India

1d ago

Lead Pyspark Developer

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs