Lead Pyspark Developer

Bengaluru - BCIT, India

INR 2520K-3380K (estimate) Senior-level Full Time

@ S...

Apply Save

Found 11d ago

Tasks

Automate workflows using orchestration tools
Collaborate with stakeholders
Develop and maintain ETL pipelines on PySpark
Document data processes
Implement data ingestion processes from multiple sources
Optimize PySpark and cluster performance
Process cleanse and transform large datasets
Troubleshoot pipeline issues
Validate and monitor data quality

Perks/Benefits

Skills/Tech-stack

Apply Save

Language: en | Views: 0 | Clicks: 0 | Saves: 0

Related jobs

Lead Consultant - RAG Engineer INR 2535K-4225K

AWS | AWS Step Functions | Airflow | Amazon SageMaker | Cloud Native

Continuous learning opportunities | Hands-on experience | Mentorship

Senior-level Full Time

India-Gurugram

19h ago
Databrick Developer INR 2000K-2040K

Agile | Airflow | Amazon Web Services | Apache Spark | CI/CD

Senior-level Full Time

IN-TN-Chennai

20h ago
Databrick Developer INR 2000K-2040K

Agile | Amazon Web Services | Apache Airflow | Apache Kafka | Apache Spark

Senior-level Full Time

IN-TN-Chennai

20h ago
Python GCP Lead INR 1500K-2000K

Agile | Apache Spark | BigQuery | Cloud Storage | Cloud platform

Senior-level Full Time

IN-AP-Hyderabad

20h ago
Consultant- Data Support INR 316K-500K

Alteryx | Azure Data | Azure Data Engineering | Azure Data Lake | Azure Databricks

24/7 rotation | Customer service focus

Entry-level Full Time

Bangalore, Karnataka, India

21h ago
Microsoft Fabric Data Engineer INR 1800K-2040K

Azure Data | Azure Data Factory | Azure DevOps | CI/CD | Data Factory

Senior-level Full Time

Thane, Maharashtra, India

22h ago
Data Science – (Gen AI Developer) - Associate INR 2000K-2400K

Autogen | CI/CD | Data Analysis | Data Visualization | ETL

Senior-level Full Time

Bengaluru, Karnataka, India

22h ago
Consultant _ADF INR 2000K-2000K

ADF Mapping Data Flows | ARM Templates | Agile | Azure Data | Azure Data Factory

Senior-level Full Time

Bangalore, Karnataka, India

22h ago
Lead Data Engineer INR 1200K-2000K

Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory

UK shift work

Senior-level Full Time

Bengaluru, KA, India

1d ago
Azure Data Engineer Consultant INR 1600K-3000K

Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks

Discounts on products and services | Maternity leave | Networking opportunities | Paternity leave

Mid-level Full Time

Bangalore, Karnataka, India

1d ago
Data Quality Engineer-Azure Data Platform Testing INR 1500K-2000K

Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage

Mid-level Full Time

Gurugram, Haryana, India

1d ago
Gen AI - Business Analyst - Manager INR 1500K-2800K

APIs | AWS | Airflow | Amazon SageMaker | Azure

Mid-level Full Time

Gurgaon, Haryana, India

1d ago
Lead Software Engineer INR 2500K-4725K

Auto Scaling | CI/CD | Caching | Celery | Cloud Pub/Sub

Senior-level Full Time

Noida

1d ago
DevOps - Senior DevOps Engineer - 532 INR 2229K-3500K

AWS | Ansible | Auto Scaling | CI/CD | CloudFormation

Senior-level Full Time

Noida, Uttar Pradesh

1d ago
DevOps - Senior DevOps Lead - 533 INR 2200K-3065K

API Security | AWS | AWS Lambda | Amazon CloudWatch | Amazon EBS

Senior-level Full Time

Noida, Uttar Pradesh

1d ago
DevOps - DevOps Engineer--576 INR 2200K-2829K

API Security | Amazon Web Services | Ansible | Auto Scaling | CentOS

Senior-level Full Time

Noida, Uttar Pradesh

1d ago
Software Engineer II- Python, Databricks, AWS, Spark, IDMC INR 1500K-2200K

AWS Lambda | Amazon Aurora | Amazon EKS | Amazon S3 | Apache Airflow

Mid-level Full Time

Bengaluru, Karnataka, India

1d ago
Senior Software Engineer INR 3200K-4225K

Access Control | Airflow | Artificial Intelligence | Astronomer | CI/CD

Senior-level Full Time

Pune, India R

1d ago
Data Architect II INR 2040K-2400K

Apache Spark | Azure | Azure SQL | Data Lake | Data Modeling

Senior-level Full Time

Bangalore, KA, IN

1d ago
Systems Integration Specialist INR 2486K-3380K

CI/CD | Docker | Docker containers | Event Driven | Event-driven architecture

Mid-level Full Time

Bangalore/Hyderabad/Chennai/Gu, KA, IN

1d ago
Data Engineer (Data Application Developer) INR 2516K-3356K

AWS | Amazon Kinesis | Amazon SQS | DBT | Data Modeling

Community involvement support | Employee support programs | Hybrid work options | In-person work options | Remote work options

Senior-level Full Time

Remote (IND), India R

1d ago
Big Data Ab Initio Engineer INR 2040K-2900K

Autosys | Bitbucket | CI/CD | Control-M | Git

Mid-level Full Time

Gera Commerzone SEZ, Pune, India

1d ago
Platform Engineer INR 1300K-1500K

API Testing | AWS | Agile | Ansible | Artifactory

Mid-level Full Time

Bangalore - Manyata Tech Park Road, …

1d ago
Lead Software Engineer - Java, React, GenAI INR 2500K-3800K

API Automation | Agile | Azure | Azure DevOps | Behavior-Driven Development

Peer mentoring | Stakeholder engagement | Vendor collaboration

Senior-level Full Time

110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India

1d ago
Backend Engineer INR 2500K-4000K

AWS | Azure | CI/CD | Docker | GCP

Senior-level Full Time

Mumbai, Maharashtra, India

1d ago

Lead Pyspark Developer

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs