PySpark Developer | Big Data, Cloud, SQL, Data Pipelines, DataOps

Chennai, India

INR 3000K-4000K (estimate) Senior-level Full Time

@ S...

Apply Save

Found 21h ago

Tasks

Automate deployment with CI/CD
Build data workflows
Collaborate with data scientists and analysts
Design data processing pipelines
Implement data transformations
Maintain data architecture documentation
Monitor pipeline performance
Optimize pipeline performance
Perform troubleshooting and tuning
Validate and ensure data quality

Perks/Benefits

Skills/Tech-stack

Apply Save

Language: en | Views: 0 | Clicks: 0 | Saves: 0

Related jobs

Sr. DevOps Engineer INR 2500K-3500K

AIOps | AKS | ARM | Azure Container | Azure Container Registry

Rotational on-call support

Senior-level Full Time

Hyderabad, India

7h ago
Database Engineer INR 1500K-2400K

AWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data Warehousing

Senior-level Full Time

IN-TN-Chennai

8h ago
Database Engineer INR 1500K-2500K

AWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud Databases

Senior-level Full Time

IN-TN-Chennai

8h ago
Gen AI Developer INR 2000K-3000K

API Integration | Claude API | Context Management | CrewAI | FastAPI

Mid-level Full Time

IN-MH-Pune

8h ago
Snowflake Developer INR 400K-1200K

Apache Airflow | DBT | Data Sharing | Dynamic Tables | ETL

Senior-level Full Time

IN-TN-Chennai

8h ago
Informatica Powercenter Developer INR 1200K-2200K

AWS | Advanced Mapping | Batch scheduling | DB2 | Data Reconciliation

Migration and modernization experience | Production support experience

Senior-level Full Time

IN-TN-Chennai

8h ago
Power BI Developer INR 2000K-2500K

DAX | Data Warehousing | ETL | Kyvos | MDX

Senior-level Full Time

IN-TN-Chennai

8h ago
Aws Etl INR 1500K-2000K

AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatch

Mid-level Full Time

IN-AP-Hyderabad

8h ago
Aws Etl INR 1500K-2000K

AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatch

Mid-level Full Time

IN-AP-Hyderabad

8h ago
Aws Etl INR 1500K-2000K

AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatch

Mid-level Full Time

IN-AP-Hyderabad

8h ago
Senior SW Engineer INR 2500K-4500K

Artificial Intelligence | CI/CD | Flyte | Java | Language Models

Senior-level Full Time

India

9h ago
Senior Applied Computer Vision Engineer - Data Driven Development INR 2000K-3900K

Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure ML

Senior-level Full Time

bengaluru, India

10h ago
Staff Software Engineer, Android Embedded Software INR 2000K-3200K

Android | C++ | Distributed Systems | Java | Performance optimization

Senior-level Full Time

Bengaluru, Karnataka, India

10h ago
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000K

Amazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMaker

Senior-level Full Time

Pune, Maharashtra, India

10h ago
Process Manager INR 1500K-2000K

Big Data | Data Modeling | Data pipeline | ETL | Hadoop

Mid-level Full Time

Mumbai, Maharashtra, India

10h ago
Manager - Python with Gen AI INR 1800K-3000K

Autogen | Claude | CrewAI | Data Pipelines | Event Driven

Mid-level Full Time

Bangalore, Karnataka, India

14h ago
Lead Software Engineer - Big Data INR 2040K-3380K

Amazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache Parquet

Senior-level Full Time

Mumbai, Maharashtra, India

14h ago
Assistant Manager- Python AI Developer INR 1800K-3000K

AWS | Autogen | Azure | Claude | CrewAI

Mid-level Full Time

Bangalore, Karnataka, India

14h ago
Consultant - Python Developer with Gen AI INR 2500K-4500K

AWS | Autogen | Azure | CrewAI | Docker

Senior-level Full Time

Bangalore, Karnataka, India

14h ago
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500K

Agent-based | Agent-based frameworks | Autogen | Claude | Cloud Computing

Mid-level Full Time

Bangalore, Karnataka, India

14h ago
Data Platforms Manager INR 2000K-2400K

AWS | Alerting | Amazon Aurora | Amazon RDS | Ansible

Senior-level Full Time

Hyderabad, India

15h ago
Sr. Data Engineer INR 2800K-4000K

Cloud warehousing | DAX | Dashboard Design | Data Quality | Data Storytelling

Community outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentives

Senior-level Full Time

Bangalore, KA, IN, 560037

15h ago
Lead Software Engineer - Java, AWS, GraphSQL, Data science INR 2500K-4500K

AWS | Amazon ECS | Amazon EKS | Application Resiliency | CI/CD

Senior-level Full Time

Hyderabad, Telangana, India

15h ago
Data Engineer INR 3000K-4000K

Apache Airflow | Apache Kafka | Apache Spark | Big Data | BigQuery

Senior-level Full Time

Gurgaon, Haryana, India

15h ago
Software Engineer INR 1000K-1496K

Bitbucket | Data Architecture | Data Modeling | Data Pipelines | Linux

Employee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time off

Mid-level Full Time

Chennai, TN, India

15h ago

PySpark Developer | Big Data, Cloud, SQL, Data Pipelines, DataOps

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs