PySpark Developer / Senior Data Engineer

Seri Lingampally, India

A INR 1500K-2700K (estimate) Senior-level Contract

@ A...

Apply Save

Found 4h ago

Tasks

Build and maintain data pipelines using PySpark and Apache Spark
Design scalable data pipelines
Develop ETL workflows for batch and near realtime processing
Implement data validation monitoring and logging frameworks
Integrate data from databases APIs files and cloud storage
Mentor junior engineers
Optimize Spark jobs for performance reliability and cost
Participate in design reviews and code reviews
Support deployment scheduling and orchestration of data pipelines
Transform large structured and unstructured datasets
Troubleshoot job failures data quality issues and performance bottlenecks
Write reusable modular PySpark code

Perks/Benefits

Skills/Tech-stack

Education

N/A

Apply Save

Language: en Views: 0

Clicks: 0

Saves: 0

Related jobs

Data Engineer - Solution Expert INR 1500K-2700K

BigQuery | CI/CD | Cloud Security | Cloud platform | Data Modeling

Senior-level Full Time

Pune, MH, India

5h ago
Generative AI Application Developers INR 1800K-4500K

C++ | Computer Vision | Debugging | Generative AI | Java

Senior-level Full Time

Pune, Maharashtra, India

6h ago
Generative AI Application Developers INR 1500K-2500K

AI integration | Deep learning | Generative AI | Language Processing | Machine Learning

Mid-level Full Time

Pune, Maharashtra, India

6h ago
Lead Analytics Engineer INR 2000K-3000K

AI Agents | AWS | CI/CD | DBT | Data Contracts

Senior-level Full Time

Mumbai, India

6h ago
Lead Analytics Engineer INR 2000K-3000K

AI Agents | AWS | CI/CD | DBT | Data Contracts

Senior-level Full Time

Mumbai, India

6h ago
Sr IT Analyst INR 2400K-4200K

CRM | Data Governance | Data Quality | Data Warehouse | Data analytics

Senior-level Full Time

Pune, Maharashtra, India

6h ago
Design Verification Engineer, PhD, Early Career INR 2500K-6000K

AI | AI accelerators | Accelerator architectures | Arithmetic Unit | Bus architecture

None Full Time

Bengaluru, Karnataka, India

6h ago
Module Lead AI/ML INR 2500K-5000K

AWS | Apache Airflow | Autogen | Azure | Cloud deployment

Inclusive workplace

Senior-level Full Time

Noida, Uttar Pradesh, India

6h ago
Embedded Engr II INR 1500K-2500K

ARP4754 | ARP4761 | C# | C++ | Configuration Management

Senior-level Full Time

Bengaluru, Karnataka, India

8h ago
Data Engineer INR 1500K-2500K

API Integration | Access Control | Apache Airflow | Astronomer | BigQuery

Senior-level Full Time

India

8h ago
Software Engineer III - Tableau SRE & Automation INR 2500K-4000K

Change Management | DNS | Dynatrace | Firewall | Grafana

Senior-level Full Time

Hyderabad, Telangana, India

8h ago
Full-Stack AI Engineer INR 2000K-4500K

AWS | Amazon ECS | CI/CD | Containers | Data Lake

Senior-level Full Time

Hyderabad, IN

9h ago
Dev Ops Manager - Azure INR 2000K-2700K

Alerting | Azure | Azure DevOps | CI/CD | Docker

Mid-level Full Time

Hyderabad, TS, India

10h ago
Lead / Manager Agentic AI Engineer - Claude Code & Codex INR 2000K-4500K

AWS | Asynchronous programming | Autogen | Azure | CI/CD

Senior-level Full Time

Hyderabad, TS, India

10h ago
Data Engineer INR 1500K-2200K

Analysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob Storage

Mid-level Full Time

Hyderabad, IN

10h ago
Senior Data Engineer INR 1500K-2600K

Analysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob Storage

Senior-level Full Time

Hyderabad, IN

10h ago
Senior Data Scientist / AI/ML INR 2500K-5000K

AWS | Azure | Bayesian Models | CNN | Chatbots

Senior-level Full Time

Gurgaon, HR, India

11h ago
Assistant Manager INR 1000K-1800K

Dashboarding | Data Analysis | Data Visualization | Power BI | SQL

Mid-level Full Time

Gurugram, Haryana, India

11h ago
Software Engineer II INR 1500K-4000K

Best practices | C# | Data Pipelines | Debugging | Distributed Systems

Mid-level Full Time

India, Karnataka, Bangalore

11h ago
(Senior) AI Engineer - Data & AI Organisation (all genders) 1 INR 2500K-5000K

API Development | Amazon Web Services | Apache Spark | CI/CD | DBT

Senior-level Full Time

Bangalore, Karnataka, IN, 560100

11h ago
(Senior) Software Engineer (all genders) 1 INR 3600K-4720K

AI Safety | AWS | Amazon Web Services | Apache Spark | Automated testing

Senior-level Full Time

Bangalore, Karnataka, IN, 560100

11h ago
Software Engr II INR 2500K-4800K

Alerting | Azure Data | Azure Data Lake | Azure IoT | Azure IoT Edge

Senior-level Full Time

Bengaluru, Karnataka, India

11h ago
Lead Developer (Python, React, AWS, GenAI) INR 3242K-4800K

AWS | Agile | Continuous integration | Design Patterns | DevSecOps

Inclusive team culture | Mentorship | Professional development programs

Senior-level Full Time

Pune, India

12h ago
AI Engineer (India, China) INR 2500K-4064K

APIs | AWS | Airflow | Apache Spark | Autogen

Annual leave | Flexible working | Life insurance | Medical insurance | Parental leave

Mid-level Full Time

Bangalore, IN

12h ago
GenAI Developer INR 2000K-5000K

AI Agents | AI Services | API Development | Async Programming | Azure AI

Senior-level Full Time

India

12h ago

PySpark Developer / Senior Data Engineer

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Related jobs