PySpark Big Data Developer
Location(s): Pune, Maharashtra, India
INR 1340K-2000K (estimate) Mid-level Full Time
Tasks
- Build and maintain big data pipelines
- Collaborate with cross functional QA team
- Contribute to production stability
- Deploy to production
- Develop and execute features
- Integrate data from multiple sources
- Learn and apply latest technology trends
- Maintain application
- Perform impact analysis
- Troubleshoot production systems
- Understand requirements
Perks/Benefits
- Challenging assignments
- External training
- Flexible working hours
- Internal training
- Life insurance
- Medical care
- Pension scheme
Skills/Tech-stack
Apache Hadoop | Apache Hive | Apache Spark | Bitbucket | CI/CD | FastAPI | Flask | Git | GitHub | HDFS | Linux | OpenShift | PySpark | Python | SQL | TeamCity | YARN
Education
Roles
Automation Tester | Big Data Developer | Data Developer | Developer | Tester
Related jobs
-
Lead Software Engineer - Python Full Stack, AI/ML INR 4000K-5000KAWS | Agile | Angular | Application Resiliency | Automated testingSenior-level Full TimeMumbai, Maharashtra, India13h ago
-
Software Engineer III - Python Developer + AWS + LLM / Gen AI INR 3500K-5000KAWS | Agile | Azure | CI/CD | Data PipelinesSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Oracle AI-Oracle AI Developer-Staff INR 3799K-5000KAgentic Frameworks | Agile Scrum | Algorithms | Artificial Intelligence | Azure AIHealth and wellness packages | Learning opportunities | Mentorship | Professional developmentSenior-level Full TimeNoida, UP, IN, 2013011d ago
-
Azure Data | Azure Data Factory | CI/CD | Clustering | Cost OptimizationEntry-level Full TimePune, India1d ago
-
Senior Data Engineer - Product Delivery INR 1500K-2400KAzure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryCareer advancement | Dental insurance | Health insurance | Inclusive work environment | Professional development trainingSenior-level Full TimeIND Bangalore C 601, India1d ago
-
IN_Specialist 3_GenAI/Python_AI in Delivery_Advisory_Gurgaon INR 1800K-2700KAWS | CI/CD | Cloud platform | Data Augmentation | Data PreprocessingFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram Novus Tower, India1d ago
-
Authorization | FastAPI | Integration Testing | JWT | MicroservicesSenior-level Full TimePune, India1d ago
-
Azure | Azure Data | Azure Data Factory | CI/CD | ClusteringFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportEntry-level Full TimePune, India1d ago
-
Analytics & Workflow Automation Developer INR 700K-1800KAI Agents | Anomaly Detection | Csharp | Data Modeling | DatabricksMid-level Full TimeBangalore - North Gate, India1d ago
-
Senior-level Full TimeIN-KA-Bangalore2d ago
-
AES - DE - Generative AI Application Developers INR 1500K-2500KAWS | Data Ingestion | Inferencing | LLM workflow | Language ModelsMid-level Full TimePune, Maharashtra, India2d ago
-
Mid-level Full TimeIndia - Remote R3d ago
-
Senior-level Full TimeIN-MH-Pune3d ago
-
Senior-level Full TimeIN-TN-Chennai3d ago
-
Senior-level Full TimeIN-TN-Chennai3d ago
-
Senior-level Full TimeIN-TN-Chennai3d ago
-
PL/SQL Developer INR 1200K-2400KBackup & Recovery | CI/CD | Data Modeling | Data Quality | Database InternalsSenior-level Full TimeIN-TN-Chennai3d ago
-
DE&A - Core - Big Data Engineering - Hadoop Ecosystem INR 3000K-4200KAPI | AWS | Apache Hadoop | Apache Spark | AzureSenior-level Full TimePune, Maharashtra, India3d ago
-
Senior AI Developer INR 2000K-4500KAWS | Angular | Azure | CI/CD | Computer VisionAnnual performance bonus | Communication Skills Training | Extended maternity leave | Family medical insurance | Flexible work scheduleSenior-level Full TimeHyderabad, Telangana, India3d ago
-
Senior Java Developer – Data Platform & Integration INR 2515K-4401KAgile Scrum | Amazon S3 | Apache Kafka | Avro | Azure BlobFlexible working | Hybrid workingSenior-level Full TimePune, Maharashtra, India3d ago
-
SA1 / Sr. Engg - GTS - Build AI INR 2000K-2800KAngular | Apache Spark | Authentication | Authorization | Azure DataSenior-level Full TimeHyderabad, Telangana, India3d ago
-
SA1 / Sr. Engg - GTS - Build AI INR 2000K-2800K.NET | Angular | Apache Spark | Authentication | AuthorizationSenior-level Full TimeHyderabad, Telangana, India3d ago
-
Asynchronous programming | Business API | Cloud API | Conversation State Management | Conversation stateFlexible schedule | Fully remote | Part time workload 10 to 20 hours per week | Performance-based bonusesMid-level FreelanceIndia - Remote R4d ago
-
Machine Learning Analyst - HIH - Evernorth INR 1800K-3000KAWS | Agentic AI | Azure | Cloud deployment | CrewAIMid-level Full TimeHIH - Hyderabad, India4d ago
-
AWS | Apache Airflow | Apache Hadoop | Apache Spark | AzureSenior-level Full TimeChennai - Menon Eternity, India4d ago