Senior Developer - Python and Spark
Location(s): Pune, Maharashtra, India
R
INR 3500K-4600K (estimate) Senior-level Full Time
Tasks
- Automate CI/CD pipelines
- Build production data ingestion transformation integration
- Collaborate with engineers and product owners
- Design ETL/ELT pipelines
- Develop production-grade code
- Embed agentic AI workflows
- Establish data quality standards
- Integrate generative AI and machine learning into data workflows
- Perform code reviews
- Perform performance tuning for large volume data
Perks/Benefits
- Continuous technical development opportunities
- Hybrid working model
- Remote work option
- Wellbeing support
- Work-life balance support
Skills/Tech-stack
Agentic AI | Apache Spark | CI/CD | Dataframes | DevOps | ELT | ETL | Generative AI | GitHub | Jupyter Notebook | Linux | Machine Learning | NumPy | Pandas | PySpark | Python | SQL | SciPy | Spark DataFrames | Spark SQL
Education
N/A
Roles
Related jobs
-
MongoDB, Python, MSA/Consultant Specialist INR 1000K-2000KAWS | Aggregation Pipeline | Azure | CI/CD | DockerFlexible working | Inclusive work environment | Professional development opportunitiesSenior-level Full TimeHyderabad, Telangana, India R11h ago
-
AWS S3 | AWS storage | AWS storage services | Active Directory | Ansible100 percent remote work | Flexible time off | Holiday allowance | Medical insurance | Shift allowanceMid-level Full TimeIndia R16h ago
-
Databricks Platform Engineer (AWS) INR 1500K-3500KAWS | AWS Cloud | AWS Cloud Database | Amazon Virtual Private Cloud | Asset bundlesFlexible work arrangement | Hybrid working model | Wellness supportSenior-level Full TimeHyderabad, India R19h ago
-
Databricks Data Engineer - Bengaluru INR 1500K-2600KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Work from anywhereMid-level Full TimeIndia-Bangalore-Office-Kalyani Vista R19h ago
-
Data Engineer, Vice President INR 3000K-4000KAWS | Azure | Cost Optimization | Data Governance | Data ModelingComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeM11 - Commers III, 43, 44 … R19h ago
-
Director, Data Engineering INR 4000K-5000KAPIs | AWS | Agile | Anomaly Detection | AzureComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeHA3-Gurugram - DLF Cyber City, India R19h ago
-
Sr Data Engineer INR 2771K-4064KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexible working hours | Paid parental leave | Remote Working | Training and development programmesSenior-level Full TimeBangalore RMZ-ECO WORLD, India R19h ago
-
Mid-level Full TimeBengaluru East, Karnataka, India R1d ago
-
Databricks Data Engineer (Databricks, PySpark, Cloud, MLOps) | 100% Remote | Contract 12 + Months | AS A INR 1500K-2600KAmazon Web Services | Apache Spark | CI/CD | Cloud platform | DatabricksRemote workSenior-level Full TimeIndia, India R1d ago
-
Data Engineer II INR 1000K-1000KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Amazon Web ServicesEmployee assistance program | Hybrid work environment | Learning stipend | Medical coverage | Role-specific trainingMid-level Full TimeMumbai R1d ago
-
Staff Engineer, Generative AI Engineer INR 2000K-5000KAI Evaluation | AI Governance | AI Security | AWS Bedrock | Argo CDSenior-level Full TimeRemote, India R1d ago
-
API Design | Apache Airflow | Apache Beam | Apache Flink | Async messagingContinuous professional development | Flexible workingMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior Data Engineer INR 3600K-5400KAPI Development | AWS | Apache Airflow | Automation | AzureDiscretionary bonus scheme | Family-friendly leave | Flexible working | Hybrid working | Life assuranceSenior-level Full TimeDelhi R1d ago
-
AI Agent Development Kit | AI Governance | Access Management | Agent Development Kit | Agent FrameworksGlobal collaboration | High-impact projects | Inclusive workplace | Innovation-focused culture | Professional growthSenior-level Full TimeIndia R1d ago
-
Automated testing | Backend APIs | CI/CD | Cloud infrastructure | Cost OptimizationCross-functional collaboration | Foundational ownership | High autonomy | Remote workMid-level Full TimeIndia R1d ago
-
Mid-level Full TimeNoida R1d ago
-
Software Engineer 2 INR 1500K-2500KAPI Design | AWS | Asynchronous Communication | Data Structures | Distributed SystemsMid-level Full TimeHybrid - Bangalore, India R1d ago
-
Senior-level Full TimeBangalore, India R1d ago
-
Senior Data Engineer INR 3000K-4000KAWS | AWS Managed Airflow | Airflow | Apache Spark | AzureMedical insurance | Remote-first workplace | Term Life and Personal Accident | Wellness allowanceSenior-level Full TimeIndia - Bangalore R1d ago
-
Data Engineer Sr. Consultant INR 2800K-4200KData Mapping | Data Reconciliation | Data Transformation | Data Validation | Defect TrackingSenior-level Full TimeChennai, TN, IN R1d ago
-
Mid-level Full TimeBengaluru, KA, IN R1d ago
-
Platform Engineer INR 2500K-5000KAPI Design | Agentic Frameworks | Backend Development | Distributed Systems | Infrastructure as CodeFull autonomy | Remote workSenior-level Full TimeIndia - Remote R1d ago
-
AI Engineer INR 3264K-5876KARM Templates | AWS SNS | AWS SQS | Access Control | Amazon EKSCareer growth | Hybrid work location | Mentorship and coachingSenior-level Full TimeHyderabad (SEZ), India R1d ago
-
AVP, Applied Model Ops Developer (L11) INR 3000K-5000KAWS | Amazon Redshift | Apache Airflow | Apache Spark | AzureFlexible work hours | Regional engagement hubs | Work from homeExecutive-level Full TimeHyderabad IN, India R1d ago
-
Senior Data & AI Engineer INR 2771K-4200KAPI Development | AWS Glue | AWS Lambda | Amazon Athena | Amazon RedshiftSenior-level Full TimeHyderabad, India R1d ago