PySpark Big Data Developer
TOWER B, EON FREE ZONE II, India
INR 1200K-1500K (estimate) Mid-level Full Time
Tasks
- Collaborate with cross-functional teams on quality assurance
- Deploy and maintain production features
- Develop and execute application features end to end
- Develop and maintain big data pipelines
- Integrate data from multiple sources
- Learn and apply new technologies
- Manage CI/CD workflows
- Monitor and improve production stability
- Troubleshoot production system issues
- Understand requirements and perform impact analysis
Perks/Benefits
- External trainings
- Flexible working hours
- Internal trainings
- Life insurance
- Medical care
- Pension scheme
Skills/Tech-stack
API Development | Apache Spark | Bitbucket | CI/CD | FastAPI | Flask | Git | GitHub | HDFS | Hadoop | Hive | Linux | OpenShift | PySpark | Python | SQL | TeamCity | Unix | YARN
Education
Related jobs
-
Sr. DevOps Engineer INR 2500K-3500KAIOps | AKS | ARM | Azure Container | Azure Container RegistryRotational on-call supportSenior-level Full TimeHyderabad, India3h ago
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai4h ago
-
Database Engineer INR 1500K-2500KAWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud DatabasesSenior-level Full TimeIN-TN-Chennai4h ago
-
Gen AI Developer INR 2000K-3000KAPI Integration | Claude API | Context Management | CrewAI | FastAPIMid-level Full TimeIN-MH-Pune4h ago
-
Senior-level Full TimeIN-TN-Chennai4h ago
-
Informatica Powercenter Developer INR 1200K-2200KAWS | Advanced Mapping | Batch scheduling | DB2 | Data ReconciliationMigration and modernization experience | Production support experienceSenior-level Full TimeIN-TN-Chennai4h ago
-
Senior-level Full TimeIN-TN-Chennai4h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad4h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad4h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad4h ago
-
Senior-level Full TimeIndia5h ago
-
Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure MLSenior-level Full Timebengaluru, India6h ago
-
Staff Software Engineer, Android Embedded Software INR 2000K-3200KAndroid | C++ | Distributed Systems | Java | Performance optimizationSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000KAmazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMakerSenior-level Full TimePune, Maharashtra, India6h ago
-
Mid-level Full TimeMumbai, Maharashtra, India7h ago
-
Manager - Python with Gen AI INR 1800K-3000KAutogen | Claude | CrewAI | Data Pipelines | Event DrivenMid-level Full TimeBangalore, Karnataka, India10h ago
-
Lead Software Engineer - Big Data INR 2040K-3380KAmazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache ParquetSenior-level Full TimeMumbai, Maharashtra, India10h ago
-
Mid-level Full TimeBangalore, Karnataka, India10h ago
-
Senior-level Full TimeBangalore, Karnataka, India10h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAgent-based | Agent-based frameworks | Autogen | Claude | Cloud ComputingMid-level Full TimeBangalore, Karnataka, India10h ago
-
Senior-level Full TimeHyderabad, India11h ago
-
Sr. Data Engineer INR 2800K-4000KCloud warehousing | DAX | Dashboard Design | Data Quality | Data StorytellingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 56003711h ago
-
Lead Software Engineer - Java, AWS, GraphSQL, Data science INR 2500K-4500KAWS | Amazon ECS | Amazon EKS | Application Resiliency | CI/CDSenior-level Full TimeHyderabad, Telangana, India11h ago
-
Senior-level Full TimeGurgaon, Haryana, India11h ago
-
Software Engineer INR 1000K-1496KBitbucket | Data Architecture | Data Modeling | Data Pipelines | LinuxEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India11h ago