Software development Engineer - Java | Hadoop | Apache Spark | AWS | 3y to 5y
Tasks
- Build batch and streaming data pipelines
- Collaborate with product analytics and platform teams to deliver data solutions
- Create technical documentation and architecture reviews
- Design scalable data processing applications
- Develop Java and Scala data processing solutions
- Ensure reliability scalability security and maintainability
- Implement test-driven development and code reviews
- Optimize data pipeline performance
- Participate in system design and HLD LLD
- Process transform and analyze large datasets
- Set up CI/CD and automated testing
- Troubleshoot production issues
Perks/Benefits
- Flexible work hours
- Medical, dental & vision coverage
- Paid parental leave
- Paid time off
- Retirement plans
- Support for community involvement
Skills/Tech-stack
AWS | Agile | Amazon EKS | Amazon EMR | Apache HBase | Apache Hadoop | Apache Kafka | Apache Oozie | Apache Spark | CI/CD | Distributed Systems | GitHub | Hue | Java | Kubernetes | MapReduce | Microservices | SVN | Scala | Test-Driven | Test-Driven Development
Education
Related jobs
-
Machine Learning Engineer IV INR 4443K-7998KAPIs | Amazon Web Services | Automated testing | Cloud Native | Cloud platformBonuses | Disability insurance | Employee resource groups | Inclusive culture | Life insuranceSenior-level Full TimeRemote, India R7h ago
-
Senior-level Full TimePune City, India11h ago
-
Mid-level Full TimePune, Maharashtra, India11h ago
-
AM - Cloud Data Engineer INR 1500K-2500KAWS N/A | Apache Airflow | Apache Kafka | Apache Spark | Azure DataClient-facing experience | Consulting experience | Growth mindset cultureSenior-level Full TimeBangalore, Karnataka, India11h ago
-
AI Engineer – Reliability & Warranty Analytics INR 1800K-3000KBacktesting | BigQuery | CI/CD | Calibration | Cloud RunMid-level Full TimeChennai, Tamil Nadu, India12h ago
-
Associate III Business Intelligence-SUPPORT SERVICES-Data & Analytics - In House Engineering INR 800K-1800KBig Data | Big data concepts | C++ | Data Visualization | Data conceptsMid-level Full TimeBangalore, Karnataka, India13h ago
-
AI Engineer – Retail/CPG Domain INR 1800K-2500KAWS | Azure | Data Governance | Data Modeling | Data SecurityMid-level Full TimeGurugram, Haryana, India13h ago
-
Consultant - Python Developer with Gen AI and AI Foundry INR 2000K-4000KAWS | Autogen | Azure | Azure OpenAI | Azure OpenAI ServiceSenior-level Full TimeBangalore, Karnataka, India14h ago
-
Associate Principal Engineer (India Office) INR 1500K-2000KADLS | Azure Data | Azure Data Factory | Azure DevOps | CDCMid-level Full TimeBangalore, Karnataka, India15h ago
-
Senior-level Full TimePune, Maharashtra, India15h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India15h ago
-
Applied AI ML Lead INR 2500K-4800KAI Agents | AWS Lambda | AWS S3 | AWS Step Functions | Agentic AISenior-level Full TimeHyderabad, Telangana, India15h ago
-
Software Engineer (Backend Developer) INR 1500K-3500KAWS | Active Directory | Agile | Algorithms | Data StructuresMid-level Full TimeBangalore, India Office (BANGALORE) R15h ago
-
Agentic AI | Agile | DAX | Data Governance | Data ModelingSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Lead Software Engineer - Java/Python, LLM, AWS INR 3000K-5000KA/B | A/B Testing | AWS | Agile | Amazon AuroraSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Platform Engineering Professional - Data Engineer INR 2200K-3500KAWS | Amazon Kinesis | Apache NiFi | Apache Spark | CI/CDMid-level Full TimeBengaluru, IN, 56010316h ago
-
AWS Data Engineer INR 1500K-6000KAWS | Automation | Cloud Architecture | Data Governance | Data IngestionExecutive-level Full TimeHyderabad, Telangana, India16h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India18h ago
-
Consultant - AI Engineer INR 2000K-4500KAutogen | CI/CD | Cloud infrastructure | CrewAI | Data PipelinesSenior-level Full TimeBangalore, Karnataka, India18h ago
-
Generative AI Engineer INR 2000K-4500KAmazon Web Services | Autogen | CI/CD | Cloud platform | CrewAISenior-level Full TimeHyderabad, Telangana, India18h ago
-
SDET- India (Chennai/Bangalore) INR 1500K-2000KAWS S3 | Apache Airflow | Apache Superset | BDD | Big DataMid-level Full TimeIndia19h ago
-
Amazon Web Services | Cloud platform | Data Modeling | Databricks | Distributed SystemsBroadband reimbursement | Continuous learning support | Global enterprise client exposure | Health insurance | Paid certificationsSenior-level Full TimeIndia19h ago
-
Sr SW Engineer, Machine Learning INR 2475K-3380KA/B Testing | Airflow | Amazon EMR | Amazon S3 | Apache KafkaCommuter benefits | Disability insurance | Financial wellness support | Healthcare (Medical Dental Vision) | Hybrid work scheduleSenior-level Full TimeBengaluru, India21h ago
-
Mid-level Full TimeBengaluru, Karnataka, India1d ago
-
EY - GDS Consulting - AIA - Agentic AI Engineer - Manager INR 1850K-3300KAWS | Async | Autogen | Azure | CelonisContinuous learning | Diverse and inclusive culture | Transformative leadershipMid-level Full TimeKolkata, WB, IN, 7000911d ago