Software development Engineer - Java | Hadoop | Apache Spark | AWS | 3y to 5y
Tasks
- Build batch and streaming data pipelines
- Collaborate with product analytics and platform teams to deliver data solutions
- Create technical documentation and architecture reviews
- Design scalable data processing applications
- Develop Java and Scala data processing solutions
- Ensure reliability scalability security and maintainability
- Implement test-driven development and code reviews
- Optimize data pipeline performance
- Participate in system design and HLD LLD
- Process transform and analyze large datasets
- Set up CI/CD and automated testing
- Troubleshoot production issues
Perks/Benefits
- Flexible work hours
- Medical, dental & vision coverage
- Paid parental leave
- Paid time off
- Retirement plans
- Support for community involvement
Skills/Tech-stack
AWS | Agile | Amazon EKS | Amazon EMR | Apache HBase | Apache Hadoop | Apache Kafka | Apache Oozie | Apache Spark | CI/CD | Distributed Systems | GitHub | Hue | Java | Kubernetes | MapReduce | Microservices | SVN | Scala | Test-Driven | Test-Driven Development
Education
Related jobs
-
Applied AI Engineer II INR 1500K-3000KAWS | Azure | CI/CD | Docker | GCPEmployee referral program | Hybrid and remote working | Life and accidental insurance | Maternity and parental leave | Medical coverageMid-level Full TimeIndia - Remote R10h ago
-
Forward Deployed Engineer INR 2040K-2800KAPI Integration | AWS | Apache Spark | Application development | AzureCustomer-facing role | Travel 20 percentSenior-level Full TimeRemote - India R13h ago
-
Machine Learning Engineer - IV (Fraud) INR 3000K-5000KAWS SageMaker | Agile | Computer Vision | Deep learning | Image dataSenior-level Full TimeBangalore15h ago
-
Database Engineer INR 500K-1500KCI/CD | DB2 | Data Warehousing | Database performance | Database performance tuningMid-level Full TimePune, MH, India18h ago
-
Senior AI Engineer I INR 3264K-5876KArtificial Intelligence | BigQuery | Cloud Composer | Cloud platform | Data ProcessingSenior-level Full TimeBengaluru, KA, India18h ago
-
Principal Engineer, Data Analytics Engineering [ 8+ years ] INR 2500K-3584KAWS | Algorithms | Azure | Big Data | CI/CDSenior-level Full TimeBengaluru, KA, India19h ago
-
Senior-level Full TimeIndia - Hyderabad19h ago
-
Staff AI/ML Engineer, YouTube Create INR 2500K-5000KAgentic framework | Algorithms | Artificial Intelligence | Audio Processing | Computer VisionSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Agent Development | Agent Development Kit | Angular | Backend Development | C++Mid-level Full TimeBengaluru, Karnataka, India20h ago
-
Senior Engineer - Data Analyst INR 3000K-5012KAPI | Automation | Big Data | Big data analytics | CI/CDSenior-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101320h ago
-
AWS | Advanced Excel | Agile Development | Apache Spark | AzureExecutive-level Full TimeKolkata, West Bengal, India R21h ago
-
Lead Software Engineer - Java and AI/ML INR 3500K-5000KAI Agents | Agile | Automated testing | CI/CD | Code modernizationSenior-level Full TimeMumbai, Maharashtra, India21h ago
-
AI Engineer I INR 2500K-5000KAWS | Azure | Azure OpenAI | Docker | FastAPIWork from office 5 days per weekSenior-level Full TimeMumbai, India22h ago
-
Mid-level Full TimePune, Maharashtra, India22h ago
-
Databricks Developer INR 1500K-2400KACID | Batch Processing | CI/CD | Cluster management | Data IngestionWork from office 5 days per weekMid-level Full TimeGurugram, Haryana, India22h ago
-
AWS | Amplitude | Apache Airflow | BigQuery | CCPAFlexible time off | Learning reimbursement | Life insurance | Long-term disability | Medical/Dental/Vision insuranceMid-level Full TimeIndia23h ago
-
Principal Data Scientist INR 3000K-4000KContainers | Continuous integration | Decoder Architecture | Deep learning | Design PatternsCar lease | Certification programs | Continuous learning programs | Corporate pension plan | Dental coverageSenior-level Full TimeBangalore, Karnataka, India23h ago
-
AWS | AWS SageMaker | CI/CD | CloudWatch | Credit RiskCareer growth opportunities | Collaborative engineering culture | Continuous learning culture | Fully remote | High-impact projectsSenior-level Full TimeIndia R23h ago
-
Lead Assistant Manager - Azure Data Engineer INR 1500K-2500KAgile | Amazon Redshift | Apache Airflow | Apache Hadoop | Apache HiveSenior-level Full TimeNoida, Uttar Pradesh, India23h ago
-
Executive - Data Governance INR 600K-840KCI/CD | Data Cleansing | Data Denormalization | Data Modeling | Data NormalizationExecutive-level Full TimeBangalore, Karnataka, India1d ago
-
Sr Data Engineer, Python + Spark (Data Federation skillset - Data Lakehouse - Eg: Starburst) - Chennai INR 1500K-2500KAWS EMR | AWS Glue | AWS S3 | Apache Hudi | Apache Iceberg401k retirement plan | Dental insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeIndia1d ago
-
Apache Kafka | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksCareer growth | Flexible engagement options | Inclusive work environment | Learning opportunities | Remote-friendly work environmentMid-level Full TimeIndia1d ago
-
Lead Software Engineer - Machine Learning INR 3000K-5000KAPI Microservices | Agent systems | Artificial Intelligence | Asynchronous Workflows | Distributed SystemsSenior-level Full TimeBengaluru, India1d ago
-
Data Science - Associate Director INR 1500K-2700KCI/CD | Caching | Cloud Run | Cloud SQL | Cloud StorageMid-level Full TimeHyderabad, Telangana, India1d ago
-
Assistant Manager- Python Gen AI Engineer INR 1200K-2500KAI Agents | API Development | Agile | Containerization | Data PipelinesWork from client office 5 days per weekMid-level Full TimeBangalore, Karnataka, India1d ago