Product Specialist - Hadoop
Tasks
- Collaborate with DevOps for cluster operations
- Design Hadoop-based applications
- Ensure post migration system reliability and performance
- Manage Hadoop YARN and Spark clusters
- Optimize distributed data processing systems
- Support data pipeline migrations
- Troubleshoot Hadoop and Spark jobs
- Tune Impala and Spark performance
Perks/Benefits
Skills/Tech-stack
AWS | Amazon EMR | Apache Hadoop | Apache Spark | Cloud Dataproc | DevOps | Distributed Systems | GCP | Google Cloud | Google Cloud Dataproc | Impala | Kubernetes | Performance Tuning | YARN
Education
N/A
Related jobs
-
Techno Functional Data & Analytics Lead INR 1500K-2600KAI | AWS | Business Intelligence | Cloud platform | Customer SegmentationHybrid work model | Open to relocationSenior-level Full TimePerungudi, India6h ago
-
AWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileHybrid work modelSenior-level ContractShaikpet, India7h ago
-
Senior-level Full TimeIND Bengaluru, India20h ago
-
Data Engineering Lead Analyst - HOH - Evernorth INR 1500K-2500KAWS Glue | AWS RDS | Amazon Athena | Amazon Redshift | Amazon S3Remote work flexibilitySenior-level Full TimeHIH - Hyderabad, India R20h ago
-
Data Engineering Analyst - HIH - Evernorth INR 1000K-1500KAWS | Data Governance | Data Lake | Data Modeling | Data QualityFlex schedule N/A | Remote work flexibilityMid-level Full TimeHIH - Hyderabad, India R20h ago
-
Associate Manager Data Engineering INR 1019K-1593KApache NiFi | Data Governance | Data Pipelines | Data Warehousing | Distributed SystemsMid-level Full TimeIN319 - IND Bangalore Electronic City …20h ago
-
Specialist - AI Model Validation & Emerging Technologies INR 1500K-2500KAWS | Advanced Cryptography | Agentic Workflows | Data Science | Generative AIMid-level Full TimeBangalore-Affluence, India20h ago
-
Entry-level Full Time InternshipPune, India20h ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCollaborative work environment | Flexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India20h ago
-
Custom Application Architect INR 3000K-4000KAWS | Amazon Redshift | Amazon S3 | Apache Airflow | Apache SparkSenior-level Full TimeBengaluru, BDC11A, India20h ago
-
Custom Application Architect INR 3000K-4000KAWS | Amazon Redshift | Amazon S3 | Analytics platform | Apache AirflowSenior-level Full TimeBengaluru, BDC11A, India20h ago
-
Custom Application Architect INR 3000K-4000KAWS | Amazon Redshift | Amazon S3 | Apache Airflow | Apache KafkaSenior-level Full TimeBengaluru, BDC11A, India20h ago
-
Custom Application Architect INR 3000K-4000KAmazon Redshift | Amazon S3 | Amazon Web Services | Apache Airflow | Apache KafkaSenior-level Full TimeBengaluru, BDC11A, India20h ago
-
Custom Application Architect INR 3000K-4000KAWS | Amazon Redshift | Amazon S3 | Apache Airflow | Apache KafkaSenior-level Full TimeBengaluru, BDC11A, India20h ago
-
Airbyte | Airflow | BigQuery | Cloud Composer | Cloud StorageContinuous learning culture | Flexible PTO | Health, dental, and vision insurance | Inclusive and transparent work culture | Remote-friendly work environmentSenior-level Full TimeIndia3d ago
-
Data Engineering Lead INR 2000K-4000KAWS | AWS Bedrock | AWS Bedrock model inference | AWS Glue | AWS IAMContinuous learning | Professional growth | Work-life balanceSenior-level Full TimeGurgaon, IN3d ago
-
Director, Data Engineering INR 1500K-6000KARM Templates | AWS | AWS Glue | AWS Lambda | AWS RedshiftExecutive-level Full TimePune, India3d ago
-
Senior-level Full TimeDGS India - Bengaluru - Manyata …3d ago
-
Data / Machine Learning Engineer (India) INR 2500K-4500KAWS | Azure | Code review | GCP | JavaCollaborative culture | Flat organizational hierarchy | Flexible learning and development | Global team collaboration | High visibility leadership accessSenior-level Full TimePune, Maharashtra, India4d ago
-
Big Data Lead INR 1500K-2000KABAC | AWS | Airflow | Amazon Kinesis | AzureCross-team collaboration | MentoringSenior-level Full TimeIndia4d ago
-
Databricks COE Lead INR 2000K-3900KActive Directory | Amazon Web Services | Apache Airflow | Apache Spark | AzureSenior-level Full TimeHyderabad, Telangana, India4d ago
-
Cloud Support Engineer – Backup & Disaster Recovery INR 800K-1000KAccess Management | Amazon Web Services | Backup | Cloud platform | ComputingCareer pathways | Development programs | Product trainingMid-level Full TimeBangalore, India4d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | BI semantic modelsCollaborative cross-functional environment | Employee well-being support | Flexible work arrangements | Healthcare benefits | MentorshipSenior-level Full TimeIndia4d ago
-
IN_Manager_Data Engineer_D&A_Advisory_Nagpur INR 1500K-2000KCI/CD | Data Modeling | Databricks | Delta Lake | DockerFlexibility programmes | Inclusive benefits | Mentorship | Support for wellbeingMid-level Full TimeNagpur, India4d ago
-
IN_Manager_Data Engineer_D&A_Advisory_Nagpur INR 1500K-2000KAzure | CI/CD | Databricks | Delta Lake | DockerMid-level Full TimeNagpur, India4d ago