Product Specialist - Hadoop
Tasks
- Collaborate with DevOps for cluster operations
- Design Hadoop-based applications
- Ensure post migration system reliability and performance
- Manage Hadoop YARN and Spark clusters
- Optimize distributed data processing systems
- Support data pipeline migrations
- Troubleshoot Hadoop and Spark jobs
- Tune Impala and Spark performance
Perks/Benefits
Skills/Tech-stack
AWS | Amazon EMR | Apache Hadoop | Apache Spark | Cloud Dataproc | DevOps | Distributed Systems | GCP | Google Cloud | Google Cloud Dataproc | Impala | Kubernetes | Performance Tuning | YARN
Education
N/A
Related jobs
-
Access Control | Apache Spark | CI/CD | DBT | Data GovernanceEmployee assistance programs | Health & wellness programs | Inclusive collaborative culture | Learning and development support | Remote-first work environmentSenior-level Full TimeIndia5h ago
-
AWS Principal AI Specialist – GSI & ITES - India & SAARC Region INR 2000K-4000KAWS | Agentic AI | Amazon Bedrock | Amazon Q | Amazon SageMakerSenior-level Full TimeBengaluru, Karnataka, IND18h ago
-
Entry-level Full Time InternshipChennai NSM Block 7, India18h ago
-
Amazon Web Services | Azure Data | Azure Data Engineering | BigQuery | Cloud ComputingFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India18h ago
-
IN_Manager_Datawarehouse Expert with Project Management_Data and Analytics_Advisory_Gurgaon INR 1500K-2400KAPI | AWS | Agile | Amazon Web Services | AzureFlexible work arrangements | Inclusive benefits | Mentorship | Travel Not Required | Wellbeing supportSenior-level Full TimeGurugram 8 B, India18h ago
-
Lead Quantitative Analytics Specialist (GenAI) INR 2000K-2250KApache Kafka | Apache Spark | Credit Risk | Elasticsearch | FaissSenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India18h ago
-
Mid-level Full TimeIND - Mumbai, India18h ago
-
Amazon Redshift | Apache Airflow | Apache Kafka | Apache Spark | Application ModernizationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India18h ago
-
Associate Manager - Data Engineering INR 885K-1250KApache Kafka | Apache Spark | Cloud Computing | Data Modeling | Data WarehousingMid-level Full TimeBangalore, Karnataka, India1d ago
-
Data Engineering Manager INR 700K-1000KAnomaly Detection | Apache Airflow | Apache Flink | Apache Hadoop | Apache HiveMid-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Software Engineering Senior Manager- Data Engineering and GenAI INR 1500K-2755KAgentic AI | Airflow | Alation | Apache Beam | Apache SparkSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
AWS EMR | AWS Glue | AWS Lambda | Amazon S3 | Amazon Web ServicesFlexible working arrangements | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
Solutions Engineer - Data Engineering USD 70K-70KAWS | Apache Airflow | Azure | CI/CD | ClouderaHybrid work modelMid-level Full TimeHyderabad3d ago
-
Engineering Manager, Data Platform INR 1500K-2100KApache Airflow | Apache Spark | CI/CD | Call Management | Code QualityMid-level Full TimeIndia Remote R3d ago
-
Principal Data Engineer INR 2475K-3380KAI Pipelines | AWS | Amazon Kinesis | Anomaly Detection | Apache AirflowSenior-level Full TimeAPAC - India - Bengaluru - …3d ago
-
Director, Data Pipeline Engineering INR 3000K-6000KAWS | Agile | Airflow | Azure | CI/CDComprehensive healthcare | Flexible time off | Hybrid work | Retirement plan | Tuition reimbursementExecutive-level Full TimeM11 - Commers III, 43, 44 … R3d ago
-
Director-Enterprise Data Platform INR 1800K-6000KAWS | AWS DataZone | AWS Glue | AWS IAM | AWS Lake FormationExecutive-level Full TimeChennai, IND-TN, India4d ago
-
Azure Data | Azure Data Factory | Azure Databricks | Azure Purview | Azure SynapseSenior-level Full TimeBangalore, Karnataka, India4d ago
-
Strategic Analytics - Vice President INR 3300K-4000KAI machine learning | Apache Spark | Data Governance | Data Product Management | Data QualityExecutive-level Full TimeBengaluru, Karnataka, India4d ago
-
Lead Specialist - Data Analytics & Insight INR 3000K-4000KAWS | Azure | Cloud Computing | Data Modeling | Data QualityHybrid work | Inclusive culture | Professional development | Supportive leadershipSenior-level Full TimeMumbai - Hiranandani, India R4d ago
-
IN_Manager_Full Stack Lead_Data and Analytics_Advisory_Bangalore INR 3000K-4000KAPI Integration | AWS | Ant Design | Azure | BootstrapSenior-level Full TimeBengaluru Millenia, India4d ago
-
Data engineering lead INR 3000K-4000KAWS DMS | AWS Lambda | AWS Step Functions | Amazon Aurora | Amazon Aurora RDSSenior-level Full TimeIND - Bengaluru, India4d ago
-
AWS | Amazon Web Services | Apache Spark | Azure | Azure DataFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India4d ago
-
IN_Manager_Data Engineer_D&A_Advisory_Bangalore INR 1500K-2000KAzure | CI/CD | Databricks | Delta Lake | DockerFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India4d ago
-
IN_Manager_Data Engineer_D&A_Advisory_Bangalore INR 1500K-2000KAzure | CI/CD | Databricks | Delta Lake | DockerFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeBengaluru Millenia, India4d ago