Product Specialist - Hadoop
Tasks
- Collaborate with DevOps for cluster operations
- Design Hadoop-based applications
- Ensure post migration system reliability and performance
- Manage Hadoop YARN and Spark clusters
- Optimize distributed data processing systems
- Support data pipeline migrations
- Troubleshoot Hadoop and Spark jobs
- Tune Impala and Spark performance
Perks/Benefits
Skills/Tech-stack
AWS | Amazon EMR | Apache Hadoop | Apache Spark | Cloud Dataproc | DevOps | Distributed Systems | GCP | Google Cloud | Google Cloud Dataproc | Impala | Kubernetes | Performance Tuning | YARN
Education
N/A
Related jobs
-
Engineering Manager - Batch Compute Infrastructure INR 1800K-2525KAWS | AWS Cloud | Amazon S3 | Apache Airflow | Apache KafkaMid-level Full TimeBengaluru9h ago
-
Technical Fulfillment Specilaist INR 1500K-2400KAWS | Atlassian Confluence | Atlassian Jira | Batch Processing | BigQueryGuided career tracks | Healthcare packages | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India14h ago
-
Senior-level Full TimeGurugram, Haryana, India22h ago
-
Data Engineering Manager INR 800K-1000KAWS | Apache Airflow | Apache Spark | Batch Processing | CI/CDHealth benefits | Learning opportunities | Paid time off | Virtual coachingMid-level Full TimeMumbai1d ago
-
Amazon EMR | Amazon Redshift | Amazon S3 | Amazon Web Services | Apache AirflowSenior-level Full TimeMumbai Goregaon, India1d ago
-
Systems Integration Senior Specialist INR 2520K-3880KAPI Key | AWS Glue | Access Control | Apache Kafka | Apache SparkSenior-level Full TimeBangalore, KA, IN1d ago
-
Principal Engineer -Data Engineering INR 2100K-3380KAgentic AI | Airflow | Alation | Apache Beam | Apache SparkSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Senior-level Full TimeBangalore, India1d ago
-
Senior Data Engineer Lead - Assistant Vice President 2 INR 2500K-3380KAWS | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India1d ago
-
Data Engineer, VP INR 2000K-2500KAgile | Apache Airflow | BigQuery | CI/CD | Cloud platformAccident insurance | Best in class leave policy | Certification and education sponsorship | Childcare assistance reimbursement | Comprehensive hospitalization insuranceExecutive-level Full TimePune - Margarpatta, India1d ago
-
Advanced Data Analyst- Configuration Management INR 837K-1250KAmazon Web Services | Apache Spark | Big Data | Cloud services | DashboardsMid-level Full TimeBangalore (Airbus), India1d ago
-
Technical Lead-Data Engg INR 1500K-3000KAPI Development | AWS | Azure | Backend Development | ERP integrationSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …1d ago
-
EY - GDS Consulting - AI and DATA - Data Architect - Manager INR 2520K-3880KAWS | Azure | Azure Cognitive | Azure Cognitive Services | Azure DataCareer development opportunities | Coaching and feedback | Flexible work arrangement | Training and mentorshipSenior-level Full TimeBengaluru, KA, IN, 5600162d ago
-
Data Eng, Mgmt & Governance Sr Analyst INR 2520K-3380KAzure DevOps | Big Data | Cloud Databases | Data Pipelines | Data TransformationSenior-level Full TimeKolkata, KDC1C, India2d ago
-
Data Engineer – Specialist INR 2040K-3100KAWS | Ataccama | Atlan | CI/CD | Cloud platformEmployee assistance programme | Flexible schedules | Health insurance | Holiday purchase scheme | Parental leaveSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …2d ago
-
Senior Data Engineering Lead-Senior Vice President INR 2000K-3500KAWS | Apache Flink | Apache Spark | Cloud platform | Data CatalogSenior-level Full TimePLOT NO-1, S.NO. 77, India2d ago
-
Big Data Spark Developer - Senior Vice President INR 2000K-2800KAPI Development | Agile | Apache Spark | Automated testing | BambooSenior-level Full TimeTOWER B, EON FREE ZONE II, …2d ago
-
Director of Data Engineering INR 1500K-4000KAPIs | Apache Airflow | Apache Kafka | Apache Spark | Artificial IntelligenceFlexi holidays | Hybrid work | Medical insuranceExecutive-level Full TimeBangalore, India Office2d ago
-
EY - GDS Consulting - AI And DATA - Data Engineer- Manager INR 1500K-2500KAWS | AWS CloudFormation | AWS Glue | AWS IAM | AWS LambdaMid-level Full TimeHyderabad, TG, IN, 500081 R2d ago
-
EY - GDS Consulting - AI And DATA - Data Engineer - Manager INR 1500K-3000KAWS | AWS CloudFormation | AWS DynamoDB | AWS ECS | AWS EKSCareer development | Coaching and feedback | Flexible working | Health and well-being support | InsuranceMid-level Full TimeHyderabad, TG, IN, 500081 R2d ago
-
EY - GDS Consulting - AI And DATA - Data Engineer - Manager INR 1500K-2000KAWS CloudTrail | AWS Glue | AWS Lambda | AWS Step Functions | Amazon EMRCareer development opportunities | Coaching and feedback | Flexible work arrangements | Training and skill developmentMid-level Full TimeHyderabad, TG, IN, 5000812d ago
-
Manager, Data Platform INR 1500K-2700KAPI Design | API Gateway | AWS | CI/CD | CloudWatchCareer development | Company incentive programs | ESG initiatives | Flexible vacation | Headspace app accessMid-level Full TimeIndia, Bengaluru, Karnataka R2d ago
-
Associate Manager - Data Engineering-Data Science INR 1340K-1600KAmazon Web Services | Apache Spark | Cloud Computing | Cloud platform | Data PrivacyMid-level Full TimeBangalore, Karnataka, India2d ago
-
Senior Consultant - Data Engineering-Data Engineering INR 2520K-3500KAWS | Access Control | Apache Hadoop | Apache Spark | Cloud ComputingSenior-level Full TimeBangalore, Karnataka, India2d ago
-
Specialist - Data Engineering-Data Engineering INR 2800K-4000KAccess Control | Amazon Redshift | Amazon Web Services | Apache Kafka | Apache SparkSenior-level Full TimeBangalore, Karnataka, India2d ago