Staff Product Support Engineer - Hadoop Operations
Tasks
- Analyze job performance and resource usage
- Assist Hadoop migration and upgrades
- Debug NiFi Impala and Spark workloads
- Design distributed Hadoop applications
- Improve post migration system performance
- Investigate data and performance issues
- Manage NiFi Impala and Spark clusters
- Optimize Hadoop performance
- Support Hadoop YARN Kubernetes and cloud operations
- Support deployments scaling and reliability
- Troubleshoot Hadoop NiFi and Spark jobs
Perks/Benefits
Skills/Tech-stack
Amazon EMR | Apache NiFi | Apache Spark | Apache YARN | Bash | Cloud Dataproc | Cluster management | Data pipeline | Distributed Systems | Google Cloud | Google Cloud Dataproc | Hadoop | Impala | Kubernetes | Linux | MySQL | NFS | Performance Tuning | PostgreSQL | Powershell | Python | Scala | Troubleshooting
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Database Design | ETL | Excel | Pandas | PythonHands-on learning | Mentorship | Real-world datasetsEntry-level InternshipMcLean, VA, US4h ago
-
AI Gateways | AWS CDK | Chunking | Context engineering | Cost Tracking401k match | Counseling membership | Flexible time away | Life insurance | Long-term disabilityMid-level Full Time-REMOTE, USA- R12h ago
-
Robotic Hardware Engineer USD 100K-150KAbstraction layers | ArduPilot | Autopilot firmware | C++ | CANMid-level Full TimeFort Walton Beach, Florida, United States15h ago
-
Senior Software Engineer, Data USD 150K-200KAWS Lambda | AWS Step Functions | Airflow | Amazon Athena | Amazon S3401k | Bagel Thursdays | Flexible PTO | Hybrid work | Medical, dental & vision coverageSenior-level Full TimeCharlotte, NC19h ago
-
Senior-level Full TimeCarlsbad, California, United States; Scottsdale, Arizona, …19h ago
-
Agile | Apache Airflow | Artificial Intelligence | Automated testing | BigQueryCollaborative culture | Flexible working hours | Performance evaluations | Professional development opportunities | Remote workSenior-level Full TimeIdaho R20h ago
-
Agile | Apache Airflow | BigQuery | CI/CD | Cloud StorageCollaborative company culture | Flexible working hours | Professional development opportunities | Remote-first work environmentSenior-level Full TimeMinnesota R20h ago
-
Agile | Airflow | BigQuery | CI/CD | Cloud StorageCollaborative culture | Professional development | Remote-first flexibilitySenior-level Full TimeColorado R20h ago
-
Agile | Airflow | BigQuery | CI/CD | Cloud StorageCollaborative company culture | Flexible working hours | Professional development opportunities | Remote-first environmentSenior-level Full TimeColumbia R20h ago
-
Agile | Airflow | Automated testing | BI tools | BigQueryCollaborative company culture | Professional development | Remote-first flexible hoursSenior-level Full TimeIllinois R20h ago
-
Agile | Airflow | BigQuery | CI/CD | Cloud StorageCollaborative company culture | Professional development opportunities | Remote-first flexible hoursSenior-level Full TimeFlorida R20h ago
-
Agile | Airflow | Automated testing | BI tools | BigQueryCollaborative culture | Flexible working hours | Professional development | Remote-first environmentSenior-level Full TimeCalifornia R20h ago
-
Agile | Apache Airflow | Automated testing | BigQuery | CI/CDCollaborative company culture | Professional development opportunities | Remote-first flexibilitySenior-level Full TimeConnecticut R20h ago
-
Agile | Airflow | BI tools | BigQuery | CI/CDCollaborative & Innovative Culture | Professional development | Remote-first flexible hoursSenior-level Full TimeArizona R20h ago
-
Data Engineer USD 140K-150KAWS | Alerting | Azure | Azure DevOps | CI/CD401k | Dental insurance | Financial planning assistance | Health insurance | Mental health counselingMid-level Full TimeChamblee, GA, United States1d ago
-
Cloud Engineer/Software Developer USD 135K-206KAWS | AWS SageMaker | CI/CD | CloudFormation | CloudWatchCompany-sponsored events | Flexible work environment | Matching 401k | On-call support | Paid life and disabilityMid-level Full TimeSt. Louis, MO1d ago
-
Staff Data Engineer USD 200K-250KAirflow | Anomaly Detection | Automated Monitoring | CI/CD | Change Data CaptureAccess to industry-leading technology | FSA option | Flexible paid time off | Fully covered healthcare | One Medical accessSenior-level Full TimeSan Francisco1d ago
-
Senior/Staff Linux Software Engineer – Robotics Platform USD 185K-225KC++ | Computer Vision | Deep learning | FPGA | Linux401k match | Career development | Equity | Health benefitsSenior-level Full TimeBurlingame, California, United States1d ago
-
AI Deployment Engineer- Startups USD 198K-280KGenerative AI | JavaScript | Language Models | Large Language Models | OpenAI APIHybrid work model | Relocation assistanceMid-level Full TimeNew York City1d ago
-
Robot Manipulation R&D Engineer USD 160K-260K3D Vision | C++ | End Effectors | Force control | Grasp Planning401k | Dental insurance | Flexible vacation policy | Life insurance | Medical insuranceMid-level Full TimeLos Angeles, CA1d ago
-
Ablation Studies | C++ | C++ integration | Data Augmentation | Data PipelinesAgile development environment | Comprehensive benefits | Work-life support programsSenior-level Full TimePalo Alto, CA1d ago
-
Scientific Data Engineer USD 120K-160KData Ingestion | Data Transformation | Data Warehousing | Data cleaning | ETL401k match | Dental insurance | Health insurance | Paid time offMid-level Full TimeSan Francisco, New York1d ago
-
Platform Engineer - Generative AI USD 120K-160KAPI Design | Caching | Continuous Deployment | Fine Tuning | Flask401k | Dental insurance | Health insuranceMid-level Full TimeNew York, San Francisco, Munich or …1d ago
-
Sr. Back-End Software Engineer - Machine Learning USD 150K-250KC++ | Computer Vision | Distributed Systems | Language Processing | Linux401k matching | Commuter benefits | Dependent Family Medical Premium Coverage | Employee referral program | Flexible spending accountsSenior-level Full TimeSanta Clara, CA1d ago
-
Staff AI engineer USD 125K-170KAI Evaluation | AWS | Agent Orchestration | Caching | Data PipelinesFlexible working hours | Hybrid work culture | Unlimited time offSenior-level Full TimeSan Francisco1d ago