Hadoop Developer
Tasks
- Automate pipeline orchestration with workflow engines
- Build ETL/ELT workflows
- Deliver curated analytics datasets
- Design big data pipelines on Hadoop
- Design data models and storage in HDFS Hive HBase
- Develop streaming data pipelines
- Implement data governance, lineage, and quality controls
- Maintain documentation and runbooks
- Optimize Spark and MapReduce jobs
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
AWS | AWS EMR | Airflow | Apache Atlas | Apache Spark | Azure HDInsight | BigQuery | CI/CD | Collibra | Databricks | Delta Lake | Flink | HBase | HDFS | Hadoop | Hive | Hudi | Iceberg | Infrastructure as Code | Java | Kafka | Kubernetes | ORC | Oozie | Parquet | Pig | Python | SQL | Scala | Shell Scripting | Snowflake | Spark Streaming | Sqoop | Trino | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Big Data Engineer | Data Engineer | Developer | Engineer | Hadoop Developer
Related jobs
-
Senior Systems Engineer, Storage - DGX Cloud USD 208K-414KAlerting | Algorithms | Ansible | Argo CD | CI/CDSenior-level Full TimeUS, CA, Remote, United States R23h ago
-
Azure Data | Azure Data Factory | Azure DevOps | CI/CD | Data Factory401k match | Disability insurance | Education benefit | Employee stock purchase plan | Life insuranceSenior-level Full TimePrudential Tower, 655 Broad Street, Newark, … R23h ago
-
Machine Learning Engineer USD 125K-234KA/B | A/B Testing | Apache Spark | B testing | Causal InferenceMid-level Full TimeSan Jose, United States R23h ago
-
Prompt Engineering Architect USD 100K-150KAgent architecture | Chunking | Embeddings | Evaluation | Fine Tuning100 percent remote | Career growth | MentorshipSenior-level Full TimeUnited States - Remote R23h ago
-
Prompt Engineering Architect USD 100K-150KAgent Frameworks | Agent systems | Chunking | Embeddings | EvaluationSenior-level Full TimeUnited States - Remote R23h ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache KafkaCareer growth | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R23h ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer (Applied AI) USD 100K-150KAccelerators | Computer Vision | Data Quality | Data labeling | Data quality monitoringRemote workMid-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer (Applied AI) USD 100K-150KAccelerator hardware | Computer Vision | Data Quality | Data quality monitoring | Deep learningRemote workMid-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer (Applied AI) USD 100K-150KAccelerator hardware | Computer Vision | Data labeling | Deep learning | Distributed TrainingMid-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer (Applied AI) USD 100K-150KAccelerators | Computer Vision | Data Modeling | Data Quality | Data ValidationCareer growth | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Data Quality | Deep learningMid-level Full TimeUnited States - Remote R23h ago
-
LLM Fine-Tuning Engineer USD 100K-150KAdapter-Tuning | Automated Benchmarks | Data Curation | Direct Preference Optimization | Distributed TrainingMid-level Full TimeUnited States - Remote R23h ago
-
AI Performance Optimization Engineer USD 100K-150KBenchmarking | C++ | Communication Primitives | Continuous batching | Distributed TrainingCareer growth potential | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
AI Performance Optimization Engineer USD 100K-150KBenchmarking | C++ | CUDA | Continuous batching | DebuggingMid-level Full TimeUnited States - Remote R23h ago
-
AI Performance Optimization Engineer USD 100K-150KC++ | CUDA | Continuous batching | Cutlass | Deep learningCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
AI Performance Optimization Engineer USD 100K-150KAttention Mechanisms | Benchmarking | C++ | CUDA | DeepSpeedBenefits | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
AI Performance Optimization Engineer USD 100K-150KC++ | Compiler optimization | Continuous batching | Distributed Training | FSDPMid-level Full TimeUnited States - Remote R23h ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Computer Vision | Concurrent Systems | Control SystemsCareer growth | Long term projects | Mentorship | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C plus plus | Concurrent programming | Control Systems | DebuggingMid-level Full TimeUnited States - Remote R23h ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Computer Vision | Concurrent Systems | Critical softwareMid-level Full TimeUnited States - Remote R23h ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Concurrent Systems | Control Systems | Data PipelinesCareer growth | Mentorship | Remote work | Technical documentation supportMid-level Full TimeUnited States - Remote R23h ago
-
Apache Airflow | DBT | Data Modeling | ETL | Embedded Analytics401k matchSenior-level Full TimeOrlando, Florida, United States - Remote R1d ago
-
DBT | Data Modeling | Data Transformation | Embedded Analytics | Liveboards401k matching | Dental insurance | Life insurance | Medical insurance | Short-term Disability InsuranceSenior-level Full TimeOrlando, Florida, United States - Remote R1d ago