Hadoop Developer
Tasks
- Automate pipeline orchestration
- Build monitoring alerting logging strategies
- Conduct performance reviews architecture audits
- Continuously evaluate adopt new big data technologies
- Deliver curated reliable documented datasets
- Design build operate big data pipelines on Hadoop
- Design data models and storage layouts
- Develop ETL/ELT workflows
- Document data architectures schemas runbooks
- Implement data governance lineage quality controls
- Implement streaming data pipelines
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Atlas | Apache Flink | Apache Hive | Apache Hudi | Apache Pig | Apache Spark | Apache Sqoop | CI/CD | Collibra | Delta Lake | Distributed Systems | HBase | HDFS | Hadoop | Iceberg | Infrastructure as Code | Kafka | Kubernetes | MapReduce | NoSQL | ORC | Oozie | Parquet | Python | SQL | Shell | Spark Streaming | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Quantitative Developer (Fintech) USD 100K-150KBacktesting | C++ | Cloud Native | Concurrency | FIXCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Data Engineer USD 125K-150KApplication Insights | Azure Data | Azure Data Factory | Azure RBAC | Azure Storage401k match | Dental insurance | Employee assistance program | Flexible spending account | Health and wellness benefitsMid-level Full TimeUnited States (Remote), United States R2d ago
-
Quantitative Developer (Fintech) USD 100K-150KBacktesting | C++ | Cloud Computing | Concurrency | Data IngestionRemote workMid-level Full TimeUnited States - Remote R2d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | ConcurrencyCareer growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache HudiCareer growth | H1B transfer support | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Pig | Apache Spark100 percent remote | Benefits | Long term multi year engagementSenior-level Full TimeUnited States - Remote R2d ago
-
Senior Storage System Software Developer USD 175K-267KC# | C++ | Debugging | Distributed Version Control | EBPF401k | Education reimbursement program | Flexible schedule | Hybrid work schedule | On-call rotational scheduleSenior-level Full TimeLivermore, CA, United States R2d ago
-
Analyst II, Full Stack (Credit Analytics) USD 128K-205KCredit Risk | Credit risk modeling | Data Mining | Data Visualization | Machine LearningEmployee stock purchase plan | Flexible spending accounts | Health care coverage | Remote-first work flexibility | Time offMid-level Full TimeRemote US R2d ago
-
AWS | Cloud Data | Cloud Data Integration | Cloud platform | Data ArchitectureLong-term contract | Remote workSenior-level Contract Full TimeBoston, MA, United States R2d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit Reporting | Audit trails | Backtesting | C++ | Cloud ArchitectureCareer growth | Remote workMid-level Full TimeUnited States - Remote R3d ago
-
Quantitative Developer (Fintech) USD 100K-150KAuditing | Backtesting | C++ | Concurrency | Data NormalizationMid-level Full TimeUnited States - Remote R3d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Atlas | Apache Spark | CI/CD | CollibraCareer growth potential | Long term projects | Remote workSenior-level Full TimeUnited States - Remote R3d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergCareer growth potential | Direct W2 employment | Long term multi year engagement | Remote workSenior-level Full TimeUnited States - Remote R3d ago
-
FSO LABS - AI Developer - Senior - Bay Area USD 102K-213KAPI | Angular | Artificial Intelligence | Azure | C SharpFlexible vacation policy | Hybrid work | Paid Holidays | Paid time offSenior-level Full TimeSan Jose, CA, US, 95110 R3d ago
-
API Integration | Agile | Angular | Artificial Intelligence | Azure Functions401k plan | Dental coverage | Hybrid work | Medical coverage | Paid time offSenior-level Full TimeSan Jose, CA, US, 95110 R3d ago
-
Senior Storage System Software Developer USD 175K-267KC# | C++ | Distributed Version Control | EBPF | GDB401k | Education reimbursement | Flexible schedules | Hybrid schedule | Relocation assistanceSenior-level Full TimeLivermore, CA, United States R3d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache KafkaCareer growth | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R5d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R5d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Spark | CI/CD | Data Governance | Data LineageBenefits package | Remote workSenior-level Full TimeUnited States - Remote R5d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Computing | Compliance reportingCareer growth | Remote workMid-level Full TimeUnited States - Remote R5d ago
-
Quantitative Developer (Fintech) USD 100K-150KBacktesting | C++ | Cloud | Compliance reporting | ConcurrencyCareer growth | Health benefits | Remote work | Technical mentorshipMid-level Full TimeUnited States - Remote R5d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Concurrency | Data SystemsMid-level Full TimeUnited States - Remote R5d ago
-
Apache Airflow | DBT | Data Modeling | ETL | Embedded Analytics401k matchSenior-level Full TimeOrlando, Florida, United States - Remote R5d ago
-
DBT | Data Modeling | Data Transformation | Embedded Analytics | Liveboards401k matching | Dental insurance | Life insurance | Medical insurance | Short-term Disability InsuranceSenior-level Full TimeOrlando, Florida, United States - Remote R5d ago