Hadoop Developer
Tasks
- Automate pipeline orchestration
- Build ETL/ELT workflows
- Design big data pipelines on Hadoop
- Design data models and storage layouts
- Develop streaming data pipelines
- Document data architectures and runbooks
- Implement data governance and quality controls
- Integrate data lakehouse formats
- Mentor junior engineers
- Optimize Spark and MapReduce performance
- Set up monitoring, alerting, and logging
- Troubleshoot debug and maintain pipelines
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Apache Atlas | Apache Flink | Apache Hudi | Apache Iceberg | Apache Pig | Apache Spark | BigQuery | CI/CD | Collibra | Data Lineage | Databricks | Delta Lake | HBase | HDFS | Hadoop | Hive | Infrastructure as Code | Java | Kafka | Kubernetes | Linux | MapReduce | ORC | Oozie | Parquet | Python | SQL | Scala | Shell | Snowflake | Spark Streaming | Sqoop | Trino | “as-code”
Education
Roles
Related jobs
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache KafkaCareer growth | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R23h ago
-
Hadoop Developer USD 100K-150KAWS | AWS EMR | Airflow | Apache Atlas | Apache SparkBenefits package | Career growth | Long-term project | Remote workSenior-level Full TimeUnited States - Remote R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
Apache Airflow | DBT | Data Modeling | ETL | Embedded Analytics401k matchSenior-level Full TimeOrlando, Florida, United States - Remote R1d ago
-
DBT | Data Modeling | Data Transformation | Embedded Analytics | Liveboards401k matching | Dental insurance | Life insurance | Medical insurance | Short-term Disability InsuranceSenior-level Full TimeOrlando, Florida, United States - Remote R1d ago
-
MATLAB | NumPy | Pandas | Python | RPart-time project workSenior-level FreelanceMichigan, United States - Remote R2d ago
-
C# | Combinatorics | Computational statistics | Graph theory | MATLABFreelance project-based work | Part-time availabilitySenior-level FreelanceTexas, United States - Remote R2d ago
-
C# | MATLAB | NumPy | Pandas | PythonFreelance project-based work | Part-time flexible hoursSenior-level FreelanceFlorida, United States - Remote R2d ago
-
Senior Developer Advocate - Modern App Development USD 194K-237KAPI Integrations | AWS | Cloud platform | Code Quality | Google CloudCommunity groups | Employee stock purchase plan | Inclusion talks | Mental health benefits | Mentor/Buddy programSenior-level Full TimeCalifornia, USA, Remote; Nevada, USA, Remote; … R3d ago
-
Senior Data Visualization Developer USD 102K-149KAWS | Agile | D3.js | Data Warehousing | Google CloudCare Com Membership | Discounted pet insurance | Headspace membership | Health savings account | Medical, dental, and vision benefitsSenior-level Full TimeArlington, Virginia, United States, Remote R3d ago
-
.NET | AWS | Angular | Asynchronous services | AzureContract role | Remote workSenior-level Contract Full TimeUnited States - Remote R3d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit Logging | Backtesting | C++ | Cloud Computing | ConcurrencyMid-level Full TimeUnited States - Remote R3d ago
-
Senior-level Full TimeUnited States - Remote R3d ago
-
Power BI Developer – Financial Analytics USD 104K-136KAzure | Azure Data | Azure Data Factory | DAX | Data Factory401k matching | Dental insurance | Disability insurance | Educational reimbursement | Employee stock purchase planMid-level Full TimeUS-VA-Richmond, United States R3d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache HBase | Apache HiveCareer growth | Remote workSenior-level Full TimeUnited States - Remote R3d ago
-
LLM | Langchain | MLOps | NumPy | PandasPart-time work | Project-based engagementMid-level FreelanceNew York, United States - Remote R3d ago
-
Mid-level FreelanceUnited States - Remote R3d ago
-
LLM | Langchain | MLOps | NumPy | PandasEnglish application requirement | Freelance opportunities | Part-time project workMid-level FreelanceTexas, United States - Remote R3d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud Native ArchitectureMid-level Full TimeUnited States - Remote R3d ago
-
Quantitative Trader USD 125K-250KAuto-correlation | Auto-regression | Backtesting | C++ | Component analysisContinuous learning opportunities | Free meals | Hybrid work | Paid time off | Sports teams and fitness eventsEntry-level Full TimeNew York R4d ago
-
.NET | ASP.Net Core | App Service | Azure App | Azure App ServiceRemote workSenior-level Contract Full TimeMt. Juliet, TN, United States R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KBacktesting | C++ | Concurrency | Derivatives pricing | FIXMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | ConcurrencyCareer growth potential | Employee mentoring | Health benefits | Remote workMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud Native ArchitectureMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud-native ArchitecturesRemote workMid-level Full TimeUnited States - Remote R4d ago