Hadoop Developer
Tasks
- Automate pipeline orchestration
- Build monitoring, alerting, logging
- Build streaming data pipelines
- Design big data pipelines
- Design data models and storage layouts
- Develop ETL/ELT workflows
- Document data architectures and runbooks
- Evaluate and adopt new big data and cloud technologies
- Implement data governance lineage quality controls
- Integrate datasets for analytics and reporting
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
- Perform architecture reviews and refactoring
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Alerting | Apache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache Spark | CI/CD | Data Governance | Data Lineage | Data Quality | Delta Lake | Distributed Systems | HBase | HDFS | Hadoop | Infrastructure as Code | Kafka | Kafka Connect | Kubernetes | Logging | MapReduce | Monitoring | NoSQL | ORC | Oozie | Parquet | Pig | Python | SQL | Shell | Spark Streaming | Sqoop | “as-code”
Education
Roles
Related jobs
-
Power BI Developer-1 USD 83KData Modeling | Data Warehousing | Power Apps | Power Automate | Power BIMid-level Full TimeRemote Work( USA), United States R23h ago
-
Solutions Engineer(Python/Airflow) USD 107K-200KAWS | Airflow | CI/CD | DBT | EC2Health resources | Remote work | Wellness Fridays | Wellness programsMid-level Full TimeRemote - United States R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Concurrency | FIXCareer growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAuditability | Backtesting | C++ | Concurrency | Data IngestionMid-level Full TimeUnited States - Remote R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Compliance reportingBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveFull-time employment | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Developer USD 100K-150KApache Airflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Hive | Apache Pig | Apache Spark | CI/CDLong-term engagement | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Bash | Coverage.py | Dagger | Docker | GcovFlexible hours | Freelance project-based collaboration | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeNew York, United States - Remote R1d ago
-
Bash | Black box testing | Black-box | Box testing | Coverage.pyFlexible schedule | Freelance participation | Global community | Project-based collaboration | Remote workSenior-level Full TimeTexas, United States - Remote R1d ago
-
Bash | Coverage.py | Dagger | Docker | GcovFlexible work hours | Freelance project-based collaboration | Fully remote | Opportunity to contribute to innovative AI projects | Supportive global communitySenior-level Full TimeFlorida, United States - Remote R1d ago
-
Bash | Black box testing | Black-box | Box testing | Coverage.pyContribute to AI projects | Flexible schedule | Freelance project-based collaboration | Fully remote work | Supportive global communitySenior-level Full TimeUnited States - Remote R1d ago
-
CI/CD | DevOps | Git | Java | JavaScript401k matching | Discounts on fitness clubs | Employee assistance program | Fertility and adoption assistance | Flexible vacation time offMid-level Full TimeUS - Field, United States R1d ago
-
AI Solutions Developer USD 90K-148KAI-powered automation | API Development | Agentic Workflows | C Sharp | CRM IntegrationHybrid work | Remote work optionMid-level Full TimeWarminster, PA R2d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time work | Project-based employmentSenior-level Full TimeNew York, New York, United States … R2d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time hours | Project based workSenior-level Full TimeTexas, United States - Remote R2d ago
-
AWS | Azure | Cloud platform | Dashboard performance | Dashboard performance tuningHybrid schedule | Remote work day | Training for end usersMid-level Full TimeScottsdale, AZ, United States R3d ago
-
Data Modeling | Data Transformation | Data cleaning | Debugging Tools | MS SQLRemote work | Training and mentorshipMid-level ContractLincoln, United States R3d ago
-
Agentic AI Developer USD 63K-105KAPI Integration | Artificial Intelligence | Cloud deployment | Human-in-the-loop | LangchainHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-Remote Work R3d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveCareer growth | Long-term engagement | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Spark | Azure HDInsightCareer growth | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Senior-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | ConcurrencyMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Compliance reportingMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud Native Architecture100 percent remote | Career growth potential | Long term multi year engagementMid-level Full TimeUnited States - Remote R4d ago