Hadoop Developer
Tasks
- Automate pipeline orchestration
- Build ETL/ELT workflows
- Design data models and storage layouts
- Design end to end big data pipelines on Hadoop
- Develop streaming data pipelines
- Document data architectures and operational runbooks
- Implement data governance and quality controls
- Integrate and manage data lakehouse formats
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Alerting | Apache Flink | Apache HBase | Apache Hive | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Pig | Apache Spark | Apache Sqoop | Azure HDInsight | BigQuery | CI/CD | Data Governance | Data Lineage | Data Quality | Databricks | Delta Lake | HDFS | Hadoop | Infrastructure as Code | Java | Kafka Streams | Kubernetes | Logging | MapReduce | Monitoring | ORC | Oozie | Parquet | Python | SQL | Scala | Shell | Snowflake | Spark Streaming | “as-code”
Education
Roles
Related jobs
-
Data Modeling | Data Quality | Data Validation | Data Warehousing | Data integrationSenior-level Full TimeGreenville Memorial Hospital, United States R1d ago
-
Senior Power BI Developer USD 72K-156KAI Assisted Development | Azure Synapse | Continuous Improvement | DAX | Data integration401k match | Associate discounts | Dental insurance | Health insurance | Life insuranceSenior-level Full TimeRemote, United States R1d ago
-
Database Developer USD 85K-120KAWS | CloudWatch | DCL | DDL | DML401k matching | Community engagement support | Commuter benefits | Flexible spending account | Flexible work scheduleMid-level Full TimeAshburn, VA (Hybrid) R1d ago
-
Analytics Lead, Full Stack USD 160K-230KCredit Risk | Credit policy | Data Mining | Data Visualization | Economic analysisDental insurance | Employee stock purchase plan | Flexible spending account | Flexible spending wallet | Health care coverageSenior-level Full TimeRemote US R1d ago
-
Mid-level Full TimeUnited States - Remote R2d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
Combinatorics | Computational statistics | Graph theory | NumPy | Number theoryPart-time hours | Project based workSenior-level FreelanceFlorida, United States - Remote R2d ago
-
C# | Combinatorics | Graph theory | MATLAB | NumPyFlexible part-time schedule | Freelance project-based workSenior-level FreelanceMichigan, United States - Remote R2d ago
-
MATLAB | NumPy | Pandas | Python | RPart-time work | Project-based assignmentsSenior-level FreelanceNew York, New York, United States … R2d ago
-
Hadoop Developer USD 100KAirflow | Apache Atlas | Apache Spark | CI/CD | Collibra100 percent remote | Career growth | Long term multi year engagementSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HudiCareer growth potential | Full-time benefits | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseCareer growth | Long term multi year engagement | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Data Analyst / Tableau Developer USD 64K-87KAgile | Data Analysis | Data Governance | Data Modeling | Data Pipelines401k company match | Flexible work arrangements | Health and wellness benefits | Paid Holidays | Paid parental leaveMid-level Full TimeUSA VA Home Office (VAHOME), United … R3d ago
-
Bash | Coverage.py | Dagger | Docker | GcovFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeNew York, United States - Remote R6d ago
-
Bash | C# | C++ | Coverage.py | DaggerFlexible schedule | Fully remote | Project-based collaboration | Supportive communitySenior-level Full TimeTexas, United States - Remote R6d ago
-
Bash | Black box testing | Black-box | Box testing | Coverage.pyFlexible schedule | Freelance project-based collaboration | Fully remote | Supportive global communitySenior-level Full TimeFlorida, United States - Remote R6d ago
-
Bash | Black box testing | Black-box | Box testing | Code CoverageFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeUnited States - Remote R6d ago
-
Mid-level Full TimeUnited States - Remote R6d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Columnar Databases | Compliance reportingCareer growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R6d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Computing | ConcurrencyCareer growth | Health benefits | Mentorship | Remote work | Work-life balanceMid-level Full TimeUnited States - Remote R6d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache PigLong term projects | Remote workSenior-level Full TimeUnited States - Remote R6d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache PigBenefits | Long term multi year engagement | RemoteSenior-level Full TimeUnited States - Remote R6d ago
-
Senior-level Full TimeUnited States - Remote R6d ago
-
Quantitative Developer (Fintech) USD 100K-150KBacktesting | C++ | Cloud Native | Concurrency | DebuggingCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R7d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R7d ago