Hadoop Big Data Developer
Tasks
- Build ETL/ELT workflows
- Design big data pipelines on Hadoop
- Design data models on HDFS Hive HBase and lakehouse formats
- Develop streaming data pipelines
- Document data architectures and runbooks
- Implement data governance and lineage
- Integrate data platforms with analytics and operational systems
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
- Orchestrate pipelines with workflow engines
- Set up monitoring, alerting, and logging
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache ORC | Apache Parquet | Apache Pig | Apache Spark | Data Governance | Data Lineage | Delta Lake | Distributed Systems | HBase | HDFS | Hadoop | Java | Kafka | Logging | MapReduce | Monitoring | NoSQL | Oozie | Python | SQL | Scala | Shell | Spark Streaming | Sqoop
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Big Data Developer | Data Developer | Developer | Hadoop Developer
Related jobs
-
API Integration | AWS | Accessibility | Azure | D3.jsCollaborative environment | Contract extension | Flexible international environment | Fully remote work | High autonomySenior-level Full TimeCanada R17h ago
-
Agentic AI Engineer (Boston, Hybrid) USD 319K-350KAI orchestration | AWS | Autogen | Azure | CrewAIEquity | Health benefits | Hybrid workMid-level Full TimeBoston R18h ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveCareer growth opportunities | Full-time remote work | H1B transfer support | Long-term engagementSenior-level Full TimeUnited States - Remote R22h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache Hudi100% remote | H1B transfer support | W2 employmentSenior-level Full TimeUnited States - Remote R22h ago
-
Data Integration Engineer / ETL Developer USD 87K-178KAWS GovCloud | Bash | Bitbucket | CI/CD | ConfluenceDental insurance | Health insurance | Paid Holidays | Paid life insurance | Paid time offMid-level Full TimeRemote (Dayton, OH) R1d ago
-
BI governance | CI/CD | CTE | Common table expressions | DAXRemote workMid-level ContractRancho Cordova, United States R1d ago
-
Adobe Customer Journey | Adobe Customer Journey Analytics | Adobe Workfront | Adobe Workfront Fusion | Customer Journey401k plan | Flexible vacation policy | Hybrid work model | Medical and dental coverage | Paid time offSenior-level Full TimeNew York, NY, US, 10001-8604 R1d ago
-
BI Developer (Databricks) USD 90K-126KDAX | Data Quality | Data Validation | Databricks | Delta Lake401k retirement account access | Dental insurance | Medical insurance | Paid sick leave | Paid time offEntry-level Full TimePA-CLIENT-STATE, United States R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveRemote workMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergCareer growth opportunities | Health benefits | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveH1B transfer support | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Solutions Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Kafka | Apache PigSenior-level Full TimeUnited States - Remote R2d ago
-
Agile | BigQuery | C# | Cloud Native | DAX401k matching | Career growth | Dental insurance | Disability insurance | HSASenior-level Full TimeRochester, MN, United States R5d ago
-
Anthropic API | Asynchronous programming | Conversational Design | Database | DockerFlexible schedule | Part-time hours | Performance bonus | Remote workMid-level FreelanceNew York, New York, United States … R5d ago
-
Anthropic API | Asynchronous programming | Docker | NoSQL | Node.jsFlexible schedule | Performance-based bonuses | Remote workMid-level FreelanceTexas, United States - Remote R5d ago
-
Anthropic | Asynchronous programming | Conversation state | Docker | LLM APIsFlexible schedule | Fully remote | Performance-based bonusesMid-level FreelanceSouth Carolina, United States - Remote R5d ago
-
Anthropic API | Async Programming | Databases | Docker | LoggingFlexible schedule | Performance based bonus programs | Remote workMid-level FreelanceUnited States - Remote R5d ago
-
Asynchronous programming | Database | Docker | NoSQL | Node.jsFlexible schedule | Fully remote | Performance bonusMid-level FreelanceMichigan, United States - Remote R5d ago
-
AI Developer USD 150K-220KAWS | Apache Spark | Azure | ChromaDB | DockerAccidental death and dismemberment insurance | Company travel coverage | Dental insurance | Flexible PTO | Health insuranceSenior-level Full TimeMiami Beach, Florida, United States - … R5d ago
-
Software Developer Sr USD 95K-169K.NET | ARM | Apache Spark | Automated testing | Azure401k plan | Charity programs | Dental insurance | Life insurance | Medical insuranceSenior-level Full TimeUnited States R6d ago
-
Software Developer Sr USD 95K-169K.NET | ARM | Apache Spark | Automated testing | Azure401k | Charity support | Dental insurance | Global Employee Stock Purchase Plan | Life insuranceSenior-level Full TimeUnited States R6d ago
-
API Integration | AWS | Azure | CI/CD | Data LakesSenior-level Full TimeTwo Destiny Way, Westlake TX, United … R6d ago
-
AI/ML Platform Software Developer USD 160K-220KAPIs | Agentic AI | Backend Development | Cloud Native | Continuous MonitoringSenior-level Full TimeRemote (United States) R7d ago