Hadoop Big Data Developer
Tasks
- Automate pipeline orchestration
- Build streaming data pipelines
- Design big data pipelines on Hadoop
- Design data models and storage layouts
- Develop ETL/ELT workflows
- Document data architectures and runbooks
- Evaluate and adopt new big data technologies
- Implement data governance lineage quality controls
- Lead performance reviews and architecture audits
- Mentor engineers and enforce best practices
- Optimize Spark and MapReduce jobs
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Flink | Apache Oozie | Apache Spark | CI/CD | Data Governance | Data Lineage | Data Quality | Delta Lake | Distributed Systems | HBase | HDFS | Hadoop | Hive | Hudi | Iceberg | Infrastructure as Code | Java | Kafka | Logging | MapReduce | Monitoring | NoSQL | ORC | Parquet | Pig | Python | SQL | Scala | Shell | Spark Streaming | Sqoop | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Big Data Developer | Data Developer | Developer | Hadoop Developer
Related jobs
-
Assistant Director, Power BI Enablement Lead USD 100K-152KALM | Analysis Services | Azure | Azure Analysis | Azure Analysis ServicesHybrid work | Inclusive culture | Professional development | Remote workSenior-level Full TimeBoston, Massachusetts, United States R13h ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Flink | Apache Hive | Apache HudiCareer growth | Equal opportunity employer | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KApache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache OozieCareer growth | Full-time employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache PigCareer growth | Full-time W2 employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Solutions Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveSenior-level Full TimeUnited States - Remote R1d ago
-
API Integration | AWS | Accessibility | Azure | D3.jsCollaborative environment | Contract extension | Flexible international environment | Fully remote work | High autonomySenior-level Full TimeCanada R1d ago
-
Agentic AI Engineer (Boston, Hybrid) USD 319K-350KAI orchestration | AWS | Autogen | Azure | CrewAIEquity | Health benefits | Hybrid workMid-level Full TimeBoston R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveCareer growth opportunities | Full-time remote work | H1B transfer support | Long-term engagementSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache Hudi100% remote | H1B transfer support | W2 employmentSenior-level Full TimeUnited States - Remote R2d ago
-
Business Intelligence | Crystal Reports | Curriculum Development | Dashboards | Data AnalysisRemote workEntry-level Full TimeBusiness Office - Benson Tower, United … R2d ago
-
.NET | AWS | Angular | Asynchronous services | AzureRemote workSenior-level Contract Full TimeNew York, New York, United States … R2d ago
-
Data Integration Engineer / ETL Developer USD 87K-178KAWS GovCloud | Bash | Bitbucket | CI/CD | ConfluenceDental insurance | Health insurance | Paid Holidays | Paid life insurance | Paid time offMid-level Full TimeRemote (Dayton, OH) R2d ago
-
BI governance | CI/CD | CTE | Common table expressions | DAXRemote workMid-level ContractRancho Cordova, United States R2d ago
-
Adobe Customer Journey | Adobe Customer Journey Analytics | Adobe Workfront | Adobe Workfront Fusion | Customer Journey401k plan | Flexible vacation policy | Hybrid work model | Medical and dental coverage | Paid time offSenior-level Full TimeNew York, NY, US, 10001-8604 R3d ago
-
BI Developer (Databricks) USD 90K-126KDAX | Data Quality | Data Validation | Databricks | Delta Lake401k retirement account access | Dental insurance | Medical insurance | Paid sick leave | Paid time offEntry-level Full TimePA-CLIENT-STATE, United States R3d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveRemote workMid-level Full TimeUnited States - Remote R3d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergSenior-level Full TimeUnited States - Remote R3d ago
-
Senior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergCareer growth opportunities | Health benefits | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveH1B transfer support | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Solutions Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Kafka | Apache PigSenior-level Full TimeUnited States - Remote R4d ago
-
Agile | BigQuery | C# | Cloud Native | DAX401k matching | Career growth | Dental insurance | Disability insurance | HSASenior-level Full TimeRochester, MN, United States R6d ago
-
Anthropic API | Asynchronous programming | Conversational Design | Database | DockerFlexible schedule | Part-time hours | Performance bonus | Remote workMid-level FreelanceNew York, New York, United States … R7d ago
-
Anthropic API | Asynchronous programming | Docker | NoSQL | Node.jsFlexible schedule | Performance-based bonuses | Remote workMid-level FreelanceTexas, United States - Remote R7d ago