Hadoop Big Data Developer
Tasks
- Automate pipeline orchestration
- Build ETL/ELT workflows
- Deliver curated datasets to analysts and data scientists
- Design data models and storage layouts
- Design end to end big data pipelines on Hadoop
- Develop streaming data pipelines
- Document data architectures and runbooks
- Implement data governance, lineage, and quality controls
- Mentor junior engineers and improve engineering standards
- Optimize Spark and MapReduce jobs
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Flink | Apache Hive | Apache Hudi | Apache Pig | Apache Spark | Apache Sqoop | CI/CD | Data Governance | Data Lineage | Delta Lake | Error Handling | Fault Tolerance | HBase | HDFS | Hadoop | Iceberg | Infrastructure as Code | Java | Kafka | Kubernetes | Logging | MapReduce | Monitoring | NoSQL | ORC | Oozie | Parquet | Python | SQL | Scala | Spark Streaming | “as-code”
Education
N/A
Roles
Big Data Developer | Data Developer | Developer | Hadoop Developer
Related jobs
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseBenefits | Full-time W2 employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Entry-level Full TimeRemote, United States R1d ago
-
AI Solutions Developer USD 70K-80KAPI Integration | Agentforce | Apps Script | Data Analysis | Data Visualization401k company match | Employee stock purchase plan | Medical, dental, vision benefits | Paid Holidays | Paid parental leaveEntry-level Full TimeIllinois, US Offsite, United States R2d ago
-
Tableau Advisor USD 90K-120KAlteryx | Calculated Fields | Data Governance | Data Modeling | Data StorytellingCareer development opportunities | Training and mentorshipMid-level Contract Full TimeUnited States - Remote R2d ago
-
AI Platform Developer, Sr. USD 94K-147KAWS | Azure | Azure ML | Cloud Security | Cloud platform401k matching | Charity support | Dental insurance | Global Employee Stock Purchase Plan | Life insuranceSenior-level Full TimeUnited States R2d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseLong-term career growth | Remote workSenior-level Full TimeUnited States - Remote R3d ago
-
Service Delivery Center, AI Developer - Senior USD 65K-152KAI Model Monitoring | AI Search | AI model | AWS Bedrock | Application InsightsFlexible vacation policy | Hybrid work model | Paid time offSenior-level Full TimeTampa, FL, US, 33602 R3d ago
-
AI Solutions Developer USD 103K-170KAPI Development | AWS | Artificial Intelligence | Backend Development | Cloud Computing401k employer match | Hybrid work environment | Medical/Dental/Vision insurance | Paid Holidays | Paid parental leaveEntry-level Full TimeCHICAGO, United States R3d ago
-
AI Solutions Developer USD 103K-170KAPI Development | Amazon Web Services | Artificial Intelligence | Backend Development | Cloud Computing401k match | FSA and HSA | Hybrid work | Medical/Dental/Vision insurance | Paid HolidaysEntry-level Full TimeCHICAGO, United States R3d ago
-
AI Developer (Web Design & User Experience Support) USD 145K-190KAmazon Web Services | Angular | Azure | CI/CD | CSSSenior-level Full TimeEl Segundo, California, United States - … R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud-native ArchitecturesBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R4d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R4d ago
-
GenAI Developer USD 96K-115KAPI Development | AWS | Angular | Authentication | Big DataCareer growth opportunities | Flexible work hours | Hybrid schedule | Paid training and advancement | Remote workMid-level Full TimeAshburn, Virginia, United States (Hybrid) R4d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiCareer growth | Full-time employment | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Data Visualization Architect USD 123K-184KDAX | Dashboard Development | Data Governance | Data Modeling | Microsoft Fabric401k plan | Accident insurance | Dental insurance | Disability insurance | Life insuranceSenior-level Full TimeRemote, United States R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud-native ArchitecturesCareer growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud Native ArchitectureCareer growth | Health benefits | Paid time off | Remote workMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KBacktesting | C++ | Cloud Computing | Concurrency | FIXBenefits package | Career growth | Mentorship | Remote work | Technical documentation and runbooksMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KBacktesting | C++ | Cloud Computing | Concurrency | Derivatives pricingCareer growth | H1B transfer support | Remote workMid-level Full TimeUnited States - Remote R4d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Spark | CI/CD | Delta Lake | FlinkCareer growth potential | Equal opportunity employer | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseCareer growth | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
API Development | Agile | Azure SQL | Execution systems | IIoT401k match | Dental insurance | Disability insurance | Employee assistance program | Health insuranceSenior-level Full TimeUS-IA-REMOTE, United States R4d ago
-
MATLAB | NumPy | Pandas | Python | RFlexible scheduling | Part-time project-based workSenior-level FreelanceFlorida, United States - Remote R7d ago
-
Power BI / Power Platform Developer USD 80K-156KAPIs | DAX | Data Modeling | Data Performance Optimization | Data TransformationMid-level Full TimeRemote, United States R7d ago