Hadoop Developer
Tasks
- Automate pipeline orchestration
- Build ETL/ELT workflows
- Collaborate on curated datasets
- Continuously improve platform performance and cost
- Design big data pipelines on Hadoop
- Design data models and storage layouts
- Develop streaming data pipelines
- Document architectures and runbooks
- Implement data governance and lineage
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Atlas | Apache Flink | Apache HBase | Apache Hive | Apache Pig | Apache Spark | CI/CD | Collibra | Delta Lake | HDFS | Hadoop | Hudi | Iceberg | Infrastructure as Code | Java | Kafka | Kubernetes | NoSQL | ORC | Oozie | Parquet | Python | SQL | Scala | Shell | Spark Streaming | Sqoop | Trino | “as-code”
Education
Roles
Related jobs
-
Senior Developer Advocate - Modern App Development USD 194K-237KAPI Integrations | AWS | Cloud platform | Code Quality | Google CloudCommunity groups | Employee stock purchase plan | Inclusion talks | Mental health benefits | Mentor/Buddy programSenior-level Full TimeCalifornia, USA, Remote; Nevada, USA, Remote; … R19h ago
-
Senior Data Visualization Developer USD 102K-149KAWS | Agile | D3.js | Data Warehousing | Google CloudCare Com Membership | Discounted pet insurance | Headspace membership | Health savings account | Medical, dental, and vision benefitsSenior-level Full TimeArlington, Virginia, United States, Remote R23h ago
-
.NET | AWS | Angular | Asynchronous services | AzureContract role | Remote workSenior-level Contract Full TimeUnited States - Remote R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit Logging | Backtesting | C++ | Cloud Computing | ConcurrencyMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Power BI Developer – Financial Analytics USD 104K-136KAzure | Azure Data | Azure Data Factory | DAX | Data Factory401k matching | Dental insurance | Disability insurance | Educational reimbursement | Employee stock purchase planMid-level Full TimeUS-VA-Richmond, United States R1d ago
-
LLM | Langchain | MLOps | NumPy | PandasPart-time work | Project-based engagementMid-level FreelanceNew York, United States - Remote R1d ago
-
Mid-level FreelanceUnited States - Remote R1d ago
-
LLM | Langchain | MLOps | NumPy | PandasEnglish application requirement | Freelance opportunities | Part-time project workMid-level FreelanceTexas, United States - Remote R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud Native ArchitectureMid-level Full TimeUnited States - Remote R1d ago
-
Quantitative Trader USD 125K-250KAuto-correlation | Auto-regression | Backtesting | C++ | Component analysisContinuous learning opportunities | Free meals | Hybrid work | Paid time off | Sports teams and fitness eventsEntry-level Full TimeNew York R1d ago
-
.NET | ASP.Net Core | App Service | Azure App | Azure App ServiceRemote workSenior-level Contract Full TimeMt. Juliet, TN, United States R1d ago
-
Senior Software and Data Engineer USD 110KAPI Testing | AWS | CI/CD | Databricks | Docker401k match | Employee stock program | Financial support | Foundation donation matching | Health, dental, vision benefitsSenior-level Full TimeUS-United States-Virtual, United States R2d ago
-
Quantitative Developer (Fintech) USD 100K-150KBacktesting | C++ | Concurrency | Derivatives pricing | FIXMid-level Full TimeUnited States - Remote R2d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | ConcurrencyCareer growth potential | Employee mentoring | Health benefits | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud Native ArchitectureMid-level Full TimeUnited States - Remote R2d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud-native ArchitecturesRemote workMid-level Full TimeUnited States - Remote R2d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | ConcurrencyMid-level Full TimeUnited States - Remote R2d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache Iceberg100 percent remote | Benefits | Career growthSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveCareer growth | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache KafkaBenefits | Long-term project | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Senior ETL Developer (Azure & MDM/Reltio Focus) USD 125K-156KARM | Agile | Apache Spark | Azure Data | Azure Data Factory401k company match | Career advancement | Dental insurance | Flexible time off | Life insuranceSenior-level Full TimeDuncan, South Carolina, United States R2d ago
-
Principal Analytics Consultant - Work From Home USD 102K-184KAlteryx | Dashboard performance | Dashboard performance optimization | Data Aggregation | Data Blending401k savings plan | Annual incentive bonus plan | Disability insurance | Employee assistance program | Healthcare wellness benefitsSenior-level Full TimeNashville Tennessee HQ (500 Great Circle … R3d ago
-
Lead Conversational AI Developer USD 130KAdaptive Dialogs | Azure Bot Framework | Azure Cognitive | Azure Cognitive Language Understanding | Azure CosmosFlexible work remote | Paid Holidays | Paid sick leave | Paid vacationSenior-level Full Time(North America) Remote, United States R3d ago