Hadoop Developer
Tasks
- Automate pipeline orchestration
- Build ETL and ELT workflows
- Design big data pipelines on Hadoop
- Design data models and storage layouts
- Develop streaming data pipelines
- Document data architectures and runbooks
- Implement data governance and quality controls
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Flink | Apache Hive | Apache Hudi | Apache Pig | Apache Spark | Apache Sqoop | Data Governance | Data Lineage | Data Quality | Delta Lake | Distributed Systems | HBase | HDFS | Hadoop | Iceberg | Idempotency | Kafka | Logging | MapReduce | Monitoring | NoSQL | ORC | Oozie | Parquet | Python | SQL | Shell | Spark Streaming | Troubleshooting
Education
Roles
Related jobs
-
Bash | Coverage.py | Dagger | Docker | GcovFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeNew York, United States - Remote R2d ago
-
Bash | C# | C++ | Coverage.py | DaggerFlexible schedule | Fully remote | Project-based collaboration | Supportive communitySenior-level Full TimeTexas, United States - Remote R2d ago
-
Bash | Black box testing | Black-box | Box testing | Coverage.pyFlexible schedule | Freelance project-based collaboration | Fully remote | Supportive global communitySenior-level Full TimeFlorida, United States - Remote R2d ago
-
Bash | Black box testing | Black-box | Box testing | Code CoverageFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeUnited States - Remote R2d ago
-
Mid-level Full TimeUnited States - Remote R2d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Columnar Databases | Compliance reportingCareer growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Computing | ConcurrencyCareer growth | Health benefits | Mentorship | Remote work | Work-life balanceMid-level Full TimeUnited States - Remote R2d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache PigBenefits | Long term multi year engagement | RemoteSenior-level Full TimeUnited States - Remote R2d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
Quantitative Developer (Fintech) USD 100K-150KBacktesting | C++ | Cloud Native | Concurrency | DebuggingCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R3d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R3d ago
-
Quantitative Engineer USD 140K-155KAI Assistant | API Design | AWS | CI/CD | Credit facility401k | Dental insurance | Fitness fund | Health insurance | Learning and development fundSenior-level Full TimeRemote - USA R4d ago
-
Data Analytics Investor Reporting - Associate USD 70K-100KAirbyte | DBT | Data Analysis | Data Modeling | Data ValidationDental insurance | Employer-Matched Retirement Plan | Flexible remote work Friday | Parental leave | Subsidized healthcareMid-level Full TimeSalt Lake City, Utah, United States R4d ago
-
Applied AI Developer (Remote) USD 125K-180KAPI Integration | AWS EC2 | Apache Airflow | CI/CD | Data PipelinesEmployee networks | Paid parental leave | Paid time off | Professional development opportunities | Volunteer opportunitiesSenior-level Full TimeUSA CA Remote, United States R4d ago
-
Cloud Data Specialist - Applications Developer USD 130K-206KAWS | Algorithms | Azure | CI/CD | Data StructuresHybrid work schedule | Inclusive culture | Professional development opportunities | Supportive leadersSenior-level Full TimeLouisville - West Market, United States R4d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time | Project-basedSenior-level Full TimeTexas, United States - Remote R4d ago
-
.NET | AWS | Angular | Asynchronous services | AzureContract role | Remote workSenior-level Contract Full TimeUnited States - Remote R4d ago
-
Senior Software Engineer (Typescript / FrontEnd) - AI/ML USD 141K-232KAPI Design | AWS | Azure | Cloud platform | Google CloudFlexible time off | Flexible work environment | Global gatherings | Healthcare | Home office setupSenior-level Full TimeUnited States (remote) R5d ago
-
C# | MATLAB | NumPy | Pandas | PythonEnglish language support | Flexible schedule | Part-time project-based workSenior-level FreelanceUnited States - Remote R5d ago
-
APIs | Agent architecture | Embeddings | Inference Serving | LLMDirect technical influence | Early stage equity upside | Fast Moving Engineering Culture | High technical autonomy | Remote workMid-level Full TimeSan Francisco, CA; Onsite R5d ago
-
Analytics Cloud | Attribution Modeling | Dashboard Wireframing | Data Modeling | Data SecurityContract to 2026 | Flexible hybrid schedule | Potential extension | Remote workSenior-level Contract Full TimeBellevue, Washington, United States - Remote R5d ago
-
NumPy | Pandas | Python | SciPy | SymPyFreelance project-based work | Part-time project workEntry-level FreelanceMichigan, United States - Remote R5d ago
-
AI Developer - Model Creation & Full Stack USD 150K-175KAWS | Angular | Azure | CI/CD | D3.jsRemote work | USPS Public Trust Clearance eligibleMid-level Full TimeWork from home, VA, United States R6d ago
-
Quantitative Developer (Fintech) USD 121K-213KAudit trails | Backtesting | C++ | Cloud Native | Cloud Native ArchitectureMid-level Full TimeUnited States - Remote R6d ago
-
Senior-level Full TimeUnited States - Remote R6d ago