Hadoop Developer
Tasks
- Build ETL/ELT workflows
- Design big data pipelines on Hadoop
- Design data models and storage layouts
- Develop streaming data pipelines
- Document data architectures and runbooks
- Evaluate and adopt new big data technologies
- Implement data governance, lineage, and quality controls
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
- Orchestrate pipeline workflows
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Atlas | Apache Flink | Apache HBase | Apache Hive | Apache Pig | Apache Spark | Apache Sqoop | CI/CD | Collibra | Delta Lake | Distributed Systems | HDFS | Hadoop | Hadoop Distributed Systems | Hudi | Iceberg | Infrastructure as Code | Java | Kafka | Kubernetes | MapReduce | NoSQL | ORC | Oozie | Parquet | Python | SQL | Scala | Shell Scripting | Spark Streaming | Trino | “as-code”
Education
Roles
Related jobs
-
Quantitative Engineer USD 140K-155KAI Assistant | API Design | AWS | CI/CD | Credit facility401k | Dental insurance | Fitness fund | Health insurance | Learning and development fundSenior-level Full TimeRemote - USA R11h ago
-
Data Analytics Investor Reporting - Associate USD 70K-100KAirbyte | DBT | Data Analysis | Data Modeling | Data ValidationDental insurance | Employer-Matched Retirement Plan | Flexible remote work Friday | Parental leave | Subsidized healthcareMid-level Full TimeSalt Lake City, Utah, United States R12h ago
-
Applied AI Developer (Remote) USD 125K-180KAPI Integration | AWS EC2 | Apache Airflow | CI/CD | Data PipelinesEmployee networks | Paid parental leave | Paid time off | Professional development opportunities | Volunteer opportunitiesSenior-level Full TimeUSA CA Remote, United States R1d ago
-
Cloud Data Specialist - Applications Developer USD 130K-206KAWS | Algorithms | Azure | CI/CD | Data StructuresHybrid work schedule | Inclusive culture | Professional development opportunities | Supportive leadersSenior-level Full TimeLouisville - West Market, United States R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Computing | ConcurrencyCareer growth potential | Full-time employment | H1B transfer support | Mentorship | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Senior Software Engineer (Typescript / FrontEnd) - AI/ML USD 141K-232KAPI Design | AWS | Azure | Cloud platform | Google CloudFlexible time off | Flexible work environment | Global gatherings | Healthcare | Home office setupSenior-level Full TimeUnited States (remote) R1d ago
-
C# | MATLAB | NumPy | Pandas | PythonEnglish language support | Flexible schedule | Part-time project-based workSenior-level FreelanceUnited States - Remote R2d ago
-
APIs | Agent architecture | Embeddings | Inference Serving | LLMDirect technical influence | Early stage equity upside | Fast Moving Engineering Culture | High technical autonomy | Remote workMid-level Full TimeSan Francisco, CA; Onsite R2d ago
-
Analytics Cloud | Attribution Modeling | Dashboard Wireframing | Data Modeling | Data SecurityContract to 2026 | Flexible hybrid schedule | Potential extension | Remote workSenior-level Contract Full TimeBellevue, Washington, United States - Remote R2d ago
-
NumPy | Pandas | Python | SciPy | SymPyFreelance project-based work | Part-time project workEntry-level FreelanceMichigan, United States - Remote R2d ago
-
AI Developer - Model Creation & Full Stack USD 150K-175KAWS | Angular | Azure | CI/CD | D3.jsRemote work | USPS Public Trust Clearance eligibleMid-level Full TimeWork from home, VA, United States R2d ago
-
AI Developer USD 149K-190KChain-of-Thought | Continuous Deployment | Continuous integration | Deep learning | FHIRFlexible work schedule | Remote work opportunitySenior-level Full TimeUnited States R2d ago
-
Quantitative Developer (Fintech) USD 121K-213KAudit trails | Backtesting | C++ | Cloud Native | Cloud Native ArchitectureMid-level Full TimeUnited States - Remote R3d ago
-
Senior-level Full TimeUnited States - Remote R3d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible schedule | Part-time work | Project based workSenior-level FreelanceMichigan, United States - Remote R3d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time project-based workSenior-level FreelanceUnited States - Remote R3d ago
-
Customer Data Engineer (Hybrid - Buffalo, NY) USD 85K-143KAmazon Redshift | Azure Synapse | CTE | Data Modeling | Data QualityHybrid work environmentMid-level Full TimeBuffalo, NY, United States R3d ago
-
Power BI Developer USD 41K-68KDAX | Dashboard Development | Data Analysis | Data Modeling | Data Visualization401k match | Employee discounts | Employee stock purchase program | Health insurance | Paid time offMid-level Full TimeUSA TX - Remote, United States R3d ago
-
Quantitative Developer (Fintech) USD 121K-213KAudit trails | Backtesting | C++ | Cloud Native | Cloud Native ArchitectureCareer growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 125K-200KAudit trails | Backtesting | C++ | Concurrency | Derivatives pricingCareer growth | Full-time W2 employment | Long term projects | Remote workMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 142K-215KAudit trails | Backtesting | C++ | Concurrency | Derivatives pricingMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 125K-213KAudit trails | Backtesting | C++ | Compliance reporting | ConcurrencyCareer growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R4d ago
-
Hadoop Developer USD 125K-146KAWS EMR | Airflow | Apache Atlas | Apache Spark | Azure HDInsightCareer growth | H1B transfer support | Health and benefits | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Senior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Developer USD 130K-188KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseBenefits | Remote workSenior-level Full TimeUnited States - Remote R4d ago