Hadoop Developer
Tasks
- Automate pipeline orchestration
- Build streaming data pipelines
- Design data models and storage layouts
- Design end to end big data pipelines on Hadoop
- Develop ETL/ELT workflows
- Document data architectures and runbooks
- Implement data governance, lineage, and quality controls
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Flink | Apache Hive | Apache Hudi | Apache Pig | Apache Spark | Apache Sqoop | CI/CD | Data Governance | Data Lineage | Data Quality | Delta Lake | Distributed Systems | HBase | HDFS | Hadoop | Iceberg | Infrastructure as Code | Java | Kafka | Kubernetes | Logging | MapReduce | Monitoring | NoSQL | ORC | Oozie | Parquet | Python | SQL | Scala | Shell | Spark Streaming | Trino | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Analytics Developer USD 61K-108KAWS | Agile methodology | Amazon Web Services | DAX | Data Modeling401k employer match | Dental insurance | Disability insurance | Flexible time off | Health insuranceEntry-level Full TimeChicago, IL, United States R1d ago
-
Automatic Clustering | CI/CD | DBT | Data Modeling | Data WarehousingHybrid work schedule | Onsite 3 days per weekSenior-level ContractTrenton, NJ R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KBacktesting | C++ | Cloud Native | Concurrency | DebuggingCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud Native ArchitectureMid-level Full TimeUnited States - Remote R1d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Quantitative Engineer USD 140K-155KAI Assistant | API Design | AWS | CI/CD | Credit facility401k | Dental insurance | Fitness fund | Health insurance | Learning and development fundSenior-level Full TimeRemote - USA R1d ago
-
Data Analytics Investor Reporting - Associate USD 70K-100KAirbyte | DBT | Data Analysis | Data Modeling | Data ValidationDental insurance | Employer-Matched Retirement Plan | Flexible remote work Friday | Parental leave | Subsidized healthcareMid-level Full TimeSalt Lake City, Utah, United States R1d ago
-
Applied AI Developer (Remote) USD 125K-180KAPI Integration | AWS EC2 | Apache Airflow | CI/CD | Data PipelinesEmployee networks | Paid parental leave | Paid time off | Professional development opportunities | Volunteer opportunitiesSenior-level Full TimeUSA CA Remote, United States R2d ago
-
Cloud Data Specialist - Applications Developer USD 130K-206KAWS | Algorithms | Azure | CI/CD | Data StructuresHybrid work schedule | Inclusive culture | Professional development opportunities | Supportive leadersSenior-level Full TimeLouisville - West Market, United States R2d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Computing | ConcurrencyCareer growth potential | Full-time employment | H1B transfer support | Mentorship | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache HBase | Apache Hive100 percent remote work | Career growth potential | Full-time W2 employment | Long-term engagementSenior-level Full TimeUnited States - Remote R2d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time | Project-basedSenior-level Full TimeTexas, United States - Remote R2d ago
-
.NET | AWS | Angular | Asynchronous services | AzureContract role | Remote workSenior-level Contract Full TimeUnited States - Remote R2d ago
-
Senior Software Engineer (Typescript / FrontEnd) - AI/ML USD 141K-232KAPI Design | AWS | Azure | Cloud platform | Google CloudFlexible time off | Flexible work environment | Global gatherings | Healthcare | Home office setupSenior-level Full TimeUnited States (remote) R3d ago
-
C# | MATLAB | NumPy | Pandas | PythonEnglish language support | Flexible schedule | Part-time project-based workSenior-level FreelanceUnited States - Remote R3d ago
-
APIs | Agent architecture | Embeddings | Inference Serving | LLMDirect technical influence | Early stage equity upside | Fast Moving Engineering Culture | High technical autonomy | Remote workMid-level Full TimeSan Francisco, CA; Onsite R3d ago
-
Analytics Cloud | Attribution Modeling | Dashboard Wireframing | Data Modeling | Data SecurityContract to 2026 | Flexible hybrid schedule | Potential extension | Remote workSenior-level Contract Full TimeBellevue, Washington, United States - Remote R3d ago
-
NumPy | Pandas | Python | SciPy | SymPyFreelance project-based work | Part-time project workEntry-level FreelanceMichigan, United States - Remote R3d ago
-
AI Developer - Model Creation & Full Stack USD 150K-175KAWS | Angular | Azure | CI/CD | D3.jsRemote work | USPS Public Trust Clearance eligibleMid-level Full TimeWork from home, VA, United States R3d ago
-
AI Developer USD 149K-190KChain-of-Thought | Continuous Deployment | Continuous integration | Deep learning | FHIRFlexible work schedule | Remote work opportunitySenior-level Full TimeUnited States R3d ago
-
Quantitative Developer (Fintech) USD 121K-213KAudit trails | Backtesting | C++ | Cloud Native | Cloud Native ArchitectureMid-level Full TimeUnited States - Remote R4d ago
-
Senior-level Full TimeUnited States - Remote R4d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible schedule | Part-time work | Project based workSenior-level FreelanceMichigan, United States - Remote R4d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time project-based workSenior-level FreelanceUnited States - Remote R4d ago
-
Customer Data Engineer (Hybrid - Buffalo, NY) USD 85K-143KAmazon Redshift | Azure Synapse | CTE | Data Modeling | Data QualityHybrid work environmentMid-level Full TimeBuffalo, NY, United States R4d ago