Hadoop Developer
Tasks
- Build ETL/ELT workflows
- Design big data pipelines on Hadoop
- Design data models and storage layouts
- Develop streaming data pipelines
- Document data architectures schemas and runbooks
- Implement data governance, lineage, and quality controls
- Integrate with lakehouse formats and data stores
- Mentor junior engineers and improve engineering standards
- Optimize Spark and MapReduce jobs
- Orchestrate workflows with Airflow or Oozie
- Set up monitoring, alerting, and logging
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache Iceberg | Apache Spark | Azure HDInsight | BigQuery | CI/CD | Collibra | Databricks | Delta Lake | Flink | HBase | HDFS | Hadoop | Hive | Infrastructure as Code | Java | Kafka | Kafka Connect | Kafka Streams | Kubernetes | MapReduce | ORC | Oozie | Parquet | Pig | Python | SQL | Scala | Shell | Snowflake | Spark Streaming | Sqoop | Trino | “as-code”
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Roles
Related jobs
-
Mid-level Full TimeUnited States - Remote R23h ago
-
Data Analyst / Tableau Developer USD 64K-87KAgile | Data Analysis | Data Governance | Data Modeling | Data Pipelines401k company match | Flexible work arrangements | Health and wellness benefits | Paid Holidays | Paid parental leaveMid-level Full TimeUSA VA Home Office (VAHOME), United … R1d ago
-
Bash | Coverage.py | Dagger | Docker | GcovFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeNew York, United States - Remote R4d ago
-
Bash | C# | C++ | Coverage.py | DaggerFlexible schedule | Fully remote | Project-based collaboration | Supportive communitySenior-level Full TimeTexas, United States - Remote R4d ago
-
Bash | Black box testing | Black-box | Box testing | Coverage.pyFlexible schedule | Freelance project-based collaboration | Fully remote | Supportive global communitySenior-level Full TimeFlorida, United States - Remote R4d ago
-
Bash | Black box testing | Black-box | Box testing | Code CoverageFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeUnited States - Remote R4d ago
-
Mid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Columnar Databases | Compliance reportingCareer growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Computing | ConcurrencyCareer growth | Health benefits | Mentorship | Remote work | Work-life balanceMid-level Full TimeUnited States - Remote R4d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache PigLong term projects | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache PigBenefits | Long term multi year engagement | RemoteSenior-level Full TimeUnited States - Remote R4d ago
-
Senior-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KBacktesting | C++ | Cloud Native | Concurrency | DebuggingCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R5d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R5d ago
-
Quantitative Engineer USD 140K-155KAI Assistant | API Design | AWS | CI/CD | Credit facility401k | Dental insurance | Fitness fund | Health insurance | Learning and development fundSenior-level Full TimeRemote - USA R6d ago
-
Data Analytics Investor Reporting - Associate USD 70K-100KAirbyte | DBT | Data Analysis | Data Modeling | Data ValidationDental insurance | Employer-Matched Retirement Plan | Flexible remote work Friday | Parental leave | Subsidized healthcareMid-level Full TimeSalt Lake City, Utah, United States R6d ago
-
Applied AI Developer (Remote) USD 125K-180KAPI Integration | AWS EC2 | Apache Airflow | CI/CD | Data PipelinesEmployee networks | Paid parental leave | Paid time off | Professional development opportunities | Volunteer opportunitiesSenior-level Full TimeUSA CA Remote, United States R6d ago
-
Cloud Data Specialist - Applications Developer USD 130K-206KAWS | Algorithms | Azure | CI/CD | Data StructuresHybrid work schedule | Inclusive culture | Professional development opportunities | Supportive leadersSenior-level Full TimeLouisville - West Market, United States R6d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time | Project-basedSenior-level Full TimeTexas, United States - Remote R6d ago
-
.NET | AWS | Angular | Asynchronous services | AzureContract role | Remote workSenior-level Contract Full TimeUnited States - Remote R6d ago
-
Senior Software Engineer (Typescript / FrontEnd) - AI/ML USD 141K-232KAPI Design | AWS | Azure | Cloud platform | Google CloudFlexible time off | Flexible work environment | Global gatherings | Healthcare | Home office setupSenior-level Full TimeUnited States (remote) R7d ago
-
C# | MATLAB | NumPy | Pandas | PythonEnglish language support | Flexible schedule | Part-time project-based workSenior-level FreelanceUnited States - Remote R7d ago
-
APIs | Agent architecture | Embeddings | Inference Serving | LLMDirect technical influence | Early stage equity upside | Fast Moving Engineering Culture | High technical autonomy | Remote workMid-level Full TimeSan Francisco, CA; Onsite R7d ago
-
Analytics Cloud | Attribution Modeling | Dashboard Wireframing | Data Modeling | Data SecurityContract to 2026 | Flexible hybrid schedule | Potential extension | Remote workSenior-level Contract Full TimeBellevue, Washington, United States - Remote R7d ago
-
NumPy | Pandas | Python | SciPy | SymPyFreelance project-based work | Part-time project workEntry-level FreelanceMichigan, United States - Remote R7d ago