Hadoop Developer
United States - Remote
R
USD 130K-188K (estimate) Senior-level Full Time
Tasks
- Build streaming data pipelines
- Collaborate on dataset curation and documentation
- Design big data pipelines on Hadoop
- Design data models and storage layouts
- Develop ETL/ELT workflows
- Document data architectures and runbooks
- Evaluate and adopt big data technologies
- Implement data governance and quality controls
- Mentor junior engineers and enforce engineering best practices
- Optimize Spark and MapReduce jobs
- Orchestrate pipeline workflows
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBase | Apache Hive | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Oozie | Apache Pig | Apache Spark | Apache Sqoop | Azure HDInsight | BigQuery | CI/CD | Collibra | Data Governance | Data Lineage | Data Quality | Databricks | Delta Lake | Error Handling | Fault Tolerance | HDFS | Hadoop | Idempotency | Infrastructure as Code | Java | Kafka Streams | Kubernetes | Logging | MapReduce | Monitoring | ORC | Orchestration | Parquet | Partitioning | Python | Python Shell | Replication | SQL | Scala | Shell Scripting | Snowflake | Trino | “as-code”
Education
Roles
Related jobs
-
AI Developer - Model Creation & Full Stack USD 150K-175KAWS | Angular | Azure | CI/CD | D3.jsRemote work | USPS Public Trust Clearance eligibleMid-level Full TimeWork from home, VA, United States R8h ago
-
Quantitative Developer (Fintech) USD 121K-213KAudit trails | Backtesting | C++ | Cloud Native | Cloud Native ArchitectureMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Quantitative Developer (Fintech) USD 121K-213KAudit trails | Backtesting | C++ | Cloud Native | Cloud Native ArchitectureCareer growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Quantitative Developer (Fintech) USD 125K-200KAudit trails | Backtesting | C++ | Concurrency | Derivatives pricingCareer growth | Full-time W2 employment | Long term projects | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Quantitative Developer (Fintech) USD 142K-215KAudit trails | Backtesting | C++ | Concurrency | Derivatives pricingMid-level Full TimeUnited States - Remote R2d ago
-
Quantitative Developer (Fintech) USD 125K-213KAudit trails | Backtesting | C++ | Compliance reporting | ConcurrencyCareer growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Hadoop Developer USD 125K-146KAWS EMR | Airflow | Apache Atlas | Apache Spark | Azure HDInsightCareer growth | H1B transfer support | Health and benefits | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
Sr AI Engineer USD 124K-171KAPIs | Cause analysis | Code review | JavaScript | JiraCompany year end break | Flexible time off | Learning and development stipend | Medical/Dental/Vision insurance | Mental wellbeing resourcesSenior-level Full TimeRemote - United States R3d ago
-
Quantitative Developer (Fintech) USD 121K-213KAudit trails | Backtesting | C++ | Cloud Native | Cloud-native ArchitecturesBenefits | Full-time employment | Remote workMid-level Full TimeUnited States - Remote R3d ago
-
Hadoop Developer USD 125K-146KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveBenefits | Remote workSenior-level Full TimeUnited States - Remote R3d ago
-
Senior AI Developer USD 106K-133KAI SDK | AVA | Agentic AI | Agile | Cloud Foundry401k matching | Bereavement | Employee assistance program | Health, dental, and vision care | HolidaysSenior-level Full TimeRemote - Nationwide, United States R3d ago
-
Sr Software Developer (Data Agents) USD 92K-165KAlerting | Azure | Azure DevOps | Azure Functions | Azure Key VaultCharity program | Recognition | Time away from work | Volunteer days | Wellness initiativesSenior-level Full TimeUnited States R3d ago
-
Sr Software Developer (Data Agents) USD 92K-165KAPI Design | Alerting | Azure | Azure DevOps | Azure FunctionsCharity involvement | Time away from work | Volunteer days | Wellness initiativesSenior-level Full TimeUnited States R3d ago
-
Data Analysis | Deep learning | GenAI | Langchain | Language ModelsFreelance project-based work | Part-time hours | Project-based compensationMid-level FreelanceUnited States - Remote R4d ago
-
Langchain | Language Models | Large Language Models | MLOps | NumPyEnglish proficiency support | Flexible workload during active phases | Part-time schedule | Project based workMid-level FreelanceTexas, United States - Remote R4d ago
-
Analytics Sr Developer - Lab/Pathology USD 89K-135KBusiness Intelligence | Business Objects | BusinessObjects Web Intelligence | Crystal Reports | Data InterpretationCareer advancement opportunities | Discounted Education | Hybrid work from home | Tuition assistanceSenior-level Full TimeBusiness Service Center, United States R4d ago
-
Senior AI DevOps Engineer USD 130K-156KAI Builder | AI Studio | API Development | AWS | AWS Bedrock401k | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R4d ago
-
Senior AI Software Engineer USD 90K-153KAsynchronous processing | CI/CD | Docker | Embedding Models | FastAPISenior-level Full TimeUSA - IL (Remote), United States R6d ago
-
Entry-level Full TimeUnited States - Remote R6d ago
-
Bash | Coverage.py | Dagger | Docker | GcovFlexible hours | Freelance project-based collaboration | Fully remote | Supportive global communitySenior-level Full TimeFlorida, United States - Remote R6d ago
-
Bash | Black box testing | Black-box | Box testing | Coverage.pyFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeTexas, United States - Remote R6d ago
-
Bash | CLI | Coverage.py | Dagger | DockerFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeNew York, United States - Remote R6d ago