Hadoop Developer
United States - Remote
R
USD 125K-146K (estimate) Senior-level Full Time
Tasks
- Automate pipeline orchestration
- Build streaming data pipelines
- Design big data pipelines on Hadoop
- Design data models and storage layouts
- Develop ETL/ELT workflows
- Document data architectures and runbooks
- Evaluate new big data technologies
- Implement data governance and quality controls
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Apache Atlas | Apache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Pig | Apache Spark | Azure HDInsight | BigQuery | CI/CD | Collibra | Databricks | Delta Lake | HBase | HDFS | Hadoop | Infrastructure as Code | Java | Kubernetes | MapReduce | ORC | Oozie | Parquet | Python | SQL | Scala | Shell | Snowflake | Spark Streaming | Sqoop | Trino | “as-code”
Education
Roles
Related jobs
-
Sr AI Engineer USD 124K-171KAPIs | Cause analysis | Code review | JavaScript | JiraCompany year end break | Flexible time off | Learning and development stipend | Medical/Dental/Vision insurance | Mental wellbeing resourcesSenior-level Full TimeRemote - United States R21h ago
-
Quantitative Developer (Fintech) USD 121K-213KAudit trails | Backtesting | C++ | Cloud Native | Cloud-native ArchitecturesBenefits | Full-time employment | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
Senior AI Developer USD 106K-133KAI SDK | AVA | Agentic AI | Agile | Cloud Foundry401k matching | Bereavement | Employee assistance program | Health, dental, and vision care | HolidaysSenior-level Full TimeRemote - Nationwide, United States R1d ago
-
Sr Software Developer (Data Agents) USD 92K-165KAlerting | Azure | Azure DevOps | Azure Functions | Azure Key VaultCharity program | Recognition | Time away from work | Volunteer days | Wellness initiativesSenior-level Full TimeUnited States R1d ago
-
Sr Software Developer (Data Agents) USD 92K-165KAPI Design | Alerting | Azure | Azure DevOps | Azure FunctionsCharity involvement | Time away from work | Volunteer days | Wellness initiativesSenior-level Full TimeUnited States R1d ago
-
Data Analysis | Deep learning | GenAI | Langchain | Language ModelsFreelance project-based work | Part-time hours | Project-based compensationMid-level FreelanceUnited States - Remote R1d ago
-
Langchain | Language Models | Large Language Models | MLOps | NumPyEnglish proficiency support | Flexible workload during active phases | Part-time schedule | Project based workMid-level FreelanceTexas, United States - Remote R1d ago
-
Analytics Sr Developer - Lab/Pathology USD 89K-135KBusiness Intelligence | Business Objects | BusinessObjects Web Intelligence | Crystal Reports | Data InterpretationCareer advancement opportunities | Discounted Education | Hybrid work from home | Tuition assistanceSenior-level Full TimeBusiness Service Center, United States R1d ago
-
Senior AI DevOps Engineer USD 130K-156KAI Builder | AI Studio | API Development | AWS | AWS Bedrock401k | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R2d ago
-
Senior AI Software Engineer USD 90K-153KAsynchronous processing | CI/CD | Docker | Embedding Models | FastAPISenior-level Full TimeUSA - IL (Remote), United States R3d ago
-
Entry-level Full TimeUnited States - Remote R3d ago
-
Bash | Coverage.py | Dagger | Docker | GcovFlexible hours | Freelance project-based collaboration | Fully remote | Supportive global communitySenior-level Full TimeFlorida, United States - Remote R3d ago
-
Bash | Black box testing | Black-box | Box testing | Coverage.pyFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeTexas, United States - Remote R3d ago
-
Bash | CLI | Coverage.py | Dagger | DockerFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeNew York, United States - Remote R3d ago
-
Bash | Coverage.py | Dagger | Docker | GcovFlexible schedule | Freelance project-based collaboration | Fully remote | Supportive global communitySenior-level Full TimeUnited States - Remote R3d ago
-
Digital Technical Specialist (Associate/Sr Associate) - Heathcare Data, Analytics & Automation - Remote USD 120K-171KAI | Automation | Data Transformation | Data integration | EHRDental insurance | Healthcare coverage | Remote work | Travel opportunity | Vision insuranceSenior-level Full TimeChicago - 550 Van Buren, United … R4d ago
-
Power BI Developer – Remote – FS434 USD 100K-120KALM Toolkit | Aggregation | Azure | Azure Data | Azure Data FactoryFlexible hours | Remote work | Work-life balanceMid-level Full TimeRemote - Franklin, Massachusetts, United States R4d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryProject based workSenior-level FreelanceFlorida, United States - Remote R8d ago
-
NumPy | Numerical Simulation | Pandas | Python | SciPyProject-based employmentSenior-level FreelanceMichigan, United States - Remote R8d ago
-
Senior Quantitative Developer - Commodities USD 179K-243KCashflow Generation | Commodities | Debugging | Derivatives | Energy Markets401k match | Dental insurance | Flexible working environment | Life insurance | Maternity leaveSenior-level Full TimeOffice - New York, United States R9d ago
-
Senior-level Full TimeHouston, Texas R10d ago
-
Software Developer - AI Business Analytics - Remote USD 99K-223KAI/ML | Analytics Cloud | Apache Spark | CI/CD | CertificatesSenior-level Full TimeUnited States R11d ago
-
Data Analyst/ETL Developer (remote) USD 80K-100KCause analysis | Data Monitoring | Data Pipelines | Data Validation | Data cleaning401k match | Flexible schedule | Health insurance | Life insurance | Paid parental leaveMid-level Full TimeWork From Home, United States R11d ago
-
Azure Data | Azure Data Lake | Azure Data Warehouse | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeEl Monte, CA R11d ago
-
AI Developer II USD 121K-186K.NET | Azure | Csharp | Evaluation | Infrastructure as CodeAdoption Assistance | Backup dependent care | Dental insurance | Infertility coverage | Medical insuranceMid-level Full TimeUSA - PA - Remote, United … R11d ago