Hadoop Developer
Tasks
- Build ETL/ELT workflows
- Design big data pipelines on Hadoop
- Design data models on HDFS Hive HBase
- Develop streaming data pipelines
- Implement data governance lineage quality controls
- Ingest transform and analyze structured and unstructured data
- Maintain data platforms for production SLAs and cost
- Optimize Spark and MapReduce jobs
- Orchestrate pipelines with Airflow or Oozie
- Set up monitoring alerting logging
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | Airflow | Apache Flink | Apache HBase | Apache Hive | Apache Hudi | Apache Kafka | Apache Pig | Apache Spark | Apache Sqoop | Azure HDInsight | CI/CD | Data Governance | Data Lineage | Data Quality | Databricks | Delta Lake | Google BigQuery | HDFS | Hadoop | Iceberg | Infrastructure as Code | Java | Kubernetes | Logging | MapReduce | Monitoring | ORC | Oozie | Parquet | Python | Python Scripting | SQL | Scala | Shell Scripting | Snowflake | Spark Streaming | Trino | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Big Data Engineer | Data Engineer | Developer | Engineer | Hadoop Developer
Related jobs
-
Senior Software Engineer, Data Governance & Foundations USD 166K-210KApache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache KafkaAnnual refresh grants | Equity grant | Remote work flexibilitySenior-level Full TimeUnited States - Remote R14h ago
-
Associate Software Engineer, Embedded Development USD 100K-150KAOSP | Android | Bash | Black box testing | Black-box401k match | Dental insurance | Free snacks | Health insurance | Life insuranceMid-level Full TimeRaleigh, NC R14h ago
-
Sr. Machine Learning Engineer USD 175K-230KAWS | C plus plus | Deep learning | Kubernetes | Language Models401k plan | Cell phone internet reimbursement | Company-Paid Holidays | Flexible paid time off | Health Savings Account employer contributionSenior-level Full TimeRemote - United States R16h ago
-
Senior AI & ML Engineer USD 194K-228KAPIs | Agent Orchestration | Agent routing | Agents SDK | Cloud infrastructureSenior-level Full TimeUnited States - Remote R17h ago
-
AI Savvy Data Analyst USD 127K-220KAnomaly Detection | Cause analysis | Cloud APIs | Colab | Data GovernanceAdditional day off for birthday | Competitive benefits package | ESG focused company | Flex days between Christmas and New Year | Flexible work hoursMid-level Full TimeDenver, CO, United States R23h ago
-
Data Engineer Lead | $140k-$175k + Hybrid + Equity | Exciting High Growth AI Operational Intelligence Startup A USD 140K-175KApache Airflow | Apache Kafka | DBT | Dagster | Data LineageEquity | Health insurance | Hybrid work | Medical insurance | Paid HolidaysExecutive-level Full TimeWayne, PA, United States R1d ago
-
Applied AI Engineer | $150K-$175K + Hybrid + Equity | High Growth AI Operational Intelligence Startup A USD 150K-175KAI Agents | AI orchestration | APIs | LLM | Model EvaluationEquity | Health medical and vision coverage | Hybrid work | One day per week onsite | Paid HolidaysExecutive-level Full TimeWayne, PA, United States R1d ago
-
Agent Frameworks | Deep learning | Distributed Systems | Fine Tuning | LLM InferenceEquity package | High-impact work | Hybrid schedule | Remote work optionSenior-level Full TimeRemote; New York, New York; Onsite R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Computer Vision | Data QualityMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data labelingMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerators | Agentic Systems | Computer Vision | Data QualityBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAccelerator hardware | Agentic Systems | Computer Vision | Data Quality | Data quality monitoringMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Computer Vision | Data QualityCareer growth | Diversity and inclusion | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Governance | Data LineageCareer growth | H1B transfer support | Remote work | W2 employmentMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KActive Learning | Apache Beam | CI/CD | Caching | CompressionRemote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Ingestion | Data LineageBenefits package | Career growth potential | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KActive Learning | Apache Beam | CI/CD | Caching | Code reviewBenefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | CI/CD | Caching | Code review | CompressionMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache SparkBenefits package | Long term projects | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveCareer growth | Long-term engagement | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Spark | Azure HDInsightCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
LLM Fine-Tuning Engineer USD 100K-150KDirect Preference Optimization | Efficient Attention | FSDP | GPU clusters | Human FeedbackBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
LLM Fine-Tuning Engineer USD 100K-150KAdapter Layers | Cluster operations | Dataset curation | Direct Preference Optimization | Efficient AttentionMid-level Full TimeUnited States - Remote R1d ago
-
LLM Fine-Tuning Engineer USD 100K-150KAdapters | Attention Mechanisms | Automated Benchmarks | DPO | Dataset curationBenefits | Remote workMid-level Full TimeUnited States - Remote R1d ago