Hadoop Developer
Tasks
- Build ETL/ELT workflows
- Conduct performance reviews and architecture audits
- Design big data pipelines on Hadoop
- Design data models and storage layouts
- Develop streaming data pipelines
- Document data architectures and runbooks
- Implement Data Governance and Data Quality
- Integrate data with analytics and operational systems
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
- Orchestrate pipelines with workflow engines
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Spark | CI/CD | Delta Lake | Flink | HBase | HDFS | Hadoop | Hive | Hudi | Iceberg | Infrastructure as Code | Kafka | Kubernetes | MapReduce | ORC | Oozie | Parquet | Pig | Python | SQL | Shell | Spark Streaming | Sqoop | Trino | “as-code”
Education
N/A
Roles
Big Data Engineer | Data Engineer | Developer | Engineer | Hadoop Developer
Related jobs
-
Agentic AI | Azure | Cloud platform | Data analytics | Document processingRemote work | W2 employmentSenior-level Full TimeChicago, IL. R9h ago
-
IT Data Engineer USD 117K-124KANSI X12 | ARM Templates | Automl | Azure | Azure DataBackground screening provided | Flexible work hours | Mentorship | Professional development opportunitiesSenior-level Full TimeUS - Remote R12h ago
-
Analytics Engineer USD 147K-225KApache Airflow | BigQuery | DBT | Data Modeling | Data Visualization401k | Comprehensive benefits | Equity | Flexible time offSenior-level Full TimeUS Remote, Los Angeles, CA; San … R22h ago
-
Autonomy | C++ | CPU GPU | CPU GPU Debugging | Critical Systems401k | Health insurance | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
Autonomy | C++ | Data Ingestion | Data Ingestion Pipelines | Deployment401k | Health insurance | Paid Holidays | Paid time off | Phone stipendMid-level Full TimeSan Carlos - Hybrid R1d ago
-
Agent Orchestration | Airflow | Argo Workflows | Artifact versioning | Autonomous workflowsRemote work flexibilitySenior-level Full TimeRemote - United States R1d ago
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Data Quality | Data labeling100 percent remote work | Career growth opportunities | Visa transfer support for qualified candidatesMid-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseLong-term career growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | Apache Spark | CI/CD | CachingBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Software Engineer (Remote) USD 50K-130KAgile | ETL | Git | Google BigQuery | Google DataformRemote workEntry-level Full TimeTEXAS - VIRTUAL - TX01, United … R1d ago
-
Sr Staff - Data Platform Engineer USD 220K-255KAWS EMR | AWS Lambda | AWS S3 | Airflow | Apache HudiDental insurance | Disability insurance | Flexible spending account | Health insurance | Health savings accountSenior-level Full TimeCalifornia - Remote Office, United States R1d ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Automated benchmarking | DPO | Dataset curation | Direct Preference OptimizationCareer growth potential | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Data & Integrations Engineer USD 100K-100KAPI Gateway | API Management | AWS API | AWS API Gateway | AWS LambdaCareer development | Fully remoteSenior-level Full TimeRemote Ohio, United States R1d ago
-
ML Platform Engineer USD 100K-150KAPI Gateway | Abuse detection | Automated rollback | Autoscaling | C++100 percent remote | Career growth | H1B transfer supportSenior-level Full TimeUnited States - Remote R1d ago
-
Audio Machine Learning | Audio Separation | Cloud Computing | Fine Tuning | Language ModelsAviation immersion opportunities | Equity upside | Free flight training | Remote work | Technical leadership opportunitySenior-level Full TimeSan Francisco, CA; Onsite R1d ago
-
Senior MLOps & Generative AI Engineer - Remote USD 91K-152KAWS | Alerting | Azure | CI/CD | Deep learningAdoption reimbursement | Emergency backup care | Fertility and surrogacy reimbursement | Long-term disability | Medical/Dental/VisionSenior-level Full TimeCorp Facilities MPB - 350 Centre … R1d ago
-
Manager, Applied AI Engineer USD 171K-375KAI/ML | ASR | CRM Integration | Go | GuardrailsHybrid work | Remote work | Work-life balanceSenior-level Full TimeRemote (US), United States R1d ago
-
Senior-level Full TimeCanada R1d ago
-
Sr. AI Engineer (Applied AI & ML Systems) USD 132K-165KAgentic AI | Context engineering | Continuous Improvement | Data Engineering | Data PipelinesE learning license | Hackathons | Healthcare benefits | Home office setup allowance | Identity theft protectionSenior-level Full TimeUnited States R1d ago
-
Data Engineer USD 95K-140KApache Spark | Automated testing | Azure Databricks | CI/CD | Data ModelingMid-level Full TimeUS Remote R1d ago
-
Senior Analytics Engineer USD 180K-208KBigQuery | Cube | Dashboards | Data Modeling | Data orchestration401k with payroll match | Dental vision and mental health care | Employer sponsored medical care | Equity | Flexible PTOSenior-level Full TimeSan Francisco R1d ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data IngestionHybrid work model | Onsite Days Per Week | Remote work | Top secret clearance requiredSenior-level Full TimeHerndon, VA R1d ago