Hadoop Big Data Developer
Tasks
- Automate pipeline orchestration
- Build monitoring, alerting, and logging
- Build streaming data pipelines
- Design big data pipelines on Hadoop
- Design data models and storage on HDFS Hive HBase
- Develop ETL/ELT workflows
- Document data architectures and operational runbooks
- Implement data governance lineage quality controls
- Integrate datasets for analytics machine learning reporting
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Flink | Apache HBase | Apache Hive | Apache Hudi | Apache Pig | Apache Spark | Apache Sqoop | CI/CD | Data Governance | Data Lineage | Data Quality | Delta Lake | Distributed Systems | HDFS | Hadoop | Iceberg | Infrastructure as Code | Java | Kafka | Kubernetes | Logging | MapReduce | Monitoring | ORC | Oozie | Parquet | Python | Python Scripting | SQL | Scala | Shell | Spark Streaming | “as-code”
Education
Related jobs
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache Hudi100 percent remote | Career growth | Full-time W2 employmentSenior-level Full TimeUnited States - Remote R23h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergSenior-level Full TimeUnited States - Remote R23h ago
-
Senior Data Analytics Developer, Power BI and AWS USD 100K-150KAWS | Amazon Redshift | Artificial Intelligence | Data Governance | Data Mining401k match | Health benefits | Hybrid work scheduleSenior-level Full TimeNewark, NJ R3d ago
-
Software Engineer, Unsecured Installments USD 136K-196KCI/CD | Cypress | GraphQL | Java | JavaScript401k | Company holidays | Dental insurance | Employee assistance program | Health insuranceSenior-level Full TimeUnited States | Remote R3d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hudi | Apache Spark | Data GovernanceBenefits | Remote workSenior-level Full TimeUnited States - Remote R3d ago
-
Asynchronous programming | Conversation State Management | Conversation state | Docker | LLM APIFlexible schedule | Remote workMid-level FreelanceMichigan, United States - Remote R3d ago
-
Anthropic API | Asynchronous programming | Databases | Docker | NoSQLFlexible schedule | Fully remote | Laptop required | Performance-based bonusesMid-level FreelanceTexas, United States - Remote R3d ago
-
Anthropic API | Asynchronous programming | Databases | Docker | NoSQL DatabasesFlexible schedule | Performance-based bonus | Remote workMid-level FreelanceSouth Carolina, United States - Remote R3d ago
-
Asynchronous programming | Business API | Discord API | Docker | LLM APIsFlexible schedule | Fully remote | Part-time hours | Performance-based bonusesMid-level FreelanceNew York, New York, United States … R3d ago
-
Asynchronous programming | Databases | Docker | LLM APIs | NoSQLFlexible schedule | Fully remote | Part-time hours | Performance-based bonusesMid-level FreelanceUnited States - Remote R3d ago
-
Associate Software Engineer – Full Stack (AI First) USD 150K-210KAPI Integration | Angular | CD pipelines | CI/CD | CI/CD pipelinesCareer development | Distributed work culture | Learning opportunities | Work from anywhereMid-level Full TimePhoenix, Arizona R4d ago
-
Associate Software Engineer – Frontend (AI First) USD 130K-190KAccessibility | Accessibility Standards | Angular | Browser Compatibility | CI/CDCareer development | Community building | Distributed work environment | Learning opportunities | Work from anywhereMid-level Full TimePhoenix, Arizona R4d ago
-
Assistant Director, Power BI Enablement Lead USD 100K-152KALM | Analysis Services | Azure | Azure Analysis | Azure Analysis ServicesHybrid work | Inclusive culture | Professional development | Remote workSenior-level Full TimeBoston, Massachusetts, United States R4d ago
-
Data Analyst USD 87K-120KDAX | Data Modeling | Data Quality | Data Refresh | Data refresh monitoring401k match | Dental insurance | Flexible spending account | Health insurance | Health savings accountMid-level Full TimeRemote, United States R4d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Flink | Apache Hive | Apache HudiCareer growth | Equal opportunity employer | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Big Data Developer USD 100K-150KApache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache OozieCareer growth | Full-time employment | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Big Data Developer USD 100K-150KApache Airflow | Apache Flink | Apache Oozie | Apache Spark | CI/CDBenefits | Career growth opportunities | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Solutions Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveSenior-level Full TimeUnited States - Remote R4d ago
-
Associate, Quantitative Developer USD 112K-164KAI coding | AI coding tools | Azure Data | Azure Data Factory | C#401k | Health insurance | Hybrid work policy | Learning and development | Paid HolidaysMid-level Full TimeRemote - Illinois, United States R4d ago
-
Senior Scientific Developer USD 175K-232KArgo Workflows | Benchmarking | CI/CD | Cheminformatics | CondaAnnual team gatherings and company events | Free lunch snacks beverages | Health, dental and vision coverage | Onsite gym accessSenior-level Full TimeUnited States - Remote R4d ago
-
Power BI Developer USD 110K-130KCommon table expressions | Data Modeling | Data Visualization | ETL | Excel401k | Dental insurance | Disability insurance | Employee assistance program | Flexible spending accountMid-level Full TimeUnited States - Remote R4d ago
-
API Integration | AWS | Accessibility | Azure | D3.jsCollaborative environment | Contract extension | Flexible international environment | Fully remote work | High autonomySenior-level Full TimeCanada R5d ago
-
Data Warehouse Developer USD 95K-115KAWS | AWS Athena | AWS Glue | AWS Lake Formation | AWS LambdaEmployee assistance program | Employee resource groups | Employee wellness program | Paid Holidays | Paid time offSenior-level Full TimeDallas, TX, United States R5d ago
-
Agentic AI Engineer (Boston, Hybrid) USD 319K-350KAI orchestration | AWS | Autogen | Azure | CrewAIEquity | Health benefits | Hybrid workMid-level Full TimeBoston R5d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveCareer growth opportunities | Full-time remote work | H1B transfer support | Long-term engagementSenior-level Full TimeUnited States - Remote R5d ago