Hadoop Big Data Developer
Tasks
- Build ETL/ELT workflows
- Collaborate with data scientists and analysts
- Design HDFS Hive HBase data models
- Design big data pipelines on Hadoop
- Develop streaming data pipelines
- Document data architectures and runbooks
- Implement data governance and quality controls
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
- Orchestrate pipelines with workflow engines
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Apache Atlas | Apache Flink | Apache Hive | Apache Hudi | Apache Pig | Apache Spark | Apache Sqoop | Azure HDInsight | CI/CD | Collibra | Databricks | Delta Lake | Google BigQuery | HBase | HDFS | Hadoop | Iceberg | Infrastructure as Code | Kafka | Kubernetes | MapReduce | ORC | Oozie | Parquet | Python | SQL | Shell | Snowflake | Spark Streaming | Trino | “as-code”
Education
N/A
Related jobs
-
Senior-level Full TimeUnited States - Remote R23h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergCareer growth opportunities | Health benefits | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R23h ago
-
Hadoop Solutions Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveSenior-level Full TimeUnited States - Remote R23h ago
-
Agile | BigQuery | C# | Cloud Native | DAX401k matching | Career growth | Dental insurance | Disability insurance | HSASenior-level Full TimeRochester, MN, United States R3d ago
-
Anthropic API | Asynchronous programming | Conversational Design | Database | DockerFlexible schedule | Part-time hours | Performance bonus | Remote workMid-level FreelanceNew York, New York, United States … R3d ago
-
Anthropic API | Asynchronous programming | Docker | NoSQL | Node.jsFlexible schedule | Performance-based bonuses | Remote workMid-level FreelanceTexas, United States - Remote R3d ago
-
Anthropic | Asynchronous programming | Conversation state | Docker | LLM APIsFlexible schedule | Fully remote | Performance-based bonusesMid-level FreelanceSouth Carolina, United States - Remote R3d ago
-
Anthropic API | Async Programming | Databases | Docker | LoggingFlexible schedule | Performance based bonus programs | Remote workMid-level FreelanceUnited States - Remote R3d ago
-
Asynchronous programming | Database | Docker | NoSQL | Node.jsFlexible schedule | Fully remote | Performance bonusMid-level FreelanceMichigan, United States - Remote R3d ago
-
AI Developer USD 150K-220KAWS | Apache Spark | Azure | ChromaDB | DockerAccidental death and dismemberment insurance | Company travel coverage | Dental insurance | Flexible PTO | Health insuranceSenior-level Full TimeMiami Beach, Florida, United States - … R3d ago
-
Software Developer Sr USD 95K-169K.NET | ARM | Apache Spark | Automated testing | Azure401k plan | Charity programs | Dental insurance | Life insurance | Medical insuranceSenior-level Full TimeUnited States R4d ago
-
Software Developer Sr USD 95K-169K.NET | ARM | Apache Spark | Automated testing | Azure401k | Charity support | Dental insurance | Global Employee Stock Purchase Plan | Life insuranceSenior-level Full TimeUnited States R4d ago
-
API Integration | AWS | Azure | CI/CD | Data LakesSenior-level Full TimeTwo Destiny Way, Westlake TX, United … R4d ago
-
Senior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Apache Airflow | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache HudiCareer growth | Remote workMid-level Full TimeUnited States - Remote R4d ago
-
Hadoop Solutions Developer USD 100K-150KAirflow | Amazon EMR | Apache Atlas | Apache Flink | Apache HudiCareer growth | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache SparkSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Big Data Developer USD 100K-150KApache Airflow | Apache Flink | Apache Hive | Apache Hudi | Apache OozieRemote workSenior-level Full TimeUnited States - Remote R4d ago
-
AI/ML Platform Software Developer USD 160K-220KAPIs | Agentic AI | Backend Development | Cloud Native | Continuous MonitoringSenior-level Full TimeRemote (United States) R5d ago
-
AI/ML Software Developer USD 130K-175KAPI | Backend Development | Cloud Architecture | Distributed Systems | EmbeddingsMid-level Full TimeRemote (United States) R5d ago
-
Senior Software Engineer/Developer USD 141K-181KAWS DMS | AWS Glue | AWS Lambda | AWS Step Functions | Acceptance TestingSenior-level Full Time300 New Millennium Way, Durham NC, … R5d ago
-
AI Software Engineer USD 110K-150KAsynchronous processing | CI/CD | Docker | Embeddings | Hugging FaceComprehensive technology setup | Connectivity reimbursement | Work from homeMid-level Full TimeUSA - IL (Remote), United States R5d ago
-
Data Analyst USD 86K-110KBI Desktop | DAX | Data Modeling | Data Quality | Data Refresh401k matching | Dental insurance | Flexible spending account | Health insurance | Health savings accountMid-level Full TimeRemote, United States R7d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveRemote workSenior-level Full TimeUnited States - Remote R7d ago