Hadoop Solutions Developer
Tasks
- Automate pipeline orchestration
- Build streaming data pipelines
- Design big data pipelines on Hadoop
- Design data models and storage layouts
- Develop ETL/ELT workflows
- Document data architectures and operational runbooks
- Implement data governance and quality controls
- Mentor junior engineers and share engineering best practices
- Optimize Spark and MapReduce jobs
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
Airflow | Amazon EMR | Apache Atlas | Apache Flink | Apache Hudi | Apache Iceberg | Apache Spark | Azure HDInsight | BigQuery | CI/CD | Collibra | Data Governance | Data Lineage | Databricks | Delta Lake | Distributed Systems | HBase | HDFS | Hadoop | Hive | Infrastructure as Code | Java | Kafka | Kafka Connect | Kubernetes | Linux Shell | MapReduce | ORC | Oozie | Parquet | Pig | Python | SQL | Scala | Snowflake | Spark Streaming | Sqoop | Terraform | Trino | “as-code”
Education
Related jobs
-
Software Developer Sr USD 95K-169K.NET | ARM | Apache Spark | Automated testing | Azure401k plan | Charity programs | Dental insurance | Life insurance | Medical insuranceSenior-level Full TimeUnited States R1d ago
-
Software Developer Sr USD 95K-169K.NET | ARM | Apache Spark | Automated testing | Azure401k | Charity support | Dental insurance | Global Employee Stock Purchase Plan | Life insuranceSenior-level Full TimeUnited States R1d ago
-
API Integration | AWS | Azure | CI/CD | Data LakesSenior-level Full TimeTwo Destiny Way, Westlake TX, United … R2d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Apache Airflow | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache HudiCareer growth | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache SparkSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Big Data Developer USD 100K-150KApache Airflow | Apache Flink | Apache Hive | Apache Hudi | Apache OozieRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
AI/ML Platform Software Developer USD 160K-220KAPIs | Agentic AI | Backend Development | Cloud Native | Continuous MonitoringSenior-level Full TimeRemote (United States) R2d ago
-
AI/ML Software Developer USD 130K-175KAPI | Backend Development | Cloud Architecture | Distributed Systems | EmbeddingsMid-level Full TimeRemote (United States) R2d ago
-
AWS | Azure | CI/CD | Data Modeling | Data QualitySenior-level Full TimeTwo Destiny Way, Westlake TX, United … R3d ago
-
Senior Software Engineer/Developer USD 141K-181KAWS DMS | AWS Glue | AWS Lambda | AWS Step Functions | Acceptance TestingSenior-level Full Time300 New Millennium Way, Durham NC, … R3d ago
-
AI Software Engineer USD 110K-150KAsynchronous processing | CI/CD | Docker | Embeddings | Hugging FaceComprehensive technology setup | Connectivity reimbursement | Work from homeMid-level Full TimeUSA - IL (Remote), United States R3d ago
-
Data Analyst USD 86K-110KBI Desktop | DAX | Data Modeling | Data Quality | Data Refresh401k matching | Dental insurance | Flexible spending account | Health insurance | Health savings accountMid-level Full TimeRemote, United States R4d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache SparkRemote workSenior-level Full TimeUnited States - Remote R5d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveRemote workSenior-level Full TimeUnited States - Remote R5d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache HBase | Apache HiveCareer growth | Equal opportunity employer | Remote workSenior-level Full TimeUnited States - Remote R5d ago
-
Hadoop Big Data Developer USD 100K-150KApache Airflow | Apache Flink | Apache Hive | Apache Oozie | Apache PigCareer growth | Employee mentoring | Long term projects | Remote workSenior-level Full TimeUnited States - Remote R5d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Oozie | Apache SparkBenefits package | Full-time remote work | Long term multi year engagementSenior-level Full TimeUnited States - Remote R5d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBase100 percent remote | Benefits package | Career growth | H1B transfer support | Long-term engagementMid-level Full TimeUnited States - Remote R5d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache SparkCareer growth | Long term remote work | MentorshipSenior-level Full TimeUnited States - Remote R5d ago
-
Quantitative Developer (Fintech) USD 100KAudit trails | Backtesting | C++ | Compliance reporting | Concurrency100 percent remote | Career growth | Long term multi year engagement | MentorshipMid-level Full TimeUnited States - Remote R5d ago
-
Data Warehouse Developer USD 65K-70KAPI Integration | Business Intelligence | Case design | Data Modeling | Data WarehousingDental insurance | Health insurance | Life insurance | Paid Holidays | Paid time offMid-level Full TimeNormal, Illinois R7d ago
-
Senior GenAI Software Developer USD 112K-179KAPI Development | AWS | AWS Bedrock | Angular | AuthenticationAgile team environment | Remote workSenior-level Full TimeUnited States R7d ago
-
Anthropic API | Asynchronous programming | Database | Docker | LLM APIFlexible schedule | Fully remote | Part-time hours | Performance-based bonusesMid-level FreelanceTexas, United States - Remote R8d ago