Hadoop Big Data Developer
Tasks
- Build streaming data pipelines
- Design big data pipelines on Hadoop
- Design data models and storage layouts
- Develop ETL/ELT workflows
- Document data architectures and runbooks
- Implement data governance and quality controls
- Integrate pipelines with analytics and operational systems
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
- Orchestrate pipeline workflows
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Flink | Apache Hive | Apache Oozie | Apache Pig | Apache Spark | Apache Sqoop | CI/CD | Data Governance | Data Lineage | Data Quality | Delta Lake | ELT | ETL | HBase | HDFS | Hadoop | Hudi | Iceberg | Infrastructure as Code | Java | Kafka | Kubernetes | Logging | MapReduce | Monitoring | NoSQL | ORC | Parquet | Python | SQL | Scala | Shell | Spark Streaming | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Data Analyst USD 86K-110KBI Desktop | DAX | Data Modeling | Data Quality | Data Refresh401k matching | Dental insurance | Flexible spending account | Health insurance | Health savings accountMid-level Full TimeRemote, United States R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache SparkRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache HBase | Apache HiveCareer growth | Equal opportunity employer | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Oozie | Apache SparkBenefits package | Full-time remote work | Long term multi year engagementSenior-level Full TimeUnited States - Remote R2d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBase100 percent remote | Benefits package | Career growth | H1B transfer support | Long-term engagementMid-level Full TimeUnited States - Remote R2d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache SparkCareer growth | Long term remote work | MentorshipSenior-level Full TimeUnited States - Remote R2d ago
-
Quantitative Developer (Fintech) USD 100KAudit trails | Backtesting | C++ | Compliance reporting | Concurrency100 percent remote | Career growth | Long term multi year engagement | MentorshipMid-level Full TimeUnited States - Remote R2d ago
-
Data Warehouse Developer USD 65K-70KAPI Integration | Business Intelligence | Case design | Data Modeling | Data WarehousingDental insurance | Health insurance | Life insurance | Paid Holidays | Paid time offMid-level Full TimeNormal, Illinois R4d ago
-
Senior GenAI Software Developer USD 112K-179KAPI Development | AWS | AWS Bedrock | Angular | AuthenticationAgile team environment | Remote workSenior-level Full TimeUnited States R4d ago
-
Anthropic API | Asynchronous programming | Database | Docker | LLM APIFlexible schedule | Fully remote | Part-time hours | Performance-based bonusesMid-level FreelanceTexas, United States - Remote R5d ago
-
Asynchronous programming | Docker | LLM API | NoSQL | Node.jsEnglish proficiency support | Flexible schedule | Performance based bonus programs | Remote workMid-level FreelanceNew York, New York, United States … R5d ago
-
Anthropic | Asynchronous programming | Docker | LLM API | NoSQLBonus programs based on quality | Flexible schedule | Performance-based bonuses | Remote workMid-level FreelanceMichigan, United States - Remote R5d ago
-
Anthropic | Asynchronous programming | Business API | Conversational Design | DatabasesFlexible schedule | Performance bonus programs | Remote workMid-level FreelanceUnited States - Remote R5d ago
-
Anthropic API | Asynchronous programming | Business API | Conversational AI | Discord APIFlexible schedule | Fully remote | Performance-based bonusesMid-level FreelanceSouth Carolina, United States - Remote R5d ago
-
Python Developer (Databricks, Medallion Architecture) USD 103K-218KACID | CI/CD | Data Modeling | Data Warehousing | DatabricksContinuing education | Flexible time off | Healthcare | Learning and development | Retirement benefitsSenior-level Full Time405 ASHBURN VA (ASHBURN CACI/CLIENT REIMB … R5d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache PigCareer growth | H1B transfer support | Long-term engagement | Remote workSenior-level Full TimeUnited States - Remote R6d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiCareer growth | Remote workSenior-level Full TimeUnited States - Remote R6d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache PigBenefits | Long-term engagement | Remote workSenior-level Full TimeUnited States - Remote R6d ago
-
Entry-level Full TimeRemote, United States R6d ago
-
AI Solutions Developer USD 70K-80KAPI Integration | Agentforce | Apps Script | Data Analysis | Data Visualization401k company match | Employee stock purchase plan | Medical, dental, vision benefits | Paid Holidays | Paid parental leaveEntry-level Full TimeIllinois, US Offsite, United States R7d ago
-
Tableau Advisor USD 90K-120KAlteryx | Calculated Fields | Data Governance | Data Modeling | Data StorytellingCareer development opportunities | Training and mentorshipMid-level Contract Full TimeUnited States - Remote R7d ago
-
AI Platform Developer, Sr. USD 94K-147KAWS | Azure | Azure ML | Cloud Security | Cloud platform401k matching | Charity support | Dental insurance | Global Employee Stock Purchase Plan | Life insuranceSenior-level Full TimeUnited States R7d ago
-
Service Delivery Center, AI Developer - Senior USD 65K-152KAI Model Monitoring | AI Search | AI model | AWS Bedrock | Application InsightsFlexible vacation policy | Hybrid work model | Paid time offSenior-level Full TimeTampa, FL, US, 33602 R8d ago
-
AI Solutions Developer USD 103K-170KAPI Development | AWS | Artificial Intelligence | Backend Development | Cloud Computing401k employer match | Hybrid work environment | Medical/Dental/Vision insurance | Paid Holidays | Paid parental leaveEntry-level Full TimeCHICAGO, United States R8d ago