Hadoop Developer
Tasks
- Build ETL and ELT workflows
- Design data models and storage layouts
- Design end to end big data pipelines on Hadoop
- Develop streaming data pipelines
- Document data architectures and runbooks
- Implement data governance and quality controls
- Optimize Spark and MapReduce jobs
- Orchestrate workflows with Airflow or Oozie
- Set up monitoring, alerting, and logging
- Troubleshoot and debug data platform issues
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Apache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Pig | Apache Spark | BigQuery | CI/CD | Databricks | Delta Lake | HBase | HDFS | Hadoop | Infrastructure as Code | Java | Kubernetes | MapReduce | ORC | Oozie | Parquet | Python | SQL | Scala | Shell | Snowflake | Spark Streaming | Sqoop | Trino | “as-code”
Education
Roles
Related jobs
-
AI Developer (Web Design & User Experience Support) USD 145K-190KAmazon Web Services | Angular | Azure | CI/CD | CSSSenior-level Full TimeEl Segundo, California, United States - … R21h ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud-native ArchitecturesBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R21h ago
-
MATLAB | NumPy | Pandas | Python | RFlexible scheduling | Part-time project-based workSenior-level FreelanceFlorida, United States - Remote R3d ago
-
ADA Title II | BI Security | Data Governance | IBM Cognos | Microsoft FabricCompany parties | Opportunity for advancementMid-level Full TimeAtlanta, GA, US R4d ago
-
Power BI / Power Platform Developer USD 80K-156KAPIs | DAX | Data Modeling | Data Performance Optimization | Data TransformationMid-level Full TimeRemote, United States R4d ago
-
Gen AI Developer USD 90K-189KAPI Authentication | API Development | API error handling | AWS | AngularContinuing education | Financial benefits | Flexible time off | Healthcare | Retirement benefitsSenior-level Full Time405 ASHBURN VA (ASHBURN CACI/CLIENT REIMB … R4d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Kafka | Apache PigRemote workSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache PigCareer growth | Employee support | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Developer USD 100K-150KApache Airflow | Apache Flink | Apache HBase | Apache Hadoop | Apache HiveSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache KafkaCareer growth | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Pig | Apache Spark100 percent remote | Full time direct employment | H1B transfer supportSenior-level Full TimeUnited States - Remote R4d ago
-
AWS | Amazon S3 | CI/CD | CSS | Databricks401k | Company paid life insurance | Dental insurance | Health insurance | Paid HolidaysEntry-level Full TimeConnecticut Work at Home, United States R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Computing | ConcurrencyMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Columnar Databases | ConcurrencyBenefits | Full-time employment | Remote workMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Concurrency | Data IngestionCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R4d ago
-
Quantitative Developer USD 100K-150KBacktesting | C++ | Concurrency | FIX Protocol | GPU ComputingCareer growth | Remote workSenior-level Full TimeUnited States - Remote R4d ago
-
Senior Data Warehouse Specialist/ETL Developer USD 130K-139KAWS Glue | Agile | Amazon Redshift | Amazon S3 | Control-M401k match | Bereavement leave | Company-Paid Holidays | Health insurance | Life insuranceSenior-level Full TimeUnited States - Remote R4d ago
-
Contact Center Analytics Developer USD 80K-103KAccess Control | Cause analysis | Dashboarding | Data Cleansing | Data PipelinesInternet speed requirement | Remote work flexibility | Uninterrupted virtual workspaceMid-level Full TimeRemote, Minnesota, United States R5d ago
-
Senior Analytics Developer USD 97K-105KBusiness Requirements | Code optimization | Concurrent programming | Data Mapping | Data Marts401k match | Dental coverage | Disability insurance | Employee assistance program | Health insuranceSenior-level Full TimeWork From Home, United States R6d ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Business Intelligence | Dashboard Development | Data Modeling | LookMLEducation and best practices | Performance-based growth | Remote-first cultureSenior-level Full TimeUnited States (remote) R6d ago
-
Lead Analytics Manager USD 120K-150KAffiliate Marketing | Dashboard Development | Data Literacy | Data Modeling | Data StandardizationEducation and best practices | Remote-first culture | Self service analytics enabledSenior-level Full TimeUnited States (remote) R6d ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Dashboard Development | Data Modeling | Data Warehousing | Data integrationCompetitive benefits | Profit-sharing bonus | Remote-first cultureSenior-level Full TimeAsheville, NC (remote); Atlanta, GA (remote); … R6d ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Business Intelligence | CAC Analysis | Creative Analytics | Dashboard DevelopmentCompetitive benefits | Professional growth opportunities | Remote-first work cultureSenior-level Full TimeArlington, VA (remote); Baltimore, MD (remote); … R6d ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Dashboard Development | Data Ingestion | Data Modeling | Data StandardizationCompetitive benefits | Profit-sharing bonus | Remote-first work environmentSenior-level Full TimeAustin, TX (remote); Dallas, TX (remote); … R6d ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Business Intelligence | Data Modeling | Data Quality | Data WarehousingEducation and best practices | Growth path | Remote-first culture | Self service enablementSenior-level Full TimeChicago, IL (remote); Columbus, OH (remote); … R6d ago