Hadoop Developer
Tasks
- Automate pipeline orchestration
- Build ETL/ELT workflows
- Build monitoring, alerting, and logging
- Design big data pipelines on Hadoop
- Design data models on HDFS Hive and HBase
- Develop streaming data pipelines
- Document data architectures and runbooks
- Evaluate and adopt big data and cloud technologies
- Implement data governance and lineage
- Mentor engineers and support engineering best practices
- Optimize Spark and MapReduce jobs
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Flink | Apache HBase | Apache Hadoop | Apache Hive | Apache Kafka | Apache ORC | Apache Oozie | Apache Parquet | Apache Pig | Apache Spark | Apache Sqoop | CI/CD | Data Governance | Data Lineage | Delta Lake | Distributed Systems | HDFS | Hudi | Iceberg | Infrastructure as Code | Java | Kafka | Kubernetes | MapReduce | NoSQL | Python | SQL | Scala | Shell | Spark Streaming | Trino | “as-code”
Education
Roles
Related jobs
-
ADA Title II | BI Security | Data Governance | IBM Cognos | Microsoft FabricCompany parties | Opportunity for advancementMid-level Full TimeAtlanta, GA, US R1d ago
-
IBM Cognos | Microsoft Fabric | Oracle DBMS | PL/SQL | Power BIRemote workMid-level ContractAthens, United States R1d ago
-
Power BI / Power Platform Developer USD 80K-156KAPIs | DAX | Data Modeling | Data Performance Optimization | Data TransformationMid-level Full TimeRemote, United States R1d ago
-
Gen AI Developer USD 90K-189KAPI Authentication | API Development | API error handling | AWS | AngularContinuing education | Financial benefits | Flexible time off | Healthcare | Retirement benefitsSenior-level Full Time405 ASHBURN VA (ASHBURN CACI/CLIENT REIMB … R1d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Kafka | Apache PigRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache PigCareer growth | Employee support | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache KafkaCareer growth | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Pig | Apache Spark100 percent remote | Full time direct employment | H1B transfer supportSenior-level Full TimeUnited States - Remote R1d ago
-
AWS | Amazon S3 | CI/CD | CSS | Databricks401k | Company paid life insurance | Dental insurance | Health insurance | Paid HolidaysEntry-level Full TimeConnecticut Work at Home, United States R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Computing | ConcurrencyMid-level Full TimeUnited States - Remote R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Columnar Databases | ConcurrencyBenefits | Full-time employment | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Concurrency | Data IngestionCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Quantitative Developer USD 100K-150KBacktesting | C++ | Concurrency | FIX Protocol | GPU ComputingCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior AI Software Engineer USD 98K-153KAsynchronous processing | CI/CD | Docker | Embeddings | Generative AIMonthly Connectivity reimbursement | Work from home optionSenior-level Full TimeUSA - IL (Remote), United States R2d ago
-
Contact Center Analytics Developer USD 80K-103KAccess Control | Cause analysis | Dashboarding | Data Cleansing | Data PipelinesInternet speed requirement | Remote work flexibility | Uninterrupted virtual workspaceMid-level Full TimeRemote, Minnesota, United States R2d ago
-
Senior Analytics Developer USD 97K-105KBusiness Requirements | Code optimization | Concurrent programming | Data Mapping | Data Marts401k match | Dental coverage | Disability insurance | Employee assistance program | Health insuranceSenior-level Full TimeWork From Home, United States R2d ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Business Intelligence | Dashboard Development | Data Modeling | LookMLEducation and best practices | Performance-based growth | Remote-first cultureSenior-level Full TimeUnited States (remote) R3d ago
-
Lead Analytics Manager USD 120K-150KAffiliate Marketing | Dashboard Development | Data Literacy | Data Modeling | Data StandardizationEducation and best practices | Remote-first culture | Self service analytics enabledSenior-level Full TimeUnited States (remote) R3d ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Dashboard Development | Data Modeling | Data Warehousing | Data integrationCompetitive benefits | Profit-sharing bonus | Remote-first cultureSenior-level Full TimeAsheville, NC (remote); Atlanta, GA (remote); … R3d ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Business Intelligence | CAC Analysis | Creative Analytics | Dashboard DevelopmentCompetitive benefits | Professional growth opportunities | Remote-first work cultureSenior-level Full TimeArlington, VA (remote); Baltimore, MD (remote); … R3d ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Dashboard Development | Data Ingestion | Data Modeling | Data StandardizationCompetitive benefits | Profit-sharing bonus | Remote-first work environmentSenior-level Full TimeAustin, TX (remote); Dallas, TX (remote); … R3d ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Business Intelligence | Data Modeling | Data Quality | Data WarehousingEducation and best practices | Growth path | Remote-first culture | Self service enablementSenior-level Full TimeChicago, IL (remote); Columbus, OH (remote); … R3d ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Dashboarding | Data Modeling | Data Warehousing | LookMLCareer growth path | Competitive benefits | Profit-sharing bonus | Remote-first cultureSenior-level Full TimeDenver, CO (remote); Las Vegas, NV … R3d ago
-
Lead Data Analyst, Marketing USD 120K-150KAffiliate Marketing | Business Intelligence | Data Modeling | Data integration | LookMLCompetitive benefits | Profit-sharing bonus | Remote-first cultureSenior-level Full TimeLos Angeles, CA (remote); Portland, OR … R3d ago
-
Lead Analytics Manager USD 120K-150KAffiliate Marketing | CAC Analysis | Creative analysis | Dashboard Standardization | Data IngestionEducation and best practices | Remote-first team | Self service analytics enablementSenior-level Full TimeAsheville, NC (remote); Atlanta, GA (remote); … R3d ago