Hadoop Solutions Developer
Tasks
- Automate pipeline orchestration
- Build monitoring, logging, and alerting
- Design big data pipelines on Hadoop
- Design data models and storage layouts
- Develop ETL ETL workflows
- Document data architectures and runbooks
- Evaluate and adopt new big data technologies
- Implement data governance and lineage controls
- Implement streaming data pipelines
- Lead performance reviews and architecture audits
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | Airflow | Apache Atlas | Apache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache Pig | Apache Spark | Apache Sqoop | Azure HDInsight | CI/CD | Collibra | Databricks | Delta Lake | Distributed File System | ELT | ETL | Fault Tolerance | File System | HBase | HDFS | HDFS replication | Hadoop | Hadoop Distributed File System | Infrastructure as Code | Java | Kafka | Kubernetes | MapReduce | NoSQL | Oozie | Partitioning | Python | SQL | Scala | Shell | Spark Streaming | Trino | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Big Data Engineer | Data Engineer | Developer | Engineer | Hadoop Developer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R11d ago
-
Sr. Embedded Software/Firmware Engineer USD 180K-240KARM | ASPICE | AUTOSAR | C# | C++Competitive compensation | Dental insurance | Flexible hours | Medical insurance | Pre-IPO stock optionsSenior-level Full TimeUnited States - Remote R9h ago
-
Senior Data Engineer - Finance USD 172K-203KARR | AWS | Apache Iceberg | Apache Spark | CRMDental insurance | Employee discounts | Flexible wellness time off | Health insurance | Hybrid workSenior-level Full TimeHybrid - San Francisco, California R14h ago
-
Security Data Analyst - Parsing USD 111K-144KAPI Gateway | Amazon Web Services | Ansible | Automation | Bash401k employer contribution | Dental insurance | Employer-paid life insurance | Flexible PTO | Health Savings Account employer contributionSenior-level Full TimeAustin, Texas | Remote R14h ago
-
Senior-level Full TimeRemote - United States R14h ago
-
Sr. Data Engineer (HYBRID) USD 145K-160KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon DynamoDBComplimentary club membership | Hybrid work schedule | Personal training | Pilates | Shop discountsSenior-level Full TimeNew York, NY, United States R14h ago
-
Staff Software Engineer, Data Products USD 171K-224KAWS | AWS Lambda | Amazon Athena | Amazon Redshift | Amazon S3401k retirement savings plan | Flexible time off | Generous parental leave | Health, dental, and vision insurance | Lifestyle spending account mental health support solutionsSenior-level Full TimeRemote, USA R15h ago
-
Senior Software Engineer (Data Engineer) USD 138K-162KAWS | Akka | Algorithms | Apache Spark | Cloud Native401k plan company match | Basic life insurance | Dental insurance | Health insurance | Vision insuranceSenior-level Full TimeUnited States R15h ago
-
Senior Data Engineer - Agentic AI Engineering USD 138K-173KAWS | Access Control | Airflow | Azure | Batch dataRemote-friendlySenior-level Full TimeUnited States of America R15h ago
-
Analytics Lead, Full Stack USD 185K-245KAI | Excel | Python | SQL | SigmaESPP (Employee Stock Purchase Plan) | Flexible spending wallets | Health care coverage | Remote-first work | Time offSenior-level Full TimeRemote US R16h ago
-
Data Engineer USD 90K-151KAPIs | Amazon Redshift | CI/CD | Cloud Computing | Cloud platform401k match | Dental insurance | Equipment provided | Health insurance | PTOMid-level Full TimeRemote, US R16h ago
-
Senior Machine Learning Engineer, Safety USD 216K-303KData Preprocessing | Deep learning | Distributed Training | Embeddings | Hugging FaceSenior-level Full TimeRemote - United States R16h ago
-
Algorithms | Concurrency | Data Structures | Database systems | Distributed SystemsCompany-matched 401k | Flexible schedule | Health coverage | Parental leave | Remote work flexibilitySenior-level Full TimeUnited States R16h ago
-
Algorithms | Concurrent programming | Data Structures | Distributed Systems | ESQL401k match | Flexible schedule | Generous vacation days | Health coverage | Parental leaveSenior-level Full TimeUnited States R16h ago
-
Applied AI Engineer USD 254K-328KAgentic Workflows | Embeddings | Golden datasets | Knowledge graph | LLM401k | Bi annual in person offsites | Equity | Visa sponsorshipSenior-level Full TimeRemote, US R16h ago
-
Algorithms | Concurrency | Data Structures | ESQL | ElasticsearchFlexible schedule | Generous vacation days | Health coverage | Parental leave | Volunteer timeSenior-level Full TimeUnited States R17h ago
-
Algorithms | Concurrency | Data Structures | Distributed Systems | Engine technologyCompany-matched 401k | Donation matching | Employee stock program | Flexible schedule | Health coverageSenior-level Full TimeUnited States R17h ago
-
Mid-level Full TimeUnited States - Remote R19h ago
-
Data Engineer - AWS/Databricks USD 122K-210KAWS | AWS Glue | Adaptive Query | Adaptive query execution | Amazon RDSMentorship | Training and certifications support | Work-life balanceEntry-level Full TimeReston, VA, United States R1d ago
-
AWS Data Engineer (Associate) USD 111K-180KAmazon Athena | Amazon Glue | Amazon Redshift | Apache Spark | Dataframe APIMid-level Full TimeSeattle, WA R1d ago
-
Principal Data Engineer USD 129K-180KAdobe Analytics | Adobe XD | Amazon Web Services | Bitbucket | CI/CDRelocation Support N/A | Remote work permittedSenior-level Full TimeUnited States R1d ago
-
AI/ML Software Engineer USD 95K-140KAWS | Agent systems | Agentic Workflows | Autogen | AzureDisability insurance | Life insurance | Paid parental leave | Paid time off | Retirement plan matchSenior-level Full TimeEvendale, United States R1d ago
-
Senior Legal AI Engineer USD 100K-185KAI Agents | Citation Evaluation | Data Protection | Enterprise Security | Ethical AIEmployee assistance program | Fitness reimbursement | Flexible work schedule | Headspace app access | Mental health daysSenior-level Full TimeUnited States of America, Eagan, Minnesota R1d ago
-
Conversational AI Engineer USD 100K-150KAgent systems | Agentic Workflows | Chunking | Cost Optimization | EmbeddingsSenior-level Full TimeUnited States - Remote R1d ago
-
Edge AI Engineer USD 100K-150KC++ | Core ML | DSP | Embedded Systems | Energy optimizationCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago