Hadoop Big Data Developer
Tasks
- Build ETL/ELT workflows
- Design big data pipelines on Hadoop
- Design data models and storage layouts
- Develop streaming data pipelines
- Document data architectures and runbooks
- Evaluate and adopt new big data and cloud technologies
- Implement data governance and quality controls
- Lead performance reviews and architecture audits
- Mentor junior engineers and enforce engineering standards
- Optimize Spark and MapReduce jobs
- Orchestrate pipelines with workflow engines
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBase | Apache Hadoop | Apache Hive | Apache Hudi | Apache Kafka | Apache Pig | Apache Spark | Apache Sqoop | Azure HDInsight | BigQuery | CI/CD | Collibra | Databricks | Delta Lake | HDFS | Iceberg | Infrastructure as Code | Java | Kubernetes | MapReduce | ORC | Oozie | Parquet | Python | SQL | Scala | Shell | Snowflake | Spark Streaming | Trino | “as-code”
Education
Roles
Big Data Engineer | Data Engineer | Data Engineering | Developer | Engineer | Engineering | Hadoop Developer
Related jobs
-
Early-Career Network Engineer (RAN Optimization) USD 82K-128K4G | 5G | Automation | C Band | CBRSEducational assistance | Matching gifts | Paid sick time | Paid vacation | Parental leaveMid-level Full TimePlano,Texas,United States R10h ago
-
Applied AI Engineer - AI Solutions USD 172K-300KAgentic Workflows | Airflow | Apache Spark | Chroma | CrewAIAnnual travel up to 25% | Employee stock options | Hybrid work | Professional developmentMid-level Full TimeNew York City, NY (Hybrid); Redwood … R20h ago
-
Product Analytics Engineer USD 130K-140KA/B | A/B Testing | Airflow | B testing | DBT401k retirement savings plan | Employer-sponsored healthcare | Flexible spending account | Health savings account | Paid parental leaveSenior-level Full TimeRemote, USA R1d ago
-
Edge AI Engineer USD 100K-150KC++ | Core ML | DSP | Embedded Systems | Federated LearningCareer growth | H1B transfer support | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
A2A protocols | API Integration | Agent Orchestration | Agentic Systems | AuthenticationRemote work | Training and support opportunitiesSenior-level Full TimeRemote - USA, United States R1d ago
-
AI Research Engineer USD 100K-150KAccelerator hardware | Agentic Systems | Computer Vision | Data Quality | Data quality monitoringMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data quality monitoringCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAccelerator hardware | Computer Vision | Data Quality | Deep learning | Distributed TrainingBenefits package | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache PigCareer growth | H1B transfer support | Long-term engagement | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
Principal Data Engineer USD 151K-220KAWS | Cloud Computing | Data Governance | Data Management | Data Modeling401k matching | Business resource groups | Dental insurance | Family and medical leave | Health insuranceSenior-level Full TimeKS Remote, United States R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Direct Preference Optimization | Efficient Attention | Evaluation methodology | FSDPMid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapters | DeepSpeed ZeRO | Direct Preference Optimization | Efficient Attention | FSDPMid-level Full TimeUnited States - Remote R1d ago
-
Prompt Engineer USD 100K-150KAgent architecture | Chunking | Embeddings | Evaluation Frameworks | Fine TuningMid-level Full TimeUnited States - Remote R1d ago
-
Prompt Engineering USD 100K-150KAgentic Workflows | Chunking | Design Patterns | Deterministic systems | EmbeddingsRemote workMid-level Full TimeUnited States - Remote R1d ago
-
Prompt Engineer USD 100K-150KAgent architecture | Agent systems | Chunking | Embeddings | EvaluationMid-level Full TimeUnited States - Remote R1d ago
-
Storage Engineer USD 100K-150KAnsible | Automation | CRUSH maps | CSI drivers | Capacity PlanningDirect W2 employment with benefits | Full-time remote work | H1B transfer support | Long term multi year engagementSenior-level Full TimeUnited States - Remote R1d ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Computer Vision | Concurrent programming | Embedded SystemsCareer growth | Mentorship | Remote work | Technical documentation supportMid-level Full TimeUnited States - Remote R1d ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Computer Vision | Concurrent programming | Control SystemsMid-level Full TimeUnited States - Remote R1d ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Concurrent programming | Control Systems | DebuggingMid-level Full TimeUnited States - Remote R1d ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C plus plus | Concurrent programming | Debugging | DynamicsCareer growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R1d ago