Hadoop Big Data Developer
Tasks
- Build data processing platforms on Hadoop
- Design Big Data processing pipelines
- Develop analytics and reporting workloads
- Implement reliable performant production data platforms
- Ingest structured and unstructured data
- Operate Hadoop and related ecosystems
- Transform and analyze large scale datasets
- Troubleshoot debug and document data pipelines
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache Iceberg | Apache Spark | Azure HDInsight | CI/CD | Collibra | Databricks | Delta Lake | Distributed Systems | Flink | HBase | HDFS | Hadoop | Hive | Infrastructure as Code | Java | Kafka | Kubernetes | Oozie | Python | SQL | Scala | Shell | Spark Streaming | Sqoop | “as-code”
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Related jobs
-
Senior Software Engineer, Data Engineering USD 243K-295KAWS | Apache Airflow | Apache Spark | Azure | Cloud ComposerSenior-level Full TimeSan Mateo, CA, United States R3h ago
-
Senior Backend Engineer, Experimentation USD 182K-263KA/B | A/B Testing | APIs | Alerting | B testingDental insurance | Health insurance | Mental health benefits | Restricted stock units | Vision insuranceSenior-level Full TimeRemote - US R8h ago
-
Biometrics | C++ | Computer Vision | Machine Learning | Multimodal LearningOffice three days per week | Relocation assistanceMid-level Full TimeSan Francisco R9h ago
-
Software Engineer - Backend Platform USD 140K-205KAPI Design | AWS | Cloud platform | Databases | Distributed SystemsComprehensive health coverage | Coworking stipend | Equity | Flexible savings accounts | Remote workMid-level Full TimePalo Alto, California, United States R9h ago
-
Backend Engineer, AI Engineering: Duo Chat USD 115K-194KAPI Design | GraphQL | Langchain | Langgraph | Language ModelsEmployee stock purchase plan | Equity compensation | Flexible paid time off | Growth and development fund | Parental leaveSenior-level Full TimeRemote, Canada; Remote, United States R12h ago
-
Machine Learning Engineer USD 210K-240KA/B | A/B Testing | B testing | Data Pipelines | Data Processing401k plan | Commuter benefits | E Bike Transportation | Generous PTO | Learning and development stipendMid-level Full TimeSan Francisco, CA (Hybrid) R12h ago
-
Data Engineer USD 130K-150KApache Spark | Azure | Azure DevOps | CI/CD | Data ContractsFree dog walking services | Free on-site gym | Free parking | Hybrid remote work | Medical/Dental/Vision insuranceMid-level Full TimeSeattle, United States R12h ago
-
Staff Data Engineer, Market Data USD 207K-244KAeron | Backend Engineering | C++ | FIX | High Throughput401k | Dental insurance | Medical insurance | Vision insuranceSenior-level Full TimeRemote - USA R12h ago
-
Data Engineer USD 119K-202KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Hybrid work arrangementMid-level Full TimeAlexandria, Virginia, United States R13h ago
-
Data Engineer II USD 130K-150KAWS | Airflow | CI/CD | CloudWatch | Containerization401k matching | Employee equity plan | Fertility and adoption reimbursement | Flexible time off | Health insuranceMid-level Full TimeUnited States R13h ago
-
Senior Algorithms and Simulation Software Engineer USD 95K-145KC++ | CI/CD | Control Systems | Git | Hardware-in-the-loopSenior-level Full TimeDevens, MA R14h ago
-
Machine Learning Engineer USD 162K-170KComputer Vision | Data Pipelines | Deep learning | Experiment design | Machine Learning401k plan | Dental insurance | Flexible work hours | Long-term disability | Medical insuranceMid-level Full TimeRemote, United States R14h ago
-
APIs | Anomaly Detection | Classification Pipeline | Evaluation | HuggingFace Transformers100 percent remote | BYOD | Eastern Time overlap | USD paymentSenior-level Full TimeRemote R15h ago
-
Staff Software Engineer (L4) Data Platform USD 171K-213KAWS | Apache Hadoop | Apache Hudi | Apache Kafka | Apache Spark401k retirement account | Health care insurance | Paid parental leave | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R15h ago
-
Staff Machine Learning Engineer USD 176K-308KA2A | Asyncio | Embeddings | FastAPI | Java401k match | ESPP | Family leave | Flexible spending accounts | Flexible time offSenior-level Full TimeSanta Clara, California, United States R16h ago
-
Senior-level Full TimeRemote or VA, VA, United States R17h ago
-
Distinguished Software Engineer, Data Infrastructure USD 253K-416KCaching | Data Infrastructure | Data Processing | Databases | Distributed SystemsExecutive-level Full TimeMountain View, CA, United States R17h ago
-
Embedded Software Engineer II USD 90K-115KC# | C++ | Driver Development | Embedded Linux | Interrupts401k | Bereavement leave | Dental insurance | FMLA | Health insuranceMid-level Full TimeCentennial, CO, United States R17h ago
-
Embedded Software Engineer III USD 100K-135KC# | C++ | Linux | MAC addresses | Memory Management401k retirement plan | Bereavement leave | Dental insurance | FMLA | Medical insuranceSenior-level Full TimeCentennial, CO, United States R17h ago
-
Associate Data Engineer USD 60K-60KAWS | Apache Spark | Azure | Data Analysis | Data MappingComprehensive health coverage | Equity | Growth-focused environment | Home office setup allowance | Monthly cell phone allowanceMid-level Full TimeRemote US R17h ago
-
Data Engineer USD 150K-200KAWS EMR | Amazon S3 | Docker | Elasticsearch | Grafana401k match | Open PTO | Remote first flexible scheduleSenior-level Full TimeUnited States R17h ago
-
Automated Speech Recognition | CI/CD | CUDA | Computer Vision | Containerization401k matching | Company events | Dental coverage | Flexible work schedules | Internet reimbursementSenior-level Full TimeAnnapolis Junction, MD R18h ago
-
Practice Architect AI/ML USD 136K-204KAWS | Agent Orchestration | Agentic Workflows | AutoGen Orchestration | Autogen401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level Full TimeHanover, Maryland, USA R18h ago
-
4G | 5G | Automation | Network Analysis | Network TroubleshootingEducational assistance | Paid Holidays | Paid vacation | Sick leave | Stock purchase planMid-level Full TimePlano,Texas,United States R18h ago
-
ArgoCD | CSI | Cluster API | Distributed Systems | FluxCompany outings | Conference attendance | Hackathons | Happy hours | Professional developmentSenior-level Full TimeRemote, USA, United States R19h ago