Hadoop Big Data Developer
Tasks
- Build analytics platforms
- Design data processing pipelines
- Develop SQL based analytics
- Document production data engineering processes
- Implement streaming data processing
- Ingest structured and unstructured data
- Operate Hadoop and big data ecosystem
- Orchestrate data workflows
- Transform and analyze large datasets
- Troubleshoot and debug data platform issues
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBase | Apache Hadoop | Apache Hive | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Oozie | Apache Spark | Apache Sqoop | Azure HDInsight | CI/CD | Collibra | Databricks | Delta Lake | Distributed Systems | HDFS | Infrastructure as Code | Java | Kubernetes | NoSQL | Python | Python Scripting | SQL | Scala | Shell Scripting | Spark Streaming | Trino | “as-code”
Education
Related jobs
-
Automated testing | C++ | CI/CD | Embedded Linux | Firmware401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractTampa, Florida, USA R11h ago
-
Backend & Data Developer (.NET Core / Cloud) USD 115K-150KAWS | AWS Lambda | Alteryx | Amazon Athena | Amazon RedshiftSenior-level Full TimeCenter, Center District, IL R16h ago
-
Anthropic API | Asynchronous programming | Business API | Conversation State Management | Conversation stateFlexible schedule | Performance-based bonuses | Remote workMid-level FreelanceTexas, United States - Remote R1d ago
-
Anthropic API | Asynchronous programming | Docker | NoSQL Databases | Node.jsFlexible schedule | Fully remote | Performance-based bonus programMid-level FreelanceUnited States - Remote R1d ago
-
Anthropic | Asynchronous programming | Business API | Conversational Design | DatabasesFlexible schedule | Performance-based bonuses | Remote workMid-level FreelanceMichigan, United States - Remote R1d ago
-
Anthropic API | Asynchronous programming | Business API | Databases | Discord APIFlexible schedule | Part-time hours | Performance-based bonuses | Remote workMid-level FreelanceNew York, New York, United States … R1d ago
-
Anthropic API | Asynchronous programming | Docker | JSON | NoSQL DatabasesFlexible schedule | Performance bonus program | Remote workMid-level FreelanceSouth Carolina, United States - Remote R1d ago
-
Data Engineer II USD 72K-115KBusiness Intelligence | Data Governance | Data Modeling | Data Quality | Data profilingMid-level Full TimeDayton WFH, United States R1d ago
-
AI Software Developer, Junior USD 55K-126KAI | APIs | Automation | Debugging | EmbeddingsDependent care | Mentorship | Paid leave | Professional development | Tuition assistanceEntry-level Full TimeUSA, CA, San Diego (49275 Electron … R1d ago
-
AI Software Developer, Senior USD 86K-198KAI | API Integration | Agile | Automation | Cloud deploymentDependent care | Disability insurance | Health benefits | Life insurance | Paid leaveSenior-level Full TimeUSA, CA, San Diego (49275 Electron … R1d ago
-
Data Scientist USD 62K-141KAgile | Angular | Authentication | Authorization | CI/CDDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeUSA, DC, Washington (200 MacDill Blvd), … R1d ago
-
Algorithmic Trading Developer USD 100K-150KAccelerated computing | C++ | Cloud Native | Concurrency | FIX ProtocolRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Hudi | Apache Iceberg | Apache SparkCareer growth | Full-time employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Robot Application Developer USD 100K-150KC++ | Computer Vision | Control Systems | Gazebo | Isaac SimRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Apache Kafka Developer USD 100K-150KACLs | AWS MSK | Ansible | Apache Kafka | Azure EventDirect W2 employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
AI Search | Application Insights | Application diagnostics | Azure AI | Azure AI Search401k | Dental insurance | Educational assistance | Health savings account | Life insuranceMid-level Full TimeNew York, United States R1d ago
-
Senior Data Platform Developer - AI Platform USD 110K-135KAWS | Agent Sandbox | Alerting | Amazon Bedrock | AzureBaby bonus and parental leave top up program | Electric vehicle purchase incentive program | Flexible working arrangements | Home office reimbursement | Home office supportSenior-level Full TimeAtlanta, Georgia - USA R1d ago
-
Senior UX Developer (NIH Data Lakehouse Support) USD 110K-149KAWS | Azure | CI/CD | CSS | DatabricksPublic trust required clearance process | Remote workSenior-level Full TimeUSA MD Home Office (MDHOME), United … R2d ago
-
Senior Analytics Developer USD 90K-130KChange Management | Dashboard Development | Data Analysis | Data Modeling | Data Visualization401k match | Employee assistance program | Flexible spending accounts | Health savings accounts | Long-term disabilitySenior-level Full TimeMJ Peoria, United States R2d ago
-
Junior Software Engineer - Python + Gen AI USD 56K-87KCI/CD | FastAPI | GitOps | Helm | MTLSEmployee resource groups | Flexible work | Healthcare | Mentoring coaching and learning programs | Mentorship programsEntry-level Full TimeColumbia, SC, US R2d ago
-
AWS | Azure | CI/CD | Docker | GitHybrid work opportunity | Inclusive work environment | Professional development | Supportive leadersSenior-level Full TimeLouisville - West Market, United States R2d ago
-
Cloud / AI Developer USD 128K-173KAlerting | Audit Logging | Authentication | Authorization | CI/CDSenior-level Full TimeUSA PA Home Office (PAHOME), United … R3d ago
-
Developer Advocate, MAX Inference & Serving USD 150K-225KBenchmarking | Benchmarks | C++ | CUDA | Discord401k matching | Hybrid work option | Insurance benefits | Paid time off | Team eventsMid-level Full TimeUnited States / Canada R4d ago
-
Fullstack Engineer, Embedded Wallet USD 177K-230KAPI Design | Backward Compatibility | Blockchain Signing | Blockchain Transactions | Blockchain integrationDistributed team collaboration | Flexible, distributed work environment | Remote work optionSenior-level Full TimeUnited States R4d ago