Hadoop Big Data Developer
Tasks
- Build ETL/ELT workflows
- Deliver curated datasets to analytics and machine learning
- Design big data pipelines on Hadoop
- Develop streaming data pipelines
- Document data architectures and runbooks
- Implement data governance and quality controls
- Maintain data models and storage layouts
- Mentor junior engineers
- Optimize Spark and MapReduce jobs
- Orchestrate workflows and manage dependencies
- Set up monitoring, alerting, and logging
Perks/Benefits
Skills/Tech-stack
AWS EMR | Apache Airflow | Apache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache Oozie | Apache Pig | Apache Spark | Apache Sqoop | BigQuery | CI/CD | Databricks | Delta Lake | HBase | HDFS | Hadoop | Infrastructure as Code | Kafka | Kubernetes | MapReduce | NoSQL | ORC | Parquet | Python | SQL | Shell | Snowflake | Spark Streaming | Trino | “as-code”
Education
Roles
Big Data Engineer | Data Engineer | Developer | Engineer | Hadoop Developer
Related jobs
-
Data Engineer USD 90K-110KAWS | AWS Lambda | Amazon DynamoDB | Amazon EMR | Amazon RedshiftFlexible schedule for time zone overlap | Remote workMid-level ContractNew York, NY R1d ago
-
IT Infrastructure Engineer II USD 139K-180KAWS | AWS Organizations | Ansible | Azure | CDNRemote work | Wellness Fridays | Wellness programsSenior-level Full TimeRemote - United States R1d ago
-
Senior Embedded Systems Engineer USD 150K-208KAutomated testing | Bluetooth Low Energy | C# | CMake | ESP-IDF401k match | Equity | Family planning support | Friends and family discounts on company products | Medical, dental, and vision insuranceSenior-level Full TimeDistributed, 🇺🇸 + 🇨🇦 (US + … R1d ago
-
Senior Data Science Engineer I, Spines USD 170K-190KAirflow | Amazon Redshift | Amazon S3 | Cloud Storage | Cost Optimization401k matching | DCFSA | Disability insurance | FSA | Flexible working hoursSenior-level Full TimeRemote R1d ago
-
Big Data | Data Engineering | PythonRemote work | US work authorization without sponsorshipSenior-level ContractBeaverton, United States R1d ago
-
Research Engineer, SysML - FAIR USD 141K-208KAgent Orchestration | Bias Mitigation | C# | C++ | CUBLASMid-level Full TimeMenlo Park, CA | Remote, US R1d ago
-
BI Dashboards | DBT | Data Governance | Data Marts | Data ModelingCross-functional collaboration | Fully remote | Health benefits coverage | High ownership | Performance bonusSenior-level Full TimeCanada R1d ago
-
Amazon Web Services | C++ | CUDA | Cloud platform | Deep learningFlexible work arrangements | Fully remoteMid-level Full TimeCanada R2d ago
-
Amazon Web Services | Argo CD | Argo Workflows | Bash | CI/CDEquity opportunities | Family support benefits | Flexible work arrangements | Health, dental, vision coverage | Learning and development supportSenior-level Full TimeCanada R2d ago
-
AI Foundry | AWS Bedrock | Agent Frameworks | Agent Orchestration | AnthropicMid-level Full TimeHouston, TX, United States R2d ago
-
Agile | BigQuery | C# | Cloud Native | DAX401k matching | Career growth | Dental insurance | Disability insurance | HSASenior-level Full TimeRochester, MN, United States R2d ago
-
Mid-level Full TimeAshville, Ohio, United States; Atlanta, Georgia, … R2d ago
-
Embedded Semiconductor Engineer USD 120K-150KAutomation | BSP | C# | C++ | CloudCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Senior AI/ML Engineer USD 125K-188KAWS | AWS Architecture Patterns | AWS CDK | AWS Lambda | AWS architecture401k matching | Dental | Health savings account | Life insurance | MedicalSenior-level Full TimeHerndon, Virginia, United States R2d ago
-
Anthropic API | Asynchronous programming | Conversational Design | Database | DockerFlexible schedule | Part-time hours | Performance bonus | Remote workMid-level FreelanceNew York, New York, United States … R2d ago
-
Anthropic API | Asynchronous programming | Docker | NoSQL | Node.jsFlexible schedule | Performance-based bonuses | Remote workMid-level FreelanceTexas, United States - Remote R2d ago
-
Anthropic | Asynchronous programming | Conversation state | Docker | LLM APIsFlexible schedule | Fully remote | Performance-based bonusesMid-level FreelanceSouth Carolina, United States - Remote R2d ago
-
Anthropic API | Async Programming | Databases | Docker | LoggingFlexible schedule | Performance based bonus programs | Remote workMid-level FreelanceUnited States - Remote R2d ago
-
Asynchronous programming | Database | Docker | NoSQL | Node.jsFlexible schedule | Fully remote | Performance bonusMid-level FreelanceMichigan, United States - Remote R2d ago
-
AI Developer USD 150K-220KAWS | Apache Spark | Azure | ChromaDB | DockerAccidental death and dismemberment insurance | Company travel coverage | Dental insurance | Flexible PTO | Health insuranceSenior-level Full TimeMiami Beach, Florida, United States - … R2d ago
-
Machine Learning Engineer USD 125K-234KAgentic AI | Data Analysis | Generative AI | Machine Learning | Mathematical ModelingEntry-level Full TimeSan Jose, United States R2d ago
-
Data Analytics Manager USD 95K-150KAPI Design | Agile | Azure | Azure Data | Azure Data FactoryComprehensive benefits package | Professional development programs | Remote work optionMid-level Full TimeDallas, Texas, United States R2d ago
-
Staff Data Engineer, Corporate Engineering USD 180K-252KAWS S3 | Automated reconciliation | CI/CD | Cloud Data | Cloud Data Warehouse401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Healthcare benefitsSenior-level Full TimeRemote - United States R2d ago
-
Senior AI Systems Engineer USD 130K-195KAlerting | Bash | CI/CD | CMMC | Configuration ManagementHybrid work option | Remote work optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R2d ago
-
Senior AI Technologist USD 145K-208KAI Agents | AI Foundry | AWS Bedrock | Apache Airflow | Apache SparkCross-functional collaboration | Fully remote or hybrid or onsite optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R2d ago