Hadoop Big Data Developer
Tasks
- Build data processing platforms
- Design big data pipelines
- Develop streaming data workflows
- Document data engineering workflows
- Implement data warehousing and analytics pipelines
- Ingest structured and unstructured data
- Operate Hadoop based data systems
- Orchestrate scheduled data jobs
- Transform and analyze large datasets
- Troubleshoot and debug data platform issues
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBase | Apache Hadoop | Apache Hive | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | Azure HDInsight | CI/CD | Collibra | Databricks | Delta Lake | Distributed Systems | HDFS | Infrastructure as Code | Java | Kafka | Kubernetes | NoSQL | Oozie | Python | SQL | Scala | Shell | Spark Streaming | Spark on Kubernetes | Sqoop | Trino | “as-code”
Related jobs
-
Data Engineer USD 150K-160KApache Iceberg | Cloud Data | Cloud Data Warehouses | Data Lakes | Data Warehouses401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractSunnyvale, California, USA R2h ago
-
Lead GenAI Engineer USD 150K-170KAgile | Azure | Cloud platform | Containerization | Cybersecurity401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilitySenior-level ContractMinneapolis, Minnesota, USA R4h ago
-
Software Engineer Level 2 -FFPP-8911 USD 78K-250KAccumulo | BSON | Bigtable | HBase | HDFS401k match | Bonus opportunities | Dental insurance | Diverse Inclusive Workplace Culture | Employee referral programSenior-level Full TimeHanover, MD; Information Technology; Hanover, MD; … R8h ago
-
Enterprise - Software Engineer - Python, PySpark, AWS USD 185K-200KAWS Glue | AWS Lambda | Amazon DynamoDB | Amazon Web Services | PySparkBirthday off | Company events | Dental coverage | Flexible work schedule | Group life insuranceSenior-level Full TimeAnnapolis Junction, MD R8h ago
-
Agile | Angular | Azure DevOps | CSS | Cloud DataHybrid RemoteMid-level Full TimeTampa R10h ago
-
AWS Glue | Amazon RDS | Amazon Redshift | Amazon S3 | Artificial Intelligence401k matching | Certification programs | Disability insurance | Employee resource groups | Fertility coverageEntry-level Full TimeRichmond, VA, United States R13h ago
-
Senior Full Stack & AI Engineer USD 100K-135K.NET | AI Foundry | Agile | Angular | Azure AIContinuous learning | Flexible schedule | Hybrid work modelSenior-level Full TimeMadrid, MD, Spain R15h ago
-
AWS Bedrock | AWS EC2 | AWS ECS | AWS EKS | AWS LambdaOn-site or hybrid work | Sabbaticals | Shared parental leave | Study assistance | Work-life balance initiativesSenior-level Full TimeUSA - Raleigh, NC (RDU), United … R1d ago
-
Senior Software Engineer, Decision Intelligence Platform USD 180K-225KCloud Computing | Data Modeling | Data Pipelines | Data Quality | Distributed SystemsEquity compensation | Hybrid work option | Medical benefits | Onsite collaboration daysSenior-level Full TimeSeattle, Washington United States, United States R1d ago
-
PAHO Consultant - Data, Analytics, and AI (ITS) USD 53K-53KActive Directory | Azure Active Directory | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeOff Site, United States R1d ago
-
Senior Staff Engineer – AI Engineering USD 113K-188KGit | Hugging Face | Language Models | Language Processing | Large Language ModelsAdoption Assistance | Disability benefits | Employee assistance program | Health Coach access | Life insuranceSenior-level Full TimeNiskayuna, United States R1d ago
-
Data Quality and Solutions Lead Developer (Hybrid) USD 86K-165KChange Management | Dashboards | Data Catalog | Data Cleansing | Data Flow401k match | Adoption Assistance | Child and elder care services | Dental insurance | Disability coverageSenior-level Full TimeUS-TX-RICHARDSON-461 ~ 3200 E Renner Rd … R1d ago
-
ADA | ARINC 429 | Agile | C++ | Confluence401k matching | Counseling sessions | Dental insurance | Disability coverage | Employee assistance programMid-level Full TimeUS-PR-AGUADILLA-110 ~ Rd 110 N Km … R1d ago
-
AI / LLM Platform Engineer USD 108K-149KAPI Development | AWS | Azure | CICD | CMMC401k match | Dental insurance | Health insurance | Hybrid work option | Life insuranceMid-level Full TimeEnglewood, CO - CO RMN, United … R1d ago
-
Staff Software Engineer-AI Solutions USD 131K-210KAJAX | Agentic AI | Artificial Intelligence | Business Rules | CMDB401k | Dental insurance | FSA/HSA | Hybrid work | Life insuranceSenior-level Full TimeAshburn, VA, United States R1d ago
-
Staff Software Test Engineer, Embedded Systems USD 140K-160KAgile | Automated testing | CI/CD | Embedded Systems | GitHub Actions401k plan | Dental insurance | Disability insurance | Employee assistance program | Employee stock purchase planSenior-level Full TimeUS - Work From Home, United … R1d ago
-
Equity Derivatives Quantitative Analyst - Vice President USD 150K-225KC++ | Data Analysis | Linux | Mathematical Modeling | Pricing modelsExecutive-level Full TimeNew York, 745 7th Avenue, United … R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Sr. Lead HR Analytics Developer USD 129K-161KCapital management | Data Governance | Data Modeling | Data Warehousing | ETLSenior-level Full TimeScottsdale, United States R1d ago
-
Big Data Engineer USD 90K-110KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Real-Time Data Engineer USD 135K-160KACLs | AWS MSK | Ansible | Apache Flink | Apache KafkaRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior SIEM Data Engineer USD 680K-1445KApache Kafka | Batch Processing | CI/CD | CIM | Cribl StreamSenior-level Full TimeQuincy, Massachusetts, United States R1d ago
-
AI Data Engineer USD 80K-100KApache Beam | Apache Spark | CI/CD | Code review | Data LineageCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Embedded Robotics Engineer USD 125K-145KAutonomous Systems | C++ | Concurrent programming | Control | DebuggingRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 72K-100KDPO | Deep learning | DeepSpeed ZeRO | Distributed Training | EvaluationCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago