Hadoop Data Engineer
Texas, Texas, United States
A USD 91K-132K (estimate) Mid-level Full Time
Tasks
- Build big data solutions
- Collaborate with stakeholders
- Design scalable data pipelines
- Develop ETL/ELT processes
- Ensure data quality integrity governance
- Implement data security controls
- Support real-time and batch processing
- Troubleshoot production issues
- Tune and optimize Hadoop Spark jobs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | Apache Airflow | Apache Kafka | Apache Oozie | Apache Spark | Azure Data | Azure Data Lake | Data Governance | Data Lake | Data Quality | Data Security | Data Warehousing | ELT | ETL | HBase | HDFS | Hadoop | Hive | Informatica | MapReduce | NoSQL | PCI DSS | Python | SOX | SQL | Scala | Talend | Unix/Linux
Education
Roles
Related jobs
-
Software Engineer, Data (L1) USD 75K-130KAI Platform | APIs | Apache Airflow | Apache Iceberg | Apache Spark401k match | Calm subscription | Career growth and learning opportunities | Commuter benefits options | Dental insuranceMid-level Full TimeAustin, TX6h ago
-
Solutions Engineer – Robotics & Autonomous Driving USD 152K-500K2D Imaging | 3D Imaging | Autonomous Driving | C++ | CameraCommuter stipend | Generous PTO | Global travel | Health, dental, vision coverage | Learning and development stipendSenior-level Full TimeSan Francisco, CA; New York, NY7h ago
-
Machine Learning Research Engineer USD 161K-189KAWS | Azure | Bias Variance | Bias-Variance Tradeoff | C++Flexible hybrid work model | Mental health counseling | Mentorship programs | Paid parental leave | Paid volunteer time offMid-level Full TimeNew York, US, New York10h ago
-
Sr. Application Software Engineer, Data Analytics USD 160K-225KAngular | C# | CI/CD | Computer Vision | Continuous integrationExtended hours | Travel | Weekend workSenior-level Full TimeBastrop, TX11h ago
-
Senior-level Full TimeOnsite - Austin, TX12h ago
-
AWS Bedrock | Agent systems | Anthropic API | Autogen | Azure401k matching program | Adoption Assistance | Development and career growth opportunities | Fertility treatments | Flexible work schedulesSenior-level Contract Full TimeRemote, OR, United States R13h ago
-
Senior Data Engineer USD 90K-110KAWS | Agile | Apache NiFi | Data Architecture | Data ModelingAutonomy | Flexible working hours | Global employee assistance programme | Online training videos | Teambuilding eventsSenior-level Full TimeNew York, United States13h ago
-
Robotics Test Engineer USD 100K-150KASan | Bitbucket Pipelines | C++ | CI/CD | DebuggingDirect hire | Mentorship | Ownership of test suitesMid-level Full TimeOnsite - Austin, TX14h ago
-
AI Engineer 1 - Compliance, Quality & Testing USD 80K-150KAI-assisted testing | CI/CD | Code review | Cypress | Defect Tracking401k match | Dental insurance | Holidays | Medical insurance | Paid time offEntry-level Full TimeWashington, DC14h ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | BigQuery | Cloud Composer | Cloud Data401k retirement plan | Dental insurance | Disability insurance | Flexible time off | Health insuranceMid-level Full TimeLisle, IL, United States R15h ago
-
Staff Data Engineer USD 185K-220KAWS | Apache Airflow | Apache Kafka | Benthos | Big DataDental insurance | Disability insurance | Flexible work hours | Health insurance | Health savings accountSenior-level Full TimeRosslyn, VA or Remote R16h ago
-
API Testing | Cypher | Data Quality | DataOps | DevOpsBenefits | Competitive pay | Growth opportunity | Remote work | Travel requiredSenior-level Full TimeReston, VA, United States R16h ago
-
Principal Engineer - Data Platform USD 221K-387KAWS | Airflow | Apache Hive | Apache Iceberg | Apache ImpalaRemote workSenior-level Full TimeSanta Clara, California, United States R17h ago
-
AI Engineer 1 - Platform Integration & AI/Data USD 80K-150KAWS | Agentic Systems | Backend Development | Backend Services | CI/CD401k match | Dental insurance | Holidays | Medical insurance | Paid time offEntry-level Full TimeWashington, DC17h ago
-
IT Infrastructure Engineer II USD 139K-178KAWS Organizations | Access Management | Amazon Web Services | Ansible | Application FirewallHealth and wellness resources | Remote work | Wellness FridaysSenior-level Full TimeRemote - United States R17h ago
-
Senior Machine Learning Engineer, Agentic AI USD 163K-245KAI Observability | Agent systems | Autonomous Agents | Benchmark Datasets | Distributed SystemsHealth insurance | Life and disability insurance | Lifestyle Benefits Account | Mental health benefits | Paid time offSenior-level Full TimeBellevue, WA; Menlo Park, CA; New …17h ago
-
Agile | Automated testing | CI/CD | Cloud Computing | CrewAIDental insurance | Health insurance | Vision insuranceMid-level Full TimeAshburn, VA, United States19h ago
-
Senior Data Engineer - Databricks USD 180K-248KAWS | Access Control | Amazon Web Services | Apache Spark | Automated testing401k match | Corporate Benefit Program | Discounted pet insurance | Educational resources | Employee Referral Bonus ProgramSenior-level Full TimeUS - Remote R20h ago
-
AI Machine Learning Skill 2-FFPP-8904 USD 78K-250KC# | Data Governance | Data Modeling | Data pipeline | Java401k plan with company match | Dental insurance | Diverse inclusive workplace | Employee referral programs | Flexible spending accountsMid-level Full TimeHanover, MD20h ago
-
AWS | AWS SageMaker | Azure | Cloud Pak for Data | Cloud infrastructureAccess to national security mission work | Hybrid work | Travel opportunitiesSenior-level Full TimeUSA-VA-Herndon20h ago
-
AI-assisted software development | AWS | Agentic AI | Azure | Cloud ComputingSenior-level Full TimeUSA-VA-Herndon20h ago
-
Analytics Engineer USD 115K-150KAgile | Azure DevOps | CI/CD | DBT | Data GovernanceAdoption Assistance | Dental insurance | Disability insurance | Educational assistance | Flexible spending accountMid-level Full TimeHouston, Texas | Tulsa, Oklahoma | …21h ago
-
AI Engineer USD 180KAgent Orchestration | Cost Management | Data Pipelines | Distributed Systems | LLM401k | Commuter benefits | Dental insurance | Flexible spending | Health insuranceMid-level Full TimeNew York, New York, United States …21h ago
-
Data & Analytics Specialist USD 87K-135KAPI Integration | Alteryx | DAX | JavaScript | Power AppsAdoption Assistance | Educational assistance | Flexible spending account | Health savings account | Life insuranceMid-level Full TimeWichita, Kansas21h ago
-
Data Platform & Engineering Specialist USD 100K-130KAWS | Amazon Kinesis | Azure | Azure Event | Azure Event HubsDental insurance | Educational assistance | Flexible spending accounts | Health insurance | Health savings accountsMid-level Full TimeLincoln, Nebraska21h ago