AVP Senior Hadoop Data Developer
USD 107K-160K Senior-level Full Time
Tasks
- Build real time streaming with Apache Kafka
- Deploy machine learning models in production
- Develop Hadoop data solutions
- Develop Spark solutions
- Implement Hadoop data pipelines
- Implement data security and governance
- Integrate AI/ML models into data pipelines
- Monitor Hadoop and streaming infrastructure
- Optimize Hadoop clusters performance
- Optimize streaming applications latency
- Own end to end data project delivery
- Perform MLOps continuous delivery
- Perform MLOps continuous integration
- Perform MLOps continuous training
- Translate data requirements into technical specifications
- Troubleshoot Hadoop and streaming issues
Perks/Benefits
- 401k
- Accident insurance
- Dental insurance
- Disability insurance
- Health insurance
- Life insurance
- Paid Holidays
- Paid time off
- Vision insurance
- Wellness programs
Skills/Tech-stack
AI/ML | AWS | Apache Hadoop | Apache Kafka | Apache Spark | Apache Zookeeper | Azure | Continuous Delivery | Continuous Training | Continuous integration | Data Governance | Data Modeling | Data Security | Data Warehousing | Dimensional Modeling | ELT | ETL | Feature Engineering | Generative AI | Google Cloud | HBase | HDFS | Hive | Linux | MLOps | Machine Learning | MapReduce | PySpark | Python | Real Time | Real-time Streaming | Regulatory Compliance | SQL | Unix | YARN
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R17d ago
-
Principal Engineer - Data Platform USD 221K-387KAccess Control | Apache Spark | Audit Logging | CDC | CompactionSenior-level Full TimeSanta Clara, California, United States R4h ago
-
Forward Deployed AI Engineer USD 90K-110KAPI Integration | AWS | Access Management | Agentic AI | Automated testingEntry-level Full TimeChicago, IL, United States7h ago
-
Senior-level Full TimeDeerfield, IL, United States R7h ago
-
.NET | ASP.Net Core | Acceptance Testing | Agile | Azure PaaSCertification reimbursement | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeSierra Vista, AZ, United States9h ago
-
Full Stack Computer Scientist (Senior-Level) USD 82K-138K.Net Core | Agile | C# | CI/CD | Configuration ManagementCertification reimbursement | Dental insurance | Life insurance | Long-term disability insurance | Medical insuranceSenior-level Full TimeSierra Vista, AZ, United States9h ago
-
Embedded Software Engineer– Technical Lead USD 150K-175KARM | Agile | Build systems | C++ | CI/CD401k match | Health insurance | Paid time off | Relocation not availableSenior-level Full TimeWaltham, MA, United States9h ago
-
AWS | AWS Config | Checkov | CloudTrail | CloudWatchDomestic travel up to 100 percent | On-call support | Remote workMid-level Full TimeRemote - USA R10h ago
-
Senior-level Full TimeOrlando, FL, United States11h ago
-
AWS | Agile | Apache Spark | Azure | Big DataMid-level Full TimeUnited States11h ago
-
Data Engineer I USD 87K-137KAPIs | Clay | Data Governance | Data Modeling | Data Quality401k match | Conference attendance support | Employee resource groups | Flexible PTO | Flexible work scheduleMid-level Full TimeMorrisville, United States11h ago
-
Global Total Cost and TVM Data Analytics Engineer USD 128K-166KAlteryx | Artificial Intelligence | Benchmarking | Dashboard Development | Data ModelingChild care subsidy | Dental insurance | Employee resource groups | Flexible family care | Medical insuranceSenior-level Full TimeAllen Park, MI, United States11h ago
-
Generative AI Engineer USD 138K-213KAWS | Azure | Caching | Cloud platform | Databricks401k matching | Generous paid time off | Health, dental, vision benefits | Work from home equipment providedSenior-level Full TimeNew York, NY, United States12h ago
-
Data Visualization & Integration Specialist USD 115K-150KAPI Integration | Bill of Materials | Data Governance | ETL | ExcelHybrid work scheduleMid-level Full TimeMarietta, GA, United States12h ago
-
Software Engineer, Scientific Computing USD 90K-160KCUDA | Debugging | Deployment | Numerical Methods | Performance optimizationEntry-level Full TimeRedwood City13h ago
-
Entry-level Full TimeRedwood City13h ago
-
Business Intelligence | Dashboard Development | Data Modeling | Data Warehousing | Report designHybrid workMid-level ContractRaleigh, United States13h ago
-
API Design | Apache Airflow | Automated testing | CI/CD | DBTComprehensive health care and benefits | Growth opportunities | Inclusion and diversity | Public service missionSenior-level Full TimePhiladelphia, PA, United States14h ago
-
Senior-level Full TimeHoboken, NJ, United States14h ago
-
AWS | Apache Airflow | Bash | CI/CD | DBTComprehensive health care and benefits | Hybrid work environment | Public sector mission driven workSenior-level Full TimePhiladelphia, PA, United States14h ago
-
AWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | AWS Step Functions100 percent on siteSenior-level ContractMc Lean, United States14h ago
-
AI | Adversarial Machine Learning | Bot Detection | Data Analysis | Data IntegrityMid-level Full TimeMountain View, CA, USA17h ago
-
Staff Software Engineer, AI/ML, Google Cloud Security USD 207K-301KAgentic AI | Cloud platform | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeReston, VA, USA; New York, NY, …17h ago
-
Senior-level Full TimeMountain View, CA, USA17h ago