Lead Data Engineer - Pipelines, Spark Streaming and Spark Offline
Tampa, FL, United States
USD 170K-200K (estimate) Senior-level Full Time
Tasks
- Build batch and real time feature engineering
- Converge physical IT and data security architecture
- Design and develop ML features and rules
- Design scalable data processing pipelines
- Develop data services and platforms
- Implement backup and recovery validation
- Maintain data pipelines
- Review access control and security auditability
Perks/Benefits
- Backup childcare
- Health care coverage
- Mental health support
- Retirement savings plan
- Tuition reimbursement
Skills/Tech-stack
AWS EKS | AWS Glue | AWS Lambda | Amazon EMR | Apache Flink | Apache Hadoop | Apache Kafka | Apache Spark | Data Lake | Data Warehousing | Databricks | Docker | ETL | Flask | Kubernetes | NoSQL | PySpark | Python | Relational databases
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior-level Full TimeNorth America, United States2h ago
-
SOFTWARE DATA ENGINEER - Enterprise Infrastructure - 5+ yrs of Experience - TS/SCI w/Poly clearance is required - ES A USD 168K-172KCloud Security | Cloud infrastructure | Linux | Network Automation | OpenStack401k retirement plan | Dental insurance | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeLaurel, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | REducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeLos Angeles, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KCybersecurity | Data Visualization | Machine Learning | PyTorch | PythonEducation budget | Fitness budget | Flexible schedule | Mentorship | Professional growthSenior-level Full TimeSan Francisco, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | RFlexible schedule | Mentorship | Office work | Professional growth | Remote workSenior-level Full TimeBoca Raton, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | REducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeOrlando, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | RFlexible schedule | Mentorship | Professional growth | Remote and office options | TechtalksSenior-level Full TimeBaltimore, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | REducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBlacksburg, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | REducation budget | Fitness budget | Flexible schedule | Mentorship | Professional growthSenior-level Full TimeBoston, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | PyTorch | Python | R | SQLFlexible schedule | Mentorship | Office options | Professional growth | Remote work optionsSenior-level Full TimeChicago, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | REducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeRichmond, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KCybersecurity | Data Visualization | Machine Learning | PyTorch | PythonFlextime | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimePort Charlotte, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | RFlexible schedule | Mentorship | Professional growth roadmap | Remote work options | TechtalksSenior-level Full TimeWest Palm Beach, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Modeling | Data Visualization | Machine Learning | PyTorch | PythonEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeHouston, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | RFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Professional growthSenior-level Full TimeTampa, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | REducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeFort Lauderdale, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KCybersecurity | Data Visualization | Machine Learning | PyTorch | PythonEducation budget | Fitness budget | Flexible schedule | Mentorship | Professional growthSenior-level Full TimeTexas City, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | RFlexible schedule | Professional growth | Remote and office optionsSenior-level Full TimeIrving, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KCloud Security | Cloud Security Posture | Cloud Security Posture Management | Data Visualization | Machine LearningFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeMiami, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | RFlextime | Professional growth | Remote work optionsSenior-level Full TimeTallahassee, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | RFlextime | Mentorship | Office options | Personalized growth roadmaps | Professional growthSenior-level Full TimeAustin, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | Predictive Modeling | PyTorch | PythonFlextime | Mentorship | Office options | Personalized growth roadmaps | Professional growthSenior-level Full TimeNew York, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KPyTorch | Python | R | SQL | TensorFlowFlexible schedule | Mentorship | Personalized growth roadmaps | Professional growth | Remote work optionSenior-level Full TimeJacksonville, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | RFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Professional growthSenior-level Full TimeJersey City, United States3h ago
-
Senior Data Scientist ID71658 USD 160K-190KData Visualization | Machine Learning | PyTorch | Python | REducation budget | Fitness budget | Flexible schedule | Personalized growth roadmaps | Professional growthSenior-level Full TimeAtlanta, United States3h ago