Senior PySpark Developer - Vice President
3800 CITIGROUP CENTER DRIVE BUILDING F TAMPA, United States
USD 113K-170K Senior-level Full Time
Tasks
- Collaborate with cross-functional teams
- Conduct code reviews
- Design data pipelines
- Develop ETL processes
- Develop data processing applications
- Diagnose pipeline and integration issues
- Ensure data governance and security
- Implement data quality checks
- Implement unit, integration, and performance testing
- Optimize database performance
- Optimize spark performance
- Provide technical guidance and mentorship
- Research and integrate new technologies
- Use AI tools to improve development and testing
- Write complex SQL queries
Perks/Benefits
- 401k
- Accident insurance
- Disability insurance
- Life insurance
- Medical, dental, and vision coverage
- Paid Holidays
- Paid time off
- Wellness programs
Skills/Tech-stack
Apache Spark | Dataframes | Django REST | Django REST Framework | Docker | FastAPI | Flask | Git | Hadoop | Hive | Jenkins | Kafka | Kubernetes | Machine Learning | MongoDB | ORC | Oracle | Parquet | PySpark | PyTorch | Pytest | Python | REST API | REST Framework | SQL | Spark SQL | Spark Streaming | TensorFlow
Education
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R10d ago
-
Director, Data Science: Data Science Tools USD 125K-211KAirflow | Bash | Celery | Dash | DatabricksHybrid schedule | Professional development | Remote workExecutive-level Full TimeRemote, Remote, United States R12h ago
-
Machine Learning Engineer, Ecommerce Risk Control USD 175K-266KData Analysis | Data Visualization | Experiment design | Machine Learning | Model DeploymentSenior-level Full TimeSan Jose, California, United States14h ago
-
Brand recognition | Computer Vision | Data Mining | Deep learning | Entity MatchingMid-level Full TimeSeattle, Washington, United States14h ago
-
Click Through Rate | Click Through Rate Prediction | Conversion Rate | Conversion Rate Prediction | Data AnalysisSenior-level Full TimeSeattle, Washington, United States14h ago
-
Computer Vision | Fraud Detection | Language Processing | Machine Learning | Natural LanguageSenior-level Full TimeSeattle, Washington, United States14h ago
-
A/B | A/B Testing | B testing | Data Mining | Distributed ComputingMid-level Full TimeSeattle, Washington, United States14h ago
-
Machine Learning Engineer, Pricing - TikTok E-commerce Global Supply Chain and Logistics USD 129K-194KCausal Inference | Data Mining | Forecasting | Graph Databases | Knowledge graphsMid-level Full TimeSeattle, Washington, United States14h ago
-
Alignment | Chain-of-Thought | Computer Vision | Data Mining | Fine TuningSenior-level Full TimeSeattle, Washington, United States14h ago
-
Machine Learning Engineer, Recommendation - E-Commerce USD 145K-337KClick Through Rate | Click Through Rate Modeling | Computer Vision | Conversion Rate | Conversion rate modelingSenior-level Full TimeSan Jose, California, United States14h ago
-
Machine Learning Engineer, Ecommerce Risk Control USD 175K-266KA/B | A/B Testing | B testing | Data Visualization | Deep learningSenior-level Full TimeSeattle, Washington, United States14h ago
-
Mid-level Full TimeSan Jose, California, United States14h ago
-
Brand recognition | Chain-of-Thought | Computer Vision | Data Mining | Feature extractionSenior-level Full TimeSeattle, Washington, United States14h ago
-
Alignment | Audio Processing | COT | Clustering | Computer VisionSenior-level Full TimeSan Jose, California, United States14h ago
-
Benchmarking | Causal Inference | Data Mining | Data Pipelines | Data PreprocessingMid-level Full TimeSeattle, Washington, United States14h ago
-
Big Data | Click Through Rate | Click Through Rate Optimization | Conversion Rate | Conversion rate optimizationSenior-level Full TimeSeattle, Washington, United States14h ago
-
Machine Learning Engineer - Marketplace Growth (TikTok Global E-commerce Supply Chain and Logistics) USD 136K-280KBenchmarking | Causal Inference | Click Through Rate | Click Through Rate Optimization | Customer SegmentationEntry-level Full TimeSan Jose, California, United States14h ago
-
A/B | A/B Testing | B testing | Continual Learning | Data SetSenior-level Full TimeSeattle, Washington, United States14h ago
-
Senior Site Reliability Engineer - Data Infrastructure USD 187K-252KAI Agents | Alerting | Automation | Capacity Planning | Change ManagementCross-team collaboration | Mentorship | Rotational on-callSenior-level Full TimeSeattle, Washington, United States14h ago
-
Benchmarking | Causal Inference | Data Mining | Data Pipelines | Data PreprocessingMid-level Full TimeSan Jose, California, United States14h ago
-
A/B | A/B Testing | B testing | Continual Learning | Dataset ConstructionSenior-level Full TimeSan Jose, California, United States14h ago
-
Senior Machine Learning Engineer - TikTok E-commerce Global Supply Chain and Logistics USD 136K-205KData Mining | Deep learning | Knowledge graphs | Machine Learning | Operations ResearchSenior-level Full TimeSeattle, Washington, United States14h ago
-
Machine Learning Engineer, Ecommerce Risk Control USD 175K-266KData Analysis | Data Pipelines | Data Visualization | Deep learning | Experiment designSenior-level Full TimeSeattle, Washington, United States14h ago
-
Site Reliability Engineer - Data Infrastructure USD 100K-215KAlerting | Bash | Change Management | Go | Incident ResponseRotational on-callEntry-level Full TimeSeattle, Washington, United States14h ago
-
Applied Scientist, Search, E-Commerce Alliance USD 136K-205KData Analysis | Language Processing | Machine Learning | Model Deployment | Natural LanguageMid-level Full TimeSan Jose, California, United States14h ago