Senior PySpark Developer - Vice President
USD 113K-170K Senior-level Full Time
Tasks
- Build ETL processes
- Collaborate with cross-functional teams
- Design data pipelines
- Develop PySpark applications
- Evaluate and integrate new technologies
- Implement data governance and security
- Improve unit testing and deployment
- Mentor junior engineers
- Optimize database performance
- Optimize distributed data processing
- Perform code reviews
- Troubleshoot data pipeline issues
- Write SQL queries
Perks/Benefits
- 401k
- Dental insurance
- Disability insurance
- Health insurance
- Life insurance
- Paid Holidays
- Paid time off
- Vision insurance
- Wellness programs
Skills/Tech-stack
ADLS | AWS | Apache Spark | Artificial Intelligence | Azure | Big Data | CI/CD | Dataframes | Django REST | Django REST Framework | Docker | ETL | FastAPI | Flask | GCP | Git | Hadoop | Hive | Integration Testing | Jenkins | Kafka | Kubernetes | Machine Learning | MongoDB | ORC | Oracle | Parquet | Performance Testing | PySpark | PyTorch | Pytest | Python | REST APIs | REST Framework | S3 | SQL | Spark SQL | Spark Streaming | Stored Procedures | TensorFlow
Education
Related jobs
-
Data Analytics & Engineering Opportunities USD 65K-105KHive | Microstrategy | MySQL | Oracle | Python401k with firm profit share | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States9h ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageRemote workMid-level Full TimeWork from home, VA, United States R11h ago
-
Senior Data Engineer USD 165K-180KAPIs | Anomaly Detection | Azure | Azure Data | Azure Data FactorySenior-level Full TimeWork from home, VA, United States R11h ago
-
Senior DevOps Engineer ID63545 USD 135K-185KAWS | Apache Airflow | ArgoCD | Azure | BigQueryFlextime | Growth roadmaps | Mentorship | Office work options | Remote work optionsSenior-level Full TimeMiami, United States13h ago
-
BigQuery | Curriculum Development | Data Governance | Data Lakehouse | Data ModelingAsynchronous hiring process | Part-time hoursSenior-level Part TimeBoston, US13h ago
-
Software Engineer Level 2-FFPP-8863 USD 78K-250KAccumulo | BSON | Bigtable | Distributed File System | File System401k match | Employee referral programs | Flexible spending accounts | Inclusive workplace culture | Medical/Dental/Vision insuranceMid-level Full TimeHanover, MD13h ago
-
Evergreen - Mathematics for Machine Learning USD 80K-300KAutodiff | JAX | Linear Algebra | Matrix Operations | NumPyAsynchronous hiring process | Flexible collaboration | Part-time hoursMid-level Full TimeBoston, US14h ago
-
Senior Director, AI / Machine Learning Software Engineer USD 136K-300KApache Flink | Apache Spark | CI/CD | Data Lineage | Data PrivacyHealth benefits | Paid leave | Paid volunteer timeSenior-level Full TimeNew York, NY, United States14h ago
-
Computer Vision | Data Analysis | Language Models | Language Processing | Large Language ModelsSenior-level Full TimeSeattle, Washington, United States14h ago
-
Classification Algorithms | Data Analysis | Deep learning | Language Models | Language ProcessingSenior-level Full TimeSan Jose, California, United States15h ago
-
Data Engineering | Machine Learning | Machine Learning Pipelines | Python | Recommendation SystemsSenior-level Full TimeSan Jose, California, United States15h ago
-
Data Pipelines | Full Stack | Full-Stack Development | Machine Learning | PythonSenior-level Full TimeSan Jose, California, United States15h ago
-
C++ | Data Analysis | Data Manipulation | Data Processing | Deep learningSenior-level Full TimeMountain View, CA, USA15h ago
-
Software Engineer, Machine Learning USD 207K-300KC++ | Data Processing | Experimentation | Information Retrieval | Just-in-TimeSenior-level Full TimeNew York, NY, USA; Mountain View, …15h ago
-
Artificial Intelligence | C++ | CSS | Data Storage | Distributed ComputingSenior-level Full TimeNew York, NY, USA15h ago
-
Associate Principal, Trust and Safety, GenAI USD 142K-205KAbuse prevention | Cybersecurity | Dashboards | Data Transformation | Data VisualizationMid-level Full TimeWashington D.C., DC, USA; Seattle, WA, …16h ago
-
Customer Engineer, Data Analytics, Google Cloud USD 153K-222KBatch Processing | Big Data | Cloud Architecture | Cloud platform | Customer RequirementsSenior-level Full TimeSunnyvale, CA, USA16h ago
-
C++ | Data Processing | Debugging | Information Retrieval | Language ModelsSenior-level Full TimeMountain View, CA, USA16h ago
-
Silicon Design Verification Engineer, Quantum AI USD 138K-198KARM | C-based testing | Chip verification | Constrained random | Constrained random verificationMid-level Full TimeMountain View, CA, USA; Goleta, CA, …16h ago
-
Algorithms | C++ | Cloud Computing | Cloud platform | Data StructuresSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Cloud Data and AI Engineer, Professional Services USD 127K-183KC++ | Capacity Planning | Cloud Databases | Data Migration | Data PipelinesTravel up to 30 percentMid-level Full TimeReston, VA, USA16h ago
-
Staff Software Engineer, ML Frameworks USD 207K-300KAPIs | Data Processing | Debugging | Fine Tuning | GPU AccelerationSenior-level Full TimeMountain View, CA, USA16h ago
-
Data Scientist USD 67K-150KA/B | A/B Testing | B testing | Clustering | Drift monitoring401k plan | AD and D insurance | Child Life Insurance | Dental insurance | Educational Assistance PlanMid-level Full TimeUnited States17h ago
-
Quantitative Research & Model, Senior Advisor USD 155K-237KAgile | Artificial Intelligence | Cloud Computing | Energy Markets | Exotic options401k match | Dental insurance | Health insurance | Hybrid work | Life insuranceSenior-level Full TimeHOUSTON, US, 7705618h ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R18h ago