Big Data PySpark Lead Engineer - Vice President
Location(s): Jersey City, New Jersey, United States
USD 142K-213K Senior-level Full Time
Tasks
- Automate pipeline scheduling and orchestration
- Build data pipelines using PySpark
- Design and develop Hadoop ecosystem solutions
- Design data models and data architecture patterns
- Develop real-time and batch data workflows
- Identify and resolve technical risks and data issues
- Write SQL queries for data analysis and validation
Perks/Benefits
- 401k
- Accident insurance
- Disability insurance
- Life insurance
- Medical, dental & vision coverage
- Paid Holidays
- Paid time off
- Wellness programs
Skills/Tech-stack
Apache Hadoop | Apache Hive | Apache Impala | Apache Kafka | Apache Spark | Autosys | Data Governance | Data Modeling | Data Quality | Data Warehouse | Dimensional Modeling | Distributed Systems | HDFS | PySpark | SQL | Scala | Shell Scripting | Sqoop | Streaming
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior-level Full TimeSan Francisco, California9h ago
-
AI Software Engineer USD 160K-250KAWS | Agent Orchestration | Async Python | CI/CD | Context ManagementEquity awards | Health insurance | Performance based cash bonus | Remote work opportunityMid-level Full TimeNew York, New York, United States R9h ago
-
Computational Chemist USD 75K-85KADMET Prediction | Artificial Intelligence | Benchmarking | Computational Chemistry | Computer-aided drug design401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeSaint Charles, MO, United States11h ago
-
Senior-level Full TimePalo Alto, CA1d ago
-
AI Algorithms | APIs | Backend Services | C++ | Cloud infrastructureMid-level Full TimeSunnyvale, CA, USA1d ago
-
Senior Software Engineer, Generative AI, Search Health USD 174K-252KA/B | A/B Testing | B testing | Computer Vision | Data AnalysisSenior-level Full TimeMountain View, CA, USA1d ago
-
Staff Software Engineer, Log Storage USD 207K-300KC++ | Data Structures | Data Structures and Algorithms | Distributed Systems | Large-scaleSenior-level Full TimeSan Jose, CA, USA1d ago
-
API Development | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote workSenior-level Full TimeWork from home, VA, United States2d ago
-
ClaimsXM Data Engineer III USD 125K-140KAnalysis Services | Azure | Azure Data | Azure Data Factory | Data Cleansing401k employer match | Health insurance | Paid Holidays | Paid Long Term Disability | Paid Short Term DisabilitySenior-level Full TimeUnited States2d ago
-
Senior-level Full TimeUnited States2d ago
-
Sr. Forward Deployed Engineer USD 182K-250KAI APIs | AWS | Apache Spark | Application development | Artificial IntelligenceCustomer travel 20 percent timeSenior-level Full TimeSan Francisco, California2d ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percent timeSenior-level Full TimeRemote - Washington D.C. R2d ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Azure | CI/CD | DatabricksTravel 20 percentSenior-level Full TimeNew York City, New York2d ago
-
Sr. Forward Deployed Engineer USD 182K-250KAPI Integration | AWS | Apache Spark | Artificial Intelligence | AzureTravel 20 percent timeSenior-level Full TimeChicago, Illinois2d ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Artificial Intelligence | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeAustin, Texas; USCA2d ago
-
Business Intelligence - Data Engineer 133-2016 USD 80K-115KData Architecture | Data Modeling | Data Pipelines | Data Transformation | Dependency managementMid-level Full TimeTulsa, OK, US2d ago
-
AWS | AWS RDS | Access Control | Auditing | AzureOnsite work days 1 onsiteSenior-level ContractPhoenix, AZ, AZ2d ago
-
AI Engineer USD 135K-135KERP | Hugging Face | Langchain | Lean | MES401k enrollment | Dental and vision | Medical coverage | Paid Holidays | Paid time offMid-level Full TimeGrand-Prairie, Texas, TX2d ago
-
Senior-level Full TimeSeattle2d ago
-
Data Scientist Lead-Vice President USD 166K-200KData Visualization | Experimental Design | Hypothesis Testing | Machine Learning | Predictive ModelingBackup childcare | Financial coaching | Health and wellness centers | Health insurance | Mental health supportSenior-level Full TimeJacksonville, FL, United States2d ago
-
Lead Machine Learning Engineer USD 183K-215KAmazon ECS | Apache Airflow | Apache Spark | CUDA | Cloud ComputingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeNew York, NY, United States2d ago
-
Senior Data Science Engineer USD 160K-175KAPI Development | Apache Airflow | Apache Spark | CI/CD | DBTFlexible work optionsSenior-level Full TimeRemote (United States) R2d ago
-
Entry-level Full TimeUnited States, Washington, Redmond2d ago
-
Accounting Analytics & BI Engineer USD 220K-270KAirflow | Analytics engineering | Business Intelligence | DBT | Data ModelingFlexible working hours | Generous vacation | Health benefits | Hybrid work policy | Optional equity donation matchingMid-level Full TimeSan Francisco, CA R2d ago
-
Senior Data Engineer USD 100K-120KAWS | Agile | Azure | Cloud Architecture | Data Lake401k employer match | Career development | Dental insurance | Employee discounts | Employer Disability BenefitsSenior-level Full TimeBurnsville, MN, US2d ago