Senior ETL Developer - Assistant Vice President
3800 CITIGROUP CENTER DRIVE BUILDING G TAMPA, United States
USD 96K-145K Senior-level Full Time
Tasks
- Design and implement Spark applications for data processing in HDFS
- Develop ETL pipelines in Spark using Python
- Ingest clean and transform large datasets
- Integrate Spark applications with Hive and Sqoop
- Load data into HDFS from multiple sources
- Monitor job logs and Spark UI
- Optimize Spark jobs for performance and resource usage
- Troubleshoot debug Spark job failures
- Tune memory management caching and partitioning
Perks/Benefits
- 401k
- Life, accident, and disability insurance
- Medical, dental, and vision insurance
- Paid Holidays
- Paid time off
- Wellness programs
Skills/Tech-stack
Apache Spark | Caching | Data Aggregation | Data Ingestion | Data Transformation | Data cleaning | ETL | HDFS | Hadoop | Hive | Memory Management | Partitioning | Python | Spark UI | Sqoop
Education
Roles
Data Engineer | Developer | ETL Developer | Engineer | Senior ETL Developer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R3h ago
-
Senior-level Full TimeAnnapolis Junction, MD4h ago
-
Agile | Cloud Pak | Cloud Pak for Data | Data Management | IBM DataStageSenior-level ContractLansing, United States5h ago
-
Data Engineer III (Top Secret Clearance Required) USD 107K-179KAWS | Azure | Cloud Integration | Computer Vision | Data PipelinesSenior-level Full TimeArlington/Rosslyn, Virginia, United States7h ago
-
Mid-level Full TimeArlington/Rosslyn, Virginia, United States7h ago
-
Software Engineer, AI/ML Computer Vision, Pixel Camera USD 147K-211KC++ | Computer Vision | Data Processing | Debugging | Image classificationMid-level Full TimeMountain View, CA, USA8h ago
-
Cloud Data and AI Engineer, Professional Services USD 127K-183KAlloyDB | Aurora | Bigtable | C++ | Capacity PlanningTechnical workshops and training delivery | Travel up to 30 percentMid-level Full TimeReston, VA, USA8h ago
-
API Design | Apache Flink | Apache Presto | Apache Spark | AutoscalingSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Machine Learning Engineer USD 136K-215KAgentic AI | Autonomous Vehicles | Bayesian Inference | Code review | Deep learningMid-level Full TimeChicago, IL, US14h ago
-
Forward Deployed AI Engineer USD 140K-240KAPIs | AWS | Azure | C# | Computer Vision401k matching | Comprehensive healthcare | Education stipend | Stock awards | Wellness stipendMid-level Full TimeMountain View, CA17h ago
-
Senior-level Full TimeCedar Rapids, IA19h ago
-
AWS | Azure | Cloud Run | Django | Docker401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeSan Jose, CA, United States19h ago
-
Senior Analytics Engineer USD 87K-161KAutomation | CI/CD | DBT | Data Ingestion | Data Modeling401k | Flexible workplace options | Hybrid work options | Paid time off | Remote work optionsSenior-level Full TimeRemote-FL, United States R19h ago
-
Senior Analytics Developer - Health Justice USD 87K-130KAlation | DAX | Data Governance | Data Lineage | Data QualitySenior-level Full TimeNYP/Weill Cornell Medical Center, United States19h ago
-
AI Software Engineer USD 264K-332KAI | Augmented Reality | Automatic Speech Recognition | BEAM Search | Bayesian analysisMid-level Full TimeSan Jose (CA), United States19h ago
-
Applied Scientist USD 120K-238KConditional Generation | Data Curation | Diffusion Models | Distributed Training | Image CaptioningEntry-level Full TimeSan Jose, United States R19h ago
-
Business Logic | Cloud Data | Cloud Data Platforms | Data Governance | Data MiningHealth benefits | Hybrid work options | Retirement planMid-level Full TimeUT MAIN CAMPUS, United States19h ago
-
Senior AI Data Science Engineer USD 149K-201KAnomaly Detection | Apache Airflow | Apache Spark | Cloud Computing | Computer VisionSenior-level Full TimeSunnyvale, CA, United States20h ago
-
AI Deployment Engineer, Enterprise USD 197K-278KAgents | Cost Optimization | Data Governance | Debugging | EvaluationMid-level Full TimeSan Francisco20h ago
-
AI Deployment Engineer, Digital Natives USD 197K-278KEnterprise Architecture | Generative AI | JavaScript | OpenAI API | Project ManagementHybrid work model | Relocation assistanceSenior-level Full TimeNew York City20h ago
-
AI Deployment Engineer, Digital Natives USD 197K-278KAPI Integration | Enterprise Architecture | Generative AI | JavaScript | OpenAI APIsHybrid work model | Relocation assistanceSenior-level Full TimeSan Francisco20h ago
-
Mid-level Contract Full TimeSan Jose, CA, United States20h ago
-
BI & Data Engineer USD 110K-130KBI Data modeling | BI Gateway | CI/CD | Container Services | DAXHybrid work | Onsite 3 days per week | St Louis onsiteSenior-level Full TimeSt. Louis, MO21h ago
-
Ansible | BGP | Bash | Ceph | Ceph RBDEducation reimbursement | Health plans | Hybrid work model | In-office perks | Parental leave optionsSenior-level Full TimeBellevue, Washington, USA; San Jose, California, …21h ago
-
Sr. Forward Deployed Engineer (FDE) - Public Sector USD 182K-250KAWS | Apache Spark | Azure | CI/CD | DatabricksSenior-level Full TimeWashington, D.C.22h ago