Senior ETL Developer - Assistant Vice President
3800 CITIGROUP CENTER DRIVE BUILDING G TAMPA, United States
USD 96K-145K Senior-level Full Time
Tasks
- Design and implement Spark applications for data processing in HDFS
- Develop ETL pipelines in Spark using Python
- Ingest clean and transform large datasets
- Integrate Spark applications with Hive and Sqoop
- Load data into HDFS from multiple sources
- Monitor job logs and Spark UI
- Optimize Spark jobs for performance and resource usage
- Troubleshoot debug Spark job failures
- Tune memory management caching and partitioning
Perks/Benefits
- 401k
- Life, accident, and disability insurance
- Medical, dental, and vision insurance
- Paid Holidays
- Paid time off
- Wellness programs
Skills/Tech-stack
Apache Spark | Caching | Data Aggregation | Data Ingestion | Data Transformation | Data cleaning | ETL | HDFS | Hadoop | Hive | Memory Management | Partitioning | Python | Spark UI | Sqoop
Education
Roles
Data Engineer | Developer | ETL Developer | Engineer | Senior ETL Developer
Related jobs
-
AI Engineer USD 165K-240KAPI Design | AWS | Agentic Workflows | Asynchronous processing | BM25401k enrollment | Gym membership stipend | Health coverage | Hybrid work environment | Paid HolidaysSenior-level Full TimeNew York8h ago
-
Senior Embedded Software Engineer (C++) USD 141K-224KAutomated testing | C++ | CI/CD | CMake | Computer VisionCompany holidays | Health insurance | Life insurance | Long-term disability | Paid parental leaveSenior-level Full TimeTorrance, California, United States9h ago
-
Compression | Computer Vision | CoreML | Data Curation | Dense PredictionCommute subsidy | Employee resource groups | Employee stock ownership | Generous vacation and personal days | Global employee assistance programSenior-level Full TimeSan Francisco, CA, USA10h ago
-
Senior Machine Learning Engineer USD 130K-160KData Pipelines | Deep learning | Distributed Training | Experimentation | Feature Engineering401k plan | Company paid life insurance | Company-Provided Technology Package | Health savings account | Hybrid workSenior-level Full TimeSan Francisco R10h ago
-
Senior Data Engineer - AI USD 147K-198KAmazon Kinesis | Amazon Redshift | Apache Airflow | Apache Flink | Apache IcebergHybrid work model | Onsite two days per weekSenior-level Full TimePennsylvania-Remote, United States R10h ago
-
Data Infrastructure Engineer (contract) USD 126K-136KAlways On | Always On Availability | Always On Availability Groups | Availability Groups | CentOSMid-level ContractMountain View, CA10h ago
-
Senior AI Integrations Engineer USD 115K-173KC# | C++ | CPU caches | Compression | Data-Oriented ProgrammingCommute subsidy | Comprehensive health life and disability insurance | Employee resource groups | Employee stock ownership | Generous vacation and personal daysSenior-level Full TimeRemote, Washington, USA R10h ago
-
Senior Software Engineer - Data Clean Room/ AI Data Hub USD 200K-287KAI/ML | Cloud Computing | Data Privacy | Database systems | Developer APIsSenior-level Full TimeUS-WA-Bellevue11h ago
-
Senior AI Engineer - Customer Agent USD 148K-222KAWS | Alembic | Amazon SQS | Apache Spark | Asynchronous processingSenior-level Full TimeBoston, MA11h ago
-
Sr. Lead AI Engineer USD 216K-324KAWS | Alembic | CI/CD | Celery | DjangoCross hub collaboration | Health and wellbeing benefits | Hybrid work 3x/week | Mentorship | Professional developmentSenior-level Full TimeBoston, MA11h ago
-
Senior Machine Learning Engineer, Search Relevance USD 211K-263KA inverted indexes | A/B | A/B Testing | B testing | C++Senior-level Full TimeRedwood City, CA11h ago
-
AI Solutions Engineer USD 106K-171KAPIs | Alteryx | Analytics | Automation | Content GenerationDiscretionary paid time off | Emotional & mental wellness support | Employee resource groups | Fitness programs | Learning and development programsMid-level Full TimeScottsdale, Arizona, United States R12h ago
-
Staff Software Engineer, Machine Learning (Health) USD 170K-230KAPIs | AWS | Batch Processing | CI/CD | Cloud platformSenior-level Full TimeBoston, MA12h ago
-
Senior Solution Engineer USD 165K-216KAI code generation | Analytics | Cloud Computing | Code generation | Data Architecture401k | Flexible PTO | Health, dental, vision insurance | Professional development budgetSenior-level Full TimeUS-NY-New York12h ago
-
Lead, Finance Analytics & Enablement AI/ML USD 140K-225KAmplitude | Automation | Business Intelligence | Cloud platform | Data Governance401k plan | Co-working access | Disability insurance | Employer paid dental | Employer paid visionSenior-level Full TimeBoston - Remote R12h ago
-
Lead, Finance Analytics & Enablement AI/ML USD 400K-500KAmplitude | Automation | Business Intelligence | Cloud platform | Data Engineering401k plan | Co-working space access | Disability insurance | Flex Spending Account | Health reimbursement accountSenior-level Full TimeNew York - Remote R12h ago
-
Senior AI/ML Engineer USD 125K-156KAWS | Access Control | Agent Orchestration | Apache Spark | CI/CD401k | Commuter benefits | Disability insurance | Employee referral program | Fertility care benefitsSenior-level Full TimeUS Remote R12h ago
-
Analytics Engineer (Remote) USD 104K-170KAWS | Apache Airflow | CI/CD | Containerization | Docker401k match | Flexible time off | Medical/Dental/Vision insurance | Paid Holidays | Remote work flexibilityMid-level Full TimeUnited States, UNITED STATES, United States R12h ago
-
APIs | AWS | Batch inference | Data Pipelines | Distributed Systems11 paid holidays | 401k employer matching | Basic life insurance | Commuter benefits match | Disability insuranceMid-level Full TimeSan Francisco, CA12h ago
-
Principal Data Engineer - AI USD 147K-198KAmazon Kinesis | Amazon Redshift | Apache Airflow | Apache Flink | Apache IcebergHybrid work onsite two days per weekSenior-level Full TimePennsylvania-Remote, United States R12h ago
-
Benchmarking | CI | CUDA | Chrome GPU Tracing | Compute ShadersCommute subsidy | Comprehensive health insurance | Disability insurance | Employee assistance program | Employee resource groupsSenior-level Full TimeSan Francisco, CA, USA13h ago
-
Senior Machine Learning Engineer USD 146K-180KAWS | AWS Lambda | Agile | Amazon Athena | Amazon BedrockMentorship | Onboarding support | Remote workSenior-level Full TimeUnited States13h ago
-
Staff Machine Learning Engineer, Notifications Relevance USD 230K-322KGenerative AI | Golang | Language Models | Large Language Models | Machine Learning401k employer match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R13h ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | Cloud Composer | Cloud Data | Cloud Dataflow401k retirement program | Annual incentive program | Dental insurance | Disability insurance | Flexible time offMid-level Full TimeLisle, IL, United States R14h ago
-
Staff Machine Learning Engineer USD 119K-196KAsync Python | BigQuery | CI/CD | Causal Inference | Cloud RunSenior-level Full TimeNew York,US-NY,United States R14h ago