Senior Data Engineer (Customer Data Products)
3750 Market Street, Philadelphia, PA, USA
USD 127K-160K Senior-level Full Time
Tasks
- Build automated scalable test driven data pipelines
- Build data integration pipelines
- Build data lakes
- Code test deploy orchestrate monitor troubleshoot data pipelines
- Coordinate solution design development testing delivery
- Define data engineering processes and procedures
- Develop scalable data solutions
- Document data engineering processes
- Educate and develop ETL developers
- Ensure data integrity and accuracy
- Ensure high data quality for analytics master data management
- Evaluate research and run experiments on batch and streaming data
- Extract, clean, and format structured and unstructured data
- Improve CI CD pipelines in AWS
- Lead adoption of emerging AI and data technologies
- Optimize data platform for analytics
- Prepare LLM data pipelines
- Prepare data for AI ML model training
- Support MLOps tools
Perks/Benefits
- 401k match
- Commuter benefit public transit or parking options
- Dental plans
- Healthcare plans
- Prescription plans
- Remote friendly workplace
- Tuition reimbursement plan
- Vision plans
Skills/Tech-stack
APIs | AWS | AWS Step Functions | Agile | Amazon EMR | Amazon Redshift | Apache Airflow | Apache Hadoop | Apache Hive | Apache Kafka | Apache Spark | As-a-Service | CI/CD | Cassandra | Data Lakes | Data Management | Data Quality | Data Security | Data Warehousing | Data as a Service | Data integration | DataOps | Feature Stores | Git | Java | Kubeflow | LLM | Luigi | MLOps | Machine Learning | MapReduce | Master Data | Master Data Management | MongoDB | NoSQL | PySpark | Python | Real Time | Real-time Data | Release Management | SQL | SQL Optimization | Scala | Shell Scripting | Step Functions | Streaming Data | Unix/Linux | Vector Databases | Vector Search
Education
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R16d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R29d ago
-
Senior-level Full TimeOrlando, FL, United States3h ago
-
AI Center | AI orchestration | Action Center | Agile | AuthenticationMid-level ContractNashville, United States R4h ago
-
Artificial Intelligence/Machine Learning Engineer 1 USD 150K-230KAI Agent | Artificial Intelligence | Documentation | Governance | Language ProcessingHybrid work | On site 3 days per weekMid-level ContractAustin, United States6h ago
-
Senior-level Full TimeAtlanta, Georgia6h ago
-
.NET | AWS | Agile | Angular | AzureSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …6h ago
-
Agent Development | Agent Orchestration | Air-gapped | Air-gapped systems | Cloud ComputingOn-site work | Travel opportunitySenior-level Full TimeWashington D.C., DC, USA; Fort Meade, …8h ago
-
2D Games | 3D Games | Algorithms | Context Assembly | Data StructuresSenior-level Full TimeMountain View, CA, USA8h ago
-
Data Modeling | Database querying | Deep learning | Incrementality testing | Language ProcessingMid-level Full TimeNew York, NY, USA; Mountain View, …8h ago
-
Benchmarking | Computer Vision | Data Mining | Deep learning | Evaluation protocolsSenior-level Full TimeMountain View, CA, USA8h ago
-
Staff Software Engineer USD 110K-165KAWS | Airflow | Automated testing | Bedrock | CI/CDHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeSt. Louis, Missouri, US, 63103-235512h ago
-
Applied AI Engineer, Investments USD 134K-183KAPIs | Cloud Computing | Data Pipelines | Data Quality | Data ValidationEmployer 401k match | Family forming benefits funding | Hybrid work onsite at least 60 percent of the time | Paid time off | Relocation supportNone Full TimeRedwood City, CA (Hybrid) R18h ago
-
Senior Machine Learning Engineer, ML Efficiency USD 216K-303KBenchmarking | Cost Optimization | Distributed Training | GPU Training | Knowledge DistillationCaregiving support | Employer 401k match | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R18h ago
-
Software Engineer, SDLC Analytics USD 175K-300KApache Airflow | Apache Spark | Data Modeling | Data Pipelines | Database technologiesSenior-level Full TimeCupertino; San Diego19h ago
-
Software Engineer, SDLC Analytics USD 175K-300KApache Airflow | Apache Spark | CI/CD | Data Ingestion | Data ModelingSenior-level Full TimeCupertino; San Diego19h ago
-
Applied AI Engineer, GTM Growth Engineering USD 230K-385KAPIs | Data Modeling | Data Pipelines | Evaluation | ExperimentationMid-level Full TimeSan Francisco19h ago
-
Staff Software Engineer, Code RL USD 405K-625KAPI Design | Async Programming | Client Libraries | Concurrency | ContainerizationSenior-level Full TimeSan Francisco, CA | New York …19h ago
-
Edge Computing AI Engineer USD 100K-150KC++ | DSP Toolchains | Device optimization | Device security | Edge inferenceMid-level Full TimeUnited States - Remote R19h ago
-
Generative AI Engineer USD 100K-150KBenchmarks | Dataset Construction | Direct Preference Optimization | Distributed Training | EvaluationCareer growth | Remote workMid-level Full TimeUnited States - Remote R19h ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R19h ago
-
Streaming Data Engineer USD 100K-150KACLs | AWS MSK | Ansible | Apache Flink | Apache KafkaRemote workSenior-level Full TimeUnited States - Remote R19h ago
-
Machine Learning Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageRemote workSenior-level Full TimeUnited States - Remote R19h ago
-
Machine Learning Infrastructure Engineer USD 100K-150KAutoscaling | Batching | C++ | Caching | Capacity PlanningSenior-level Full TimeUnited States - Remote R19h ago
-
Robotics Engineer USD 100K-150KC++ | Concurrent programming | Control | Gazebo | Isaac SimCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R19h ago