Senior Data Engineer (Customer Data Products)
3750 Market Street, Philadelphia, PA, USA
USD 127K-160K Senior-level Full Time
Tasks
- Build automated scalable test driven data pipelines
- Build data integration pipelines
- Build data lakes
- Code test deploy orchestrate monitor troubleshoot data pipelines
- Coordinate solution design development testing delivery
- Define data engineering processes and procedures
- Develop scalable data solutions
- Document data engineering processes
- Educate and develop ETL developers
- Ensure data integrity and accuracy
- Ensure high data quality for analytics master data management
- Evaluate research and run experiments on batch and streaming data
- Extract, clean, and format structured and unstructured data
- Improve CI CD pipelines in AWS
- Lead adoption of emerging AI and data technologies
- Optimize data platform for analytics
- Prepare LLM data pipelines
- Prepare data for AI ML model training
- Support MLOps tools
Perks/Benefits
- 401k match
- Commuter benefit public transit or parking options
- Dental plans
- Healthcare plans
- Prescription plans
- Remote friendly workplace
- Tuition reimbursement plan
- Vision plans
Skills/Tech-stack
APIs | AWS | AWS Step Functions | Agile | Amazon EMR | Amazon Redshift | Apache Airflow | Apache Hadoop | Apache Hive | Apache Kafka | Apache Spark | As-a-Service | CI/CD | Cassandra | Data Lakes | Data Management | Data Quality | Data Security | Data Warehousing | Data as a Service | Data integration | DataOps | Feature Stores | Git | Java | Kubeflow | LLM | Luigi | MLOps | Machine Learning | MapReduce | Master Data | Master Data Management | MongoDB | NoSQL | PySpark | Python | Real Time | Real-time Data | Release Management | SQL | SQL Optimization | Scala | Shell Scripting | Step Functions | Streaming Data | Unix/Linux | Vector Databases | Vector Search
Education
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R7d ago
-
AWS | Bash | CI/CD | Collibra | Data Governance100 percent onsite | Onsite support in McLean VASenior-level ContractMc Lean, United States8h ago
-
Analytics & Reporting (SAP & Alteryx) USD 90K-150KAlteryx | Alteryx Designer | Alteryx Server | Data Analysis | Data BlendingMid-level Full TimeScott Air Force Base, United States8h ago
-
A/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkSenior-level ContractSanta Monica, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Advanced SQL | Advanced SQL optimization | AirflowEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeFort Lauderdale, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Apache Airflow | Apache Spark | Avro | Columnar StorageFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeRichmond, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Advanced SQL | Advanced SQL optimization | AirflowEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeMiami, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeTexas City, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | AWS SageMaker | Apache Airflow | Apache Spark | AvroFlextime | Mentorship | Personalized growth roadmaps | Professional growth | Remote work optionsSenior-level Full TimeBoca Raton, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | AWS SageMaker | Airflow | Apache SparkEducation budget | Exciting projects | Fitness budget | Flexible schedule with remote and office options | FlextimeSenior-level Full TimeBaltimore, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Amazon S3 | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeIrving, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPIs | AWS | Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeJersey City, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Airflow | Avro | Big DataExciting projects | Flexible schedule | Flextime | Mentorship | Office optionsSenior-level Full TimeOrlando, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Apache Airflow | Apache Scala | Apache SparkExciting projects | Flexible schedule | Global collaboration | Mentorship | Modern solutionsSenior-level Full TimeHouston, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Advanced SQL | Advanced SQL optimization | AirflowEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeTallahassee, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeBlacksburg, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPIs | AWS | Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeDallas, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flextime | Mentorship | Office optionsSenior-level Full TimeWest Palm Beach, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Apache Airflow | Apache Spark | Avro | Cloud platformFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeAustin, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Airflow | Avro | Big Data | Columnar StorageFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Professional growthSenior-level Full TimeLos Angeles, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | AWS SageMaker | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flextime | Mentorship | Office work optionSenior-level Full TimePort Charlotte, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Amazon Web Services | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office option | Personalized growth roadmaps | Professional growthSenior-level Full TimeAtlanta, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Apache Airflow | Apache Spark | Avro | BigQueryEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeJacksonville, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Airflow | Apache Avro | Apache Jupyter | Apache ParquetFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote optionsSenior-level Full TimeBoston, United States9h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPIs | AWS | Airflow | Apache Kafka | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Professional growthSenior-level Full TimeChicago, United States9h ago