Senior Data Engineer (Customer Data Products)
3750 Market Street, Philadelphia, PA, United States
USD 127K-160K Senior-level Full Time
Tasks
- Build data lakes
- Code test deploy and monitor data engineering processes
- Coordinate technical solution design development testing and delivery
- Create automated scalable test driven data pipelines
- Define data engineering processes and procedures
- Develop data integration pipelines
- Educate and develop ETL developers
- Ensure data security integrity and accuracy
- Extract clean and format data for AI ML
- Implement batch and streaming data solutions
- Implement version control with Git
- Improve DataOps tools and frameworks
- Lead evaluation research and experimentation
- Maintain high data quality for analytics and master data management
- Optimize data platform for analytics AI ML
- Orchestrate and troubleshoot data pipelines
- Prepare data for LLM training and feature extraction
- Set up CI CD and release management in AWS
- Support MLOps tooling
Perks/Benefits
- 401k match
- Commuter benefits public transit or parking
- Dental insurance
- Healthcare
- Prescription Coverage
- Remote friendly workplace
- Tuition reimbursement
- Vision insurance
Skills/Tech-stack
AI/ML | API Development | AWS | AWS Step Functions | Airflow | Batch Processing | CI/CD | Cassandra | Data Lakes | Data Pipelines | Data Quality | Data Security | Data integration | ETL | Feature Stores | Git | Hadoop | Hive | Java | Kafka | Kubeflow | LLM | Luigi | MLOps | MapReduce | MongoDB | NoSQL | PySpark | Python | Redshift | Release Management | SQL | SQL Optimization | Scala | Shell Scripting | Spark | Step Functions | Streaming Data | Unix/Linux | Vector Databases
Education
Roles
Regions
Countries
States
Related jobs
-
Acceptance Testing | Business Objects | Cause analysis | Data Visualization | Data WarehousingOn-site work | Security clearance supportSenior-level Full TimeReston, VA; Information Technology3h ago
-
Amazon Redshift | Data Modeling | Data Quality | Data Warehouse | Data Warehouse ArchitectureOnsite work at client site | Paid on time | Potential project extensions | Support from consultantsMid-level Full TimeJuno Beach, FL; Juno Beach, FL; …3h ago
-
Lead Software Engineer / Data Analyst - (MUST be eligible for a TS/SCI security clearance) - 1822 A USD 115K-185K.NET | AWS | Angular | Automated testing | CI/CDEvery other Friday off on 9 80 schedule | Onsite work | Relocation assistanceSenior-level Full TimePatrick Space Force Base, FL3h ago
-
API Design | BigQuery | CI/CD | Chunking | Cloud BuildHybrid work | Local preferred | Onsite 4 days per weekMid-level Full TimeDearborn, United States R5h ago
-
Agent Orchestration | Agentic AI | Airflow | Autogen | BentoMLSenior-level Full TimeCharlotte, United States6h ago
-
Agile | Azure Databricks | Azure Logic | Azure Logic Apps | Azure SynapseEntry-level Full Time InternshipPella, IA, United States6h ago
-
AI Foundry | Agent systems | Agentic AI | Amazon Web Services | Artificial IntelligenceMid-level Full TimeMechanicsburg, Pennsylvania, United States7h ago
-
Intelligent Automation Manager | TS/SCI USD 137K-229KAWS Bedrock | AWS Textract | Agile | Amazon Web Services | Data ArchitectureSenior-level Full TimeRosslyn, Virginia, United States7h ago
-
Senior/Staff LLM Application Engineer - Data Application USD 108K-190KAgentic Systems | Benchmarking | Data Querying | Data analytics | Fine TuningSenior-level Full TimeSan Jose, California, United States7h ago
-
Action Conditioned World Models | C plus plus | Computer Vision | Deep learning | Dexterous ManipulationOpen science contributionsEntry-level Full TimeMenlo Park, CA8h ago
-
AI workflows | Anomaly Detection | Data Architecture | Data Lakehouse | Data StorageSenior-level Full TimeMenlo Park, CA8h ago
-
Research Engineer, Frontier AI, Incubation, DeepMind USD 174K-252KAlgorithm Design | C++ | Compute Optimization | Data Structures | Distributed SystemsEntry-level Full TimeMountain View, CA, USA8h ago
-
C++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA; Pittsburgh, PA, …8h ago
-
Artificial Intelligence | C++ | CSS | Data Storage | Distributed ComputingHealth insurance | Paid time off | Parental leave | Retirement plansSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Senior Data Engineer, gTech Risk USD 156K-226KApache Flume | Apache Spark | Data Modeling | Data Pipelines | Data VisualizationSenior-level Full TimeChicago, IL, USA8h ago
-
Staff Software Engineer, Data Protection USD 207K-300KAccess Control | Big Data | Big data analytics | C# | C++Senior-level Full TimeNew York, NY, USA8h ago
-
Software Engineer, AI/ML, Computer Vision, XR USD 147K-210K3D Reconstruction | Android | Auto-exposure | C++ | Computer VisionMid-level Full TimeSan Jose, CA, USA8h ago
-
Senior Software Engineer, Data Engineering, Cloud AI USD 174K-252KAccess Control | Alerting | Artificial Intelligence | Batch Processing | Cloud StorageSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA8h ago
-
Data Engineer USD 220K-226KC++ | Data Exploration | Data Modeling | Data Visualization | Data pipelineHybrid scheduleMid-level Full TimeMountain View, CA, USA R8h ago
-
Software Engineer, Generative AI, Shopping on Gemini USD 147K-210KBackend Development | C++ | Computer Vision | Data Preparation | Data ProcessingMid-level Full TimePittsburgh, PA, USA; Mountain View, CA, …8h ago
-
AI Solution Security Engineer USD 147K-210KAccess Control | C++ | Cloud Security | Data Flow | Data Flow SecurityMid-level Full TimeChicago, IL, USA8h ago
-
Software Engineer USD 149K-175KAlgorithms | C# | C++ | Cause analysis | Code ReviewsBenefits | Hybrid scheduleEntry-level Full TimeMountain View, CA, USA R8h ago
-
C++ | Clustering | Computer Vision | Data Processing | Data StorageSenior-level Full TimePittsburgh, PA, USA8h ago
-
Software Engineer III, Embedded Systems/Firmware, XR USD 147K-210KAlgorithms | Android | Android HAL | Bootloader | C#Senior-level Full TimeMiami, FL, USA; San Jose, CA, …8h ago
-
Staff Software Engineer, Android Agent USD 207K-300KData Pipelines | Data Processing | Data Structures | Data Structures and Algorithms | Data cleaningSenior-level Full TimeMountain View, CA, USA8h ago