Data Engineer Associate - Asset Management Group (PySpark, Hadoop, SQL)
Two PNC Plaza (PA374), United States
USD 45K-142K Mid-level Full Time
Tasks
- Build and support data ingestion pipelines
- Design data service infrastructure
- Develop and maintain data pipelines
- Document data and promote data to production
- Implement data solutions for scalability availability maintainability
- Manage data governance and metadata
- Perform data requirement analysis
- Support data validation and quality checks
- Transform and migrate data
- Write optimized SQL queries
Perks/Benefits
- 401k match
- Dental insurance
- Educational assistance
- Health insurance
- Paid time off
- Vision insurance
- Wellness program
Skills/Tech-stack
Agile | Alation | Data Documentation | Data Governance | Data Ingestion | Data Migration | Data Pipelines | Data Quality | Data Security | Data Transformation | Data Validation | HDFS | Hadoop | Hive | Impala | Metadata Management | PySpark | SQL | Source-to-Target Mapping | Spark | Sprint Planning | Target Mapping
Education
Roles
Related jobs
-
Computer Scientist III USD 91K-135KC++ | Communication links | Configuration Management | Database Design | Development Lifecycle401k match | Dental insurance | Disability insurance | Health insurance | Health savings accountSenior-level Full TimeNorth Las Vegas, NV, United States5h ago
-
CLOUD SOFTWARE ENGINEER - Big Data Cloud - 8+ yrs of Experience - TS/SCI w/Poly clearance is required - TB A USD 213K-219KAngular | Apache Lucene | Apache NiFi | Apache Solr | Aspect Oriented Design401k retirement plan | AD D Insurance | Dental plan | Federal Holidays | Floating holidaysSenior-level Full TimeAnnapolis Junction, United States7h ago
-
Senior Software Engineer, Database Acceleration USD 212K-450KApache Flink | Apache Spark | Big Data | Cloud Native | Data LakeSenior-level Full TimeSan Jose, California, United States10h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud USD 183K-265KAccelerators | C++ | Cloud Architecture | Data Pipelines | Distributed TrainingTravelSenior-level Full TimeAddison, TX, USA; Washington D.C., DC, …11h ago
-
Data engineer , Machine Learning USD 170K-240KApache Airflow | Apache Spark | Audio Data | Coverage monitoring | DagsterEmployee Assistance Program (EAP) | Employer matching 401k | Health, dental, vision insurance | Unlimited PTOMid-level Full TimeSan Francisco16h ago
-
Data Platform Engineer II USD 100K-113KAzure Data | Azure Data Factory | Azure Key Vault | Azure Managed | Azure Managed IdentitiesDental insurance | Disability insurance | Health insurance | Life insurance | Unlimited paid time offMid-level Full TimeNeedham, MA16h ago
-
Senior Data Engineer USD 160K-207KDBT | Data Architecture | Data Governance | Data Observability | Data Quality401k match | Dental insurance | Equity | Family planning resources | Flexible vacation daysSenior-level Full TimeRemote - USA R18h ago
-
Machine Learning Engineer USD 138K-183KAWS | Airflow | Amazon Redshift | Amazon SageMaker | Apache Flink401k retirement savings | Health care insurance | Occasional travel for meetings | Paid parental leave | Paid sick timeMid-level Full TimeRemote - US R19h ago
-
Staff Data Engineer USD 160K-207KAnomaly Detection | DBT | Data Governance | Data Modeling | Data Quality401k match | Dental insurance | Family planning resources | Flexible vacation policy | Fully remoteSenior-level Full TimeRemote - USA R20h ago
-
Senior Software Engineer, Data Engineering USD 164K-227KAWS | AWS Glue | Amazon EMR | Amazon Redshift | Apache Airflow401k match | Backup Child Care | Backup elder care | Backup pet care | Chime days paid time offSenior-level Full TimeSan Francisco, CA, USA21h ago
-
Database Engineer USD 162K-203KAWS | Backup and Restore | C++ | Cost Optimization | Data WarehouseCommuter stipend | Generous PTO | Health, dental, vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; New York, NY21h ago
-
Sr Analyst, Data Engineer USD 76K-143KAPI Integration | AWS | Agile | Batch Processing | CI/CD401k match | Business Casual Attire | Dental insurance | Health insurance | Hybrid work optionSenior-level Full TimeOhio - Columbus, Three Nationwide Plaza, … R22h ago
-
Data Engineer (Denver, Colorado, USA) USD 120K-150KApache Spark | Data Engineering | Data Governance | Data Pipelines | Data Quality401k retirement plan | Client-facing work | Health insurance | Paid vacationSenior-level Full TimeDenver, Colorado, United States22h ago
-
Mid-level Full Time3401 WEST END AVE (LOC00541), United … R22h ago
-
Sr Data Visualization Developer, Investments USD 125K-152KAgile | DAX | DevOps | MDX | Power BI401k match | Adoption Assistance | Dental insurance | Medical insurance | Paid parental leaveSenior-level Full TimeCharlotte - Remote, United States R22h ago
-
.NET | API Integration | AWS | Agile | Audit LoggingSenior-level Full TimeGreenville, United States22h ago
-
Analytics Engineer USD 81K-141KData Pipelines | Data Preprocessing | Data Quality | Data Security | Data WarehousingEntry-level Full TimeUnited States - Sylmar : 15900 …22h ago
-
Senior-level Full TimeBoston, United States22h ago
-
Senior ML/AI Engineer USD 114K-227KA/B | A/B Testing | AWS | Anomaly Detection | Azure401k matching | Disability insurance | Employee assistance program | Gym membership reimbursement | Healthcare coverageSenior-level Full TimeRichmond, Virginia, United States22h ago
-
Director, Principal AI Engineer USD 193K-257KAWS | AWS Bedrock | Agile | Azure | Azure OpenAI401k plan | Dental insurance | Employee assistance program | Flexible work options | Health insuranceSenior-level Full TimeSeattle 400 Dexter - WA, United …22h ago
-
Analytics Engineer USD 81K-141KBig Data | Compliance | Data Modeling | Data Preprocessing | Data QualityEntry-level Full TimeUnited States - Sylmar : 15900 …22h ago
-
Senior Analytics Engineer USD 87K-161KCI/CD | Data Lakehouse | Data Modeling | Data Pipelines | Data mesh401k plan | Health insurance | Hybrid work options | Paid time off | Remote work optionsSenior-level Full TimeRemote-MO, United States R22h ago
-
Senior Data Engineer USD 114K-227KAlerting | Anomaly Detection | Apache Spark | Data Modeling | Data ObservabilityCaregiver support | Disability insurance | Employee assistance program | Gym membership reimbursement | Life insuranceSenior-level Full TimeRichmond, Virginia, United States22h ago
-
Data Engineer USD 135K-178KAWS Glue | AWS Lambda | AWS S3 | Amazon Redshift | Apache Airflow100 percent remote | Federal clearance requiredSenior-level Full TimeUnited States - Remote R22h ago
-
Principal Machine Learning Engineer USD 190K-404KAWS | Agent systems | Airflow | Azure | Big Data401k company match | Company paid disability benefits | Dental insurance | ESPP | Fertility benefitsSenior-level Full TimeCA HQ, United States22h ago