Data Engineer – Big Data Platform
Two PNC Plaza (PA374), United States
USD 86K-172K Mid-level Full Time
Tasks
- Automate optimize and right size data systems
- Build analytics solutions
- Build data lakehouse solutions
- Design and build scalable data platform
- Implement platform operations best practices
- Implement process improvements using analytics
- Improve query performance and data structures
- Maintain data platform performance
- Migrate user data to unified data platform
- Modernize Hadoop systems to cloud
- Monitor data platform health
- Review platform architecture
- Translate business requirements into technical solutions
Perks/Benefits
- 401k match
- Dental insurance
- Educational assistance
- Health insurance
- Paid time off
- Pension plan
- Stock purchase plan
- Vision insurance
- Wellness program
Skills/Tech-stack
AWS | Apache Airflow | Apache Iceberg | Automation | Azure | Big Data | Cloud Native | Data Architecture | Data Lakehouse | Data Migration | Data Transformation | Hadoop | Performance Tuning | Python | SQL | Scala | Spark | Trino
Education
Roles
Related jobs
-
Mid-level Full TimeHerndon, VA; Information Technology; Beavercreek, OH; …6h ago
-
Cloud Software Engineer III USD 180K-250KAnsible | Apache Superset | CentOS | Elasticsearch | GrafanaSenior-level Full TimeAnnapolis Junction, MD; Laurel, MD; Annapolis …6h ago
-
Software Engineer 2 - (Python, LLM, Machine Learning) USD 201K-246KAPI Integration | AWS | Agentic Workflows | Azure | CrewAI401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland R6h ago
-
AWS | CI/CD | Docker | Kubernetes | LLM401k match | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, MD6h ago
-
Amazon Web Services | PySpark | Python | Web Services401k contribution | Full healthcare | Generous PTOMid-level Full TimeAnnapolis Junction, MD6h ago
-
AI/ML | AKS | Audit Logs | Azure DevOps | Azure MonitoringLocal only candidates required | Onsite 2 days per week | Remote 3 days per weekSenior-level Full TimeAustin, TX R6h ago
-
Data Analyst & Technical Developer USD 116K-150KDAX | Data Modeling | Data Pipelines | Power Automate | Power BIActive secret clearance | Cross-functional collaboration | Top secret clearance eligibilitySenior-level Full TimeWright-Patterson Air Force Base, OH, USA7h ago
-
Code-Review and the Applicability of LLM Graduate Assistant (Software Eng. and Data Mining with Dr. Rahman) USD 38K-46KC++ | Data Mining | GitHub | Java | Machine LearningEntry-level Part TimeErie, Pa9h ago
-
Senior Data Engineer USD 114K-164KAzure DevOps | Azure Synapse | CI/CD | Data Governance | Data QualitySenior-level Full TimeSan Diego9h ago
-
Analytics and Insights Engineer II USD 84K-140KAlgorithm Development | DAX | Databricks | Entity Resolution | Language ProcessingEntry-level Full TimeRosslyn, Virginia, United States10h ago
-
Palantir AI and Data Science Engineer USD 84K-121KAgile | Cloud Computing | Data Engineering | Data Modeling | Data VisualizationEntry-level Full TimeHuntsville, Alabama, United States10h ago
-
Sr Data Engineer USD 130KAmazon Kinesis | Automation | Data Governance | Data Lake | Data PipelinesSenior-level Full TimeEstero, FL, United States10h ago
-
Production Systems Engineer, AI Systems USD 147K-208KAutomated Provisioning | Automated remediation | DAC | Data Visualization | DriversSenior-level Full TimeMenlo Park, CA11h ago
-
Senior Software Engineer, AI/ML, YouTube USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA11h ago
-
Senior Software Engineer, Agentic AI, AIR USD 174K-252KComputer Vision | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA; New York, …11h ago
-
C++ | Computer Vision | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeBoulder, CO, USA11h ago
-
ATA | Algorithms | C# | C++ | Data StructuresSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Staff Software Engineer, AI/ML, Search Ads USD 207K-300KAgentic AI | C++ | Data Processing | Data Quality | Deep learningSenior-level Full TimeMountain View, CA, USA11h ago
-
Agent systems | Apache Beam | Artificial Intelligence | Autonomous Agents | Autonomous ReasoningMid-level Full TimeLondon, UK; Mountain View, CA, USA11h ago
-
Software Engineer, AI/ML, Full Stack, Search Ads USD 147K-210KA/B | A/B Testing | Agentic AI | B testing | C++Mid-level Full TimeMountain View, CA, USA11h ago
-
Staff Software Engineer, Network Health USD 207K-300KAnomaly Detection | Automated remediation | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Customer Engineer, Databases, Google Public Sector USD 152K-221KAnalytical workloads | Cloud Computing | Cloud Native | Cloud Native Architecture | Cloud platformSenior-level Full TimeReston, VA, USA; Washington D.C., DC, …11h ago
-
Novel AI Lead Methodologist USD 171K-247KAutomation | Data Analysis | Data Manipulation | Experiment design | Language ProcessingSenior-level Full TimeWashington D.C., DC, USA; Atlanta, GA, …11h ago
-
AI machine learning | Algorithms | C++ | Data Analysis | Data StructuresSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA11h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL11h ago