Data Platform Manager- Hybrid (Applicants must reside in Pittsburgh, PA)
Pittsburgh, PA, United States
R
A USD 172K-237K (estimate) Mid-level Full Time
Tasks
- Build scalable data pipelines
- Conduct code reviews and enforce development standards
- Design enterprise data warehouse platforms
- Design lakehouse architecture with Delta Lake
- Implement data governance and security with Unity Catalog
- Implement data ingestion processing storage and governance best practices
- Implement data quality checks and validation
- Implement data transformations enrichment and quality checks
- Implement medallion architecture bronze/silver/gold
- Integrate CI CD for data pipelines
- Integrate real time and batch sources
- Lead data engineering team
- Operationalize and deploy machine learning models
- Optimize pipeline performance cost and scalability
- Optimize queries and execution plans
- Orchestrate workflows across Azure services
- Oversee batch and streaming ETL ELT pipelines
- Troubleshoot production data incidents
- Tune Spark jobs and Databricks clusters
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Hadoop | Apache Kafka | Apache Spark | Avro | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Unity | Azure Unity Catalog | CI/CD | Data Factory | Data Lake Storage Gen2 | Data Lineage | Databricks | Delta Lake | Key Vault | MLflow | ORC | Parquet | Presto Trino | PySpark | Python | RBAC | SQL | Scala | Unity Catalog | VNet
Education
Regions
Countries
States
Cities
Related jobs
-
Product Manager, Data & Analytics USD 97K-133KAcceptance criteria | Agile | CI/CD | Dashboarding | Data EngineeringDisability insurance | Education programs | Family support programs | Health insurance | Life insuranceMid-level Full TimeRemote Worker - New Jersey, USA, … R1d ago
-
Manager, Marketing Data Analytics USD 88K-150KCRM | DAX | Data Governance | Data Modeling | Data QualitySenior-level Full TimeRemote - NC, United States R1d ago
-
Data Platform Architect USD 100K-150KAWS | Alation | Amazon Redshift | Apache Hudi | Apache IcebergBenefits package | Career growth | Long-term engagement | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Manager, Forecasting & Analytics USD 140K-160KBias | BigQuery | Business Intelligence | Data Visualization | Demand Planning401k match | Fitness allowance | Flexible time off | Health insurance | Lunch and snacksSenior-level Full TimeRemote, New York City, San Francisco R1d ago
-
Director of Data Engineering & Data Science - IAA USD 175K-272KApache Airflow | Azure | Azure Event | Azure Event Hubs | Azure SynapseExecutive-level Full TimeChicago, IL (Hybrid) R1d ago
-
Staff Technical Lead Manager - AI Data Engine USD 172K-229KAWS | AWS Step Functions | Apache Airflow | Bazel | C++401k match | Dental insurance | Health insurance | Health savings account | Hybrid workSenior-level Full TimePittsburgh, Pennsylvania, United States R1d ago
-
Staff Technical Lead Manager - AI Data Engine USD 172K-229KAWS | AWS Step Functions | Apache Airflow | Bazel | C++401k match | Dental insurance | Health savings account | Hybrid schedule | Life insuranceSenior-level Full TimeBoston, Massachusetts, United States; Remote U.S. R1d ago
-
Principal Snowflake Data Platform Engineer USD 165K-216KAWS | Agile | Ansible | Backup and Resiliency | BashFlexible hybrid work model | Health and life insurance | Paid time off | Retirement benefitsSenior-level Full TimeTX, United States R1d ago
-
AI Governance | AWS | Analytics architecture | BI | Data Architecture401k match | Dental insurance | Employee assistance program | Employer HSA Options | Flexible work scheduleExecutive-level Full TimeTamarac, Florida, United States R1d ago
-
Product Data Analyst (Fintech/Payments) USD 90K-125KAcceptance Testing | Acceptance criteria | Agile | Apache Airflow | CCPACompany volunteer days | Dental insurance | Flex PTO | Health insurance | Paid HolidaysMid-level Full TimeRemote, US R1d ago
-
Field Service Analytics Manager- Dashboards & Insights USD 120K-140KAI | Automation | Data Analysis | Data Modeling | Data VisualizationMid-level Full TimeUS - Remote R1d ago
-
Marketing Analytics & Operations USD 100K-140KAd Spend | Attribution Modeling | Conversion Tracking | Customer Acquisition | Customer Acquisition CostMid-level Full TimeUnited States R1d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Flink | Apache HudiSenior-level Full TimeUnited States - Remote R2d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
Business Intelligence | Cisco | Data Modeling | Data Quality | ETLHybrid workSenior-level Full TimeAZ, Tempe, 2040 West Rio Salado … R2d ago
-
Principal Product Manager, GenAI Landscape Intelligence USD 148K-282KBenchmarking | Competitive Analysis | Data Analysis | Generative AI | LicensingSenior-level Full TimeSan Jose, United States R2d ago
-
Value-Based Programs Lead (Data and Analytics) USD 104K-143KCMS | Data Quality | Data extraction | Data integration | Databricks401k matching | Life insurance | Long-term disability | Medical, dental, vision benefits | Paid time offSenior-level Full TimeRemote US, United States R2d ago
-
Engineer III - Data Analytics (Hybrid) USD 120K-180KAWS | Azure | Billing APIs | CI/CD | Cloud billing401k | Hybrid work schedule | Paid adoption leave | Paid parental leave | Paid time offSenior-level Full TimeUSA NY Remote, United States R2d ago
-
VP, Forward Deployed Data Engineering USD 239K-359KAWS Glue | AWS S3 | Access Control | Airflow | Amazon Redshift401k match | Career development | Dental insurance | Disability insurance | Education benefitExecutive-level Full TimeWash, 213 Washington St., Newark, NJ, … R2d ago
-
Sr Program Manager – Pricing Analytics USD 110K-178KAWS | Alteryx | Artificial Intelligence | Azure | Business Intelligence401k | Dental insurance | Disability insurance | Discounts | Employee stock purchase planSenior-level Full TimeTowson MD USA - 701 E … R2d ago
-
Senior Manager, Data Engineering USD 140K-165KApache Spark | Azure | Azure DevOps | CI/CD | Configuration Driven PipelinesDental insurance | Disability insurance | Flexible spending accounts | Health insurance | Health savings accountsSenior-level Full TimeRemote CW Site - USA - … R2d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
Team Lead, AI Engineering USD 140K-190KAPI Integration | Agent Orchestration | Agent systems | Agile | Code review401k match | Career growth opportunities | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R3d ago
-
Manager, Digital Marketing Analytics USD 90K-105KAttribution Modeling | Audience Segmentation | Customer Lifetime Value | Data Analysis | Data VisualizationMid-level Full TimePortland, OR, US R3d ago