Data Platform Manager- Hybrid (Applicants must reside in Pittsburgh, PA)
Pittsburgh, PA, United States
R
A USD 172K-237K (estimate) Mid-level Full Time
Tasks
- Build scalable data pipelines
- Conduct code reviews and enforce development standards
- Design enterprise data warehouse platforms
- Design lakehouse architecture with Delta Lake
- Implement data governance and security with Unity Catalog
- Implement data ingestion processing storage and governance best practices
- Implement data quality checks and validation
- Implement data transformations enrichment and quality checks
- Implement medallion architecture bronze/silver/gold
- Integrate CI CD for data pipelines
- Integrate real time and batch sources
- Lead data engineering team
- Operationalize and deploy machine learning models
- Optimize pipeline performance cost and scalability
- Optimize queries and execution plans
- Orchestrate workflows across Azure services
- Oversee batch and streaming ETL ELT pipelines
- Troubleshoot production data incidents
- Tune Spark jobs and Databricks clusters
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Hadoop | Apache Kafka | Apache Spark | Avro | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Unity | Azure Unity Catalog | CI/CD | Data Factory | Data Lake Storage Gen2 | Data Lineage | Databricks | Delta Lake | Key Vault | MLflow | ORC | Parquet | Presto Trino | PySpark | Python | RBAC | SQL | Scala | Unity Catalog | VNet
Education
Regions
Countries
States
Cities
Related jobs
-
Attribution Modeling | Causal Inference | Customer Lifetime Value | Customer Segmentation | Difference-in-differences401k match | Annual bonus | Company equipment provided | Company subsidized medical dental and vision | Disability benefitsSenior-level Full TimeAtlanta, GA preferred, Remote R18h ago
-
Data Science Manager - Sports Pricing USD 160K-190KMachine Learning | Optimization | Python | R | Risk Management401k with company match | Company equipment provided | Company in person events | Company subsidized medical dental vision | Disability benefitsMid-level Full TimeAtlanta, GA preferred, Remote R1d ago
-
Data Science Manager - Market Origination USD 160K-190KData Science | Experimentation | Forecasting | Machine Learning | Predictive Modeling401k match | Annual performance reviews | Career development opportunities | Company equipment | Company in person eventsMid-level Full TimeAtlanta, GA preferred, Remote R1d ago
-
Principal Data Engineer USD 152K-190KApache Spark | Artificial Intelligence | CI/CD | Cloud Platforms | Code Coverage401k company match | Dental insurance | Flexible paid time off | Life insurance | Long-term disabilitySenior-level Full TimeDallas, TX - Hybrid (3x in … R1d ago
-
Analytics Team Lead USD 109K-230KA/B | A/B Testing | B testing | Crime analysis | Data AnalysisBonus eligibility | Remote workSenior-level Full TimeHome based-Florida, United States R1d ago
-
Director, Finance Analytics & Reporting USD 160K-213KAccess Management | Analytics | Business Intelligence | Change Management | Data Modeling401k matching | Dental insurance | Employee stock purchase program | Flexible time off | Health insuranceExecutive-level Full TimeUSA Remote, United States R1d ago
-
Senior-level Full TimeBethesda, MD R1d ago
-
Sr. Manager, Club Analytics & Insights - Remote USD 168K-224KActuarial concepts | Analytics | Business Intelligence | Data Analysis | Data StorytellingSenior-level Full TimeArizona - Home Teleworkers, United States R3d ago
-
Manager, GTM Analytics & Intelligence USD 160K-250KARR Waterfall | B2B SaaS | Data Governance | Data Modeling | Data Pipelines401k | AD D Insurance | Dental insurance | Employee assistance program | FSAMid-level Full TimeRemote, United States R3d ago
-
Senior Data Science Manager USD 258K-293KCausal Inference | Data Storytelling | Experimentation | Machine Learning | Observational InferenceCareer coaching | Fitness benefits | Inclusive family building benefits | Mental health benefits | Retirement savings planSenior-level Full TimeSan Francisco R4d ago
-
API Integration | AWS | Access Control | Azure | BI reportingSenior-level Full TimeHouston, TX, United States R4d ago
-
Engineering Manager, Machine Learning USD 145K-180KData Pipelines | Data Science | Experimentation | Geospatial Data | Machine LearningCoworking stipend | Education budget | Flexible schedule | Home office stipend | Remote workMid-level Full TimeRemote: United States | Canada | … R4d ago
-
Manager, Credentialing and Enrollment Special Projects USD 107K-140KAPI Integrations | Code Automation | Compliance | Data Analysis | Excel401k program | Commuter benefits | Comprehensive health coverage | Equity opportunities | Flexible PTOMid-level Full TimeRemote US R4d ago
-
AWS | Azure | CI/CD | Data Warehousing | DockerFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsSenior-level Full TimeJersey City, NJ, United States R4d ago
-
Manager, Data Engineering - Hybrid Schedule USD 75K-94KAWS | Agile | Apache Airflow | CI/CD | Data Architecture401k match | Company holidays | Discounts with preferred vendors | Employee assistance program | FSAMid-level Full TimeCharlotte, NC, US R4d ago
-
Senior Manager, Workforce Analytics USD 133K-153KAdvanced modeling | Agent Productivity | Agent Productivity Metrics | Capacity Planning | Conversion funnelEmployee growth opportunities | Leadership programs | Mentorship programsSenior-level Full TimeUnited States R4d ago
-
Senior-level Full TimeUnited States - Remote R4d ago
-
Data Engineering Manager - Remote USD 116K-216KAccess Management | Azure Data | Azure Data Lake | Azure Data Lake Storage | Batch Processing401k match | Certification reimbursement | Disability insurance | Emergency backup care | Free access to CEUsSenior-level Full TimeSentara Park 1330, United States R4d ago
-
Manager, Healthcare Analytics USD 107K-199KCause analysis | Change Management | Claims pricing | Contract Analysis | Data Management401k matching | Flexible work arrangements | Health insurance | Holiday pay | Hybrid work optionsMid-level Full TimeRemote-FL, United States R4d ago
-
Cause analysis | Change Management | Claims Payment | Claims pricing | Contract Network Analysis401k | Flexible work schedules | Health insurance | Paid time off | Stock purchase plansMid-level Full TimeRemote-MO, United States R4d ago
-
Quantitative Analytics Manager- Model Risk USD 116K-216KCECL | Cloud Computing | Database Design | Distributed Computing | ETLFlexible work optionsMid-level Full Time127 Public Square, Cleveland, OH, United … R4d ago
-
Principal Marketing Analytics Manager USD 145K-188KAI Automation | B2B Marketing | Data Modeling | Data Transformation | Executive reporting401k match | Dental insurance | Disability insurance | Financial wellness benefits | Flexible PTOSenior-level Full TimeAnywhere in the United States R5d ago
-
Senior Consultant - Data Engineering / Data Architect USD 147K-253KAWS | Analytics | Azure | Cloud Computing | Dashboards401k match | Disability insurance | Hybrid work options after 90 days | Medical/Dental/Vision | Paid HolidaysSenior-level Full TimePhoenix, AZ, US R5d ago
-
Data Platform Engineer III USD 74K-171KAzure | Cloud Computing | Data Governance | Data Lakes | Data ModelingAnnual bonus plan | Competitive benefits package | Healthcare benefits | Professional developmentSenior-level Full TimeRemote, TX, United States R5d ago
-
Senior Manager, AI Engineering (Agent OS Platform) USD 223K-299KAPI Design | Application Architecture | Audit Logging | Audit trails | Cost latency telemetryFlexible time off | Health and wellness | Learning and development opportunities | Remote work flexibilitySenior-level Full TimeUS CA Remote, United States R5d ago