Data Platform Manager- Hybrid (candidates must be living in Pittsburgh, PA)
Pittsburgh, PA, United States
R
A USD 158K-217K (estimate) Mid-level Full Time
Tasks
- Build batch ETL pipelines
- Build streaming ETL pipelines
- Conduct code reviews
- Design Lakehouse architecture
- Develop PySpark transformations
- Develop SQL transformations
- Ensure data integrity and availability
- Ensure development standards
- Gather requirements from stakeholders
- Implement data governance controls
- Implement data lineage tracking
- Implement data quality checks
- Implement medallion architecture
- Integrate ADF pipelines
- Integrate Kafka streaming sources
- Lead data engineering team
- Manage production incidents
- Operationalize and deploy machine learning models
- Optimize query performance
- Orchestrate CI/CD pipelines
- Translate requirements into technical specifications
- Troubleshoot data incidents
- Tune Spark jobs and clusters
Perks/Benefits
- N/A
Skills/Tech-stack
Access control RBAC | Airflow | Apache Hadoop | Apache Kafka | Apache Spark | Auto Scaling | Avro | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Key Vault | CI/CD | Data Factory | Data Lake Storage Gen2 | Data Modeling | Databricks Clusters | Databricks Delta | Delta Lake | Key Vault | MLflow | ORC | Parquet | Powershell | Presto | PySpark | Python | Role-Based Access | Role-Based Access Control | Role-Based Access Control (RBAC) | SQL | Scala | Spark | Trino | Unity Catalog | Virtual Network | Virtual Network VNet
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Attribution Modeling | Causal Inference | Customer Lifetime Value | Customer Segmentation | Difference-in-differences401k match | Annual bonus | Company equipment provided | Company subsidized medical dental and vision | Disability benefitsSenior-level Full TimeAtlanta, GA preferred, Remote R19h ago
-
Data Science Manager - Sports Pricing USD 160K-190KMachine Learning | Optimization | Python | R | Risk Management401k with company match | Company equipment provided | Company in person events | Company subsidized medical dental vision | Disability benefitsMid-level Full TimeAtlanta, GA preferred, Remote R1d ago
-
Data Science Manager - Market Origination USD 160K-190KData Science | Experimentation | Forecasting | Machine Learning | Predictive Modeling401k match | Annual performance reviews | Career development opportunities | Company equipment | Company in person eventsMid-level Full TimeAtlanta, GA preferred, Remote R1d ago
-
Principal Data Engineer USD 152K-190KApache Spark | Artificial Intelligence | CI/CD | Cloud Platforms | Code Coverage401k company match | Dental insurance | Flexible paid time off | Life insurance | Long-term disabilitySenior-level Full TimeDallas, TX - Hybrid (3x in … R1d ago
-
Data Modeling | Data Visualization | Excel | Forecasting | PowerPointHybrid schedule | Professional development | Remote workExecutive-level Full TimeBoston, MA, United States R1d ago
-
Analytics Team Lead USD 109K-230KA/B | A/B Testing | B testing | Crime analysis | Data AnalysisBonus eligibility | Remote workSenior-level Full TimeHome based-Florida, United States R1d ago
-
Director, Finance Analytics & Reporting USD 160K-213KAccess Management | Analytics | Business Intelligence | Change Management | Data Modeling401k matching | Dental insurance | Employee stock purchase program | Flexible time off | Health insuranceExecutive-level Full TimeUSA Remote, United States R1d ago
-
Senior-level Full TimeBethesda, MD R1d ago
-
Sr. Manager, Club Analytics & Insights - Remote USD 168K-224KActuarial concepts | Analytics | Business Intelligence | Data Analysis | Data StorytellingSenior-level Full TimeArizona - Home Teleworkers, United States R3d ago
-
Manager, GTM Analytics & Intelligence USD 160K-250KARR Waterfall | B2B SaaS | Data Governance | Data Modeling | Data Pipelines401k | AD D Insurance | Dental insurance | Employee assistance program | FSAMid-level Full TimeRemote, United States R4d ago
-
Senior Data Science Manager USD 258K-293KCausal Inference | Data Storytelling | Experimentation | Machine Learning | Observational InferenceCareer coaching | Fitness benefits | Inclusive family building benefits | Mental health benefits | Retirement savings planSenior-level Full TimeSan Francisco R4d ago
-
API Integration | AWS | Access Control | Azure | BI reportingSenior-level Full TimeHouston, TX, United States R4d ago
-
Engineering Manager, Machine Learning USD 145K-180KData Pipelines | Data Science | Experimentation | Geospatial Data | Machine LearningCoworking stipend | Education budget | Flexible schedule | Home office stipend | Remote workMid-level Full TimeRemote: United States | Canada | … R4d ago
-
Manager, Credentialing and Enrollment Special Projects USD 107K-140KAPI Integrations | Code Automation | Compliance | Data Analysis | Excel401k program | Commuter benefits | Comprehensive health coverage | Equity opportunities | Flexible PTOMid-level Full TimeRemote US R4d ago
-
AWS | Azure | CI/CD | Data Warehousing | DockerFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsSenior-level Full TimeJersey City, NJ, United States R4d ago
-
Manager, Data Engineering - Hybrid Schedule USD 75K-94KAWS | Agile | Apache Airflow | CI/CD | Data Architecture401k match | Company holidays | Discounts with preferred vendors | Employee assistance program | FSAMid-level Full TimeCharlotte, NC, US R4d ago
-
Senior Manager, Workforce Analytics USD 133K-153KAdvanced modeling | Agent Productivity | Agent Productivity Metrics | Capacity Planning | Conversion funnelEmployee growth opportunities | Leadership programs | Mentorship programsSenior-level Full TimeUnited States R4d ago
-
Senior-level Full TimeUnited States - Remote R4d ago
-
Data Engineering Manager - Remote USD 116K-216KAccess Management | Azure Data | Azure Data Lake | Azure Data Lake Storage | Batch Processing401k match | Certification reimbursement | Disability insurance | Emergency backup care | Free access to CEUsSenior-level Full TimeSentara Park 1330, United States R4d ago
-
Manager, Healthcare Analytics USD 107K-199KCause analysis | Change Management | Claims pricing | Contract Analysis | Data Management401k matching | Flexible work arrangements | Health insurance | Holiday pay | Hybrid work optionsMid-level Full TimeRemote-FL, United States R4d ago
-
Cause analysis | Change Management | Claims Payment | Claims pricing | Contract Network Analysis401k | Flexible work schedules | Health insurance | Paid time off | Stock purchase plansMid-level Full TimeRemote-MO, United States R4d ago
-
Quantitative Analytics Manager- Model Risk USD 116K-216KCECL | Cloud Computing | Database Design | Distributed Computing | ETLFlexible work optionsMid-level Full Time127 Public Square, Cleveland, OH, United … R4d ago
-
Principal Marketing Analytics Manager USD 145K-188KAI Automation | B2B Marketing | Data Modeling | Data Transformation | Executive reporting401k match | Dental insurance | Disability insurance | Financial wellness benefits | Flexible PTOSenior-level Full TimeAnywhere in the United States R5d ago
-
Senior Product Manager for Analytics USD 113K-160KAI Generated Insights | Aggregation Logic | Analytics Partnerships | Anomaly Detection | Customer discoveryHybrid working model | Medical insurance | Office lunch allowance | Paid vacation | Parental leaveSenior-level Full TimeCyprus - Remote R5d ago
-
Airflow | Apache Hadoop | Apache Kafka | Apache Spark | AvroMid-level Full TimePittsburgh, PA, United States R5d ago