Data Platform Manager- Hybrid (candidates must be living in Pittsburgh, PA)
Pittsburgh, PA, United States
R
A USD 158K-217K (estimate) Mid-level Full Time
Tasks
- Build batch ETL pipelines
- Build streaming ETL pipelines
- Conduct code reviews
- Design Lakehouse architecture
- Develop PySpark transformations
- Develop SQL transformations
- Ensure data integrity and availability
- Ensure development standards
- Gather requirements from stakeholders
- Implement data governance controls
- Implement data lineage tracking
- Implement data quality checks
- Implement medallion architecture
- Integrate ADF pipelines
- Integrate Kafka streaming sources
- Lead data engineering team
- Manage production incidents
- Operationalize and deploy machine learning models
- Optimize query performance
- Orchestrate CI/CD pipelines
- Translate requirements into technical specifications
- Troubleshoot data incidents
- Tune Spark jobs and clusters
Perks/Benefits
- N/A
Skills/Tech-stack
Access control RBAC | Airflow | Apache Hadoop | Apache Kafka | Apache Spark | Auto Scaling | Avro | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Key Vault | CI/CD | Data Factory | Data Lake Storage Gen2 | Data Modeling | Databricks Clusters | Databricks Delta | Delta Lake | Key Vault | MLflow | ORC | Parquet | Powershell | Presto | PySpark | Python | Role-Based Access | Role-Based Access Control | Role-Based Access Control (RBAC) | SQL | Scala | Spark | Trino | Unity Catalog | Virtual Network | Virtual Network VNet
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Product Manager - Data & Analytics USD 110K-145KAgile | Amazon Web Services | Cloud Computing | Cloud platform | Data Architecture401k | Dental insurance | Discounts | Medical insurance | Paid leaveMid-level Full TimeUniversal City, CALIFORNIA, United States R11h ago
-
Senior Manager, Marketing Analytics & Operations USD 145K-155KA/B | A/B Testing | Ad Spend | Ads API | Airbyte11 paid holidays | 401(k) plan match | Employee assistance program | Employee discounts | Employee ownership programSenior-level Full TimeRemote United States R16h ago
-
Technical Lead, Data Platform [Hybrid] USD 120K-201KAPI | AWS | AWS CDK | Agile | Airflow401k matching | Buddy programs | Health coverage | Learning and career development | Mentorship programsSenior-level Full TimeSan Diego, CA, United States R1d ago
-
Associate Director, Data Science USD 160K-297KADME | Data Analysis | Data Mining | Data Visualization | Deep learning401k match | Disability benefits | Health benefits | Hybrid work | Life benefitsMid-level Full TimeCambridge (USA), United States R1d ago
-
Biostatistical Programming Manager USD 129K-174KADaM | Pinnacle 21 | Python | R | SAS BaseAward-winning time-off plans | Comprehensive benefits package | Discretionary annual bonus program | Flexible spending accounts | Flexible work modelsMid-level Full TimeUS - California - Thousand Oaks … R1d ago
-
AVP, Medicare Quality Analytics USD 149K-224KAzure | Data Governance | Data Lake | Data Quality | Data ValidationInnovation opportunities | PST schedule flexibility | Professional growth | Remote workExecutive-level Full TimeRemote CA Outside Bay Area, United … R1d ago
-
Senior-level Full TimeCanada R3d ago
-
Manager, Sales Operations and Analytics USD 140K-160KAI | Business Intelligence | Data Governance | Data Modeling | ExcelMid-level Full TimeUS PA Pittsburgh Gamma, United States R4d ago
-
Senior-level Full TimeUnited States - Remote R4d ago
-
Adobe Analytics | Adobe Customer Journey | Adobe Customer Journey Analytics | Adobe Experience | Adobe Experience CloudDiscretionary bonus eligibility | Flexible schedule | Team aligned flexibility | Work from home flexibilityMid-level Full TimeUSA-MN-Minneapolis-801 Nicollet Mall, United States R4d ago
-
Access Control | Artificial Intelligence | B2B SaaS | Data Governance | Data SecurityRemote workMid-level Full Timeremote, United States R4d ago
-
Senior Program Manager, Contracts & Analytics USD 148K-175KAI Automation | API Integrations | Automation | Backlog prioritization | Build vs BuySenior-level Full TimeRemote - USA R5d ago
-
Manager, Statistical Analysis - W&H USD 155K-170KAI | Data Analysis | Data Automation | Data Quality | Data quality controlFully remote | Professional developmentMid-level Full TimeLos Angeles, United States R5d ago
-
Cons-Tech Cons-AI and Quan Modelling-A I Data Scientist - Manager - Multiple Positions - 1717977 USD 169K-169KAgile | Azure DevOps | Cloud Computing | Containerization | Data Mining401k plan | Continuous learning | Dental coverage | Flexible vacation policy | Hybrid work modelMid-level Full TimeHoboken, NJ, US, 07030 R5d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Atlan | BigQuery | Cloud ComputingSenior-level Full TimeUnited States - Remote R5d ago
-
Data Platform Architect USD 100K-150KAWS | Access Management | Alation | Atlan | Azure100 percent remote work | Career growth potentialSenior-level Full TimeUnited States - Remote R5d ago
-
Data Platform Architect USD 100K-150KAWS | Access Management | Alation | Amazon Redshift | Apache FlinkRemote workSenior-level Full TimeUnited States - Remote R5d ago
-
Data Platform Architect USD 100K-150KAccess Management | Amazon Redshift | Apache Hudi | Batch Processing | BigQuery100 percent remote | Full-time W2 employment | H1B transfer supportSenior-level Full TimeUnited States - Remote R5d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Flink | Apache HudiCareer growth | Remote workSenior-level Full TimeUnited States - Remote R5d ago
-
Data Platform Architect USD 100K-150KAccess Control | Access Management | Alation | Amazon Redshift | Apache FlinkSenior-level Full TimeUnited States - Remote R5d ago
-
Associate Business Operations Analyst USD 90K-134KArtificial Intelligence | Automation | Business Analysis | Communication | DBTEmployee assistance program | Healthcare insurance | Life insurance | Paid Company Holidays | Pension/retirement matchingMid-level Full TimeU.S. Remote R5d ago
-
Director, Data Platform USD 170K-225KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageHybrid work | Remote 2 days per week | Supportive collaborative environment | Travel to client sitesExecutive-level Full TimeAtlanta; Boston; Charlotte; Chicago; Dallas; Los … R5d ago
-
Lead, Finance Analytics & Enablement AI/ML USD 400K-500KAmplitude | Automation | Business Intelligence | Cloud platform | Data Engineering401k plan | Co-working space access | Disability insurance | Flex Spending Account | Health reimbursement accountSenior-level Full TimeNew York - Remote R5d ago
-
Senior Financial Analytics Advisor-Remote USD 105K-143KAlteryx | Analytics reporting | Artificial Intelligence | Automl | BigQuery100 percent remote work | Comprehensive benefit plans | Continuing education | Dental insurance | FSASenior-level Full TimeRochester, MN, United States R5d ago
-
Artificial Intelligence | Data Analysis | Data Quality | Data Wrangling | Data quality assessmentRemote workSenior-level Full TimeThousand Oaks, CA R5d ago