Director of Data Engineering & Platform
San Francisco, United States
USD 270K-325K (estimate) Executive-level Full Time
Tasks
- Build and operate data platform
- Collaborate on data certification workflow and access policies
- Coordinate infrastructure dependencies outside Databricks
- Define and maintain gold layer architecture
- Deliver Northstar Lakehouse across Bronze Silver Gold
- Ensure data quality gates and governance controls
- Establish Data Vault 20 pipelines
- Implement medallion architecture
- Lead data engineering and platform function
- Manage CDC ingestion integration with Qlik Replicate
- Manage Databricks platform security configuration
- Monitor pipeline execution and incidents
- Oversee platform and operations reliability
- Own CI CD framework for data pipeline deployment
- Own Databricks platform architecture decisions
- Partner with data products and intelligence teams on gold layer delivery
- Set data quality baseline for Bronze layer
Perks/Benefits
- N/A
Skills/Tech-stack
3NF | AWS | Agile | CDC | CI/CD | Data Quality | Data Vault | Data Vault 2 | Data Vault 2 0 | DataOps | Databricks | Delta Lake | Governance | Incident Management | Medallion Architecture | Qlik Replicate | SQL Warehouse | Unity Catalog
Education
N/A
Regions
Countries
States
Related jobs
-
AWS | Azure | Behavior Driven Design | C# | C++Entry-level Full Time InternshipUSA - FL - 10000 Lake …17h ago
-
Data Engineering Lead USD 125K-166KAWS Batch | AWS CloudFormation | AWS Glue | AWS Lambda | Agile Scrum401k matching | Dental insurance | Flexible schedule | Flexible spending account | Health insuranceSenior-level Full TimeSuitland-Silver Hill, Maryland, United States1d ago
-
Director of Embedded Software USD 200K-258KBluetooth Low Energy | C# | C++ | CI/CD | Embedded SystemsExecutive-level Full TimeBoston MA1d ago
-
Director, Enterprise Procurement Finance & Analytics USD 157K-210KBudgeting | Business Intelligence | Cash Flow | Cash Flow Forecasting | Contract ManagementExecutive-level Full TimePittsburgh, PA, US1d ago
-
Agile | Amazon Redshift | Apache Airflow | Apache Spark | Azure SynapseSenior-level Full TimeAtlanta, Georgia, United States2d ago
-
ClaimsXM Data Engineer III USD 125K-140KAnalysis Services | Azure | Azure Data | Azure Data Factory | Data Cleansing401k employer match | Health insurance | Paid Holidays | Paid Long Term Disability | Paid Short Term DisabilitySenior-level Full TimeUnited States2d ago
-
Senior Manager, Data Engineering USD 175K-220KAWS | Apache Iceberg | Apache Spark | Argo | CI/CDContinuous learning | Hybrid work | Leadership development | Professional certifications | Quarterly perks programSenior-level Full TimeAlpharetta, GA2d ago
-
AWS QuickSight | DBT | Data Analysis | Data Modeling | Data Quality401k benefits | Baby bonding leave | Commuter benefits | Dental insurance | Disability insuranceMid-level Full TimeUS Remote R2d ago
-
Senior Director, Data USD 194K-432KCCPA | Data Governance | Data Lake | Data Quality | Data SecuritySenior-level Full TimeSan Francisco, CA2d ago
-
Senior Engineer, Platform & Data USD 150K-200KAWS | Concurrency | Consistency | Containerization | Data Management401k | Employee insurance coverage | Flexible PTO | Stock optionsSenior-level Full TimeSanta Clara R2d ago
-
Sr Manager, Data Engineering USD 135K-170KAgile | Amazon Web Services | Azure | Cloud Computing | Cost OptimizationSenior-level Full TimeClearwater, FL, United States3d ago
-
Director of Analytics USD 140K-160KA/B | A/B Testing | Adobe Analytics | Adobe Data Collection | Attribution Modeling401k match | Commuter benefits | Dental insurance | Disability coverage | Health insuranceExecutive-level Full TimeBoston, Massachusetts, United States R3d ago
-
Data & Analytics Engineering Manager USD 185K-200KA/B | A/B Testing | AI tools | Agile | Alert triageSenior-level Full TimeNew York, NY R3d ago
-
UIGTM Analytics Executive Director USD 200K-301KBusiness Intelligence | Customer Data | Customer Data Management | Dashboarding | Data GovernanceFinancial benefits | Health and wellness benefitsExecutive-level Full TimeUS (non-CA) Off-Site Office, US (non-CA) …3d ago
-
Agentic AI | Attribution Modeling | Bayesian Methods | BigQuery | CalibrationExecutive-level Full Time135 W 26th Street, New York, … R3d ago
-
Director, AI & Agentic Engineering CAD 200KAI Foundry | AWS Bedrock | Amazon Web Services | CI/CD | Cloud platformExecutive-level Full Time135 W 26th Street, New York, …3d ago
-
Sr. Databricks Consultant - Secret Clearance USD 175K-250KAWS S3 | Agile | Amazon Kinesis | Apache Kafka | Apache SparkSenior-level Full TimeWork from home, VA, United States3d ago
-
Data Engineering Manager, Sr USD 98K-199KAgile | Cloud Platforms | Continuous Improvement | Data Architecture | Data Engineering401k | Continuing education | Dental insurance | Employee assistance program | Medical insuranceMid-level Full TimeLake Elmo, MN, United States3d ago
-
Executive-level Full TimeRemote, United States3d ago
-
Director, Data Analytics USD 140K-185KAutomation | BigQuery | DBT | Dashboarding | Data QualityEquity program | Health insurance | Life insurance | Paid time off | Retirement benefitsExecutive-level Full TimeUSA, United States3d ago
-
Data Architecture/Data Fabric Senior Manager - Utilities USD 132K-338KAPI Architecture | Azure Synapse | Cloud Data | Cloud Data Platforms | Data Architecture401k plan | Bonus opportunities | Dental insurance | Life insurance | Long-term disabilitySenior-level Full TimeChicago, Accenture Tower, Corp, United States3d ago
-
Data Architecture/Data Fabric Manager - Utilities USD 94K-293KAPI | Active metadata | Azure Synapse | BigQuery | Cloud Data401k plan | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeSeattle, 1191 2nd Avenue, Corp, United …3d ago
-
Associate Director Systems and Analytics USD 200K-276KCash Collections | Data Analysis | Data Visualization | Data reporting | ExcelHybrid work modelMid-level Full TimePalo Alto, CA, United States R3d ago
-
Senior Director, Marketing Data Architecture USD 193K-224KAPI Integration | Access Control | Adobe Experience | Adobe Experience Platform | Apache ParquetSenior-level Full TimeUS - GA - Atlanta, United …3d ago
-
Director, Marketing Data Engineering USD 169K-200KApache Spark | Automated testing | Azure Data | Azure Data Factory | Azure Data LakeExecutive-level Full TimeUS - GA - Atlanta, United …3d ago