Senior Data Architect - Databricks Platform

Tasks

• Build automation and guardrails for governance
• Conduct cost estimation and FinOps optimization
• Design OLTP OLAP schema evolution strategies
• Design batch and streaming pipelines
• Design workspace consolidation and persona permissioning
• Develop certified data products and semantic layer
• Document architecture decisions and roadmaps
• Enforce architecture documentation and standards
• Ensure scalability and production readiness
• Establish CI CD for platform extension
• Expose lineage and metadata for self service
• Implement configuration as code patterns
• Implement security networking and automation patterns
• Integrate Unity Catalog with metadata repositories
• Lead Databricks platform architecture
• Optimize Spark configurations clusters and Delta Lake storage
• Plan migrations onto Databricks
• Translate business use cases into platform capabilities

Perks/Benefits

• Equipment stipend
• Flexible PTO
• Paid Exam and Certification Support
• Paid travel up to 25%
• Performance bonus awards
• Professional development plan
• Remote work

Skills/Tech-stack

AWS | AWS Glue | Access Control | Apache Spark | CI/CD | Configuration Management | Data Governance | Data product | Databricks | Delta Lake | Delta Lake Storage | Disaster Recovery | FinOps | High Availability | Lakehouse | Lineage | Metadata Management | Networking | OLAP | OLTP | PySpark | Schema evolution | Semantic layer | Structured Streaming | Terraform | Unity Catalog