Sr. BI & Data Architect [Fixed Term Contract]

Tasks

• Architect transformation pipelines with Delta Live Tables or Spark
• Build CI CD pipelines for data models
• Build executive dashboards for self service analytics
• Configure Z-Ordering and Liquid Clustering
• Design and implement Unity Catalog structure
• Design partition strategy for performance and cost
• Develop semantic layer models in Omni
• Migrate legacy SQL logic to Databricks Lakehouse
• Optimize Spark query performance using execution plans
• Partner with business stakeholders to define data solutions
• Reduce data skew and optimize join strategies
• Refactor SQL into modular maintainable code
• Translate performance and cost metrics into recommendations

Perks/Benefits

• N/A

Skills/Tech-stack

CI/CD | Databricks | Delta Lake | Delta Lake OPTIMIZE | Delta Live Tables | Delta Live) | Dimensional Modeling | Git | GitHub Actions | Liquid clustering | Omni | Python | SQL | SQL Warehouses | Serverless SQL | Serverless SQL Warehouses | Snowflake Schema | Spark | Star Schema | Unity Catalog | VACUUM | Z-Order