DataBricks Data Architect
A CAD 160K-233K (estimate) Senior-level Full Time
Tasks
- Automate notebook job and cluster deployments
- Configure Azure Databricks clusters
- Implement Lakehouse architecture
- Implement Unity Catalog governance
- Implement data masking encryption and audit logging
- Implement incremental data processing
- Integrate workflows into CI CD pipeline
- Maintain data lineage and access controls
- Manage GIT/source control
- Optimize Spark jobs and ETL
- Own data platform architecture
- Profile PySpark code and refactor
- Recommend performance and cost optimizations
- Tune Databricks SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
Active Directory | Apache Spark | Audit Logging | Auto Scaling | Azure | Azure Active Directory | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Key Vault | Azure Pipelines | Azure Synapse | Azure Synapse Analytics | Blob Storage | CI/CD | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data masking | Databricks | Databricks Lakehouse | Databricks SQL | Databricks Unity Catalog | Delta Lake | ETL | Encryption | Git | Infrastructure as Code | Key Vault | MLflow | PySpark | Python | SQL | Spark SQL | Synapse Analytics | Terraform | Unity Catalog | “as-code”
Education
Roles
Related jobs
-
AI Solution Architech CAD 126K-155KAPI Security | AWS | Agent Orchestration | Azure | Data GovernanceSenior-level Full TimeCanada - Bromont, QC (TDY)15h ago
-
Machine Learning & Game Tech Architect CAD 180K-247KAPI Design | C plus plus | C# | Computer Architecture | Deep learningChildcare benefits | Company paid medical healthcare | Dental coverage | Dog-friendly office | Family-friendly eventsSenior-level Full TimeMontreal, QC, Canada R1d ago
-
Machine Learning & Game Tech Architect CAD 127K-187KAPI Design | C# | C++ | Code optimization | Game enginesCollective retirement plan | Flexible work schedule | Medical, dental & vision coverage | Mental health support | Paid time offSenior-level Full TimeMontreal, QC, Canada R1d ago
-
Relocate to Malta Data Architect (Intelligent Cloud/ Data & Analytics/ Consulting/Big4) A CAD 114K-203KAzure | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DBHybrid work | Relocation package | Training and development | Visa supportSenior-level Full TimeOttawa, ON, Canada1d ago
-
Solutions Architect - Montreal CAD 160K-246KAWS | Apache Kafka | Apache Spark | Azure | Cloud platformSenior-level Full TimeMontréal, Canada1d ago
-
Solutions Architect CAD 160K-214KAWS | Apache Kafka | Apache Spark | Azure | Cloud platformTravel opportunitiesSenior-level Full TimeOttawa, Canada1d ago
-
Managing Data Architect USD 91K-214KAnalytics | Artificial Intelligence | Business Intelligence | Cloud Computing | ComplianceCompany holidays | Paid time off | Personal days | Sick leaveSenior-level Full TimeToronto, CA2d ago
-
Managing Data Architect USD 91K-214KAnalytics | Artificial Intelligence | Business Intelligence | Cloud Computing | Compliance ManagementCompany-Paid Holidays | Disability insurance | Employee assistance program | Life insurance | Paid time offSenior-level Full TimeToronto, CA2d ago
-
AWS | Apache Hadoop | Apache Kafka | Apache Spark | Artificial IntelligenceCareer progression | Certification support | Collaborative work environment | Continuous learning support | Flexible work arrangementsSenior-level Full TimeCanada3d ago
-
Senior Data Architect CAD 132K-170KAggregation Framework | Atlas triggers | Auto Loader | Change streams | Data CatalogingDiscount program | Flexible medical spending account | Health benefits | RRSP matching program | Tuition reimbursementSenior-level Full TimeGreater Toronto Area, ON, Canada3d ago
-
Data Architect CAD 113K-156KBusiness Analysis | Business Continuity | Conceptual data modeling | Data Dictionary | Data GovernanceCritical illness insurance | Dental insurance | Educational assistance program | Employee assistance program | Flexible work arrangementSenior-level Full TimeWinnipeg, MB, Canada4d ago
-
Lead Solution Architect AI/ML CAD 113K-210KAI | API Integration | AWS | Agile | Architecture patternsDental insurance | Disability insurance | Employee assistance program | Health insurance | Life insuranceSenior-level Full TimeCAN, Ontario, Toronto, 200 Bloor Street …4d ago
-
Senior Azure AI Solution Architect CAD 137K-187KAI Foundry | API Management | Acceptance Test | Acceptance Test-Driven Development | AgileSenior-level Full TimeToronto - 18 York Street, Canada7d ago
-
Solutions Architect CAD 164K-224KApache Spark | Data Engineering | Data Science | Data Warehousing | DatabricksRemote work options | Travel up to 30 percentSenior-level Full TimeToronto, Canada8d ago
-
AWS | Apache Spark | Artificial Intelligence | Azure | Data GovernancePotential for permanent employment | Remote work Monday and FridaySenior-level ContractToronto, Canada9d ago
-
Lead Data AI Architect CAD 113K-210KAIOps | API Management | API Standards | Analytics | AzureDental insurance | Employee assistance program | Health insurance | Life insurance | Paid time offSenior-level Full TimeCAN, Ontario, Toronto, 200 Bloor Street …9d ago
-
Data Architect, Wealth and Asset Management CAD 153K-197KAWS | Azure | Cloud Computing | Data Architecture | Data GovernanceCompany paid life insurance | Company-paid disability insurance | Company-paid health insurance | Employee assistance program | Parental leave top-upSenior-level Full TimeCanada - Toronto9d ago
-
Azure Fundamentals | Batch Processing | CI/CD | DAX | Data FactoryBilingual communication support | Knowledge transfer sessions | MentoringSenior-level Full TimeMontreal, Quebec, Canada10d ago
-
AI ML Architect CAD 144K-183KAWS SageMaker | Azure Machine Learning | CI/CD | Deep learning | DockerFlexible work schedule | Generous time off | Mental Health plans | Remote-first work environment | Wellbeing focused timeSenior-level Full TimeCanada12d ago
-
Data Architect CAD 120K-160KAccess Control | Airflow | CCPA | CDC | CI/CDContinuous learning opportunities | Dental insurance | Health insurance | Hybrid work flexibility | Vision insuranceSenior-level Full TimeToronto, Ontario14d ago
-
Manager, Data Architecture & Application Services CAD 122K-153KBI Publisher | Change Management | Commvault | Crystal Reports | Data GovernanceComprehensive health benefits | Compressed work week | Employee assistance program | Employee discounts | Flexible work arrangementsSenior-level Full TimeTown Hall, Canada14d ago
-
AI Solutions Architect USD 129K-168KAnalytics | Conversation Design | Data Analysis | Intercom | JavaScriptSenior-level Full TimeSan Francisco, CA, New York, NY, … R14d ago
-
Senior AI/ML Applications Architect CAD 135K-200KAWS | Adversarial Networks | Amazon SageMaker | Azure | Azure MLSenior-level Full TimeMarkham, Canada15d ago
-
Senior Data Architect CAD 99K-136KAzure Data | Azure Data Factory | Boomi | Data Factory | Data GovernanceHealth and welfare benefits | Paid time off | Wellness benefitsSenior-level Full TimeMississauga, Canada15d ago
-
Senior AI/ML Applications Architect CAD 135K-200KAPI first | AWS SageMaker | Adversarial Networks | Auto Scaling | Azure MLSenior-level Full TimeMarkham, Canada15d ago