Senior Data Engineer
Tasks
- Assist Databricks library installs
- Check Kubernetes logs
- Debug Databricks job failures
- Debug Databricks notebook failures
- Ensure technical excellence
- Fix RBAC access issues
- Foster collaboration with stakeholders
- Lead and manage data engineering team
- Manage ADLS Gen2 permissions
- Manage Databricks PAT tokens
- Manage Key Vault secrets
- Manage VM key rotation
- Manage server patching
- Monitor Airflow DAG failures
- Oversee data engineering projects
- Resolve Databricks workspace issues
- Restart Airflow scheduler workers
- Review Airflow task logs
- Rotate service principal tokens
- Support AKS pod restarts
- Support AKS scaling
- Support Unity Catalog access
- Troubleshoot ADLS mounts
- Troubleshoot Azure VM issues
- Troubleshoot CPU memory issues
- Validate Airflow connections and variables
- Validate service and ingress connectivity
Perks/Benefits
- Company holidays
- Employee assistance program
- Job incident response support
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
ADLS Gen2 | AKS | Access Control | Airflow | Azure | Azure CLI | Azure Monitor | Azure Portal | Azure Resource | Azure Resource Based Access Control | Bash | Databricks | Databricks Unity | Databricks Unity Catalog | Git | Key Vault | Kubectl | Kubernetes | Log Analytics | Managed Identity | Python | Service Principal | Unity Catalog
Education
N/A
Regions
Countries
States
Related jobs
-
AI Developer CAD 44K-57KAPI Development | Apache Spark | Data Engineering | Databricks | DockerHIPAA regulated environment | Healthcare domain workEntry-level Full TimeToronto, ON, Canada14h ago
-
Agentic Analytics Engineer CAD 110K-145KAI Agents | Airflow | BigQuery | DBT | Data Modeling401k | Dental insurance | Life insurance | Medical insurance | Unlimited PTOMid-level Full TimeToronto14h ago
-
Senior Data Engineer CAD 120K-145KApache Spark | Azure | Azure Data | Azure Data Factory | Azure FabricAnnual tech allowance | Annual travel allowance | Flexible working hours | Health and wellness benefits | Learning and developmentSenior-level Full TimeToronto15h ago
-
Computer Vision | Data Modeling | Excel | Financial Modeling | Language ModelsAnnual learning and development allowance | Company outings and offsites | Comprehensive benefits | Flexible time off | Home office setup stipendMid-level Full TimeMontreal, QC R15h ago
-
Computer Vision | Data Modeling | Excel | Language Models | Large Language ModelsAnnual learning and development allowance | Company-sponsored outings and offsites | Comprehensive benefits package | Flexible time off | Home office setup stipendMid-level Full TimeCalgary, AB R15h ago
-
Climate Modeling | Computer Vision | Data Modeling | Excel | Financial ModelingAnnual learning and development allowance | Company outings and offsites | Comprehensive benefits | Flexible time off | Home office setup stipendMid-level Full TimeVancouver, BC R15h ago
-
Climate Modeling | Computer Vision | Data Modeling | Excel | Financial ModelingAnnual learning and development allowance | Company offsites | Comprehensive benefits package | Flexible time off | Home office setup stipendMid-level Full TimeToronto, ON R15h ago
-
Senior Data Engineer, Event Data CAD 145K-185KAWS | AWS CloudFormation | Amazon Kinesis | Apache Flink | Apache KafkaFinancial benefits | Medical benefits | Other benefitsSenior-level Full TimeMovable Ink - Toronto18h ago
-
ADC | Bazel | C# | C++ | CANBonuses | Career growth opportunities | Equity | Flexible time off | Health benefitsSenior-level Full TimeCanada20h ago
-
Principal Data Engineer CAD 108K-155KApplication development | Azure | CI/CD | Data Modeling | Data Pipeline DevelopmentComprehensive health benefits | Discount offers | Employee recognition programs | Employer-paid training | Extended health and dentalSenior-level Full TimeVancouver, BC, Canada1d ago
-
Senior-level Full TimeVancouver, BC, Canada1d ago
-
Data Engineer CAD 100K-125KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQLCollaborative Agile team | Continuous innovation | Hybrid work environment | Learning new technologies | Personal growthMid-level Full TimeMississauga, Canada – Meadowvale Office (HQ)1d ago
-
Machine Learning Engineer II CAD 154K-199KAzure | Cloud Architecture | Data Engineering | Deep learning | Generative AIBanking benefits and discounts | Career development | Health and well-being benefits | Mentoring programs | Paid time offSenior-level Full Time661 University Avenue, Toronto, Ontario, Canada1d ago
-
Sr. Machine Learning Engineer (MLE) CAD 112K-162KApache Hadoop | Apache Kafka | Apache Spark | Big Data | Data ModelingDisability insurance | Employee assistance program | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeToronto Office TRO, Canada1d ago
-
Principal Machine Learning Engineer (MLE) CAD 112K-162KA/B | A/B Testing | AWS | Attention Mechanisms | Automated retrainingEmployee assistance programSenior-level Full TimeToronto Office TRO, Canada1d ago
-
Agile | Angular | Artificial Intelligence | Azure | C++Onsite five days per week | Relocation assistance not offered | Up to 10 percent international travelEntry-level Full TimeLaval, Quebec, Canada1d ago
-
Angular | Artificial Intelligence | Azure | C++ | CANInternational travel up to 10% | Onsite work required | Relocation assistance not providedSenior-level Full TimeLaval, Quebec, Canada1d ago
-
Data Machine Learning Engineer CAD 86K-125KAWS Glue | Amazon Athena | Amazon SageMaker | Apache Airflow | Big DataCompany-Paid Holidays | Employee assistance programs | Life and disability insurance | Medical, dental, and vision coverage | Paid time offMid-level Full TimeToronto, CA1d ago
-
Staff Applied AI Engineer USD 180K-273KAWS SageMaker | Agentic AI | Amazon Bedrock | CI/CD | Caching401k match | Dental insurance | Fertility assistance | Flexible paid time off | Health insuranceSenior-level Full TimeRemote - US & Canada R1d ago
-
Senior Software Engineer, Data Platform USD 163K-247KAWS | Amazon EMR | Amazon Kinesis | Amazon MSK | Amazon Redshift401k match | Equity RSUs | Health insurance | Paid time offSenior-level Full TimeDenver, CO;San Francisco, CA;New York, NY;Los … R1d ago
-
Principal Data Scientist CAD 130K-170KAgent Frameworks | Auditability | BigQuery | CI/CD | Compliance reportingCareer growth and development opportunities | Community involvement | Health and wellbeing resources | Hybrid work environment | Paid vacationSenior-level Full TimeToronto, ON, M2N 5M9, CA1d ago
-
Senior Software Engineer - Data Platform CAD 217K-217KApache Airflow | Apache Kafka | Apache Spark | Caching | Cloud DataCollaboration offsites | In-person offsites | Remote-first work flexibilitySenior-level Full TimeRemote - Canada R1d ago
-
Senior-level Full TimeCanada1d ago
-
Staff, ML Engineer - BEV CAD 209K-313K3D Vision | BEV Transformers | Birds Eye View | Camera | Deep learningDental insurance | Flexible schedule | Hybrid work | Life insurance | Medical insuranceSenior-level Full TimeRemote - Canada, Montreal, Canada R1d ago
-
Forward Deployed Developer IV, GenAI, Google Cloud CAD 204K-204KAPIs | Agent systems | Agentic Workflows | CrewAI | Data integrationSenior-level Full TimeToronto, ON, Canada1d ago