Senior Data Engineer
Tasks
- Assist Databricks library installs
- Check Kubernetes logs
- Debug Databricks job failures
- Debug Databricks notebook failures
- Ensure technical excellence
- Fix RBAC access issues
- Foster collaboration with stakeholders
- Lead and manage data engineering team
- Manage ADLS Gen2 permissions
- Manage Databricks PAT tokens
- Manage Key Vault secrets
- Manage VM key rotation
- Manage server patching
- Monitor Airflow DAG failures
- Oversee data engineering projects
- Resolve Databricks workspace issues
- Restart Airflow scheduler workers
- Review Airflow task logs
- Rotate service principal tokens
- Support AKS pod restarts
- Support AKS scaling
- Support Unity Catalog access
- Troubleshoot ADLS mounts
- Troubleshoot Azure VM issues
- Troubleshoot CPU memory issues
- Validate Airflow connections and variables
- Validate service and ingress connectivity
Perks/Benefits
- Company holidays
- Employee assistance program
- Job incident response support
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
ADLS Gen2 | AKS | Access Control | Airflow | Azure | Azure CLI | Azure Monitor | Azure Portal | Azure Resource | Azure Resource Based Access Control | Bash | Databricks | Databricks Unity | Databricks Unity Catalog | Git | Key Vault | Kubectl | Kubernetes | Log Analytics | Managed Identity | Python | Service Principal | Unity Catalog
Education
N/A
Regions
Countries
States
Related jobs
-
Computer Vision | Data Modeling | Excel | Financial Modeling | Language ModelsAnnual learning and development allowance | Company outings and offsites | Comprehensive benefits | Flexible time off | Home office setup stipendMid-level Full TimeMontreal, QC R13h ago
-
Computer Vision | Data Modeling | Excel | Language Models | Large Language ModelsAnnual learning and development allowance | Company-sponsored outings and offsites | Comprehensive benefits package | Flexible time off | Home office setup stipendMid-level Full TimeCalgary, AB R13h ago
-
Climate Modeling | Computer Vision | Data Modeling | Excel | Financial ModelingAnnual learning and development allowance | Company outings and offsites | Comprehensive benefits | Flexible time off | Home office setup stipendMid-level Full TimeVancouver, BC R13h ago
-
Climate Modeling | Computer Vision | Data Modeling | Excel | Financial ModelingAnnual learning and development allowance | Company offsites | Comprehensive benefits package | Flexible time off | Home office setup stipendMid-level Full TimeToronto, ON R13h ago
-
Senior Data Engineer, Event Data CAD 145K-185KAWS | AWS CloudFormation | Amazon Kinesis | Apache Flink | Apache KafkaFinancial benefits | Medical benefits | Other benefitsSenior-level Full TimeMovable Ink - Toronto16h ago
-
Data Engineer CAD 100K-125KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQLCollaborative Agile team | Continuous innovation | Hybrid work environment | Learning new technologies | Personal growthMid-level Full TimeMississauga, Canada – Meadowvale Office (HQ)1d ago
-
Machine Learning Engineer II CAD 154K-199KAzure | Cloud Architecture | Data Engineering | Deep learning | Generative AIBanking benefits and discounts | Career development | Health and well-being benefits | Mentoring programs | Paid time offSenior-level Full Time661 University Avenue, Toronto, Ontario, Canada1d ago
-
Sr. Machine Learning Engineer (MLE) CAD 112K-162KApache Hadoop | Apache Kafka | Apache Spark | Big Data | Data ModelingDisability insurance | Employee assistance program | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeToronto Office TRO, Canada1d ago
-
Principal Machine Learning Engineer (MLE) CAD 112K-162KA/B | A/B Testing | AWS | Attention Mechanisms | Automated retrainingEmployee assistance programSenior-level Full TimeToronto Office TRO, Canada1d ago
-
Agile | Angular | Artificial Intelligence | Azure | C++Onsite five days per week | Relocation assistance not offered | Up to 10 percent international travelEntry-level Full TimeLaval, Quebec, Canada1d ago
-
Angular | Artificial Intelligence | Azure | C++ | CANInternational travel up to 10% | Onsite work required | Relocation assistance not providedSenior-level Full TimeLaval, Quebec, Canada1d ago
-
Data Machine Learning Engineer CAD 86K-125KAWS Glue | Amazon Athena | Amazon SageMaker | Apache Airflow | Big DataCompany-Paid Holidays | Employee assistance programs | Life and disability insurance | Medical, dental, and vision coverage | Paid time offMid-level Full TimeToronto, CA1d ago
-
Staff Applied AI Engineer USD 180K-273KAWS SageMaker | Agentic AI | Amazon Bedrock | CI/CD | Caching401k match | Dental insurance | Fertility assistance | Flexible paid time off | Health insuranceSenior-level Full TimeRemote - US & Canada R1d ago
-
Senior Software Engineer, Data Platform USD 163K-247KAWS | Amazon EMR | Amazon Kinesis | Amazon MSK | Amazon Redshift401k match | Equity RSUs | Health insurance | Paid time offSenior-level Full TimeDenver, CO;San Francisco, CA;New York, NY;Los … R1d ago
-
Principal Data Scientist CAD 130K-170KAgent Frameworks | Auditability | BigQuery | CI/CD | Compliance reportingCareer growth and development opportunities | Community involvement | Health and wellbeing resources | Hybrid work environment | Paid vacationSenior-level Full TimeToronto, ON, M2N 5M9, CA1d ago
-
Senior Software Engineer - Data Platform CAD 217K-217KApache Airflow | Apache Kafka | Apache Spark | Caching | Cloud DataCollaboration offsites | In-person offsites | Remote-first work flexibilitySenior-level Full TimeRemote - Canada R1d ago
-
Senior-level Full TimeCanada1d ago
-
Staff, ML Engineer - BEV CAD 209K-313K3D Vision | BEV Transformers | Birds Eye View | Camera | Deep learningDental insurance | Flexible schedule | Hybrid work | Life insurance | Medical insuranceSenior-level Full TimeRemote - Canada, Montreal, Canada R1d ago
-
Forward Deployed Developer IV, GenAI, Google Cloud CAD 204K-204KAPIs | Agent systems | Agentic Workflows | CrewAI | Data integrationSenior-level Full TimeToronto, ON, Canada1d ago
-
Agile | C++ | Cloud infrastructure | Data Processing | DebuggingSenior-level Full TimeWaterloo, ON, Canada1d ago
-
AI Scientist, Risk Modelling (Questbank) CAD 90K-120KAWS | Agile | Artificial Intelligence | Azure | CI/CDCareer growth and development | Community volunteering opportunities | Health and wellbeing resources | Hybrid work schedule | Paid sick daysMid-level Full TimeToronto, ON, M2N 5M9, CA2d ago
-
Airflow | Apache Kafka | Apache Spark | Azure | Azure EventCompetitive benefits | Employee resource groups | Flexible work schedule | Hybrid work environment | Mentorship opportunitiesSenior-level Full TimeMontreal - MRC (Papineau) (36.25), Canada2d ago
-
Senior Data Scientist- Pricing Optimization CAD 110K-162KAzure | Cross-Functional Collaboration | Cross-functional | Data Analysis | Data ScienceCareer developmentSenior-level Full TimeToronto, Ontario, Canada - Remote R2d ago
-
Applied AI Backend Software Developer CAD 76K-105KAPI | AWS | Azure | CI/CD | DockerCritical illness insurance | Employee resource groups | Health and dental coverage | Life insurance | Long-term disabilityNone Full TimeOttawa, Canada2d ago
-
Applied AI Full Stack Engineer MacOS CAD 105K-130KAgile | C++ | CI/CD | Design Patterns | DevOps14 Annual Holidays | Critical illness insurance | Employee resource groups | Health and dental coverage | Life insuranceMid-level Full TimeOttawa, Canada2d ago