Senior Data Engineer
Tasks
- Build and maintain Databricks pipelines
- Collaborate with stakeholders on data requirements
- Design scalable data pipelines
- Develop ETL and ELT workflows
- Implement data quality and governance best practices
- Integrate Azure key vault for secrets
- Manage CI/CD workflows
- Optimize pipeline performance and cost
- Support data platform migration and modernization
- Troubleshoot data workflow issues
Perks/Benefits
Skills/Tech-stack
Access Management | Apache Spark | Authentication | Azure Architecture | Azure DevOps | Azure DevOps Pipelines | Azure Key Vault | Azure Pipelines | CI/CD | Cloud Security | Data Modeling | Data Warehousing | Databricks | Databricks SQL | Databricks Workflows | Delta Lake | DevOps Pipelines | Distributed Computing | ELT | ETL | Identity and Access Management | Identity and access | Key Vault | Python | SQL | Scala
Education
N/A
Related jobs
-
Senior-level ContractDowntown Toronto (Richmond / Adelaide / … R14h ago
-
Agent Orchestration | Artificial Intelligence | BERT | C# | C++Entry-level Apprenticeship Full TimeRemote, Canada R17h ago
-
Principal Java Data Engineer BRL 30KAWS | Alerting | Apache Hudi | Apache Spark | Apache TrinoCaregiver leave | Continuous development support program | Employee assistance program | Flexible paid time off | Parental leaveSenior-level Full TimeMississauga R1d ago
-
Senior Machine Learning Engineer USD 151K-191KAWS | Accuracy | Anomaly Detection | Azure | ClassificationDental insurance | Equity | Flexible PTO | Health insurance | Mental health supportSenior-level Full TimeRemote (US/Canada) R1d ago
-
Senior Manager, GTM Sales Engineer & AI solutions CAD 136K-218KAPI Development | API Integration | Access Control | Agentic Workflows | AgileSenior-level Full TimeToronto, Ontario, Canada R1d ago
-
AI Systems & ML Engineering Industry Expert CAD 140K-185KA/B | A/B Testing | API Design | AWS | Agentic SystemsFlexible schedule | Fully remote | Hourly paySenior-level Part TimeToronto, Ontario, CA R1d ago
-
Senior CRM & AI Solutions Developer (Power Platform) CAD 130K-165KAI Builder | AI Services | Azure AI | Azure AI Services | Azure DevOpsDental insurance | Disability insurance | Employee stock purchase plan | Generous vacation policy | Life insuranceSenior-level Full TimeToronto R1d ago
-
AI Evaluation | AI Observability | ASP.Net Core | AWS | Agentic Architectures401k matching | Continuing education | Flexible PTO | Health and wellness programs | Health, dental, and vision insuranceSenior-level Full TimeCanada R1d ago
-
Azure | CI/CD | Databricks | Infrastructure as Code | LLMDental insurance | Health insurance | Paid time off | Pension plan | Remote work one day per weekSenior-level Full Time TemporaryCA Vancouver, Canada R2d ago
-
Mid-level Full TimeCAN - Richmond, Canada R2d ago
-
Mid-level Full TimeCanada - Remote R2d ago
-
Senior Machine Learning Engineer CAD 150K-210KAPIs | Algorithms | Concurrency | Data Modeling | Data StructuresSenior-level Full TimeToronto, Ontario, Canada R2d ago
-
Staff Full Stack AI Engineer CAD 145K-175K.NET | AI Evaluation | AWS | Agentic Workflows | AutoGPT401k matching | Company lunches | Company outings | Continuing education | Flexible PTOSenior-level Full TimeAtlanta, Charlotte, Denver, New York, Remote … R2d ago
-
Senior Data Engineer CAD 135K-159KAWS | Agile | DBT | Data Governance | Data ModelingHybrid work model | Life leave days | Professional development days | Retirement savings options | Vacation timeSenior-level Full TimeOttawa, ON, Canada R2d ago
-
Lang Chain Deployment AI Engineer CAD 143K-170KAI Search | API Security | AWS | Asynchronous programming | Audit LoggingBenefits above the law | Flexible working hours | Mentorship | Remote work options | Stock optionsSenior-level Full TimeCanada R2d ago
-
Senior Software Engineer, Data - Mapping CAD 136K-170KA/B | A/B Testing | AWS | Airflow | Apache IcebergChild care benefits | Disability benefits | Extended health and dental coverage | Family building benefits | Flexible paid time offSenior-level Full TimeToronto, Canada R2d ago
-
Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryAnnual company retreat | Conference talk sponsorship | Employee leave policies | Home office fund | In person coworking sprintsMid-level Full TimeCanada R2d ago
-
AI Agents | API Integration | Access Management | Agent Frameworks | Cost OptimizationCompany offsites | Equity participation | Flexible schedule | Flexible vacation | Fully remoteMid-level Full TimeCanada R2d ago
-
Advisor, Data engineering CAD 83K-133KAlgorithms | Data Engineering | Data Modeling | Data Pipelines | Data StorageDefined benefit pension plan | Flexible vacation | Group insurance | Health & wellness reimbursement | TelemedicineSenior-level Full TimeComplexe Desjardins Montréal, Canada R3d ago
-
Senior Software Engineer, AI Enablement & Solutions CAD 140K-210KAPIs | AWS | AWS Bedrock | Distributed Systems | MicroservicesEmployee accounts required as applicable | Hybrid work environment | In-office collaborationSenior-level Full TimeToronto, Canada R3d ago
-
AWS ETL Data Engineer - REMOTE CAD 86K-133KAWS Glue | AWS Lambda | AWS S3 | Amazon Redshift | Apache AirflowDisability insurance | Employee assistance program | Gym discounts | Health and dental coverage | Income protectionSenior-level Full TimeHalifax, NS, CA R3d ago
-
Data Engineer (Databricks) CAD 80K-90KAlgorithms | Apache Spark | CI/CD | Data Modeling | Data Structures401k | Dental insurance | Educational events | Health insurance | Networking eventsSenior-level Full TimeToronto, Ontario, Canada - Remote R3d ago
-
Lead Databricks Consultant CAD 114K-164KAWS | Access Control | Apache Spark | Azure | Batch Processing401k retirement plan | Dental insurance | Employee assistance program | Medical insurance | Paid HolidaysSenior-level Full TimeCAN, ON, Work-at-Home, Canada R3d ago
-
Senior Machine Learning Engineer CAD 120K-160KAPI Design | Agentic Workflows | Automated testing | C# | Cloud infrastructureCareer development and mentoring programs | Community Volunteering and Philanthropy Programs | Employee peer recognition programs | Flexible time off | Health insuranceSenior-level Full TimeRemote, Canada R3d ago
-
Staff Data Engineer CAD 131K-164KAWS | Azure | CI | CI/CD | Cloud platform401k | Dental insurance | Discretionary time off | Equity participation | Health insuranceSenior-level Full TimeRemote - Canada R3d ago