Data Platform Engineer (DevOps)
Montreal, Quebec, Canada
CAD 126K-157K (estimate) Senior-level Full Time
Tasks
- Build Docker images and publish artifacts
- Build and maintain CI/CD pipelines
- Build and operate Spark Structured Streaming pipelines
- Collaborate in Agile to deliver data products
- Deploy and manage release versioning
- Design and maintain Databricks jobs and pipelines
- Develop real time streaming and change data capture pipelines
- Develop reusable pipeline components and frameworks
- Implement Bronze Silver Gold data layer movement
- Manage catalog schema and access governance
- Manage remote state and per environment configuration
- Own Helm charts and Kubernetes jobs deployment
- Provision AWS and Databricks workspaces using Terraform
- Secure secrets and credentials with cloud secret management
- Tune clusters and SQL warehouses for cost and performance
Perks/Benefits
Skills/Tech-stack
AWS | Apache Spark | Azure Artifacts | Azure Artifacts N/A | CI/CD | Databricks | Docker | Git | Helm | Java | Kubernetes | Maven | N A | PySpark | Python | SQL | Spark Structured Streaming | Structured Streaming | Terraform
Education
N/A
Roles
Data Platform | Data Platform Engineer | DevOps | DevOps Engineer | Engineer | Platform Engineer
Related jobs
-
Senior Analytics Engineer USD 148K-218KAutomation | BI tools | CCPA | CI/CD | DBTDental insurance | Equity | Medical insurance | Remote work | Vision insuranceSenior-level Full TimeRemote, USA ; Remote, Canada R2d ago
-
Data Engineer CAD 73K-91KApache Airflow | Apache Beam | BigQuery | CI/CD | Cloud StorageAnonymous reporting platform | Course Reimbursement Program | Flexible hybrid work environment | Free online doctor visits | Frequent Employee Pulse SurveysMid-level Full TimeOakville, Canada R2d ago
-
Senior Principal AI Engineer CAD 165K-180KAgentOps | Artificial Intelligence | Automation | CI/CD | ComplianceCareer growth and development opportunities | Community volunteering opportunities | Health and wellbeing resources | Hybrid work schedule | Paid personal daysSenior-level Full TimeToronto, ON, M2M 4G3, CA2d ago
-
Agile | Azure | Azure Blob | Azure Blob Storage | Azure DataEmployee assistance program | Global career opportunities | Health and wellness programs | Insurance benefits | Paid time offEntry-level Full TimeCanada, British Columbia2d ago
-
Mid-level ContractMontréal, Canada2d ago
-
AWS CloudWatch | AWS Glue | AWS HealthLake | AWS S3 | Access ControlSenior-level ContractToronto, Canada2d ago
-
Machine Learning Engineer CAD 125K-154KAWS | Azure | Data Architecture | Databricks | Enterprise DataEmployee and family assistance program | Employee share ownership plan | Health and dental benefits | In-store discount | Learning and development opportunitiesSenior-level Full TimeToronto, ON, M5V 1X6, CAN2d ago
-
Sr. Software Developer - ETL (Microsoft D365, SQL, SQL Azure, Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory) - RQ09450 A CAD 141K-212KAPI Management | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageContract with possible extension | Hybrid work scheduleSenior-level Full TimeToronto, ON, Canada2d ago
-
BERT | Hyperparameter Tuning | Language Processing | Machine Learning | Natural LanguageHybrid workSenior-level Full TimeToronto, ON, Canada2d ago
-
.NET | Azure | Azure CLI | Azure Data Factory | Azure SQLHybrid workSenior-level Full TimeToronto, ON, Canada2d ago
-
Analyst, Data Science & AI developper CAD 74K-104KAI Foundry | Agile | App Service | Azure | Azure AIDental insurance | Disability insurance | Employee assistance program | Flexible/hybrid work policies | Health insuranceMid-level Full TimeDorval, Québec, CA, H4S 1Y92d ago
-
Analyst, Data Science & AI CAD 71K-106KAzure | Backtesting | Calibration | Cross-validation | Data GovernanceEmployee assistance program | Flexible and hybrid work policies | Insurance plans | Retirement savings plan | Tele Health ProgramMid-level Full TimeDorval, Québec, CA, H4S 1Y92d ago
-
A/B | A/B Testing | Advertising analytics | Airflow | B testingEquity grants | Flexible remote work | Professional developmentSenior-level Full TimeCanada2d ago
-
Senior Data Engineer (Snowflake) CAD 140K-179KApache Airflow | BigQuery | Compliance | DBT | DagsterExtended health and dental plan | Flexible PTO | Flexible work arrangements | Mentorship | Training budgetSenior-level Full TimeToronto3d ago
-
Senior AI Lead -Snowflake CAD 131K-278KAnthropic API | Autogen | CI/CD | Cortex AI | Cortex AnalystSenior-level Full TimeMontreal, 5 Place Ville Marie, Corp, …3d ago
-
Senior Data Engineer CAD 99K-136KBigQuery | CI/CD | Cloud platform | DBT | Data GovernanceBuy and sell PTO | Digital nomads 4 weeks per year | Flexible dental insurance | Flexible medical insurance | Generous PTOSenior-level Full TimeToronto King Street E Office, Canada3d ago
-
Engineer, AI Developer Platforms CAD 95K-129KAutomated testing | Code review | Debugging | Generative AI | Human reviewCollaborative culture | Professional growth opportunities | Training and enablement sessionsMid-level Full TimeCanada - Burnaby3d ago
-
Machine Learning Engineer II CAD 154K-199KC# | C++ | Deep learning | GPU Computing | Generative AICareer development | Health and well-being benefits | Mentoring programs | Paid time off | Reward and recognition programsEntry-level Full Time661 University Avenue, Toronto, Ontario, Canada3d ago
-
Senior AI/LLM Engineer USD 179K-201KAPI Development | CI/CD | Embeddings | Fine Tuning | Guardrails401k match | Dental insurance | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote (US/Canada) R3d ago
-
AWS | CI/CD | Code review | Data Transformation | DatabricksAnnual training bonus | Flexible schedule | Flexible time off | Free telemedicine | Hybrid workSenior-level Full TimeMontréal, Quebec, Canada; Québec, Quebec, Canada3d ago
-
Data and Artificial Intelligence Fall Student CAD 52K-52KBusiness Intelligence | Data Engineering | Data Visualization | Generative AI | Machine LearningAccess to data and technology tools | Collaborative inclusive environment | Hybrid work arrangements | Remote work flexibility | Travel for office workNone Full TimeSt Catharines, Ontario, Canada; Etobicoke, Ontario, … R3d ago
-
Embedded Systems Test Engineer CAD 95K-130KARM Cortex | Ansible | Buildah | C# | C++Flexible work hours | Health benefits | Personal education funds | Profit sharing | RRSP matchingSenior-level Full TimeWaterloo, Ontario, Canada3d ago
-
AI Engineer Sr CAD 110K-172KAI Observability | API | AWS | Agent systems | Amazon Web ServicesComprehensive wellness initiatives | Recognition programs | Time away from work programs | Volunteer daysMid-level Full TimeCanada3d ago
-
AI Engineer Sr CAD 110K-172KAI Agents | AI Observability | AI orchestration | APIs | AWSCharity support | Recognition programs | Time off | Volunteer days | Wellness programsMid-level Full TimeCanada3d ago
-
AWS | Alteryx | Amazon Redshift | Azure Synapse | Azure Synapse AnalyticsContinuous learning opportunities | Fully remote work | Professional growthSenior-level Full TimeCanada R3d ago