Data Architect / Engineer
Tasks
- Advise on Supabase Postgres architecture suitability
- Build ingestion ETL pipelines from SharePoint and Microsoft stack
- Build monitoring alerting and error handling for ingestion jobs
- Define schema taxonomy and graph model for knowledge domains
- Design temporal document versions and machine readable representations
- Document data models schemas and pipeline architecture
- Establish data quality, lineage, and governance standards
- Handle multimodal content ingestion for presentations documents transcripts
- Keep knowledge graph synchronized with evolving source documents
- Optimize pipeline cost throughput and reliability
- Validate ingested content quality with QA
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Change Data Capture | Data Capture | Data Governance | Data Lineage | Data Modeling | Data Pipelines | Data Privacy | Data Quality | Data Security | Document versioning | ETL | Graph Databases | Incremental ingestion | Knowledge representation | LLM retrieval | Neo4j | Ontology | Postgres | Python | RAG | SQL | Supabase | Taxonomy | Temporal Data
Education
Roles
Related jobs
-
Advisor, Data engineering CAD 83K-133KAlgorithms | Data Engineering | Data Modeling | Data Pipelines | Data StorageDefined benefit pension plan | Flexible vacation | Group insurance | Health & wellness reimbursement | TelemedicineSenior-level Full TimeComplexe Desjardins Montréal, Canada R22h ago
-
Data Architect CAD 118K-152KAPI Integration | Cloud Data | Cloud Data Platforms | Data Governance | Data LakesBusiness coaching | Disability insurance | Employee assistance program | Fitness reimbursement | Health insuranceSenior-level Full TimeCanada - Toronto1d ago
-
Data Architect / Engineer CAD 115K-145KAirflow | Change Data Capture | Data Capture | Data Governance | Data LineageSenior-level Full TimeMontreal1d ago
-
Staff Data Engineer CAD 131K-164KAWS | Azure | CI | CI/CD | Cloud platform401k | Dental insurance | Discretionary time off | Equity participation | Health insuranceSenior-level Full TimeRemote - Canada R1d ago
-
Senior-level Full TimeRemote, Canada; Computer/Software; Canada, Canada; Remote, … R1d ago
-
AI Development Co-op CAD 85K-111KData Preprocessing | Feature Engineering | GitLab | Hopsworks | JavaScriptSenior-level Full TimeMontreal,Quebec,Canada1d ago
-
AI Software Engineer CAD 130K-155K.NET | Authentication | Authorization | Azure DevOps | Azure OpenShiftFree snacks | Health, dental, vision coverage | Paid personal days | Paid vacation | Professional dues reimbursementSenior-level Full TimeCambridge, ON, CA1d ago
-
Access Management | Business glossary | Change Data Capture | Data Capture | Data Catalog401k matching | Dental insurance | Flexible work arrangements | Fully remote | Health insuranceMid-level Full TimeCanada R1d ago
-
Développeur I- IA Analytique avancée CAD 72K-121KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsFlexible work schedule | Health insurance programs | Hybrid telework | Paid vacation | Retirement planMid-level Full TimeMontréal, QC, CA1d ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Entrepreneurial environment | Hands-off management | Remote distributed settingMid-level Full TimeWaterloo, Canada1d ago
-
Senior Data Engineer CAD 80K-138KActive Directory | Azure Active Directory | Azure Blob | Azure Blob Storage | Azure DataDeloitte Days | Development and Innovation Days | Flexible benefit spending account | Flexible work arrangements | Hybrid workSenior-level Full TimeToronto, ON, CA, M5H 0A9 R1d ago
-
Machine Learning Operations Engineer CAD 110K-150KCloud services | Containerization | Docker | Edge AI | IoTDiscount program | Flexible health spending account | Health benefits | RRSP matching program | Tuition reimbursementSenior-level Full TimeGreater Toronto Area, ON, Canada1d ago
-
AWS | AWS Bedrock | Agent patterns | Airtable | Backend DevelopmentFully remote | Globally distributed team | Home office stipend | Learning and development stipend | Long-Term Disability coverageMid-level Full TimeCanada R1d ago
-
Senior-level Full TimeToronto, Canada1d ago
-
Senior Data Platform Engineer CAD 157K-212KAPI Design | AWS CloudFormation | AWS Glue | Amazon Kinesis | Amazon S3Counseling benefit | Flexible time off | Hybrid work environment | RESP contribution | RRSP matchingSenior-level Full TimeCalgary, Canada R1d ago
-
Mid-level Full TimeLocation(s): Mississauga, Ontario, Canada1d ago
-
AI Engineering Specialist CAD 108K-152KAI Foundry | AI Search | AWS Fargate | AWS IAM | AWS LambdaDental insurance | Disability insurance | Employee share purchase program | Life insurance | Medical insuranceMid-level Full TimeWaterloo, Ontario, Canada1d ago
-
AWS | Azure | Azure DevOps | Bash | CI/CDCoaching and development | Collaborative team environment | World class training programMid-level Full TimeRBC CENTRE, 155 WELLINGTON ST W:TORONTO, …1d ago
-
Data Engineer CAD 120K-170KAWS | Adaptive Query | Adaptive query execution | Apache Iceberg | Apache KafkaSenior-level Full TimeLocation(s): Mississauga, Ontario, Canada1d ago
-
Embedded Software Engineer - New Grad CAD 68K-109KAgile | Bare Metal | Bash | C# | C++401k matching | Company-Paid Holidays | Employee assistance program | Employee stock purchase program | Paid family leaveEntry-level Full TimeCanada- Ottawa- 385 Terry Fox- Bldg …1d ago
-
Machine Learning Software Engineer - (New Grad) CAD 60K-103KCI/CD | Code review | Containers | Data Pipelines | Data PreprocessingCoaching | Collaborative team environment | Development opportunities | Flexible working environmentEntry-level Full Time777 BAY ST, TH 27:TORONTO, Canada1d ago
-
AI Engineer CAD 94K-135KAI Foundry | AI Services | Azure AI | Azure AI Foundry | Azure AI ServicesCollaborative workplace | Flexible work environment | Opportunities for innovation and cutting edge projects | Professional growth and learning opportunitiesMid-level Full TimeMontreal - 8585 Cote-De-Liesse, QC, Canada1d ago
-
Databricks Data Engineering Advisor CAD 105K-120KAzure Databricks | Azure Functions | Azure Storage | C# | Data GovernanceFlexible vacation | Group insurance | Health and wellness reimbursement | Pension plan | TelemedicineMid-level Full TimeComplexe Desjardins Montréal, Canada R1d ago
-
Senior Data Engineer CAD 110K-136KAzure | Bitbucket | CI/CD | Cloud infrastructure | Cloud platformAccessibility accommodations | Community engagement programs | Employee resource groups | Flexible vacation | Free tea and coffeeSenior-level Full TimeToronto, ON, CA, M5H 1H11d ago
-
AWS | Azure | Containerization | Data Governance | Data WarehousingCasual dress environment | Coaching and learning opportunities | Gamification challenges | Student networking events | Work on agile teamEntry-level Full Time InternshipBAY WELLINGTON TOWER, 181 BAY ST:TORONTO, …1d ago