Senior Data Platform Engineer
Tasks
- Build ingestion pipelines
- Build serving pipelines
- Build transformation pipelines
- Define CI CD practices for data systems
- Define data standards
- Define dataset SLOs and SLAs
- Deliver reusable datasets
- Design data platform architecture
- Enforce data modeling standards
- Ensure audit and compliance
- Handle PII data
- Handle incidents
- Implement data governance
- Implement data observability
- Manage RBAC access
- Manage data contracts
- Manage metadata
- Monitor data quality
- Monitor orchestration workflows
- Own lakehouse and warehouse architecture
- Run batch processing pipelines
- Run streaming processing pipelines
- Set data retention policies
- Track dataset completeness
- Track dataset freshness
- Track dataset latency
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Alation | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Auditability | Azure | Azure Event | Azure Event Hubs | Batch Processing | CI/CD | Collibra | Containerization | DBT | Dagster | Data Contracts | Data Governance | Data Lake | Data Lineage | Data Modeling | Data Observability | Data Quality | Data Retention | Data Warehouse | Data pipeline | Datahub | Delta Lake | Event Hubs | Great Expectations | Infrastructure as Code | Kubernetes | Lakehouse | Looker | Metadata | Microsoft Purview | PII | Power BI | Prefect | Python | RBAC | SQL | Schema management | Soda | Spark Streaming | Streaming processing | Tableau | Terraform | Unity Catalog | “as-code”
Education
N/A
Related jobs
-
Engineer - ML & RL CAD 93K-116KAgent systems | Contextual bandit | Deep learning | DeepSpeed | Distributed TrainingMid-level Contract Full TimeEdmonton, Alberta, Canada14h ago
-
Senior Data Engineer (Hybrid) CAD 267K-315KAPI ingestion | Amazon S3 | Apache Airflow | Apache Kafka | Apache SparkCompany holidays | Dental insurance | Flex Time Off | Health insurance | Life insuranceSenior-level Full TimeToronto R14h ago
-
Data Engineer CAD 90K-110KAccess Control | CI/CD | Data Governance | Data Lakehouse | Data PipelinesRemote-first environmentMid-level Full TimeVancouver, British Columbia, Canada; Calgary, Alberta, … R14h ago
-
Machine Learning & Game Tech Architect CAD 180K-247KAPI Design | C# | C++ | Game Engine | GoDental & vision coverage | Employer RRSP matching | Employer-paid medical | Flexible working hours | International working environmentSenior-level Full TimeVancouver, BC, Canada R16h ago
-
Senior Machine Learning Engineer (Cloud & Data Platform) - |5-8 years of exp. | Canada Role | Bank & Finance| CAD 103K-192KBenchmarking | Cloud Computing | Data Processing | Data Warehousing | Data pipelineSenior-level Contract Full TimeMontreal, QC, Canada16h ago
-
Senior MLOps Engineer CAD 175K-200KAccess Management | Argo | CI/CD | CircleCI | Cloud platformDental insurance | Extended long weekends | Flexible work hours | Health insurance | Holiday shutdownSenior-level Full TimeToronto, Ontario18h ago
-
AI Solutions Engineer CAD 100K-120KAI workflow | AI workflow automation | API Integration | Content Management | Content Management SystemsEmployee discounts | Group benefits | Paid time off | RRSP matchMid-level Full TimeHybrid- Toronto, ON R22h ago
-
Ansible | Backup and Recovery | Barman | Bash | Cause analysisAI assisted tooling support | Flexible location in Canada | Healthcare benefits | Inclusive work culture | Professional developmentSenior-level Full TimeCanada R23h ago
-
Summer Student - Data Engineer CAD 65K-85KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Cause analysisCommunity involvement | Free tea and coffee | Training and educationMid-level Full TimeWinnipeg, MB, CA1d ago
-
AI / ML Engineer CAD 84K-150KAI SDK | Agile | Automation | Azure | Azure AIColleague resource groups | Employee assistance program | Employee wellbeing incentives | Flex PTO | Flexible work arrangementsMid-level Full TimeCanada1d ago
-
Amazon Redshift | DBT | Data Architecture | Data Modeling | Data QualityFully remote | Healthcare | Home office equipment allowance | Learning and development budget | Paid parental leaveSenior-level Full TimeCanada R1d ago
-
AWS EC2 | AWS Glue | AWS Lambda | AWS S3 | AWS Step FunctionsSenior-level Full TimeMontreal, Quebec, Canada1d ago
-
Data Engineer CAD 86K-136KAPI Management | App Service | Azure | Azure App | Azure App ServiceFlexible work environment | Health benefits | Learning and development | Paid time off | Retirement savings plansMid-level Full TimeCAN, Ontario, Toronto, 200 Bloor Street …1d ago
-
Senior Backend Engineer CAD 126K-170KAWS | Access Management | Algorithms | Automated testing | AzureDental insurance | Employee Assistance Program (EAP) | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeRemote Canada - ON R1d ago
-
Senior Applied AI Engineer CAD 120K-154KAPI Development | Agent Orchestration | Agent systems | Asynchronous programming | CI/CDSenior-level Full TimeMontreal, QC, CA1d ago
-
AI Engineer CAD 75K-129KAPIs | Agent workflows | Automation | Azure | Cloud infrastructureBenefits | Community engagement opportunities | Cross-functional development opportunities | Flexible vacation | Online coursesMid-level Full TimeToronto, ON, CA, M5H 1H11d ago
-
Senior AI Engineer USD 176K-245KAccess Control | Agent workflows | Alerting | Auditability | AutomationSenior-level Full TimeToronto, TX, US1d ago
-
Sr Machine Learning Engineer CAD 156K-234KAWS | Asynchronous programming | Concurrent programming | Data Validation | Data WranglingEmployee mentoring | Flexible work schedule | Health benefits | Paid time off | Remote work optionsSenior-level Full TimeCanada, ON, Toronto1d ago
-
Senior Engineer, Data Platform CAD 145K-185KAWS | Access Control | Amazon Redshift | Apache Airflow | Apache FlinkSenior-level Full TimeMovable Ink - Toronto1d ago
-
Intermediate AI Developer (AI First) CAD 111K-132KAPI Integration | Agile | C# | C++ | Cost OptimizationHealth and safety focus | Remote workMid-level Full TimeEdmonton, AB, Canada1d ago
-
Senior Backend Engineer, Analytics CAD 140K-180KAWS | CI/CD | Cloud platform | Code review | Distributed SystemsFinancial benefits | Medical benefits | Other benefitsSenior-level Full TimeMovable Ink - Toronto1d ago
-
Data Engineer CAD 108K-162KAirflow | Amazon Redshift | Amazon Web Services | Apache Beam | Apache KafkaCareer development | Competitive benefits package | Flex Time Off | Hybrid work from homeMid-level Full TimeWinnipeg1d ago
-
Senior AI Engineer CAD 120K-150KAgent Orchestration | Agent systems | Artificial Intelligence | Autonomous Agents | Dynamic routingBirthday off | Generous vacation package | Health days | Health spending account | Hybrid workSenior-level Full TimeToronto R1d ago
-
Senior Data Engineer CAD 112K-140KAccess Control | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeCanada1d ago
-
AWS | Agent systems | Anthropic | Azure | CI/CDHybrid workSenior-level Full TimeMontreal, Quebec, Canada1d ago