Senior Data Platform Engineer
Tasks
- Build ingestion pipelines
- Build serving pipelines
- Build transformation pipelines
- Define CI CD practices for data systems
- Define data standards
- Define dataset SLOs and SLAs
- Deliver reusable datasets
- Design data platform architecture
- Enforce data modeling standards
- Ensure audit and compliance
- Handle PII data
- Handle incidents
- Implement data governance
- Implement data observability
- Manage RBAC access
- Manage data contracts
- Manage metadata
- Monitor data quality
- Monitor orchestration workflows
- Own lakehouse and warehouse architecture
- Run batch processing pipelines
- Run streaming processing pipelines
- Set data retention policies
- Track dataset completeness
- Track dataset freshness
- Track dataset latency
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Alation | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Auditability | Azure | Azure Event | Azure Event Hubs | Batch Processing | CI/CD | Collibra | Containerization | DBT | Dagster | Data Contracts | Data Governance | Data Lake | Data Lineage | Data Modeling | Data Observability | Data Quality | Data Retention | Data Warehouse | Data pipeline | Datahub | Delta Lake | Event Hubs | Great Expectations | Infrastructure as Code | Kubernetes | Lakehouse | Looker | Metadata | Microsoft Purview | PII | Power BI | Prefect | Python | RBAC | SQL | Schema management | Soda | Spark Streaming | Streaming processing | Tableau | Terraform | Unity Catalog | “as-code”
Education
N/A
Related jobs
-
Engineer - ML & RL CAD 93K-116KAgent systems | Contextual bandit | Deep learning | DeepSpeed | Distributed TrainingMid-level Contract Full TimeEdmonton, Alberta, Canada11h ago
-
Senior Data Engineer (Hybrid) CAD 267K-315KAPI ingestion | Amazon S3 | Apache Airflow | Apache Kafka | Apache SparkCompany holidays | Dental insurance | Flex Time Off | Health insurance | Life insuranceSenior-level Full TimeToronto R11h ago
-
Senior MLOps Engineer CAD 175K-200KAccess Management | Argo | CI/CD | CircleCI | Cloud platformDental insurance | Extended long weekends | Flexible work hours | Health insurance | Holiday shutdownSenior-level Full TimeToronto, Ontario14h ago
-
AI Solutions Engineer CAD 100K-120KAI workflow | AI workflow automation | API Integration | Content Management | Content Management SystemsEmployee discounts | Group benefits | Paid time off | RRSP matchMid-level Full TimeHybrid- Toronto, ON R19h ago
-
Ansible | Backup and Recovery | Barman | Bash | Cause analysisAI assisted tooling support | Flexible location in Canada | Healthcare benefits | Inclusive work culture | Professional developmentSenior-level Full TimeCanada R20h ago
-
Summer Student - Data Engineer CAD 65K-85KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Cause analysisCommunity involvement | Free tea and coffee | Training and educationMid-level Full TimeWinnipeg, MB, CA22h ago
-
AWS EC2 | AWS Glue | AWS Lambda | AWS S3 | AWS Step FunctionsSenior-level Full TimeMontreal, Quebec, Canada1d ago
-
Data Engineer CAD 86K-136KAPI Management | App Service | Azure | Azure App | Azure App ServiceFlexible work environment | Health benefits | Learning and development | Paid time off | Retirement savings plansMid-level Full TimeCAN, Ontario, Toronto, 200 Bloor Street …1d ago
-
Senior Backend Engineer CAD 126K-170KAWS | Access Management | Algorithms | Automated testing | AzureDental insurance | Employee Assistance Program (EAP) | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeRemote Canada - ON R1d ago
-
Senior Applied AI Engineer CAD 120K-154KAPI Development | Agent Orchestration | Agent systems | Asynchronous programming | CI/CDSenior-level Full TimeMontreal, QC, CA1d ago
-
Senior Engineer, Data Platform CAD 145K-185KAWS | Access Control | Amazon Redshift | Apache Airflow | Apache FlinkSenior-level Full TimeMovable Ink - Toronto1d ago
-
Intermediate AI Developer (AI First) CAD 111K-132KAPI Integration | Agile | C# | C++ | Cost OptimizationHealth and safety focus | Remote workMid-level Full TimeEdmonton, AB, Canada1d ago
-
Senior Backend Engineer, Analytics CAD 140K-180KAWS | CI/CD | Cloud platform | Code review | Distributed SystemsFinancial benefits | Medical benefits | Other benefitsSenior-level Full TimeMovable Ink - Toronto1d ago
-
Data Engineer CAD 108K-162KAirflow | Amazon Redshift | Amazon Web Services | Apache Beam | Apache KafkaCareer development | Competitive benefits package | Flex Time Off | Hybrid work from homeMid-level Full TimeWinnipeg1d ago
-
Senior AI Engineer CAD 120K-150KAgent Orchestration | Agent systems | Artificial Intelligence | Autonomous Agents | Dynamic routingBirthday off | Generous vacation package | Health days | Health spending account | Hybrid workSenior-level Full TimeToronto R1d ago
-
Senior Data Engineer CAD 112K-140KAccess Control | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeCanada1d ago
-
AWS | Agent systems | Anthropic | Azure | CI/CDHybrid workSenior-level Full TimeMontreal, Quebec, Canada1d ago
-
3D Geometry | 6D Pose Estimation | AWS | C plus plus | Computer VisionAutonomy | High-impact work | In-person collaboration | Learning cultureSenior-level Full TimeVancouver, British Columbia1d ago
-
Elastic AI Engineer - Canada (Remote) CAD 101K-161KAWS | Agent Orchestration | Azure | Docker | ElasticsearchEmployee donations match | Flexible work schedule | Generous vacation days | Health coverage | Parental leaveMid-level Full TimeCanada R1d ago
-
Analytics engineering | BigQuery | DBT | Dashboard Development | Data ModellingCross-functional collaboration | Documentation and enablement culture | Remote-first teamMid-level Full TimeCanada1d ago
-
Senior / Staff Engineer, Data Platform CAD 103K-140KAirflow | Apache Flink | Apache Kafka | Apache Spark | Batch ProcessingCompany-wide events | Game nights | Hybrid work | Team lunchSenior-level Full TimeMontreal R1d ago
-
Senior Data Engineer – Big Data & Analytics Platforms CAD 130K-144KApache Airflow | Apache Hive | Apache Spark | Apache Zeppelin | CloudHybrid work option | Remote work optionSenior-level Full TimeToronto, ON, Canada1d ago
-
ISP Platform AI Software and Driver Architect CAD 135K-220KArtificial Intelligence | C++ | Camera Drivers | Computer Vision | Edge AISenior-level Full TimeMARKHAM, ON, Canada2d ago
-
Senior AI Engineer CAD 90K-140KAPIs | AWS | AWS Lambda | Chatbot Development | Continuous DeliveryCareer development | Hybrid work flexibility | Networking opportunities | Wellness programsSenior-level Full TimeSun Life Waterloo King, Canada2d ago
-
Senior AI Engineer CAD 90K-140KAPIs | AWS | AWS Lambda | Amazon Web Services | Artificial IntelligenceCareer growth | Employee well-being support | Hybrid work option | Networking opportunities | Wellness programsSenior-level Full TimeSun Life Waterloo King, Canada2d ago