Senior Data Platform Engineer
Tasks
- Build ingestion pipelines
- Build serving pipelines
- Build transformation pipelines
- Define CI CD practices for data systems
- Define data standards
- Define dataset SLOs and SLAs
- Deliver reusable datasets
- Design data platform architecture
- Enforce data modeling standards
- Ensure audit and compliance
- Handle PII data
- Handle incidents
- Implement data governance
- Implement data observability
- Manage RBAC access
- Manage data contracts
- Manage metadata
- Monitor data quality
- Monitor orchestration workflows
- Own lakehouse and warehouse architecture
- Run batch processing pipelines
- Run streaming processing pipelines
- Set data retention policies
- Track dataset completeness
- Track dataset freshness
- Track dataset latency
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Alation | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Auditability | Azure | Azure Event | Azure Event Hubs | Batch Processing | CI/CD | Collibra | Containerization | DBT | Dagster | Data Contracts | Data Governance | Data Lake | Data Lineage | Data Modeling | Data Observability | Data Quality | Data Retention | Data Warehouse | Data pipeline | Datahub | Delta Lake | Event Hubs | Great Expectations | Infrastructure as Code | Kubernetes | Lakehouse | Looker | Metadata | Microsoft Purview | PII | Power BI | Prefect | Python | RBAC | SQL | Schema management | Soda | Spark Streaming | Streaming processing | Tableau | Terraform | Unity Catalog | “as-code”
Education
N/A
Related jobs
-
Senior Forward Deployed Developer, Applied AI CAD 182K-187KBigQuery | C++ | CI/CD | Cloud Storage | Data ProcessingBonus | Equity | Health insurance | Paid time off | Professional developmentSenior-level Full TimeWaterloo, ON, Canada4h ago
-
Senior Data Engineer CAD 92K-171KAPI Integration | Agile | Alerting | Azure | Batch ProcessingCross-functional development opportunities | Employee resource groups | Flexible vacation | Online courses | Personal daysSenior-level Full TimeToronto, ON, CA, M5H4A613h ago
-
Cloud Computing | Data Processing | Databricks | Git | IP AddressingKnowledge sharing sessions | On-site collaborationEntry-level Full Time InternshipCanada15h ago
-
Cloud Data Developer - Databricks CAD 110K-152KAWS | Apache Kafka | Apache Spark | Azure | CI/CDAccess Online Learning Platforms | Employee & Family Assistance Program | Employee volunteer opportunities | Health, dental, vision benefits | Health/wellness spending accountSenior-level Full TimeCalgary, AB, Canada17h ago
-
API Design | Asynchronous programming | Auditability | Azure | Azure KubernetesAfter hours coverage | Hybrid workSenior-level ContractToronto, Canada1d ago
-
Mid-level Full TimeMarkham, Canada1d ago
-
Senior Data Engineer - Toronto, ON CAD 120K-140KAirflow | Apache Hive | Apache Spark | Data Modeling | Data Pipeline MonitoringSenior-level Full TimeToronto, ON, Canada1d ago
-
AI Agents | Computer Vision | Edge AI | Language Models | LinuxEntry-level Full TimeSaskatoon, SK, CA, S7K 5R61d ago
-
APIs | Airbyte | Apache Airflow | DBT | Data ModelingHome office setup budget | Language learning sessions | Paid sick days | Paid time off | Professional development courses accessSenior-level Full TimeCanada R1d ago
-
Senior Data Engineer CAD 64K-106KApache Airflow | Azure | Bash | Change Data Capture | Cloud SDKCareer growth opportunities | Continuing education | Performance incentives | Product Discounts | Retirement programsSenior-level Full Time20 Eglinton West, Canada1d ago
-
Principal Software Engineer, Agentic AI DevOps CAD 185K-309KAWS | DevOps | Generative AI | Go | Information RetrievalSenior-level Full TimeVancouver, British Columbia, CAN1d ago
-
AI DevOps Engineer CAD 125K-214KAWS | Argo CD | Argo CD GitOps | Azure | BTP Cloud FoundryHealth and wellbeing support | Hybrid work model | In office requirement 3 days per week | Learning and skill growthSenior-level Full TimeVancouver, British Columbia, CA, V6B 1A91d ago
-
Software Engineer with ETL and DataStage Development CAD 92K-164KAgile | CI/CD | Data Governance | Data Lineage | DataStageContinuous learning | Inclusive work environment | Paid vacation | Pension matching | Performance bonusSenior-level Full TimeToronto, ON, CA, M5H 1H11d ago
-
Backend Developer - Machine Learning Platform CAD 112K-141KAWS | Application design | Distributed Systems | Java | KubernetesMid-level Full TimeMontreal (Province of Quebec, Canada)2d ago
-
Machine Learning Engineer CAD 70K-100KAWS | Data cleaning | Django | GRPC | KubernetesBirthday off | Parental leave | Remote-first | Work anywhere up to 3 months | Work from home stipendMid-level Full TimeCanada - Remote, E. Europe - … R2d ago
-
Embedded Systems Designer CAD 65K-80KAlgorithms | C# | C++ | CAN bus | Data StructuresCommunity involvement | Dental insurance | Disability insurance | Employee assistance program | Gym subsidy programMid-level Full TimeWinnipeg, MB, R2K 0Y2, CA2d ago
-
Alerting | Automation systems | Cloud Platforms | Containerization | Deployment PipelinesFlexible working schedule | High autonomy | Performance bonus opportunity | Remote workMid-level FreelanceCanada R2d ago
-
Anomaly Detection | Dashboards | Data Modeling | Data Pipelines | Data QualityContinuous learning | Education support | Employee discounts | Family support | Flexible time offMid-level Full TimeCanada2d ago
-
Applied AI Engineer CAD 115K-150KAWS SageMaker | Agent Orchestration | Azure ML | DVC | Deep learningAutonomy | Continuous learning culture | Equity participation | International team | Mission-driven workMid-level Full TimeMontreal, QC2d ago
-
Staff Engineer, Data & Analytics CAD 118K-162KApache Airflow | CI/CD | Cloud platform | Containerization | DBTFlexible vacation | Flexible work options | Hackathons | Mentorship programs | Recognition programsSenior-level Full TimeRemote, Canada R2d ago
-
Apache Airflow | Apache Hadoop | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full Time5900 HURONTARIO STREET MISSISSAUGA, Canada2d ago
-
Apache Airflow | Apache Iceberg | Apache Spark | Data Lakehouse | Data orchestrationSenior-level Full Time5900 HURONTARIO STREET MISSISSAUGA, Canada2d ago
-
ML Engineer CAD 88K-132KAgentic Workflows | Application Programming | Application Programming Interfaces | Data Pipelines | DockerEmployee assistance program | Health insurance | Paid Holidays | Paid time off | Retirement plansMid-level Full TimeToronto Office TRO, Canada2d ago
-
Senior Advisor, HR Data and Analytics CAD 96K-139KAuditability | Bias Mitigation | Dashboard Development | Data Documentation | Data GovernanceCompetitive pension plan | Discounts on iA products | Employee assistance program | Ergonomic furniture program | Family assistance programSenior-level Full TimeQuebec / 1080, Grande Allee West …2d ago
-
AWS | AWS Glue | AWS Lake Formation | AWS Lambda | Amazon AthenaHybrid work environmentSenior-level Full TimeSt. John's - 18 Hebron Way, …2d ago