Principal Data Engineer (streaming)
Tasks
- Automate schema evolution and transformation tests
- Collaborate with product, analytics, and AI teams
- Define SLAs and SLOs for streaming jobs
- Design and implement scalable streaming data pipelines
- Drive data governance observability and performance tuning
- Embed data quality in processing pipelines
- Engineer and optimize real time data solutions
- Implement metrics logging tracing and alerting
- Modernize data ecosystem
- Perform peer reviews and provide feedback
Perks/Benefits
- Allyship and inclusion communities
- Caregiver leave
- Continuous development support program
- Employee assistance program
- Employee recognition
- Fertility and adoption support
- Flexible paid time off
- Parental leave
- Retirement plan matching
- Wellness Support Programs and Resources
Skills/Tech-stack
AWS | Alerting | Apache Flink | Apache Hudi | Apache Kafka | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | CI/CD | Cloud platform | Containerization | DBT | Data Governance | Data Lake Storage Gen2 | Data Quality | Databricks | Distributed Systems | Distributed tracing | Event Driven | Event-driven architecture | Google Cloud | Google Cloud Platform | Great Expectations | Lakehouse Architecture | Latency optimization | Logging | Metrics | Observability | Performance Tuning | Schema Contracts | Schema evolution | Spark Streaming | Throughput Optimization
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Senior Storage Engineer CAD 160KCapacity Planning | Cause analysis | Cloud Platforms | Data Center Infrastructure | Data centerDental coverage | Extended health coverage | Hybrid work model | Onsite gym | Paid vacationSenior-level Full TimeVancouver, British Columbia R9h ago
-
Apache Iceberg | Apache Spark | CI/CD | Clustering | CompactionDental insurance | Employee stock purchase plan | Flexible spending accounts | Health care coverage | Paid time offSenior-level Full TimeRemote Canada R1d ago
-
AI Model Deployment | AI model | API Development | AWS | C#Dental insurance | Disability insurance | Employee assistance program | Employee savings program | Fully remote within CanadaSenior-level Full TimeCanada R1d ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R2d ago
-
Principal Data Engineer USD 180K-220KAWS | Apache Airflow | Artificial Intelligence | CI/CD | Confluence401k | Autonomy | Company paid life insurance | Disability coverage | FSASenior-level Full TimeRemote - US, Canada and Poland R3d ago
-
API Design | Agent Optimization | Agent systems | Atomic operations | Caching401k plan | Calm app access | Disability insurance | In Home Office Setup Support | Internet stipendSenior-level Full TimeUnited States and Canada - Remote … R4d ago
-
Alerting | Buildkite | CI/CD | Cause analysis | Cross Database GrantsDental coverage | Employee stock purchase plan | Flexible spending account | Health coverage | Remote workSenior-level Full TimeRemote Canada R4d ago
-
Airbyte | Apache Airflow | Apache Iceberg | Cloud platform | DBTContinuous learning environment | Fully remote work environment | Health benefits | Home office setup allowance | Remote work stipendSenior-level Full TimeCanada R4d ago
-
AWS | Artificial Intelligence | BigQuery | Cloud platform | Computer VisionEquity incentives | Flexible time off | Fully remote | Healthcare coverage | Professional developmentSenior-level Full TimeCanada R4d ago
-
21 CFR | 21 CFR Part 11 | API Design | Access Control | Audit SupportEquity opportunities | Flexible seasonal breaks | Flexible work arrangements | Medical/Dental/Vision insurance | Paid parental leaveSenior-level Full TimeCanada R4d ago
-
AI Engineer Sr CAD 110K-172KAI Observability | AI Search | AI orchestration | API Development | Agentic WorkflowsCharity involvement | Recognition programs | Time off | Volunteer days | Wellness initiativesSenior-level Full TimeCanada R5d ago
-
AI Engineer Sr CAD 110K-172KAI orchestration | APIs | AWS | Access Control | Agentic WorkflowsEqual opportunity employer | Recognition programs | Time off programs | Volunteer days | Wellness programsSenior-level Full TimeCanada R5d ago
-
Airbyte | Apache Airflow | Apache Iceberg | Cloud platform | ComposerFully remote work | Health benefits | Home office setup allowance | Monthly stipend | Stock optionsSenior-level Full TimeCanada R5d ago
-
A/B | A/B Testing | B testing | C++ | Cost OptimizationEmployee assistance programs | Equity opportunities | Equity refresh grants | Medical, dental, and vision coverage | Paid time offEntry-level Full TimeCanada R5d ago
-
Machine Learning Engineer - Core Signals USD 180K-275KApache Airflow | Apache Spark | Bazel | CI/CD | CTR modeling401k match | Annual bonus | Dental insurance | Equity incentive | Fully remoteNone Full TimeRemote (US + Canada Only) R5d ago
-
Machine Learning Engineer - Applied / Product USD 180K-275KAirflow | Bazel | CI/CD | Data Pipelines | Data orchestration401k match | Dental insurance | Equity | Health insurance | Remote workSenior-level Full TimeRemote (US + Canada Only) R5d ago
-
Embedded Developer CAD 72K-80KAutomated testing | C++ | CI/CD | FastAPI | GRPCComprehensive benefits | Hybrid work | Mentorship | Paid volunteering days | Parental supportEntry-level Full TimeMontreal, QC, Canada R6d ago
-
Databricks Engineer CAD 146K-214KACID transactions | AWS Glue | AWS S3 | Agile | Amazon RedshiftCareer development | Learning and growth | Remote workSenior-level Full TimeCanada - Remote R6d ago
-
Adobe Journey Optimizer Engineer CAD 100K-150KA/B | A/B Testing | Adobe Experience | Adobe Experience Cloud | Adobe Experience PlatformComprehensive insurance plan | Growth opportunities | International career opportunities | Long-Term Disability coverage | Short term disability coverageMid-level Full TimeCanada - Remote R6d ago
-
API Development | Backend Development | Cause analysis | Cloud Native | Data QualityFlexible paid time off | Fully remote work | Parental leave | Professional growth and developmentSenior-level Full TimeCanada R6d ago
-
API Integration | AWS | Accessibility | Azure | D3.jsCollaborative environment | Contract extension | Flexible international environment | Fully remote work | High autonomySenior-level Full TimeCanada R7d ago
-
Data Platform Engineer CAD 90K-113KAWS | Airflow | Automated testing | Bash | BigQueryDocumentation and knowledge sharing culture | On demand incident response | On-call support | Remote-first workSenior-level Full TimeCanada R7d ago
-
Data Platform Engineer CAD 90K-113KAWS | Airflow | BigQuery | CI/CD | Cloud IAMFlexible work approach | On-call support rotation | Remote-first work environmentSenior-level Full TimeCanada R7d ago
-
Staff Machine Learning Engineer, Merchants CAD 213K-314KA/B | A/B Testing | B testing | Data labeling | Deep learningSenior-level Full TimeToronto, ON, CA, Remote, Canada R7d ago
-
Backend Development | Cause analysis | ClickHouse | Cloud Native | Data IntegrityEmployee stock purchase plan | Equity compensation | Flexible paid time off | Growth and development fund | Parental leaveSenior-level Full TimeRemote, Canada; Remote, US R7d ago