Principal Data Engineer (streaming)
Tasks
- Automate schema evolution and transformation tests
- Collaborate with product, analytics, and AI teams
- Define SLAs and SLOs for streaming jobs
- Design and implement scalable streaming data pipelines
- Drive data governance observability and performance tuning
- Embed data quality in processing pipelines
- Engineer and optimize real time data solutions
- Implement metrics logging tracing and alerting
- Modernize data ecosystem
- Perform peer reviews and provide feedback
Perks/Benefits
- Allyship and inclusion communities
- Caregiver leave
- Continuous development support program
- Employee assistance program
- Employee recognition
- Fertility and adoption support
- Flexible paid time off
- Parental leave
- Retirement plan matching
- Wellness Support Programs and Resources
Skills/Tech-stack
AWS | Alerting | Apache Flink | Apache Hudi | Apache Kafka | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | CI/CD | Cloud platform | Containerization | DBT | Data Governance | Data Lake Storage Gen2 | Data Quality | Databricks | Distributed Systems | Distributed tracing | Event Driven | Event-driven architecture | Google Cloud | Google Cloud Platform | Great Expectations | Lakehouse Architecture | Latency optimization | Logging | Metrics | Observability | Performance Tuning | Schema Contracts | Schema evolution | Spark Streaming | Throughput Optimization
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Senior-level Full TimeCanada R2d ago
-
Mid-level Full TimeVancouver, Canada R3d ago
-
AI Observability | AWS | Azure | CI/CD | Cost ControlCareer advancement | Fully remote work | Professional development opportunities | Work-life balanceSenior-level Full TimeCanada R3d ago
-
AI Workflow Orchestration | AI workflow | AWS DynamoDB | AWS Lambda | AWS Step FunctionsArchitectural influence | Engineering Led Collaboration | High technical ownership | Learning opportunities | Remote-first work modelSenior-level Full TimeCanada R3d ago
-
Software Engineer II - Data Platform CAD 103K-129KAirflow | Artificial Intelligence | BigQuery | DBT | DockerDental coverage | LinkedIn Learning access | Medical coverage | Paid Company Holidays | Paid sick leaveMid-level Full TimeCanada (Remote) R4d ago
-
Senior Data Engineer CAD 120K-160KAirflow | Azure DevOps | Bash | BigQuery | CI/CDCareer development | Flexible paid time off | Health/dental coverage | In-person gatherings | Learning opportunitiesSenior-level Full TimeToronto, Ontario, Canada - Remote R4d ago
-
Senior Data & Analytics Engineer CAD 105K-128KArtificial Intelligence | Data Analysis | Data Architecture | Data Engineering | Data LineageDental insurance | Flexible remote work | Health insurance | Paid time off | Pension planSenior-level Full TimeCA Victoria, Canada R4d ago
-
Senior Machine Learning Operations Engineer USD 166K-208KAlerting | CI/CD | Canary Deployment | Champion Challenger | Drift DetectionSenior-level Full TimeSan Francisco, CA, New York, NY, … R4d ago
-
Senior Data Engineer CAD 132K-166KAWS Glue | AWS Lambda | Data Governance | Data Observability | Data QualitySenior-level Full TimeCanada (Remote) R4d ago
-
A/B | A/B Testing | AWS | Apache Kafka | B testingDental insurance | Equity | Medical insurance | Remote work environment | Vision insuranceSenior-level Full TimeRemote, USA; Remote, Canada R4d ago
-
Senior Data Engineer, Fixed Term - Toronto CAD 70K-80KAWS | Airflow | Azure | Cloud Computing | DBTBiweekly breakfasts and lunches | Buddy program | Charity volunteering days | Free snacks | Hybrid working policySenior-level TemporaryToronto Canada R4d ago
-
Senior AI Engineer | Canada | Remote CAD 164K-197KAPIs | Anthropic MCP) | BigQuery | CI/CD | CLIsGlobal annual leave policy | Remote workSenior-level Full TimeCanada (Remote) R4d ago
-
AI Safety | API Development | AWS | Agentic Systems | Amazon Web ServicesSenior-level Full TimeRemote, Canada R4d ago
-
Senior Machine Learning Engineer, Personalization CAD 156K-222KA/B | A/B Testing | B testing | CI/CD | DatabricksSenior-level Full TimeRemote - Canada R5d ago
-
Senior Data Engineer - Palantir Foundry (Hybrid, Canada) CAD 149K-190KAgile | Cloud Engineering | Data Engineering | Data Pipelines | Data QualityAutonomy | Builder culture | Career growth in new market | Hybrid work | Travel opportunitiesSenior-level Full TimeMontreal, Quebec, Canada R5d ago
-
Data Architect (BigQuery / GCP) CAD 90K-130KAirflow | Audit Logging | BigQuery | BigQuery ML | CI/CDHybrid work environment | Professional growth | Supportive work environmentSenior-level Full TimeToronto, ON, Canada R5d ago
-
Lead, Finance Analytics & Enablement AI/ML CAD 400K-500KAmplitude | Automation frameworks | Business Intelligence | Cloud platform | Cost OptimizationCo-working access | HSA | Health insurance | Life insurance | Long-term disabilitySenior-level Full TimeToronto - Remote R5d ago
-
Amplitude | Data Governance | Data Pipelines | Data Reconciliation | Data WarehousingCo-working space access | Health insurance coverage | Health savings account | Life insurance coverage | Long-term disabilitySenior-level Full TimeMontréal - Remote R5d ago
-
API Integration | API Security | Authentication | CI/CD | Cloud NetworkingAnnual performance bonus | Career growth | Fully remote workSenior-level Full TimeCanada R6d ago
-
Machine Learning Developer CAD 102KAWS | Angular | Apache Hive | Apache Pig | AzureHealth benefits | Paid time off | Retirement planEntry-level Full TimeRemote - Ontario, Canada R6d ago
-
Agile | Angular | Automated testing | Azure OpenAI | CI/CDEmployee assistance program | Health benefits | Hybrid work environment | Paid time offSenior-level Full TimeMontreal 111, Canada R6d ago
-
Senior Data Engineer CAD 121K-190KAttribution | CDP tooling | Consent Management | Cookiebot | Cross domainSenior-level Full TimeCanada R6d ago
-
Senior Data Engineer, Hybrid CAD 100K-150KApache Airflow | Apache Beam | BigQuery | CI/CD | Cost OptimizationCourse Reimbursement Program | Flexible hybrid work environment | Free online doctor visits | Mental health support | Paid time offSenior-level Full TimeOakville, Canada R6d ago
-
Senior Machine Learning Engineer CAD 142K-190KAdvertising Auction | Airflow | BigQuery | Convolutional Neural Networks | Data Pipelines401k employer match | Caregiving support | Coaching benefits | Family planning support | Flexible vacationSenior-level Full TimeRemote - Ontario, Canada R6d ago
-
Staff Data Engineer - CANADA (Remote) USD 159K-250KAWS | Airflow | Apache Kafka | Cloud Security | Data GovernanceMentorship | On-call participation | Remote work | Technical leadership growthSenior-level Full TimeCanada R6d ago