Principal Data Engineer (streaming)
Tasks
- Automate schema evolution and transformation tests
- Collaborate with product, analytics, and AI teams
- Define SLAs and SLOs for streaming jobs
- Design and implement scalable streaming data pipelines
- Drive data governance observability and performance tuning
- Embed data quality in processing pipelines
- Engineer and optimize real time data solutions
- Implement metrics logging tracing and alerting
- Modernize data ecosystem
- Perform peer reviews and provide feedback
Perks/Benefits
- Allyship and inclusion communities
- Caregiver leave
- Continuous development support program
- Employee assistance program
- Employee recognition
- Fertility and adoption support
- Flexible paid time off
- Parental leave
- Retirement plan matching
- Wellness Support Programs and Resources
Skills/Tech-stack
AWS | Alerting | Apache Flink | Apache Hudi | Apache Kafka | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | CI/CD | Cloud platform | Containerization | DBT | Data Governance | Data Lake Storage Gen2 | Data Quality | Databricks | Distributed Systems | Distributed tracing | Event Driven | Event-driven architecture | Google Cloud | Google Cloud Platform | Great Expectations | Lakehouse Architecture | Latency optimization | Logging | Metrics | Observability | Performance Tuning | Schema Contracts | Schema evolution | Spark Streaming | Throughput Optimization
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Senior Data Platform Engineer USD 133K-197KAWS | Amazon IAM | Amazon Redshift | Ansible | Apache IcebergDental benefits | Free 1Password account | Generous paid time off | Health benefits | Maternity and Parental Leave Top-UpSenior-level Full TimeRemote (United States | Canada) R2d ago
-
Senior ML Engineer USD 152K-228KAmazon SageMaker | Baseten | Batching | CI/CD | Google Vertex401k matching | Dental insurance | Fertility assistance | Flexible time off | Health insuranceSenior-level Full TimeRemote - US & Canada (see … R2d ago
-
AWS SageMaker | Airflow | Azure ML | CI/CD | Canary DeploymentSenior-level Full TimeMontreal,QC,Canada R2d ago
-
AI Software Engineer USD 181K-270KAWS | CI/CD | Docker | Edge Functions | GitHub CopilotComprehensive benefits | Equity | Learning stipend | Remote-first cultureSenior-level Full TimeUnited States or Canada R3d ago
-
AI Architect CAD 120K-140K.Net Core | API Integration | AWS | Autogen | AzureDeferred profit-sharing | Dental insurance | Health insurance | Hybrid work | Paid time offSenior-level Full TimeRemote (Canada) with optional hybrid work … R3d ago
-
Data Developer CAD 120K-140KAPIs | AWS | Apache Airflow | Apache Spark | AzureOn call support for global time zones | Remote work flexibilitySenior-level Full TimeCanada Home Office - ON R3d ago
-
Senior Staff Data Engineer - Platform Data and Analytics CAD 228K-313KAWS | Alerting | Apache Airflow | Apache Spark | Batch ProcessingComprehensive benefits | Equity | Hybrid work flexibility | Remote work up to 4 weeks per yearSenior-level Full TimeKitchener-Waterloo, ON; Toronto, ON R3d ago
-
Principal Data AI Architect CAD 189K-304KApache Flink | Apache Kafka | Apache Spark | Artificial Intelligence | Big DataInteractive career development tools | Learning and development programs | MentorshipSenior-level Full TimeToronto, Canada R3d ago
-
AI Agents | AI Governance | Access Control | Azure OpenAI | Azure SecurityCertification support | Collaborative innovation driven culture | Continuous learning opportunities | Employer-paid medical premiums | Exposure to enterprise AI deploymentsMid-level Full TimeCanada R4d ago
-
Senior Data Engineer CAD 140K-210KAWS | AWS CDK | AWS Glue | Amazon Athena | Amazon SageMakerCompany paid group benefits | Holiday closure | Mental health support stipend | Monthly paid meals | Paid time offSenior-level Full TimeRemote - Canada R4d ago
-
AI infrastructure | Benchmarking | Bottleneck analysis | Cloud Computing | Edge ComputingAutonomy | Continuous learning | Flexible location options | Fully remote work | Professional developmentMid-level Full TimeCanada R5d ago
-
Senior-level Full TimeVancouver, British Columbia, Canada R5d ago
-
Software Engineer II - Model Platform CAD 100K-159KAWS | Asynchronous Communication | Azure | Data Pipelines | Data ProcessingMid-level Full TimeRemote - Canada R5d ago
-
Senior Software Engineer (Typescript / FrontEnd) - AI/ML CAD 140K-195KAI Inference | API Design | AWS | Azure | Cloud deploymentFlexible time off | Global gatherings | Healthcare | Home office setup | Remote-friendlySenior-level Full TimeCanada R6d ago
-
AI Agents | Access Management | Azure OpenAI | C# | ComplianceContinuous learning | Dental insurance | Flexible work arrangements | Fully remote | Health insuranceMid-level Full TimeCanada R6d ago
-
Senior Data Platform Engineer USD 148K-227KAWS | Airbyte | Ansible | Apache Airflow | DBT401k matching | Dental benefits | Health benefits | IT Setup Stipend | Internet and mobile stipendSenior-level Full TimeRemote - Canada Only R6d ago
-
Staff Data Eng, Data Systems, TCGplayer CAD 142K-190KApache Kafka | Data Architecture | Data Engineering | Data Governance | Data Lifecycle ManagementSenior-level Full TimeRemote Canada R6d ago
-
Machine Learning Engineer (with Vertex AI Experience) CAD 152K-180KAuthentication | Automl | BigQuery | CI/CD | Cloud BuildCareer development opportunities | Entrepreneurial environment | Equal employment opportunity | High responsibilitySenior-level Full TimeCanada - Remote R7d ago
-
AWS | Airflow | Apache Flink | Apache Hadoop | Apache KafkaFully remote-first | Home office stipend | Inclusive workplace culture | Manager coaching | Paid parental leaveSenior-level Full TimeCanada R7d ago
-
Lead Machine Learning Engineer CAD 175K-200KAI Pipelines | CI/CD | Cloud platform | Distributed Computing | FastAPICompany off-sites and meetups | Family assistance program | Group insurance | Home office budget | Lifestyle daysSenior-level Full TimeCanada R8d ago
-
Staff Software Developer, Machine Learning CAD 118K-162KAWS | Argo CD | Azure | Big Data | Context engineeringCareer development | Flexible vacation | Flexible work options | Hackathons | Mentorship programsSenior-level Full TimeRemote, Canada R10d ago
-
Senior AI Engineer CAD 143K-150KAPI Design | AWS | Async Programming | Bedrock | CI/CDDental | Extended Health | Flexible paid time off | Health spending account | Long-term disabilitySenior-level Full TimeCAN-ON-Remote, Canada R10d ago
-
Data Engineer II CAD 80K-100KAWS EMR | AWS S3 | Airflow | Amazon EC2 | Amazon Web ServicesCharity matching | Community volunteering time off | Comprehensive benefits package | Education reimbursement | Generous paid time offEntry-level Full TimeVictoria, British Columbia, Canada; Remote, Alberta, … R10d ago
-
Senior Data Engineer CAD 110K-140KAgile | Apache Spark | BigQuery | Cloud platform | Continuous integrationGroup insurance | Home office budget | Lifestyle days | Paid books and subscriptions | Paid certificationsSenior-level Full TimeCanada R11d ago
-
Apache Spark | Azure | CI/CD | Data Governance | Data LineageFlexible vacation | Flexible work options | Hackathons | Mentorship programs | Recognition programsSenior-level TemporaryRemote, Canada R11d ago