Senior Data Engineer (Team Lead)
Tasks
- Architect batch data solutions
- Architect streaming data solutions
- Communicate technical solutions to stakeholders
- Define data strategies with product and analytics
- Deploy and monitor data infrastructure
- Design and develop data pipelines
- Establish data governance, security, compliance
- Improve data engineering processes and tooling
- Lead data engineering initiatives
- Manage data platform reliability and scalability
- Mentor engineers and promote best practices
- Optimize data processing performance
- Support architectural decisions
Perks/Benefits
Skills/Tech-stack
Apache Hadoop | Apache Kafka | Apache Spark | Batch Processing | Cloud Data | Cloud Data Platforms | Compliance | Data Governance | Data Pipelines | Data Quality | Data Security | Data platforms | Debugging | Distributed Systems | Google BigQuery | Monitoring | Performance Tuning | Streaming Architecture | Workflow Management
Education
Related jobs
-
AWS | Alteryx | Amazon Redshift | Azure Synapse | Azure Synapse AnalyticsContinuous learning opportunities | Fully remote work | Professional growthSenior-level Full TimeCanada R1d ago
-
API Development | Agent Builder | Automated testing | BigQuery | CI/CDCareer growth | Diversity, Equity, and Inclusion Initiatives | Flexible vacation policies | Flexible working arrangements | Health and wellness benefitsSenior-level Full TimeCanada R1d ago
-
.NET | Agile | Automated testing | Azure Container | Azure Container AppsCareer growth | Collaborative team environment | Flexible work options | Generous PTO | Leadership programsSenior-level Full TimeNationwide, Canada R1d ago
-
Staff Data Engineer CAD 152K-237KAI tools | Attribution | Consent Management | Customer Data | Customer Data PlatformSenior-level Full TimeCanada R1d ago
-
DBT | DBT Cloud | DBT Core | Data Modeling | Data QualityAI tools budget | Books budget | Coaching | Coworking support | Flex daysMid-level Full TimeCanada R2d ago
-
Freelance Senior Data Engineer CAD 100K-120KAdobe Analytics | Adobe Journey Optimizer | Adobe Launch | Analytics implementation | Customer DataRemote workSenior-level FreelanceCanada R2d ago
-
API Design | Agentic Workflows | Architecture Decision | Architecture Decision Records | Artificial IntelligenceCollaborative innovation culture | Flexible work from anywhere in Canada | Fully remote work | Hiring accommodations during process | Inclusive workplace cultureSenior-level Full TimeCanada R3d ago
-
AI Search | API Design | Access Control | Artificial Intelligence | Azure AICollaborative culture | Continuous learning | Fully remote | Inclusive culture | Professional developmentMid-level Full TimeCanada R3d ago
-
Senior Engineer, Data CAD 123K-187KAmazon Redshift | Apache Airflow | Apache Kafka | Backpressure | Bias VarianceDental coverage | Flexible work hours | Fully remote | Health coverage | Parental leave top-upsSenior-level Full TimeCanada (Remote) R3d ago
-
Databricks Technical Lead CAD 145K-217KApache Spark | CI/CD | Data Quality | Data orchestration | DatabricksContinuous learning resources | Hybrid work model | Remote work option | Wellbeing support | Work-life balance programsSenior-level Full TimeLocation(s): Mississauga, Ontario, Canada R3d ago
-
Software Engineer - Canada CAD 58K-99KApache Cassandra | Apache Flink | Apache HBase | Apache Hadoop | Apache KafkaHealth insurance | Paid time offEntry-level Full TimeVancouver, British Columbia, Canada - Remote R3d ago
-
Staff ML Engineer CAD 160K-200KApache Spark | Csharp | Data Pipelines | Information Retrieval | Machine LearningCareer Development Programs | Family-friendly policies | Health benefits | Hybrid work model | Learning programsSenior-level Full TimeToronto, Canada R3d ago
-
Engineering Manager, Machine Learning Platform CAD 181K-241KData Quality | Deep learning | Deployment Workflows | Distributed Systems | GPU infrastructureDental insurance | Employee stock purchase plan | Flexible spending accounts | Health insurance coverage | Paid time offSenior-level Full TimeRemote Canada R3d ago
-
None Full TimeVancouver, British Columbia, Canada R3d ago
-
Senior-level Full TimeToronto, Canada R3d ago
-
Senior Machine Learning Engineer (GCP) CAD 182K-187KAsynchronous processing | Automl | BigQuery | CI/CD | Cloud BuildSenior-level Full TimeCanada - Remote R4d ago
-
Staff Data Eng, Data Systems, TCGplayer CAD 142K-190KAccess Control | Change Data Capture | Data Capture | Data Governance | DebeziumSenior-level Full TimeRemote Canada R4d ago
-
Apache Spark | Azure SQL | Backup and Restore | Change Data Capture | ClusteringHealth and wellness benefits | Hybrid work environment | Remote work optionSenior-level Full TimeMontreal 700, Canada R4d ago
-
Data Engineer CAD 110K-140KAPI Integration | Access Control | Alerting | Azure Data | Azure Data FactorySenior-level Full TimeCAN - Ontario - Remote, Canada R4d ago
-
Staff Data Eng, Data Systems, TCGplayer CAD 142K-190KAccess Control | Change Data Capture | Data Capture | Data Governance | Data WarehousingSenior-level Full TimeRemote Canada R4d ago
-
Associate Architect - Data Engineer CAD 100K-130KAI Search | API Design | Azure AI | Azure AI Search | Batch ProcessingMid-level Full TimeCanada - Remote R5d ago
-
Senior Machine Learning Engineer CAD 113K-153KA/B | A/B Testing | API Design | Azure Machine Learning | B testingRemote workSenior-level Full TimeVancouver, British Columbia, Canada R6d ago
-
Senior Data Engineer CAD 115K-160KAirflow | Anomaly Detection | BigQuery | Data Governance | Data ModelingDonation matching | Employee assistance program | Flexible schedule | Generous referral scheme | Health benefitsSenior-level Full TimeOttawa, Ontario - Remote R7d ago
-
Forward Deployed Engineer (Generative AI) CAD 131K-170KAI Agent Builder | AI Pipelines | Agent Builder | Agent Developer Kit | AlloyDBCareer development | Equal employment opportunity | Individual responsibilitySenior-level Full TimeCanada - Remote R7d ago
-
Data Quality Engineer (Contract) CAD 120K-130KAgile | Data Governance | Data Quality | Data Reconciliation | Data TestingDonation matching | Early leave days | Education assistance | Flexible health benefits | Flexible-hybrid workSenior-level Contract Full TimeToronto, 105 Adelaide St W, Canada R7d ago