Lead Data Engineer, (Global Security)
16 YORK ST:TORONTO, Canada
CAD 90K-140K (estimate) Senior-level Full Time
Tasks
- Automate data quality checks
- Build ETL/ELT workflows
- Conduct code reviews
- Define data models
- Design and implement batch pipelines
- Design and implement streaming pipelines
- Drive incident response for data pipelines
- Enforce schema standards
- Ensure data quality
- Implement CI/CD
- Implement observability
- Implement testing
- Improve pipeline reliability
- Ingest data from Kafka
- Ingest data from REST APIs
- Ingest data from S3
- Ingest data from enterprise databases
- Lead data engineering squad
- Maintain documentation
- Optimize pipeline performance
- Own end to end delivery of data products
- Prioritize backlog with stakeholders
- Provide technical mentorship
- Reduce pipeline cost
- Set technical direction
- Unblock team and drive sprint delivery
Perks/Benefits
- Bonuses
- Client impact
- Flexible benefits
- Learning and development coaching
- Stock options where applicable
- World class training program
Skills/Tech-stack
Airflow | Amazon S3 | Apache Kafka | CI/CD | Data Modeling | Data Quality | Databricks | Delta Lake | ELT | ETL | Git | Infrastructure as Code | Observability | Packaging | PySpark | Python | REST APIs | SQL | Terraform | Testing | Unity Catalog | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
C++ | Compiler design | Computer Architecture | Linux | Machine LearningHealth insurance | Hybrid work model | Life insurance | Paid time off | Retirement savings matchSenior-level Full TimeRemote, Canada R2h ago
-
Data Analysis | Data pipeline | Machine Learning | Multimodal Learning | PythonMid-level Full TimeSan Francisco, California; Toronto, Canada; Redwood … R2h ago
-
Active Learning | Adaptive Sampling | Deep learning | Direct Preference Optimization | Human FeedbackMid-level Full TimeSan Francisco, California; Remote, US or … R2h ago
-
Artificial Intelligence | Cloud Computing | Data integration | Generative AI | High AvailabilityMid-level Full TimeNew York City, NY; Toronto, Ontario; … R2h ago
-
AI | AWS | Apache Kafka | Azure | C#Collaborative culture | Fully remote | Leadership opportunitySenior-level Full TimeRemote, Toronto R2h ago
-
AWS | AWS Bedrock | AWS CDK | Anthropic | CelerySenior-level Full TimeKitchener, Ontario; Remote, Canada; Remote, Canada; … R2h ago
-
Senior-level Full TimeRemote, Canada; Remote, Canada; Toronto, Ontario; … R2h ago
-
AWS | Azure | Data Analysis | Data Visualization | Deep learningMid-level Full TimeRemote, Canada; San Francisco, California; Toronto, … R2h ago
-
AWS | Automated testing | Azure | CI/CD | Cloud platformHigh ownership culture | Startup experienceSenior-level Full TimeOttawa, Ontario2h ago
-
APIs | Data Governance | Data Migration | Data Modeling | Data WarehousingSenior-level Full TimeOntario, Canada2h ago
-
Senior-level Full TimeCanada or US, N/A; Toronto, Ontario; … R2h ago
-
AWS | Azure | Data Annotation | Data Pipelines | Docker100% remote in Quebec | AI coding tool subscription | Bilingual support | Travel up to 25 percentMid-level Full TimeMontreal or Quebec City, Quebec; Toronto, … R2h ago
-
AWS CDK | AWS DynamoDB | AWS EventBridge | AWS Glue | AWS KinesisSenior-level Full TimeToronto, Ontario; Kitchener/Waterloo, Ontario; Remote, Canada … R2h ago
-
AWS CDK | AWS DynamoDB | AWS EventBridge | AWS Glue | AWS KinesisSenior-level Full TimeToronto, Ontario; Toronto, Ontario; Toronto, Ontario; …2h ago
-
Anomaly Detection | Classification | Clustering | Data Modeling | Data PipelinesHealth benefits | Hybrid work arrangement | Paid time off | Professional developmentSenior-level Full TimeToronto, Ontario; Kitchener, Ontario; The Valley, … R2h ago
-
AWS Data | AWS Data Lakes | Amazon Web Services | Apache Spark | Data AnalysisFlexible work schedule | Hybrid work modelSenior-level Full TimeToronto, Ontario; Remote, Canada; Toronto, Ontario; … R2h ago
-
AI frameworks | API Development | AWS | AWS GenAI | Agentic SystemsSenior-level Full TimeRemote, Canada; Remote, Canada; Remote, Canada; … R2h ago
-
Azure | Azure Data | Azure Data Services | Data Services | Data WarehousingAnnual leave | Comprehensive benefits | Employer RRSP contribution | Flexible-hybrid work | Healthy work-life balanceMid-level Full TimeToronto, Ontario; Remote, Canada; Remote, Canada; … R2h ago
-
API Design | Distributed Systems | LLM | Python | RAGEarly-stage environment | Enterprise customer impact | High autonomySenior-level Full TimeRemote, Canada or US; Remote, Canada; … R2h ago
-
AWS | Agentic AI | Agile | Amazon Bedrock | Apache AirflowSenior-level Full TimeToronto, Ontario; New York, USA; Bay … R2h ago
-
ASIC design | C# | CDC analysis | Clock Domain | Clock Domain CrossingOn-site workSenior-level Full TimeToronto, Ontario; Toronto, Ontario8h ago
-
0in | AHB | AI/ML | AI/ML hardware | AI/ML hardware accelerationSenior-level Full TimeToronto, Ontario8h ago
-
AI Engineer CAD 135K-170KAPI Design | Agent architecture | CI/CD | Cost Optimization | DockerBusiness travel coverage | Employee stock options ESOP where applicable | Equipment allowance | Health and dental coverage | Internet reimbursementSenior-level Full TimeToronto, Ontario, Canada1d ago
-
Senior AI Engineer CAD 90K-135KAWS | AWS Lambda | AWS SageMaker | Agile | AirflowCoaching and development opportunities | Dynamic collaborative team | Flexible work life balance options | Training programSenior-level Full TimeRBC CENTRE, 155 WELLINGTON ST W:TORONTO, …1d ago
-
Senior AI Engineer CAD 90K-135KAWS | AWS Lambda | AWS SageMaker | Amazon S3 | Apache AirflowCoaching and mentoring | Flexible work-life balance | Training programsSenior-level Full TimeRBC CENTRE, 155 WELLINGTON ST W:TORONTO, …1d ago