Lead Data Engineer, (Global Security)
16 YORK ST:TORONTO, Canada
CAD 90K-140K (estimate) Senior-level Full Time
Tasks
- Automate data quality checks
- Build ETL/ELT workflows
- Conduct code reviews
- Define data models
- Design and implement batch pipelines
- Design and implement streaming pipelines
- Drive incident response for data pipelines
- Enforce schema standards
- Ensure data quality
- Implement CI/CD
- Implement observability
- Implement testing
- Improve pipeline reliability
- Ingest data from Kafka
- Ingest data from REST APIs
- Ingest data from S3
- Ingest data from enterprise databases
- Lead data engineering squad
- Maintain documentation
- Optimize pipeline performance
- Own end to end delivery of data products
- Prioritize backlog with stakeholders
- Provide technical mentorship
- Reduce pipeline cost
- Set technical direction
- Unblock team and drive sprint delivery
Perks/Benefits
- Bonuses
- Client impact
- Flexible benefits
- Learning and development coaching
- Stock options where applicable
- World class training program
Skills/Tech-stack
Airflow | Amazon S3 | Apache Kafka | CI/CD | Data Modeling | Data Quality | Databricks | Delta Lake | ELT | ETL | Git | Infrastructure as Code | Observability | Packaging | PySpark | Python | REST APIs | SQL | Terraform | Testing | Unity Catalog | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Analysis | Data pipeline | Machine Learning | Multimodal Learning | PythonMid-level Full TimeSan Francisco, California; Toronto, Canada; Redwood … R2h ago
-
Active Learning | Adaptive Sampling | Deep learning | Direct Preference Optimization | Human FeedbackMid-level Full TimeSan Francisco, California; Remote, US or … R2h ago
-
Artificial Intelligence | Cloud Computing | Data integration | Generative AI | High AvailabilityMid-level Full TimeNew York City, NY; Toronto, Ontario; … R2h ago
-
AI | AWS | Apache Kafka | Azure | C#Collaborative culture | Fully remote | Leadership opportunitySenior-level Full TimeRemote, Toronto R2h ago
-
AWS | AWS Bedrock | AWS CDK | Anthropic | CelerySenior-level Full TimeKitchener, Ontario; Remote, Canada; Remote, Canada; … R2h ago
-
Senior-level Full TimeRemote, Canada; Remote, Canada; Toronto, Ontario; … R2h ago
-
AWS | Automated testing | Azure | CI/CD | Cloud platformHigh ownership culture | Startup experienceSenior-level Full TimeOttawa, Ontario2h ago
-
AWS | Azure | Data Annotation | Data Pipelines | Docker100% remote in Quebec | AI coding tool subscription | Bilingual support | Travel up to 25 percentMid-level Full TimeMontreal or Quebec City, Quebec; Toronto, … R2h ago
-
AWS CDK | AWS DynamoDB | AWS EventBridge | AWS Glue | AWS KinesisSenior-level Full TimeToronto, Ontario; Kitchener/Waterloo, Ontario; Remote, Canada … R2h ago
-
AWS CDK | AWS DynamoDB | AWS EventBridge | AWS Glue | AWS KinesisSenior-level Full TimeToronto, Ontario; Toronto, Ontario; Toronto, Ontario; …2h ago
-
Anomaly Detection | Classification | Clustering | Data Modeling | Data PipelinesHealth benefits | Hybrid work arrangement | Paid time off | Professional developmentSenior-level Full TimeToronto, Ontario; Kitchener, Ontario; The Valley, … R2h ago
-
AWS Data | AWS Data Lakes | Amazon Web Services | Apache Spark | Data AnalysisFlexible work schedule | Hybrid work modelSenior-level Full TimeToronto, Ontario; Remote, Canada; Toronto, Ontario; … R2h ago
-
AI frameworks | API Development | AWS | AWS GenAI | Agentic SystemsSenior-level Full TimeRemote, Canada; Remote, Canada; Remote, Canada; … R2h ago
-
Azure | Azure Data | Azure Data Services | Data Services | Data WarehousingAnnual leave | Comprehensive benefits | Employer RRSP contribution | Flexible-hybrid work | Healthy work-life balanceMid-level Full TimeToronto, Ontario; Remote, Canada; Remote, Canada; … R2h ago
-
AWS | Agentic AI | Agile | Amazon Bedrock | Apache AirflowSenior-level Full TimeToronto, Ontario; New York, USA; Bay … R2h ago
-
ASIC design | C# | CDC analysis | Clock Domain | Clock Domain CrossingOn-site workSenior-level Full TimeToronto, Ontario; Toronto, Ontario7h ago
-
0in | AHB | AI/ML | AI/ML hardware | AI/ML hardware accelerationSenior-level Full TimeToronto, Ontario7h ago
-
AI Engineer CAD 135K-170KAPI Design | Agent architecture | CI/CD | Cost Optimization | DockerBusiness travel coverage | Employee stock options ESOP where applicable | Equipment allowance | Health and dental coverage | Internet reimbursementSenior-level Full TimeToronto, Ontario, Canada23h ago
-
Senior AI Engineer CAD 90K-135KAWS | AWS Lambda | AWS SageMaker | Agile | AirflowCoaching and development opportunities | Dynamic collaborative team | Flexible work life balance options | Training programSenior-level Full TimeRBC CENTRE, 155 WELLINGTON ST W:TORONTO, …23h ago
-
Senior AI Engineer CAD 90K-135KAWS | AWS Lambda | AWS SageMaker | Amazon S3 | Apache AirflowCoaching and mentoring | Flexible work-life balance | Training programsSenior-level Full TimeRBC CENTRE, 155 WELLINGTON ST W:TORONTO, …23h ago
-
API Design | Airflow | Apache Spark | Apigee | AuthenticationSenior-level Full Time335 8 AVE SW:CALGARY, Canada23h ago
-
AI Engineer CAD 67K-100KAgentic Frameworks | Deep learning | Embeddings | Fine Tuning | Generative AIMid-level Full TimeRBC CENTRE, 155 WELLINGTON ST W:TORONTO, … R23h ago
-
Senior QA Automation & AI Lead CAD 90K-136KAI Agents | API Testing | Artificial Intelligence | Azure DevOps | CI/CDCareer development opportunities | Coaching and mentoring | Dynamic collaborative team | Flexible work-life balance | Opportunities to take on greater responsibilitiesSenior-level Full Time90 WESTERN PKY:BEDFORD, Canada23h ago
-
Software Engineer, AI Platform CAD 100K-140KAlerting | C# | Event Driven | Event-driven architecture | LLMMid-level Full TimeRemote - Canada R23h ago
-
Lead AI Engineer- GTM Systems USD 135K-175KAWS Bedrock | AWS Lambda | AWS SNS | AWS SQS | Amazon EventBridgeRSU grant eligible | Remote work opportunitySenior-level Full TimeRemote - Canada R1d ago