Lead Data Engineer
Tasks
- Architect ETL ELT pipelines in AWS
- Design scalable data ingestion and transformation
- Implement data pipeline orchestration and scheduling
- Lead defect resolution and root cause analysis
- Lead migration from Ab Initio and on prem to AWS native solutions
- Mentor and guide junior engineers to deliver quality releases
- Optimize ETL application performance and reliability
- Perform Agile Scrum or SAFe planning and tracking in Jira
- Support ETL application enhancement
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | Ab Initio | Agile | Amazon Redshift | Analytical modeling | Ansible | Artifactory | Batch Processing | CI/CD | Data Governance | Data Modeling | Data Warehousing | Data pipeline | Data pipeline orchestration | Dimensional Modeling | ELT | ETL | GitHub Actions | IAM | Jira | Pipeline Orchestration | SAFe | SQL | Scrum | Security
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Engineer - EA Sports FC CAD 96K-133KAWS | Alation | Apache Airflow | Apache Kafka | Apache SparkFree games | Health insurance | Hybrid work | Mental health support | Paid time offMid-level Full Time地点:Vancouver, British Columbia, Canada9h ago
-
AI Agents | APIs | Cloud infrastructure | Governance | Language ModelsAccess to modern tools and innovation focused environment | Flexible remote work options | Holidays | Medical, dental, and vision coverage | Paid parental leaveSenior-level Full TimeCanada16h ago
-
GenAI Software Developer CAD 61K-113KAI Agents | AI Governance | AI orchestration | Agile | Cause analysisAccident insurance | Health insurance | Life insurance | Retirement benefits | Tuition reimbursementMid-level Full TimeGCS, Canada22h ago
-
Lead Data Scientist - R&D CAD 127K-203KAgentic AI | Azure | Databricks | FastAPI | Feature EngineeringSenior-level Full TimeToronto, Canada22h ago
-
Lead Machine Learning Engineer CAD 156K-251KAWS | Azure | CI/CD | Cloud Computing | Cloud platformAutonomy | Career development support | Learning and development programs | Mentorship and coachingSenior-level Full TimeToronto, Canada R23h ago
-
Principal AI Engineer CAD 214K-344KCI/CD | Container Orchestration | Docker | Fine Tuning | Information RetrievalInteractive career development tools | Learning and development programs | MentorshipSenior-level Full TimeToronto, Canada1d ago
-
AI Process Automation Engineer CAD 80K-100KAPI Integration | Agile | Application Programming | Application Programming Interface | Artificial IntelligenceAssociate discount | Health and dental benefits | Learning and development programs | Performance bonuses | RRSP/DPSPMid-level Full TimeRichmond Hill, ON, Canada1d ago
-
Senior-level Full TimeToronto, ON, Canada1d ago
-
Data Warehouse Engineer CAD 85K-95KAccess Control | Agile Development | Amazon S3 | Apache Flink | AzureMid-level Full TimeKingsville, Ontario, Canada1d ago
-
Data Warehouse Engineer CAD 90K-110KAccess Control | Agile methodology | Amazon S3 | Azure Data | Azure Data LakeMid-level Full TimeKingsville, Ontario, Canada1d ago
-
Data Analytics Engineer CAD 55K-60KData Analysis | Data Modeling | Dimensional Modeling | GitHub Copilot | LLMAccommodation for disabilitiesMid-level Full TimeKingsville, Ontario, Canada1d ago
-
Data Analytics Engineer CAD 55K-60KData Analysis | Data Modeling | Dimensional Modeling | GitHub Copilot | LLMAccommodation support for disabilitiesEntry-level Full TimeKingsville, Ontario, Canada1d ago
-
Senior Machine Learning Engineer (Fraud) CAD 153K-213KAirflow | Apache Spark | Batch Processing | CatBoost | DaskDental coverage | Employee Stock Purchase Plan (ESPP) | Flexible spending wallets | Health coverage | Remote work optionSenior-level Full TimeRemote Canada R1d ago
-
AI Foundry | Agent systems | Anthropic Claude | Azure AI | Azure AI FoundryCaregiver leave | Continuous development support program | Employee assistance program | Flexible paid time off | Parental leaveMid-level Full TimeMississauga R1d ago
-
Mid-level Full TimeToronto, ON, Canada1d ago
-
AWS SageMaker | Azure Machine Learning | CI/CD | Computer Vision | DockerBilingual work environmentMid-level Full TimeMontréal, Canada1d ago
-
Junior to Intermediate Data Engineer CAD 61K-83KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageAnnual vacation | Company holidays | Reduced rate company shares | Retirement savings plan with employer contribution | Supplementary parental leaveEntry-level Full TimeMontreal, QC, H3B 3M4, CAN1d ago
-
Data Analysis | Data Automation | Excel | Experiment design | Financial ModelingDental coverage | Employee stock purchase plan | Flexible spending allowances | Healthcare coverage | Paid HolidaysSenior-level Full TimeCanada R1d ago
-
Data Engineering Consultant CAD 95K-109KAmazon Web Services | Apache Airflow | Apache Spark | Cloud platform | DatabricksCare days | Dental care | Extended health benefits | Health savings account | Paid vacation daysMid-level Full TimeToronto1d ago
-
Senior-level Full TimeToronto R1d ago
-
Senior Data Engineer CAD 90K-110KCost Optimization | Data Ingestion | Data Modeling | Data Transformation | Data pipelineAdditional paid time off option | Annual bonus eligibility | Career development opportunities | Corporate wellness programs | Employee driven diversity programsSenior-level Full TimeCanada - Markham ON 10 Aviva …1d ago
-
Mid-level Full TimeMississauga, CA1d ago
-
Senior Software Engineer (Data Engineering) CAD 140K-210KAWS | Apache Avro | Apache Flink | Apache Iceberg | Apache KafkaFlexible work schedule | Hybrid work model | On-call supportSenior-level Full TimeCanada, BC, Vancouver1d ago
-
Ab Initio Developer (Big Data & Hadoop) CAD 88K-95KAb Initio | Apache Hadoop | CI/CD | Data Lake | Data ModelingCompany-Paid Holidays | Employee assistance program | Life and disability insurance | Medical, dental, and vision coverage | Paid time offSenior-level Full TimeToronto, CA1d ago
-
Senior-level Full TimeMarkham, Canada1d ago