Data Engineer
Location(s): Mississauga, Ontario, Canada
CAD 120K-170K Senior-level Full Time
Tasks
- Architect batch and real time data pipelines
- Define coding testing deployment monitoring standards
- Develop scalable data pipelines
- Enforce data modeling and Lakehouse standards
- Implement lakehouse table formats
- Lead and mentor data engineering teams
- Manage Databricks workspaces and governance
- Manage delivery milestones risks and dependencies
- Optimize Spark jobs and SQL queries
- Perform code reviews and architecture reviews
- Tune Spark performance and execution plans
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Adaptive Query | Adaptive query execution | Apache Iceberg | Apache Kafka | Apache Spark | Broadcast Join | Catalyst Optimizer | Compaction | Data Skew | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Execution Plans | Job Clusters | Lakehouse | Medallion Architecture | Memory Management | Partition Pruning | Predicate pushdown | Python | Query Execution | SQL | Scala | Schema evolution | Shuffling | Spark Structured Streaming | Structured Streaming | Tungsten | Unity Catalog | Z-ordering
Education
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead
Related jobs
-
Senior-level Full TimeRemote, Canada; Computer/Software; Canada, Canada; Remote, … R8h ago
-
AI Development Co-op CAD 85K-111KData Preprocessing | Feature Engineering | GitLab | Hopsworks | JavaScriptSenior-level Full TimeMontreal,Quebec,Canada10h ago
-
AI Software Engineer CAD 130K-155K.NET | Authentication | Authorization | Azure DevOps | Azure OpenShiftFree snacks | Health, dental, vision coverage | Paid personal days | Paid vacation | Professional dues reimbursementSenior-level Full TimeCambridge, ON, CA14h ago
-
Développeur I- IA Analytique avancée CAD 72K-121KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsFlexible work schedule | Health insurance programs | Hybrid telework | Paid vacation | Retirement planMid-level Full TimeMontréal, QC, CA17h ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Entrepreneurial environment | Hands-off management | Remote distributed settingMid-level Full TimeWaterloo, Canada18h ago
-
Senior Data Engineer CAD 80K-138KActive Directory | Azure Active Directory | Azure Blob | Azure Blob Storage | Azure DataDeloitte Days | Development and Innovation Days | Flexible benefit spending account | Flexible work arrangements | Hybrid workSenior-level Full TimeToronto, ON, CA, M5H 0A9 R18h ago
-
AWS | AWS Bedrock | Agent patterns | Airtable | Backend DevelopmentFully remote | Globally distributed team | Home office stipend | Learning and development stipend | Long-Term Disability coverageMid-level Full TimeCanada R21h ago
-
Senior-level Full TimeToronto, Canada1d ago
-
Senior Data Platform Engineer CAD 157K-212KAPI Design | AWS CloudFormation | AWS Glue | Amazon Kinesis | Amazon S3Counseling benefit | Flexible time off | Hybrid work environment | RESP contribution | RRSP matchingSenior-level Full TimeCalgary, Canada R1d ago
-
Mid-level Full TimeLocation(s): Mississauga, Ontario, Canada1d ago
-
AI Engineering Specialist CAD 108K-152KAI Foundry | AI Search | AWS Fargate | AWS IAM | AWS LambdaDental insurance | Disability insurance | Employee share purchase program | Life insurance | Medical insuranceMid-level Full TimeWaterloo, Ontario, Canada1d ago
-
AWS | Azure | Azure DevOps | Bash | CI/CDCoaching and development | Collaborative team environment | World class training programMid-level Full TimeRBC CENTRE, 155 WELLINGTON ST W:TORONTO, …1d ago
-
Embedded Software Engineer - New Grad CAD 68K-109KAgile | Bare Metal | Bash | C# | C++401k matching | Company-Paid Holidays | Employee assistance program | Employee stock purchase program | Paid family leaveEntry-level Full TimeCanada- Ottawa- 385 Terry Fox- Bldg …1d ago
-
Machine Learning Software Engineer - (New Grad) CAD 60K-103KCI/CD | Code review | Containers | Data Pipelines | Data PreprocessingCoaching | Collaborative team environment | Development opportunities | Flexible working environmentEntry-level Full Time777 BAY ST, TH 27:TORONTO, Canada1d ago
-
AWS DataHub Developer CAD 115K-157KAPI Gateway | AWS CDK | AWS CloudFormation | AWS Glue | AWS LambdaSenior-level Contract Full TimeCanada - Remote R1d ago
-
Machine Learning Engineer CAD 99K-149KAmazon Web Services | C++ | CUDA | Cloud platform | Distributed SystemsMid-level Full TimeToronto1d ago
-
AAC | Android | Audio drivers | Bring-up | C#Senior-level Full TimeMarkham, Ontario2d ago
-
Data Quality Management Lead CAD 85K-156KAnomaly Detection | Ataccama | Azure | Collibra | Data ClassificationDeloitte Days | Flexible benefits spending account | Flexible work arrangements | Hybrid work | Learning daysSenior-level Full TimeToronto, ON, CA, M5H 0A9 R2d ago
-
Data Governance Lead CAD 85K-156KAgile | Alation | Approval Workflows | Ataccama | AtlanHybrid work model | Mentoring | On-the-job coaching | Proactive benefits | Wellbeing benefitsSenior-level Full TimeToronto, ON, CA, M5H 0A9 R2d ago
-
Agile Scrum | Azure Data | Azure Data Factory | Azure DevOps | CI/CDFrench required | Hybrid workMid-level Full TimeMontreal, Quebec, Canada3d ago
-
Analyste en ETC (Extraction, Transformation et Chargement des données) / Data Engineer A CAD 82K-128KAgile | Data Governance | Data Mart | Data Quality | Data SecuritySenior-level Full TimeMontreal, Quebec, Canada3d ago
-
Software Engineer, Fulfillment CAD 108K-135KAWS | Buildkite | CI/CD | CircleCI | Distributed SystemsChild care benefits | Company retirement plan | Dental insurance | Disability benefits | Family building benefitsMid-level Full TimeToronto, Canada R3d ago
-
DeepSpeed | Distributed Systems | Docker | FSDP | Fine TuningEntry-level Full TimeEdmonton, Alberta, Canada3d ago
-
AI Agents | Cloud Computing | Databases | Debugging | Distributed SystemsEntry-level Full TimeMarkham, Ontario, Canada3d ago
-
Forward Deployed AI Lead CAD 228K-253KAWS | Agentic AI | Anthropic Claude | Artificial Intelligence | CI/CD100% remote work | Annual learning and development stipend | Equipment and office stipend | Equitable Life Hybrid Plan | Long-term disabilitySenior-level Full TimeCANADA R3d ago