Senior Data Engineer
Tasks
- Collaborate with data analysts data scientists and business stakeholders
- Design, develop and maintain ETL/ELT data pipelines
- Develop and optimize data processing solutions on Databricks
- Ensure data quality, consistency, and governance
- Implement data transformations cleansing and aggregation
- Ingest data from databases APIs files and cloud systems
- Maintain documentation for workflows pipelines and data models
- Monitor troubleshoot and resolve job failures and performance issues
- Optimize jobs for performance scalability and cost efficiency
- Orchestrate workflows using Apache Airflow
- Support deployment processes and release data solutions
Perks/Benefits
- Company-Paid Holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
AWS | Apache Airflow | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake | CI/CD | Data Factory | Data Governance | Data Lake | Data Modeling | Data Security | Databricks | Delta Lake | ELT | ETL | GCP | Git | Kafka | Logging | Monitoring | PySpark | Python | SQL | Spark Streaming
Education
N/A
Related jobs
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R22h ago
-
Senior-level Full TimeCanada R22h ago
-
Senior Applied AI Engineer CAD 144K-165KAI SDK | AWS ECS | AWS ECS Fargate | AWS Key Management Service | AWS LambdaSenior-level Full TimeCanada1d ago
-
AI Savvy Data Analyst (English version) CAD 110K-140KAnomaly Detection | BigQuery | Cloud APIs | Colab | Data GovernanceAdditional day off | Birthday day off | Flex days paid | Flexible work hours | Montreal transit pass discountMid-level Full TimeMontréal, QC, Canada R1d ago
-
Certified Datasets | DAX | Data Catalog | Data Governance | Data ModelingHealth insurance | Life insurance | Medical insurance | Pension plan matching | Remote workSenior-level Full TimeOttawa, ON, Canada1d ago
-
Senior Data Engineer - Corporate Data Analytics Group CAD 111K-130KAccess Control | Azure Data | Azure Data Factory | CI/CD | Data ClassificationHealth insurance | Life insurance | Medical insurance | Pension plan with company matching | Remote workSenior-level Full TimeOttawa, ON, Canada1d ago
-
Forward Deployed AI Engineer CAD 135K-170KAgent Orchestration | Azure | CI/CD | Cloud Computing | ContainersSenior-level Full TimeToronto1d ago
-
C# | CAN | Cellular communication | Code review | DebuggingMid-level Full TimeSt. Laurent, Quebec, Canada1d ago
-
Researcher – AI/ML Engineering CAD 106K-156KAudio Processing | CUDA | Computer Vision | Data Curation | Deep learningEntry-level Full TimeMarkham, Ontario, Canada1d ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting-edge technologies | Autonomy | Bonus | Collaborative culture | Distributed-first environmentMid-level Full TimeCanada R1d ago
-
Senior-level Full TimeToronto, ON, Canada1d ago
-
APIs | CI/CD | Cloud platform | Compliance | ContainersAnnual leave | Dental coverage | Health coverage | High autonomy | Home office setup supportSenior-level Full TimeCanada R1d ago
-
A/B | A/B Testing | Asynchronous programming | B testing | Canary ReleasesEngineering autonomy | Inclusive work environment | Mentorship | Remote-first flexibility | Technical leadership developmentSenior-level Full TimeCanada1d ago
-
Computer Vision/ML Engineer CAD 110K-155KC++ | Computer Vision | Data Structures | Edge AI | Embedded SystemsContinuous learning culture | High autonomy | Remote work opportunities | Technical ownershipMid-level Full TimeMontreal, QC1d ago
-
Consultant, Data and AI Analytics CAD 75K-95KAzure Databricks | C Sharp | Copilot Studio | Data analytics | GenAICareer development opportunities | Employee share purchase plan | Hybrid work arrangement | Paid growth day | Paid time offMid-level Full TimeToronto-81 Bay, 15th Floor, Canada1d ago
-
Alteryx | BigQuery | Cloud platform | Data Modeling | Data VisualizationSenior-level Full TimeToronto-81 Bay, 22nd Floor, Canada1d ago
-
API Apps | Agent systems | Angular | Apache Kafka | App ServiceDefined benefit pension plan | Employee share purchase plan | Hybrid work arrangement | Paid day off for growth and development | Social points based recognition programSenior-level Full TimeToronto-81 Bay, 15th Floor, Canada1d ago
-
Data Engineer CAD 86K-136KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageDental insurance | Disability insurance | Employee assistance program | Health insurance | Life insuranceMid-level Full TimeCAN, Ontario, Waterloo, 500 King Street …1d ago
-
Principal, Software Development Engineer CAD 168K-252KContinuous integration | Distributed Systems | Monitoring | Observability | PrometheusFlex workSenior-level Full TimeCanada, ON, Toronto1d ago
-
Data Analyst CAD 80K-128KAWS | Data Governance | Data Ingestion | Data Modeling | Data Warehousing15 vacation days | Career development opportunities | Flexible benefits | Global learning access 24 7 | Hybrid work environmentSenior-level Full TimeSun Life Toronto One York, Canada1d ago
-
Senior Data Engineer CAD 94K-129K3NF | Access Control | Asset bundles | Attribute-Based Access Control | Attribute-based accessHybrid work model | Occasional travel | Total Rewards benefitsSenior-level Full TimeVancouver - Guinness Tower, Canada1d ago
-
Software Engineer II - Gen AI CAD 81K-115KAI Studio | Azure AI | Azure AI Studio | Azure OpenAI | Data StructuresContinuous improvement | Growth opportunities | Knowledge transfer | Skill developmentMid-level Full TimeTD Centre - South - 79 …1d ago
-
Développeur en IA/AI Developer CAD 118K-152KApplication Architecture | Data Ingestion | Document processing | Enterprise Integration | Entity ExtractionCareer coaching | Disability insurance | Employee assistance program | Fitness reimbursement | Health insuranceSenior-level Full TimeCanada - Montreal2d ago
-
Senior-level Full TimeOntario, Canada2d ago
-
Senior-level Full TimeCanada R3d ago