Senior Software Engineer - Data Platform (Spark & Trino)
Tasks
- Build end to end tracing metrics and alerting
- Build large scale distributed data processing platform in cloud
- Design fault-tolerant, high-availability architectures
- Develop data processing algorithms for large datasets
- Implement multi tenant isolation for elastic workloads
- Implement resiliency and graceful degradation for Spark and Trino clusters
- Optimize resource allocation and cluster auto scaling
Perks/Benefits
Skills/Tech-stack
AWS | Apache Spark | Cloud platform | Distributed Systems | Google Cloud | Google Cloud Platform | Grafana | JMX | Java | Linux | OpenTelemetry | Presto | Prometheus | SQL | Scala | Trino
Education
Regions
Countries
States
Related jobs
-
Senior Data Engineer INR 1500K-2800KApache Spark | Data Governance | Data Pipelines | Data Privacy | Data SecurityLocal presence requiredSenior-level Full TimeOntario Centre (Queensville), India1d ago
-
Machine Learning Analyst CAD 68K-93KAWS | Azure | Databricks | Faiss | GCPEmployee assistance program | Employee share ownership plan | Health and dental benefits | In-store discount | Learning and development opportunitiesEntry-level Full TimeToronto, ON, M5V 1X6, CAN1d ago
-
Senior-level Full TimeCAN, Ontario, Toronto, 200 Bloor Street …1d ago
-
ML Platform Engineer CAD 129K-174KAWS | Azure | CI/CD | GCP | Generative AICounseling benefit | Employee recognition program | Flexible time off | Health, dental, and vision insurance | Hybrid work environmentSenior-level Full TimeRemote - Canada R1d ago
-
Senior Developer (Lending Data Engineering) CAD 107K-145KAWS Glue | AWS Lambda | AWS Step Functions | Amazon EventBridge | Amazon QuickSightGroup benefits | Hybrid work options | Learning and development opportunities | Performance-based incentive | Savings plansSenior-level Full TimeAgriculture Place, Canada1d ago
-
Databricks/Snowflake/Python CAD 62K-142KAgile | Apache Airflow | Automated testing | Autosys | AzureCompany-Paid Holidays | Employee assistance programs | Life and disability insurance | Medical, dental, and vision coverage | Paid time offEntry-level Full TimeMontreal, CA1d ago
-
AI Engineer CAD 143K-170KAnthropic API | BigQuery | CAG | Function Calling | GitOpsCareer growth | Healthcare benefitsSenior-level Full TimeBrampton, Ontario, Canada1d ago
-
Data Engineer CAD 88K-120KAccess Governance | Agile | Business Objects | CI/CD | Continuous integrationVisa sponsorshipMid-level Full TimeMontreal, QC1d ago
-
Attribution Modeling | CRM | Cohort Analysis | Commerce Cloud | Data GovernanceDental insurance | Employer REER contribution | Health and wellness reimbursement | New parent leave supplement | Online health supportEntry-level Full TimeMontreal, QC, Canada1d ago
-
Agile | Bring-up | C# | C++ | CI/CDDental insurance | Disability income protection | Employee assistance program | Family assistance program | Flexible drug plansSenior-level Full TimeSainte-Anne-de-Bellevue, Quebec, Canada1d ago
-
Développeur en apprentissage automatique, senior CAD 133K-238KApache Spark | Azure | Azure Functions | Azure Key Vault | Azure LogicEntry-level ApprenticeshipCanada1d ago
-
Senior-level Full TimeEast Toronto (Studio District), Canada2d ago
-
API Key | Airflow | Alerting | BigQuery | Data orchestration401k Retirement Plan Support | Dental coverage | Flexible PTO | Healthcare coverage | Home office stipendSenior-level Full TimeCanada2d ago
-
AWS | AWS Lambda | Amazon DynamoDB | Amazon Kinesis | Amazon RDSFlexible remote work | Health, dental, vision benefits | Parental leave benefits | Professional development stipendSenior-level Full TimeCanada2d ago
-
A/B | A/B Testing | B testing | Caching | Causal InferenceDental insurance | Health insurance | Holidays | Learning resources | Paid time offSenior-level Full TimeCanada R2d ago
-
AWS | CI/CD | Cloud platform | Distributed Systems | DockerDental insurance | Equity opportunities | Health insurance | Holiday closures | Paid time offSenior-level Full TimeCanada2d ago
-
AI Prompt Engineer USD 40K-60KConversational AI | Generative AI | Information Retrieval | JavaScript | Language ModelsSenior-level Full TimeCanada2d ago
-
Data Engineer CAD 120K-150KBigQuery | CI/CD | Cloud platform | Data Governance | Data ModelingCareer advancement | Flexible workplace | Referral programSenior-level Full TimeToronto, ON, Canada2d ago
-
Mid-level Full TimeFCP, Canada2d ago
-
Azure | CI/CD | Cloud Data | Cloud Data Platform Administration | Cloud data platformBenefits allowance | Comprehensive health and dental benefits | Defined benefit pension plan | Employee and family assistance program | One day remote per weekSenior-level Full TimeCA Vancouver, Canada R2d ago
-
Amazon QuickSight | Amazon Redshift | Data Modeling | Data Transformation | Data WarehousingDental insurance | Health insurance | Paid time off | Retirement plan | Vision insuranceMid-level Full TimeVancouver, British Columbia, CAN2d ago
-
Data Engineer CAD 86K-136KAzure Data | Azure data pipelines | Cognos | Data Governance | Data LakeDental insurance | Disability insurance | Employee assistance program | Health insurance | Life insuranceMid-level Full TimeCAN, Ontario, Toronto, 200 Bloor Street …2d ago
-
Fall Co-op 2026 – Data Engineer CAD 52K-70KAWS | Azure | Bitbucket | Data Modeling | Data WarehousingCommunity events | Hybrid work | Mentorship | Personalized career developmentEntry-level Full TimeCAN, Ontario, Toronto, 200 Bloor Street … R2d ago
-
Analytics Engineer, 12 Month Contract CAD 69K-126KAI | Data Cleansing | Data Enrichment | Data Mining | Data ModelingMid-level Full TimeToronto, ON, CA, M5C2W12d ago
-
Senior Software Engineer CAD 94K-152KApache Kafka | Apache Spark | Azure | Cloud platform | Data ClassificationAccessibility and workplace accommodations | Community engagement programs | Employee resource groups | Flexible vacation | Free tea and coffeeSenior-level Full TimeToronto, ON, CA, M5H 1H12d ago