Senior Cloud Data Platform Engineer
Tasks
- Architect implement change data capture solutions
- Automate manual processes and implement data governance rules
- Build tune maintain ClickHouse OLAP clusters
- Create maintain data pipeline architecture for streaming and batch
- Design build operate Kafka streaming pipelines
- Maintain data protection and network security on cloud infrastructure
- Monitor manage Kafka cluster health and consumer lag
- Peer review code and promote DevOps culture
- Support data related technical issues and data infrastructure needs
- Use CI CD and infrastructure as code with Terraform
Perks/Benefits
- Career development opportunities
- Community involvement opportunities
- Health & wellbeing resources
- Hybrid work schedule
- Paid vacation
- Personal days
- Sick days
Skills/Tech-stack
Amazon Redshift | Apache Airflow | Apache Kafka | Avro | CI/CD | Change Data Capture | ClickHouse | Clickhouse SQL | Cloud Dataflow | Cloud SQL | Cloud platform | Data Capture | Debezium | Druid | GCP Pub/Sub | Google BigQuery | Google Cloud | Google Cloud Platform | JSON | Kafka Connect | Kafka Streams | Materialized views | MergeTree | Message Broker | ORC | Parquet | Protobuf | Pub/Sub | Python | SQL | Schema Registry | Terraform
Education
N/A
Related jobs
-
Mid-level Full TimeCA-ON-Mississauga10h ago
-
Data Scientist CAD 105K-132KCode review | Data Modeling | Data Pipelines | Data Warehousing | GitActionable feedback | Performance reviews | Remote-firstSenior-level Full TimeOntario23h ago
-
Data Engineer II CAD 80K-95KAccess Management | Alerting | Automation | Azure Data | Azure Data FactoryCareer progression opportunities | Collaborative supportive team | Hybrid work modelMid-level Full TimeSurrey, BC, CA, Canada23h ago
-
Availability | C37-118 | Cause analysis | Condition-Based Maintenance | CybersecuritySenior-level Full TimeMarkham, Canada R23h ago
-
Software Engineer II - Data Platform CAD 103K-129KAirflow | BigQuery | DBT | Data Engineering | Data WarehousingDental coverage | LinkedIn Learning access | Medical coverage | Paid Company Holidays | Paid sick leaveMid-level Full TimeCanada (Remote) R1d ago
-
Lead Data Engineer CAD 150K-241KBig Data | Continuous Delivery | Data Architecture | Data Engineering | Data GovernanceCareer growth support | Learning and development programs | Mentoring and coaching | Remote work optionSenior-level Full TimeToronto, Canada R1d ago
-
Senior Data Engineer USD 186K-232KAWS Lambda | Amazon EC2 | Amazon EKS | Amazon S3 | Apache AirflowChildcare support | Company paid medical/dental/vision insurance | Financial planning support | Flexible spending accounts | Health perksSenior-level Full TimeCanada1d ago
-
Machine Learning Engineer, Operations Technology CAD 135K-155KAgentic architecture | CI/CD | Data Drift | Data Drift Detection | Data QualityCareer growth and development | Fitness membership discount | Flexible-hybrid work | Generous vacation | Health and dental benefitsMid-level Full TimeToronto, Ontario, Canada1d ago
-
Staff Generative AI Engineer USD 128K-160KAWS Bedrock | Azure OpenAI | Docker | Elasticsearch | EmbeddingsSenior-level Full TimeCanada1d ago
-
Senior-level Full TimeCanada1d ago
-
A/B | A/B Testing | APIs | Agent Orchestration | Agentic AIEquity participation | Fully remote | Medical/Dental/Vision insurance | Regular offsitesSenior-level Full TimeCanada R1d ago
-
AQL | AWS | Cypher | Data Modeling | Data TransformationAnnual vacation | Hybrid work model | Learning and development support | Onboarding support buddy system | Paid sick daysSenior-level Full TimeCanada1d ago
-
Agile | Docker | Few-Shot Learning | Few-shot | Fine Tuning401k matching | Career growth | Flexible vacation | Medical/Dental/Vision insurance | Paid parental leaveSenior-level Full TimeCanada R1d ago
-
Senior AI Engineer CAD 90K-140KAPI Development | API Management | AWS | AWS Lambda | CI/CDCareer development paths | Employee well being recognition | Hybrid work flexibility | Mentoring and coaching opportunities | Wellness programsSenior-level Full TimeSun Life Toronto One York, Canada1d ago
-
Support Engineer, Data & Analytics Operations CAD 65K-105KAWS | AWS Glue | AWS Lambda | Amazon Redshift | Ansible24x7 rotational support allowance | Continuous learning and improvement | Hybrid work | Pension | Savings programsSenior-level Full TimeSun Life Toronto One York, Canada1d ago
-
Senior Data Engineer CAD 113K-163KAKS | Apache Spark | Autogen | Azure | Azure DatabricksDental insurance | Disability insurance | Employee assistance program | Health insurance | Life insuranceSenior-level Full TimeCAN, Ontario, Toronto, 250 Bloor Street …1d ago
-
Senior Data Engineer CAD 80K-128KAWS | Amazon QuickSight | Analytical modeling | Big Data | Data GovernanceCareer growth opportunities | Employee Networking | Employee mental health support programs | Hybrid work environment | Wellness programsSenior-level Full TimeSun Life Toronto One York, Canada1d ago
-
Software Engineer - Python CAD 110K-141KAPI Development | AWS | Agentic AI | Artificial Intelligence | CI/CDMid-level Full TimeCanada Remote - Consultant use only R1d ago
-
AI Engineer CAD 143K-170KBigQuery | Cache Augmented Generation | Function Calling | GitOps | Knowledge-Augmented GenerationCareer growth | Healthcare benefitsSenior-level Full TimeBrampton, Ontario, Canada1d ago
-
Senior AI Engineer CAD 90K-140KAPI Development | AWS | AWS Lambda | CI/CD | Chatbot DevelopmentCareer growth opportunities | Employee mental health support | Hybrid work options | Networking opportunities | Wellness programsSenior-level Full TimeSun Life Toronto One York, Canada1d ago
-
Director, First Party Fraud Analytics CAD 132K-231KBias Mitigation | Big Data | Data Mining | Data Visualization | DataikuAccident insurance | Coaching | Health insurance | In-depth training | Life insuranceExecutive-level Full TimeFCP, Canada1d ago
-
Support Engineer, Data & Analytics Operations CAD 65K-105KAWS | AWS Glue | AWS Lambda | Amazon Redshift | Ansible24x7 rotational support overtime eligible | Continuous learning and improvement | Hybrid work | Pension | Security clearance requiredSenior-level Full TimeSun Life Toronto One York, Canada1d ago
-
Applied AI ML Engineer - Ottawa, ON CAD 105K-130KAWS | Apache Spark | Azure | CUDA | Cloud platformCritical illness insurance | Employee resource groups | Health and dental coverage | Life insurance | Long-term disabilityMid-level Full TimeOttawa, Canada1d ago
-
Senior Data Engineer CAD 80K-128KAWS | Amazon QuickSight | Analytical Models | Big Data | Data CatalogCareer growth opportunities | Hybrid work | Networking opportunities | Wellness programsSenior-level Full TimeSun Life Toronto One York, Canada1d ago
-
Senior DevOps/MLOps CAD 90K-130KArtifactory | CI/CD | CockroachDB | Configuration Management | Continuous DeliveryExtended health benefits | Maternity parental enhancement program | Paid sick days | Paid vacation days | RRSP matchingSenior-level Full TimeVancouver, British Columbia, Canada2d ago