Senior Software Engineer - Data Platform
Tasks
- Build data replication systems
- Build metadata and orchestration services
- Create data catalogs and discovery services
- Design data ingestion systems
- Develop Spark and Databricks processing improvements
- Develop internal libraries and APIs
- Improve reliability observability scalability security
- Operate data lakehouse infrastructure
Perks/Benefits
Skills/Tech-stack
AWS ECS | AWS Lambda | AWS S3 | Airflow | Amazon DynamoDB | Amazon Kinesis | Amazon RDS | Amazon SQS | Amundsen | Apache Hudi | Apache Iceberg | Apache Spark | CloudFormation | Dagster | Data orchestration | Data replication | Databricks | Datahub | Delta Lake | Docker | Event Driven | Event-driven architecture | Go | Hive Metastore | Hudi | Infrastructure as Code | Java | Kubernetes | Prefect | Python | Scala | Streaming Data | Terraform | Unity Catalog | “as-code”
Education
N/A
Related jobs
-
ETL Data Engineer - HYBRID CAD 110K-144KAWS | Airflow | Amazon Redshift | Azure | Azure SynapseHybrid workSenior-level Full TimeHalifax, NS, CA R10h ago
-
Senior-level Full TimeToronto, Canada R11h ago
-
Operations Data Engineer | Luma CAD 105K-125KAWS | Cloud Architecture | Cloud Cost Optimization | Cloud Governance | CloudWatchCareer development | Collaborative team environment | Health and wellness benefits | Remote-friendly environmentMid-level Full TimeRemote - Canada R1d ago
-
Agile | BigQuery | Cloud Composer | Cloud Storage | Cloud platformRemote workSenior-level Full TimeToronto, ON, CA, M5J 2V5 R1d ago
-
Senior Software Engineer - Data Platform CAD 191K-191KAccess Control | Apache Airflow | Apache Kafka | Apache Spark | Cloud DataSenior-level Full TimeRemote - Canada R1d ago
-
Senior Software Engineer, Data Systems (Python) USD 170K-200KAPI | API Keys | Alerting | Apache Airflow | Batch Processing401k | Flexible PTO | Healthcare benefits | Paid Holidays | Paid parental leaveSenior-level Full TimeRemote - Canada R1d ago
-
Senior Data Engineer II, Finance CAD 188K-198KAirflow | Amazon Redshift | Apache Iceberg | Apache Spark | DBTAnnual refresh grants | Flexible work location | New hire equity grant | Remote workSenior-level Full TimeCanada - Remote (ON, AB, BC, … R1d ago
-
Senior Data Engineer CAD 120K-145KAWS | AWS CloudFormation | Apache Flink | Azure | Batch ProcessingSenior-level Full TimeCanada, Remote R1d ago
-
AWS | Amazon Aurora | Amazon RDS | Automation | Database Backup24/7 on-call rotation | Collaborative engineering environment | Fully remote within Canada | Long-term career growthSenior-level Full TimeCanada R1d ago
-
AI Agents | API Integration | Automation tools | Language Models | Large Language ModelsAccess to cutting-edge technologies | Collaboration with experienced professionals | Fully remote | High ownership and autonomy | Learning-focused cultureMid-level Full TimeCanada R2d ago
-
Senior Synapse Engineer (Remote) CAD 120K-145KAutoscaling | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Remote workSenior-level Full TimeOntario, Canada, Canada R2d ago
-
AWS | Azure | CI/CD | Cloud platform | Data PipelinesDental insurance | Family support benefits | Flexible spending accounts | Flexible time off | Health insuranceSenior-level Full TimeCanada R3d ago
-
Senior Software Engineer (Pipeline team) CAD 145K-191KA/B | A/B Testing | AWS Bedrock | AWS ECS | AWS EKSSenior-level Full TimeCanada - Remote R4d ago
-
AWS | Airflow | Apache Spark | Azure Synapse | Azure Synapse Analytics401k matching | Disability insurance | Employee assistance program | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeRemote, USA ; Remote, Canada R4d ago
-
AI Pipelines | CI/CD | Cloud platform | Distributed Computing | FastAPIAnnual learning and equipment budget | Company provided MacBook | Employer Paid Dental Benefits | Employer paid health benefits | Employer paid virtual medical benefitsSenior-level Full TimeCanada R5d ago
-
Freelance Machine Learning Engineer CAD 110KLLM | Langchain | MLOps | NumPy | PandasFlexible hours | Part-time project-based workMid-level FreelanceCanada - Remote R5d ago
-
LLMs | Langchain | MLOps | Machine Learning | NumPyProject based workMid-level FreelanceCanada - Remote R5d ago
-
Systems Engineer - Analytics (Hybrid) CAD 75K-102KC# | Data Analysis | IEC 60601 | IEC 62304 | ISO 13485Adoption leave top up | Career learning support | Fertility drug treatment coverage support | Flexible work hours | Hybrid work environmentMid-level Full TimeBurnaby, BC, V5J 0B6, CAN R5d ago
-
Principal Data Engineer - MarTech USD 143K-178KAPI Integration | Batch Data Processing | Batch data | CCPA | Customer DataHealth and welfare benefits | Hybrid work model | Paid time off | Remote work flexibilitySenior-level Full TimeRemote, US or Remote, Ontario, Canada R5d ago
-
Staff Backend Engineer (AI Platform team) USD 185K-242KAWS | Agent Frameworks | Compliance | Data Privacy | DatadogEquity | Flexible PTO | Medical coverage | Monthly lifestyle stipendSenior-level Full TimeRemote - United States & Canada R5d ago
-
AWS | Amazon Kinesis | Apache Airflow | Apache Kafka | Apache SparkEmployee assistance program | Equity participation opportunities | Flexible paid time off | Fully remote work | Learning and professional developmentSenior-level Full TimeCanada R6d ago
-
Big Data Senior Developer, Marketing & Advertising Data (French Services) (Telework/Hybrid) CAD 80K-110KAirflow | Apache Spark | Azure | Azure Data | Azure Data FactoryBackground check required | Employee benefits package | Employee resource groups | Flexible hours | Hybrid workSenior-level Contract Full TimeQuebec (36.25), Canada R6d ago
-
Software Dev QA (FortiSASE) CAD 83K-102KAWS | Azure | Cloud platform | DNS | FirewallsCritical illness insurance | Disability insurance | Employee assistance program | Group retirement savings plan | Health spending accountEntry-level Full TimeBurnaby, BC, Canada R6d ago
-
Senior Software Engineer I — Agentic Analytics USD 168K-177KAirflow | Cost Optimization | DBT | Evaluation Frameworks | Machine LearningAnnual equity refresh grants | Equity grant | Flex First work policy | In-person events | Remote workSenior-level Full TimeCanada - Remote (ON, AB, BC, … R6d ago
-
C# | C++ | CUDA | Convolutional Neural Network | LSTMFull-time employment | Permanent employment | Remote workSenior-level Full TimeOntario; Montreal; Quebec City; Nova Scotia; … R6d ago