Senior Software Engineer - Data Platform
Tasks
- Build data replication systems
- Build metadata and orchestration services
- Create data catalogs and discovery services
- Design data ingestion systems
- Develop Spark and Databricks processing improvements
- Develop internal libraries and APIs
- Improve reliability observability scalability security
- Operate data lakehouse infrastructure
Perks/Benefits
Skills/Tech-stack
AWS ECS | AWS Lambda | AWS S3 | Airflow | Amazon DynamoDB | Amazon Kinesis | Amazon RDS | Amazon SQS | Amundsen | Apache Hudi | Apache Iceberg | Apache Spark | CloudFormation | Dagster | Data orchestration | Data replication | Databricks | Datahub | Delta Lake | Docker | Event Driven | Event-driven architecture | Go | Hive Metastore | Hudi | Infrastructure as Code | Java | Kubernetes | Prefect | Python | Scala | Streaming Data | Terraform | Unity Catalog | “as-code”
Education
N/A
Related jobs
-
Senior Software Engineer, MLOps CAD 175K-220KAgile | Airflow | Batch Processing | DBT | Data PipelinesCharitable donation match | Flexible time off | Medical/Dental/Vision | Paid parental leave | Professional development budgetSenior-level Full TimeRemote - Alberta, Canada R17h ago
-
Algorithms | Data Structures | Database systems | Distributed Systems | ESQLDonation matching | Flexible schedule | Health coverage | Parental leave | Vacation timeSenior-level Full TimeCanada R20h ago
-
Algorithms | Concurrency | Continuous integration | Data Structures | Database systemsDonation matching | Employee well-being programs | Flexible schedule | Fully remote | Health coverageSenior-level Full TimeCanada R20h ago
-
Algorithms | Concurrency | Data Structures | Elasticsearch | IndexingCompany-matched retirement plan | Donation matching | Flexible schedule | Health coverage | Parental leaveSenior-level Full TimeCanada R21h ago
-
Airflow | Autogen | ClickHouse | CrewAI | DagsterAnnual performance bonus | Equipment support | Flexible working hours | Gifts and rewards | Lunch allowanceSenior-level Full TimeCanada R1d ago
-
Agentic AI | Backend Engineering | Cloud Computing | Deployment | Generative AIAnnual bonus programs | Equity incentives | Health wellness and retirement benefits | Paid leave | Professional development budgetSenior-level Full TimeCanada R1d ago
-
AI/ML Technical Practice Lead CAD 131K-170KAWS Agentic AI | AWS CloudFormation | AWS ECS | AWS Fargate | AWS IAMContinuous learning culture | Professional development | Remote work | Training sessions | Travel opportunitiesSenior-level Full TimeCanada - Remote R1d ago
-
AI Data Engineer CAD 120K-154KAWS | Amazon Redshift | CI/CD | Data Governance | Data ModelingCritical illness insurance | Extended Healthcare Plan | Flexible hours | Group Life AD D | Group RRSPSenior-level Full TimeToronto, Ontario, Canada - Remote R1d ago
-
Senior Software Engineer - Canada CAD 120K-150KApache Cassandra | Apache Flink | Apache Hadoop | Apache Kafka | Apache SparkAccidental insurance | Canada Life Policy | Dental care | Extended health care | Health insuranceSenior-level Full TimeCalgary, Alberta, Canada - Remote R2d ago
-
GenAI Engineer CAD 135K-170KA/B | A/B Testing | B testing | Cost Optimization | ExperimentationCareer development opportunitiesSenior-level Full TimeCanada - Remote R2d ago
-
Staff/Lead Python Engineer (FastAPI, Orchestration) EUR 82K-112KAsynchronous programming | Cloud platform | Concurrent programming | FastAPI | GenAIAnnual learning and development budget | Co-working budget | Company laptop | Enhanced parental leave | Flexible scheduleSenior-level Full TimeRemote Anywhere R2d ago
-
AWS | AWS SageMaker | Data 360 | Data Federation | Data ModelingFully remote | Opportunity for Greenfield Work | Supportive collaborative cultureMid-level Full TimeCanada R3d ago
-
Staff Machine Learning Engineer CAD 195K-235KAWS | Agile | Docker | Generative AI | JAXGenerous leave | Professional development budget | Remote work | Wellbeing daysSenior-level Full TimeCAN: British Columbia Remote R3d ago
-
AWS | Apache Airflow | CI/CD | Cloud platform | Data PipelinesAccess to modern development tools and hardware | Collaborative innovation focused environment | Continuous learning opportunities | Equity opportunities | Medical, dental, and vision benefitsMid-level Full TimeCanada R4d ago
-
Amazon Web Services | Apache Spark | Big Data | Data Analysis | Data setsRemote workSenior-level Full TimeMontreal, QC, Canada R4d ago
-
AWS | Azure | Bitbucket | DBT | Data ModelingAccidental death and dismemberment coverage | Company equity participation | Continuous learning and professional development | Critical illness coverage | Flexible remote work environmentSenior-level Full TimeCanada R4d ago
-
Engineering - Internal AI Transformation USD 74K-110KAPIs | Agentic Workflows | Auditability | Authentication | DockerAnnual company offsite | Co-working stipend | Learning and development stipend | Social travel stipendEntry-level Full TimeUnited States R4d ago
-
Staff Machine Learning Engineer CAD 143K-214KA/B | A/B Testing | B testing | Batch inference | CI/CDSenior-level Full TimeREMOTE-CANADA, Canada R4d ago
-
Senior-level Full TimeREMOTE-CANADA, Canada R4d ago
-
Staff Machine Learning Platform Engineer CAD 216K-297KAWS | Access Control | Access Management | Airflow | CI/CDComprehensive benefits | Equity | Hybrid work | Remote work up to 4 weeks per yearSenior-level Full TimeKitchener-Waterloo, ON; Toronto, ON R4d ago
-
Senior Staff Machine Learning Platform Engineer CAD 248K-341KAWS | Airflow | CI/CD | Cloud Architecture | CockroachDBComprehensive benefits | Equity | Hybrid work arrangement | Remote work flexibilitySenior-level Full TimeKitchener-Waterloo, ON; Toronto, ON R4d ago
-
Mid-level Full TimeCanada R4d ago
-
Senior Analytics Engineer USD 115K-193KAirflow | Amazon Athena | Apache Iceberg | BigQuery | CI/CD401k | Dental insurance | Health insurance | Paid time off | Remote work opportunitySenior-level Full TimeRemote (United States | Canada) R5d ago
-
AWS | Azure | C++ | Cloud infrastructure | Cloud platformEquity opportunities | Fully remote | Professional growthSenior-level Full TimeCanada R6d ago
-
API Design | AWS | Agentic Systems | Caching | Data handlingContinuous learning | Fully remote | Mentorship opportunitiesSenior-level Full TimeCanada R6d ago