Data Platform Engineer
Tasks
- Build batch data pipelines
- Build streaming data pipelines
- Design scalable storage for IoT data
- Design scalable storage for time series data
- Develop real-time data ingestion
- Develop real-time data processing
- Enhance data replication
- Enhance data storage
- Implement data enrichment
- Implement data lineage
- Implement distributed tracing
- Implement observability patterns
- Improve data reporting
- Improve monitoring and troubleshooting
- Make architecture decisions for reliability
- Make architecture decisions for scalability
- Optimize batch data pipelines
- Optimize streaming data pipelines
- Write maintainable Java code
- Write maintainable Python code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CDK | AWS EventBridge | AWS Lambda | AWS Step Functions | Amazon DynamoDB | Amazon Glue | Amazon Kinesis | Amazon S3 | Amazon SQS | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | CI/CD | Data Lineage | Data Processing | Data replication | Distributed Systems | Distributed tracing | GitHub Actions | Infrastructure as Code | Java | Lake House | Lake house architecture | Observability | Python | Real Time | Real-time Data | Real-time Data Processing | Redis | Spring Boot | Step Functions | “as-code”
Education
N/A
Related jobs
-
AI Agents | API | Backend Development | Cloud Applications | Cloud MarketplaceDental insurance | Health insurance | Hybrid work model | Life insurance | Office stipendSenior-level Full TimeVancouver, BC R14h ago
-
Embedded Software Developer CAD 94K-115KApplication Layer Protocols | Application-layer | C# | C++ | FirewallCritical illness insurance | Disability insurance | Employee assistance program | Flexible leave policies | Group Registered Retirement Savings Plan with MatchMid-level Full TimeBurnaby, BC, Canada18h ago
-
Senior-level Full TimeCanada, Remote R18h ago
-
Machine Learning Developer CAD 122K-180KAWS | Amazon Web Services | At-Scale | Data Pipelines | Information RetrievalMid-level Full TimeMontreal (Province of Quebec, Canada)20h ago
-
Machine Learning Engineer CAD 118K-152KAgile | Cloud Computing | Feature Engineering | Generative AI | Language ModelsEmployee assistance program | Fitness reimbursement | Retirement savings plan | Virtual health care | Wellness supportMid-level Full TimeCanada - Montreal20h ago
-
Finance Staff Data Engineer, AI Native USD 190K-280KAPI rate-limiting | AWS | Airflow | Alerting | Apache Spark401k matching | Employee Assistance Program (EAP) | Equipment and tools reimbursement | Flexible PTO | Free membership Platinum subscriptionSenior-level Full TimeRemote, USA; Remote, Canada R21h ago
-
Data Engineer CAD 90K-125KAzure | Azure Data | Azure Data Factory | CI/CD | DBTFlexible working hours | Health and wellness benefits | Learning and development | Parental leave | Retirement planningMid-level Full TimeToronto1d ago
-
Senior Data Engineer CAD 120K-145KApache Hadoop | Apache Kafka | Apache Spark | Azure Fabric | Data ArchitectureAnnual tech allowance | Annual travel allowance | Flexible working hours | Health and wellness benefits | Learning and development programsSenior-level Full TimeToronto1d ago
-
Data Engineer CAD 87K-120KAzure Data | Azure Data Factory | Azure DevOps | Azure SQL | CI/CDAdvancement opportunities | Continuing education coverage | Defined benefit pension plan | Hybrid work | Mental wellness supportSenior-level Full TimeWaterloo, ON, Canada R1d ago
-
ML Engineer, II - App Engine FRENCH USD 139K-166KC++ | CUDA | Distributed Systems | Embedded Software | EthernetDental insurance | Flexible schedule | Health insurance | Life insurance | Paid time offMid-level Full TimeMontreal, Canada, Ann Arbor, MI1d ago
-
ML Engineer, II - App Engine USD 153K-183KC++ | CUDA | Distributed Systems | GPU Programming | Linux401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeAnn Arbor, MI, Montreal, Canada1d ago
-
Data Engineer CAD 100K-130KData Modeling | Data Pipelines | Data Transformation | Data Validation | DatabricksExtended mental health coverage | Paid time off | Paid wellness days | Parental leave top-up | Remote workEntry-level Full TimeGreater Toronto Area R1d ago
-
Machine Learning & Game Tech Architect CAD 127K-187KAPI Design | C# | C++ | Code optimization | Game enginesCollective retirement plan | Flexible work schedule | Medical, dental & vision coverage | Mental health support | Paid time offSenior-level Full TimeMontreal, QC, Canada R1d ago
-
AWS Glue | Airbyte | Amazon Redshift | Apache Airflow | Apache IcebergRemote workSenior-level Full TimeToronto, ON, Canada1d ago
-
API Integration | CRM Integration | Claude | HubSpot | JavaScriptCareer growth | Continuous learning | Fully remote | Global team collaborationMid-level Full TimeCanada R1d ago
-
Senior Data Engineer CAD 86K-118KAWS DMS | AWS Glue | AWS Lambda | Agile | Amazon AthenaAccident and life insurance | Health insurance | Other location specific benefitsSenior-level Full TimeCalgary, Alberta, Canada; Winnipeg, Manitoba, Canada; …1d ago
-
PySpark Big Data Senior Developer - Vice President CAD 120K-170KAWS | AWS Glue | Amazon Redshift | Amazon S3 | Apache HiveSenior-level Full Time5900 HURONTARIO STREET MISSISSAUGA, Canada1d ago
-
Senior Data Engineer (Databricks Focused) CAD 84K-128KARM Templates | Apache Spark | Azure Data | Azure Data Lake | Azure DatabricksFlexible benefits | Personal Time Off | Professional growth opportunities | Wellness reimbursement | Work flexibilitySenior-level Full TimeToronto - Bay St, Canada1d ago
-
Senior Machine Learning Engineer CAD 84K-128KARM Templates | Apache Spark | Azure ARM | Azure ARM templates | Azure DataFlexible benefits | Paid time off | Reimbursement for wellness initiatives | Wellness reimbursementSenior-level Full TimeToronto - Bay St, Canada1d ago
-
Senior Machine Learning Engineer, Agentic AI CAD 128K-176KBigQuery | Cloud Composer | Cloud Storage | Design Patterns | DockerSenior-level Full Time500 Lake Shore Blvd W, Toronto, …1d ago
-
Senior Machine Learning Engineer CAD 128K-176KBigQuery | Cloud Composer | Cloud Storage | Design Patterns | DockerSenior-level Full Time500 Lake Shore Blvd W, Toronto, …1d ago
-
AI Engineer - Tech Lead - Remote CAD 126K-145KAWS | Agentic Workflows | Azure | CI/CD | Cloud NativeRemote workSenior-level Full TimeToronto, ON, CA R1d ago
-
Agentic AI Systems Developer - Remote CAD 109K-140KAI Studio | AKS | Agent Orchestration | Anomaly Detection | AuditabilityRemote workSenior-level Full TimeToronto, ON, CA R1d ago
-
Platform Engineer (AWS) - Remote CAD 130K-155KAWS CloudFormation | AWS CodePipeline | Amazon Elastic Container Service | Amazon Elastic Kubernetes Service | Amazon Web ServicesRemote workSenior-level Full TimeToronto, ON, CA R1d ago
-
Senior Data Engineer CAD 69K-119KAutomated testing | Bitbucket | CI/CD | DBT | Data ArchitectureCorporate discount program | Education Related Programs | Employee savings plan | Enhanced group benefits | Life and disability insuranceSenior-level Full TimeCDA ON Head Office - 15 …1d ago