Data Platform Engineer
Tasks
- Build batch data pipelines
- Build streaming data pipelines
- Design scalable storage for IoT data
- Design scalable storage for time series data
- Develop real-time data ingestion
- Develop real-time data processing
- Enhance data replication
- Enhance data storage
- Implement data enrichment
- Implement data lineage
- Implement distributed tracing
- Implement observability patterns
- Improve data reporting
- Improve monitoring and troubleshooting
- Make architecture decisions for reliability
- Make architecture decisions for scalability
- Optimize batch data pipelines
- Optimize streaming data pipelines
- Write maintainable Java code
- Write maintainable Python code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CDK | AWS EventBridge | AWS Lambda | AWS Step Functions | Amazon DynamoDB | Amazon Glue | Amazon Kinesis | Amazon S3 | Amazon SQS | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | CI/CD | Data Lineage | Data Processing | Data replication | Distributed Systems | Distributed tracing | GitHub Actions | Infrastructure as Code | Java | Lake House | Lake house architecture | Observability | Python | Real Time | Real-time Data | Real-time Data Processing | Redis | Spring Boot | Step Functions | “as-code”
Education
N/A
Related jobs
-
DSP | FPGA | FPGA Integration | FPGA implementation | Hardware DesignDental insurance | Employee assistance program | Employer matching retirement savings | Flexible work hours | Health insuranceMid-level Full TimeMontreal (CAN), Canada21h ago
-
Data Engineer Co-op (8-12 Months) CAD 45K-45KAirflow | BI Dashboards | CI/CD | Cloud platform | Data ModelingCorporate partner discounts | Employee purchase program | Free Kobo device | Free weekly ebooks or audiobooks | Hybrid work modelNone Full TimeON-John Street, Canada21h ago
-
Data Engineer CAD 100K-140KAWS | Apache Spark | Azure | CI/CD | Data GovernanceContinuous learning opportunities | Coverage for dependents | Dental insurance | Health insurance | Hybrid workMid-level Full TimeToronto, Ontario1d ago
-
.NET | AWS | Agile | Apache Flume | Apache IcebergEntry-level Full TimeQuebec City, QC, Canada1d ago
-
AWS CDK | AWS EventBridge | AWS Glue | AWS Lambda | AWS SQSSenior-level Full TimeToronto, Ontario1d ago
-
Automated testing | CI/CD | Cloud Security | Cloud platform | Distributed SystemsHigh stakes fast paced environment | Startup experience favoredSenior-level Full TimeOttawa, Ontario1d ago
-
A/B | A/B Testing | B testing | Data Warehousing | DatabasesSenior-level Full TimeRemote, Canada or US R1d ago
-
Caching | Data Streaming | Distributed Systems | Multi-cloud | Multi-regionAutonomy | Direct customer collaboration | Fast-paced startup environment | High ownershipSenior-level Full TimeRemote, Canada or US R1d ago
-
SENIOR AI ENGINEER (Canada) CAD 125K-160KAWS ECS | Amazon S3 | Background job | Background job processing | DockerComprehensive training program | Global multicultural team | Great referral programs | Growth opportunities | Product DiscountsSenior-level Full TimeCanada1d ago
-
Embedded Software Developer-Team Lead CAD 130K-140KAgile | Automated testing | Bare Metal | C# | C++In-office workSenior-level Full TimeOttawa, Ontario, Canada1d ago
-
Senior Data Engineering Developer CAD 83K-139KAPI Management | Azure API | Azure API Management | Azure Data | Azure Data FactoryEmployee assistance program | Flexible work options | Group retirement savings plans | Health and wellness programs | Mental health supportSenior-level Full TimeGuelph, Ontario, Canada; Quebec, Quebec, Canada1d ago
-
Head of AI Platform & Agentic Architecture - NI CAD 126K-210KAgent systems | Control Plane | Control plane architecture | Distributed Systems | InferenceSenior-level Full TimeCanada1d ago
-
Senior-level Full TimeToronto, Ontario, Canada1d ago
-
APIs | AWS | Code Refactoring | Data Modeling | Distributed SystemsContinuing education benefits | Disability | Employee stock purchase plan | Family-forming benefits | Four weeks vacationSenior-level Full TimeBurnaby, British Columbia, Canada1d ago
-
Software Developer-Embedded-Onsite Position CAD 74K-100KBare Metal | Bare metal programming | Board Bring-up | Bring-up | C#Competitive pay | Employee stock purchase plan | Health and wellness benefits | Inclusive & Supportive Culture | Learning and development opportunitiesMid-level Full TimeCanada-Ottawa1d ago
-
ARM | Bare Metal | Board Bring-up | Bring-up | C#Employee stock purchase plan | Health and wellness benefits | Inclusive & Supportive Culture | Learning and development opportunities | Paid time offSenior-level Full TimeCanada-Ottawa1d ago
-
Senior AI Engineer CAD 82K-154KAPI Gateway | API Management | ARM | Access Management | Agent OrchestrationAccident and life insurance | Health insurance | Retirement savings plans | Tuition reimbursementSenior-level Full TimeFCP, Canada1d ago
-
Software Engineer II - Machine Learning (B3617) CAD 81K-115KAIOps | AWS | Agentic AI | Azure | Azure DataCareer development | Health and well-being benefits | Mentoring programs | Paid time off | Skill developmentMid-level Full Time661 University Avenue, Toronto, Ontario, Canada1d ago
-
Data Scientist – AI Agents & Advanced Analytics USD 84K-134KAI Agents | AWS | Agile | Apache Spark | CI/CDMid-level Full TimeCanada- Ottawa- 385 Terry Fox- Bldg …1d ago
-
Senior AI Engineer, Microsoft/Azure CAD 111K-130KAI Agents | AI Foundry | Azure | Azure Container | Azure Container AppsDefined benefit pension | Extra vacation days | Flexible work-life balance | Health dental disability and life insurance | Hybrid work modelSenior-level Full TimeOttawa (Downtown), ON, CA1d ago
-
Big Data DBT/Redshift Engineer (Contract) CAD 90K-166KAWS Glue | AWS Lambda | AWS Redshift | AWS Step Functions | Amazon AthenaSenior-level ContractVancouver, British Columbia, Canada1d ago
-
Entry-level Full Time InternshipToronto, Ontario, Canada1d ago
-
Software Developer II (AI/ML) CAD 100K-134KA/B | A/B Testing | Artificial Intelligence | B testing | BanditsDisability insurance | Health insurance | Life insurance | Paid Holidays | Retirement savings planMid-level Full TimeKanata 307 Legget Dr., Canada1d ago
-
Senior Machine Learning Engineer, vLLM CAD 142K-171KComputer Vision | Deep learning | Graph theory | Language Processing | Linear AlgebraCode review feedback culture | Open source collaboration | Remote work flexibilitySenior-level Full TimeRemote CA ON, Canada R1d ago
-
Machine Learning Engineer CAD 128K-192KDeep learning | Graph theory | Inference Optimization | LLM Inference | LLM Inference OptimizationMid-level Full TimeToronto - MSO, Canada R1d ago