Senior Software Engineer-Data Platform
Tasks
- Align resample calibrate multi sensor data
- Architect data platform pipelines
- Build backfill and reprocessing frameworks
- Build labeling tool and pre label workflows
- Create data quality instrumentation metrics dashboards alerts
- Develop dataset discovery and access APIs
- Implement lineage and versioning for reproducibility
- Ingest real time acoustic and telemetry data
- Optimize storage layout with columnar formats
Perks/Benefits
Skills/Tech-stack
AWS | Chunking | Columnar Storage | Compression | Data Processing | Data Quality | Data pipeline | Data quality monitoring | Dataset versioning | Geospatial Context | Go | High Throughput | High-throughput data | High-throughput data processing | Lineage Tracking | Metadata Management | NumPy | Pandas | Polars | PyArrow | Python | Quality monitoring | Rust | SciPy | Series data | Sharding | Time Series | Time Series Data | TypeScript
Education
N/A
Roles
Related jobs
-
AWS CloudWatch | AWS Glue | AWS HealthLake | AWS S3 | Access ControlSenior-level ContractToronto, Canada3h ago
-
Analyst, Data Science & AI developper CAD 74K-104KAI Foundry | Agile | App Service | Azure | Azure AIDental insurance | Disability insurance | Employee assistance program | Flexible/hybrid work policies | Health insuranceMid-level Full TimeDorval, Québec, CA, H4S 1Y911h ago
-
Analyst, Data Science & AI CAD 71K-106KAzure | Backtesting | Calibration | Cross-validation | Data GovernanceEmployee assistance program | Flexible and hybrid work policies | Insurance plans | Retirement savings plan | Tele Health ProgramMid-level Full TimeDorval, Québec, CA, H4S 1Y911h ago
-
A/B | A/B Testing | Advertising analytics | Airflow | B testingEquity grants | Flexible remote work | Professional developmentSenior-level Full TimeCanada12h ago
-
Apache Airflow | Apache Flink | Backend Development | Compliance | Data GovernanceAnnual equity refresh opportunities | Collaborative innovation focused environment | Flexible remote work | Health and well-being benefits | New hire equity grantsMid-level Full TimeCanada12h ago
-
Senior Data Engineer (Snowflake) CAD 140K-179KApache Airflow | BigQuery | Compliance | DBT | DagsterExtended health and dental plan | Flexible PTO | Flexible work arrangements | Mentorship | Training budgetSenior-level Full TimeToronto16h ago
-
Senior AI/LLM Engineer USD 179K-201KAPI Development | CI/CD | Embeddings | Fine Tuning | Guardrails401k match | Dental insurance | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote (US/Canada) R18h ago
-
AWS | CI/CD | Code review | Data Transformation | DatabricksAnnual training bonus | Flexible schedule | Flexible time off | Free telemedicine | Hybrid workSenior-level Full TimeMontréal, Quebec, Canada; Québec, Quebec, Canada22h ago
-
Data and Artificial Intelligence Fall Student CAD 52K-52KBusiness Intelligence | Data Engineering | Data Visualization | Generative AI | Machine LearningAccess to data and technology tools | Collaborative inclusive environment | Hybrid work arrangements | Remote work flexibility | Travel for office workNone Full TimeSt Catharines, Ontario, Canada; Etobicoke, Ontario, … R22h ago
-
Embedded Systems Test Engineer CAD 95K-130KARM Cortex | Ansible | Buildah | C# | C++Flexible work hours | Health benefits | Personal education funds | Profit sharing | RRSP matchingSenior-level Full TimeWaterloo, Ontario, Canada22h ago
-
AI Engineer Sr CAD 110K-172KAI Observability | API | AWS | Agent systems | Amazon Web ServicesComprehensive wellness initiatives | Recognition programs | Time away from work programs | Volunteer daysMid-level Full TimeCanada1d ago
-
AI Engineer Sr CAD 110K-172KAI Agents | AI Observability | AI orchestration | APIs | AWSCharity support | Recognition programs | Time off | Volunteer days | Wellness programsMid-level Full TimeCanada1d ago
-
AWS | Alteryx | Amazon Redshift | Azure Synapse | Azure Synapse AnalyticsContinuous learning opportunities | Fully remote work | Professional growthSenior-level Full TimeCanada R1d ago
-
Apache Hadoop | Apache Kafka | Apache Spark | Batch Processing | Cloud DataFully remote | International team collaboration | Training and professional developmentSenior-level Full TimeCanada R1d ago
-
Agile | Data Migration | Data Quality | Data Validation | Data pipelineCompany events | Dental insurance | Flexible working hours | Health insurance | Life insuranceMid-level Full TimeCanada1d ago
-
API Development | Agent Builder | Automated testing | BigQuery | CI/CDCareer growth | Diversity, Equity, and Inclusion Initiatives | Flexible vacation policies | Flexible working arrangements | Health and wellness benefitsSenior-level Full TimeCanada R1d ago
-
Senior ASIC Package Design Automation and AI Engineer CAD 145K-194K2.5D IC | 3D-IC | Artificial Intelligence | C++ | CadenceSenior-level Full TimeMARKHAM, ON, Canada1d ago
-
Data Engineer III CAD 125K-154KCI/CD | Code Management | Coding practices | Cycle management | Data GovernanceBanking benefits and discounts | Career development and training | Health and well-being benefits | Paid time off | Savings and retirement programsSenior-level Full TimeTD Centre - South - 79 …1d ago
-
Machine Learning Engineer CAD 128K-192KAWS | Cloud Computing | Data Wrangling | Deep learning | DockerFlexible work schedule | Health and wellness benefits | Professional development supportMid-level Full TimeCanada, BC, Vancouver1d ago
-
AI Engineer CAD 90K-140KA/B | A/B Testing | AWS Athena | AWS Bedrock | AWS LambdaCare days | Charitable giving program | Collaborative team environment | Flexible work arrangement | Hybrid work flexibilitySenior-level Full TimeSun Life Toronto One York, Canada1d ago
-
Senior Data Engineer I CAD 80K-128KAWS Lambda | AWS S3 | AWS Step Functions | Bitbucket | Data GovernanceCode review support | Flexible work options | Hybrid work modelSenior-level Full TimeSun Life Toronto One York, Canada1d ago
-
Data Engineer II (Production Support) CAD 81K-115KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageBanking benefits and discounts | Career development | Health and wellbeing benefits | Mentoring programs | Paid time offMid-level Full TimeTD Centre - South - 79 …1d ago
-
Data Engineer II (Production Support) CAD 81K-115KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCareer development | Paid time off | Training and onboardingMid-level Full TimeTD Centre - South - 79 …1d ago
-
Data Engineer I (Production Support) CAD 69K-98KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageBanking benefits and discounts | Career development | Health and well-being benefits | Mentoring programs | Paid time offSenior-level Full TimeTD Centre - South - 79 …1d ago
-
Senior AI Engineer - AI Engineering & Enablement CAD 120K-140K.NET | APIs | Access Management | Agent Orchestration | AuditabilityCareer growth and development opportunities | Community contribution opportunities | Health and wellbeing resources and programs | Inclusive collaborative environment | Paid vacation personal and sick daysSenior-level Full TimeToronto, ON, M2N 5M9, CA1d ago