Senior Data Engineer, AI Systems
Tasks
- Build ML Data Lake
- Build production data pipelines
- Collaborate on platform architecture evolution
- Configure and tune clusters
- Ensure data quality and accessibility
- Identify performance bottlenecks
- Improve data infrastructure scalability and reliability
- Maintain production data pipelines
- Optimize data pipelines performance
- Release data products and features
- Resolve scaling limitations
- Scale Spark batch pipelines
- Support ML model development
- Support model training and evaluation
Perks/Benefits
Skills/Tech-stack
Advanced Query Optimization | Apache Spark | CI/CD | Cloud platform | Continuous Delivery | Continuous integration | Dataproc | Delta Lake | Docker | Git | GitHub Actions | Google Cloud | Google Cloud Platform | Kafka | Kubernetes | Parquet | PySpark | Python | Query Optimization | Unit Testing
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeMontreal, QC15h ago
-
Développeur(euse) de logiciels / Embedded Software Developer (Security & Platform Integration) CAD 96K-135KAPI | Authentication | Build systems | C# | C++Mid-level Full TimeMontreal, Canada15h ago
-
Software Engineer, GTM AI - Python USD 125K-145KA/B | A/B Testing | API Integration | Alerting | AuthenticationMid-level Full TimeUnited States; Brazil; Canada17h ago
-
AWS | Airflow | Apache Spark | Azure Synapse | Azure Synapse Analytics401k matching | Disability insurance | Employee assistance program | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeRemote, USA ; Remote, Canada R17h ago
-
Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr) USD 100K-400KAI Assisted Development | Claude Code | Cursor | JavaScript | OpenAI CodexSenior-level Full TimeMiami23h ago
-
AI Pipelines | CI/CD | Cloud platform | Distributed Computing | FastAPIAnnual learning and equipment budget | Company provided MacBook | Employer Paid Dental Benefits | Employer paid health benefits | Employer paid virtual medical benefitsSenior-level Full TimeCanada R1d ago
-
AWS | Apache Spark | Azure | Data Engineering | Data GovernanceCareer growth opportunities | Continuous learning culture | Exposure to AI and BI initiatives | Inclusive workplace | Remote work within CanadaSenior-level Full TimeCanada1d ago
-
Embedded Software Quality Assurance Specialist / Assurance Qualité des Logiciels Embarqués CAD 95K-110KAPI Testing | BLE | C++ | CI/CD | Embedded SystemsEmployee assistance program | Health insurance plan | LinkedIn Learning access | Pension plan | Unlimited Referral Reward BonusesMid-level Full TimeMontreal, CA1d ago
-
Data Engineering | Fine Tuning | Human Feedback | JAX | Learning from Human FeedbackMeal Delivery Stipend | Medical coverage | Paid time off | Remote work | Team offsitesSenior-level Full TimeCanada1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive salary | Remote-friendlyMid-level Full TimeMontreal, Canada1d ago
-
Freelance Machine Learning Engineer CAD 110KLLM | Langchain | MLOps | NumPy | PandasFlexible hours | Part-time project-based workMid-level FreelanceCanada - Remote R1d ago
-
Lead Software Engineer - MLOps CAD 90K-140KAPIs | AWS | CI/CD | Cloud Architecture | Cloud NativeCareer path opportunities | Employee well-being support | Hybrid work flexibility | Networking opportunities | Training and coachingSenior-level Full TimeSun Life Waterloo King, Canada1d ago
-
Data Engineer CAD 96K-127KArtificial Intelligence | Azure | Azure Data | Azure Data Factory | Azure DevOpsDiscounts on products | Employee assistance program | Ergonomic furniture program | Family assistance program | Flexible scheduleSenior-level Full TimeQuebec / 1080, Grande Allee West …1d ago
-
Lead Software Engineer - MLOps CAD 90K-140KAPI Development | AWS | CI/CD | Cloud Native | Cloud Native ArchitectureCareer path opportunities | Employee coaching and training | Employee well-being support | Hybrid work flexibility | Networking potentialSenior-level Full TimeSun Life Waterloo King, Canada1d ago
-
Senior Software Engineer, Events Analytics Platform CAD 200K-295KClickHouse | Distributed Systems | Kafka | Memcached | PostgreSQLSenior-level Full TimeToronto, Ontario, Canada1d ago
-
Senior-level Full TimeToronto, Canada1d ago
-
Principal Data Engineer - MarTech USD 143K-178KAPI Integration | Batch Data Processing | Batch data | CCPA | Customer DataHealth and welfare benefits | Hybrid work model | Paid time off | Remote work flexibilitySenior-level Full TimeRemote, US or Remote, Ontario, Canada R1d ago
-
Automation & AI Engineer CAD 150K-150KAlembic | Anthropic | Claude Code | Cloud platform | CopilotIn studio work location | Radical transparency cultureMid-level Full TimeKelowna, BC1d ago
-
Staff Backend Engineer (AI Platform team) USD 185K-242KAWS | Agent Frameworks | Compliance | Data Privacy | DatadogEquity | Flexible PTO | Medical coverage | Monthly lifestyle stipendSenior-level Full TimeRemote - United States & Canada R1d ago
-
Analytics Engineer IV, ACV Capital CAD 122K-153KAI-assisted analytics | BigQuery | Business Intelligence | Complex joins | DBTCritical illness coverage | Employee stock purchase program | Generous parental leave top up pay | Learning and development opportunities | Life/AD&D insuranceSenior-level Full TimeToronto, ON, CA1d ago
-
AWS | Amazon Kinesis | Apache Airflow | Apache Kafka | Apache SparkEmployee assistance program | Equity participation opportunities | Flexible paid time off | Fully remote work | Learning and professional developmentSenior-level Full TimeCanada R2d ago
-
AWS | Azure | CI/CD | DevOps | Distributed SystemsAccident insurance | Career progression | Collaborative work environment | Continuous learning support | Health insuranceSenior-level Full TimeCanada2d ago
-
Data Engineer CAD 110K-125KApache Kafka | Azure | CI/CD | Data Governance | Data PrivacyCoaching opportunities | Flexible hybrid policy | Higher education certification policy | Insurance (medical | Insurance dentalMid-level Full TimeMississauga, ON, Canada2d ago
-
Big Data Senior Developer, Marketing & Advertising Data (French Services) (Telework/Hybrid) CAD 80K-110KAirflow | Apache Spark | Azure | Azure Data | Azure Data FactoryBackground check required | Employee benefits package | Employee resource groups | Flexible hours | Hybrid workSenior-level Contract Full TimeQuebec (36.25), Canada R2d ago
-
AWS | Access Control | Agile | Ansible | AzureSenior-level Full TimeAMER - Canada - Ontario - …2d ago