Researcher - Distributed AI Computing

Huawei Technologies Canada Co., Ltd.

Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices.

Apply now Apply later

Posted 5 days ago

Our team has an immediate 12-month contract opening for a Researcher.

Responsibilities:

Carry out research on next-generation emerging technologies related to AI and computing, survey the latest trends on a regular basis, and understand the technology evolution roadmap
Propose innovative architectures and algorithms to optimize distributed computing, considering scalability and efficiency.
Model AI performance across various parallelization techniques and network topologies, with a strong focus on different architectures, including Transformers, State Space Models (SSMs), and Retrieval Augmented Generation (RAG).
Conduct cutting-edge research on reinforcement learning, particularly its applications in multi-agent systems and distributed AI models.
Evaluate and enhance AI performance under different parallelization strategies and network topologies.
Explore and innovate at the intersection of AI algorithms and hardware, focusing on hardware-aware model optimization and efficient computation.
Study the industry’s competitive landscape to learn the latest technical trends and to create insight.
Proactively work to achieve challenging goals and create IP by innovative designs and architectures
Produce detailed documentation, technical reviews

What you'll bring to the team:

PhD in Electrical Engineering, Computer Science or relevant discipline with at least 2 years of relevant experience.
Deep knowledge of large generative and foundational AI models.
Advanced knowledge of distributed computing and associated techniques including model, data, and pipeline parallelization.
Strong understanding of the theory of deep neural networks (DNN), including their dynamics, stability, and learning algorithms.
Proficiency in designing and implementing algorithms related to Transformers, State Space Models (SSMs), and Neural ODEs.
Excellent programming skills (Python/C).
Motivated self-starter with excellent communication skills in written and spoken English.
Good teamwork spirit and adaptability.
Thrive in a dynamic, innovative, and research-oriented environment focused on prototyping.