Researcher - Distributed AI Computing

Our team has an immediate 12-month contract opening for a Researcher.

Responsibilities:

• Carry out research on next-generation emerging technologies related to AI and computing, survey the latest trends on a regular basis, and understand the technology evolution roadmap
• Propose innovative architectures and algorithms to optimize distributed computing, considering scalability and efficiency.
• Model AI performance across various parallelization techniques and network topologies, with a strong focus on different architectures, including Transformers, State Space Models (SSMs), and Retrieval Augmented Generation (RAG).
• Conduct cutting-edge research on reinforcement learning, particularly its applications in multi-agent systems and distributed AI models.
• Evaluate and enhance AI performance under different parallelization strategies and network topologies.
• Explore and innovate at the intersection of AI algorithms and hardware, focusing on hardware-aware model optimization and efficient computation.
• Study the industry’s competitive landscape to learn the latest technical trends and to create insight.
• Proactively work to achieve challenging goals and create IP by innovative designs and architectures
  Produce detailed documentation, technical reviews

Requirements

What you'll bring to the team:

• PhD in Electrical Engineering, Computer Science or relevant discipline with at least 2 years of relevant experience.
• Deep knowledge of large generative and foundational AI models.
• Advanced knowledge of distributed computing and associated techniques including model, data, and pipeline parallelization.
• Strong understanding of the theory of deep neural networks (DNN), including their dynamics, stability, and learning algorithms.
• Proficiency in designing and implementing algorithms related to Transformers, State Space Models (SSMs), and Neural ODEs.
• Excellent programming skills (Python/C).
• Motivated self-starter with excellent communication skills in written and spoken English.
• Good teamwork spirit and adaptability.
• Thrive in a dynamic, innovative, and research-oriented environment focused on prototyping.