Modeling Expert Interactions in Sparse Mixture of Experts via Graph Structures

M. Nguyen-Nhat*, R. Teo*, L. Abdullaev, M. Mok, T. Hoang, T. Nguyen • 2026

Math4AI Workshop @ AAAI

• #Mixture of Experts
• #Transformers