Code repository for the following paper: Nguyen, H., Nguyen, T., & Ho, N. (2023). Demystifying Softmax Gating Function in Gaussian Mixture of Experts. NeurIPS 2023 Spotlight. https://openreview.net/forum?id=cto6jIIbMZ.
This code has only been tested using Python 3.9.13. Beyond the Python Standard Library, the only required packages are NumPy
, Scipy
and Matplotlib
.
To reproduce the paper's simulation results, run these shell scripts:
source execute.sh
source execute_plots.sh