Student developer converts Mistral Nemo to 16-expert MoE model but seeks help with training due to budget constraints.

A student researcher converted Mistral Nemo from a dense model into a sixteen expert Mixture-of-Experts (MoE) version, available on Hugging Face as Mistral-NeMoE-12B-16E

The model suffers from accuracy issues and instruction-following problems due to limited fine-tuning, constrained by the developer's student budget and rental GPU access

The developer is seeking community interest and collaboration to properly train the model, offering to expand expert capacity and parameters once a trained version is released