Kawrakow dbfd151594 Grouped expert routing (CPU only) (#836) ...

* Better argsort (CPU)

* Attemt at grouped topk

* This seems to do the trick for grouped experts routing

* Cleanup

* Trying to merge, something is not right

* Working merged grouped top_k (CPU)

* Add command line option to enable grouped expert routing

* Add grouped expert routing option to llama-bench

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>

2025-10-16 14:57:02 +03:00

..

llama.h

Grouped expert routing (CPU only) (#836)

2025-10-16 14:57:02 +03:00