CUDA: reduce MMQ stream-k overhead#22298

JohannesGaessler merged 2 commits intoggml-org:masterggml-org/llama.cpp:masterfrom

JohannesGaessler:cuda-mmq-fastdiv-8JohannesGaessler/llama.cpp:cuda-mmq-fastdiv-8Copy head branch name to clipboard