Jeff Bolz 50b7f076a5 vulkan: Use mul_mat_vec_id for small values of n (#18918) ...

Change ggml_vk_mul_mat_vec_id_q_f16 to loop over the batch dimension and
update the indexing calculations in get_offsets.

Mat-vec is faster than mat-mat for small values of n. We don't get the same
reuse of the weights as in the non-ID path, but with this the cost is linear
in n rather than n>1 being far slower than n==1.

2026-01-21 16:22:02 +01:00

..

cmake

ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (#15094)

2025-08-07 13:45:41 +02:00

include

ggml : add ggml_build_forward_select (#18550)

2026-01-19 20:03:19 +02:00

src

vulkan: Use mul_mat_vec_id for small values of n (#18918)

2026-01-21 16:22:02 +01:00

.gitignore

vulkan : cmake integration (#8119)

2024-07-13 18:12:39 +02:00

CMakeLists.txt

ggml : bump version to 0.9.5 (ggml/1410)

2025-12-31 18:54:43 +02:00