Aman Gupta bcb43163ae ggml-cpu: Use tiled FA for prompt-processing (#19012) ...

* ggml-cpu: Use tiled FA for prompt-processing

the FA performance is gimped on CPU on long contexts because it essentially uses a vector kernel. This PR adds a tiled FA for PP. Perf tuning for tile sizes done on a AMD EPYC single-socket 64-c machine.

* fix out of bounds for mask

* skip rows where there are all masks

* skip tile if mask is inf

* store mask in worksize

* check inf tile earlier

2026-01-25 23:25:58 +08:00

..

cmake

ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (#15094)

2025-08-07 13:45:41 +02:00

include

ggml : add ggml_build_forward_select (#18550)

2026-01-19 20:03:19 +02:00

src

ggml-cpu: Use tiled FA for prompt-processing (#19012)

2026-01-25 23:25:58 +08:00

.gitignore

vulkan : cmake integration (#8119)

2024-07-13 18:12:39 +02:00

CMakeLists.txt

ggml : bump version to 0.9.5 (ggml/1410)

2025-12-31 18:54:43 +02:00