Aman Gupta 9f682fb640 ggml-cpu: FA split across kv for faster TG (#19209) ...

* ggml-cpu: split across kv for faster TG

* simplify sinks application

* add ref impl

2026-02-03 01:19:55 +08:00

..

ggml-alloc.h

llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (#16653)

2025-12-15 09:24:59 +01:00

ggml-backend.h

vulkan: extend topk_moe to handle sigmoid w/exp_probs_b for nemotron (#18295)

2026-01-01 08:58:27 +01:00

ggml-blas.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-cann.h

docs : Minor cleanups (#19252)

2026-02-02 08:38:55 +02:00

ggml-cpp.h

ggml : fix ggml_gallocr_ptr type (ggml/1205)

2025-05-01 09:58:44 +03:00

ggml-cpu.h

ggml-cpu: FA split across kv for faster TG (#19209)

2026-02-03 01:19:55 +08:00

ggml-cuda.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-hexagon.h

Add experimental ggml-hexagon backend for the Hexagon NPU (#16547)

2025-10-22 13:47:09 -07:00

ggml-metal.h

metal : refactor + optimize v2 (#15995)

2025-09-17 20:38:12 +03:00

ggml-opencl.h

Introducing experimental OpenCL backend with support for Qualcomm Adreno GPUs (#10693)

2024-12-13 12:23:52 -08:00

ggml-opt.h

finetune: SGD optimizer, more CLI args (#13873)

2025-08-14 12:03:57 +02:00

ggml-rpc.h

rpc : fix alloc size logic (#17116)

2025-12-05 19:39:04 +02:00

ggml-sycl.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-virtgpu.h

ggml: new backend for Virglrenderer API Remoting acceleration (v2) (#18718)

2026-01-28 17:49:40 +08:00

ggml-vulkan.h

vulkan: Make Vulkan optional at runtime (#11493). (#11494)

2025-02-10 07:17:21 +01:00

ggml-webgpu.h

ggml: Add initial WebGPU backend (#14521)

2025-07-16 18:18:51 +03:00

ggml-zdnn.h

zdnn: refactor codebase + add docs (#16178)

2025-09-23 14:53:05 +08:00

ggml-zendnn.h

ggml-zendnn : add ZenDNN backend for AMD CPUs (#17690)

2025-12-07 00:13:33 +08:00

ggml.h

docs : Minor cleanups (#19252)

2026-02-02 08:38:55 +02:00

gguf.h

GGUF: C++ refactor, backend support, misc fixes (#11030)

2025-01-07 18:01:58 +01:00