sdgoij/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-05-08 18:14:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b8262
llama.cpp/ggml/src
History
Paul Flynn e22cd0aa15 metal : extend mul_mv_ext to BF16, Q2_K, Q3_K (#20250) 
Enable mul_mv_ext small-batch kernels (BS 2-8) for BF16, Q2_K,
and Q3_K quantization types. These types previously fell through
to the slower single-row mul_mv path.

BF16 uses the float4 dequantize path (like F16). Q2_K and Q3_K
use the float4x4 K-quant path (like Q4_K/Q5_K/Q6_K).

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-09 16:48:12 +02:00
..
ggml-blas
ggml: update comments for backends which have no memory to report (#20157)
2026-03-06 23:24:38 +08:00
ggml-cann
CANN: Remove unnecessary wrapper for gml_backend_buft_is_cann (#18968)
2026-02-10 14:19:30 +08:00
ggml-cpu
ggml: add GATED_DELTA_NET op (#19504)
2026-03-07 15:41:10 +08:00
ggml-cuda
ggml-cuda: disable gdn for musa (#20278)
2026-03-09 16:15:36 +08:00
ggml-hexagon
hexagon: add f32 ssm_conv op (#20122)
2026-03-06 09:59:26 -08:00
ggml-hip
HIP: add mmf for CDNA (#18896)
2026-01-29 11:10:53 +01:00
ggml-metal
metal : extend mul_mv_ext to BF16, Q2_K, Q3_K (#20250)
2026-03-09 16:48:12 +02:00
ggml-musa
CUDA: faster tile FA, add oob checks, more HSs (#16492)
2025-10-11 20:54:32 +02:00
ggml-opencl
opencl: add l2_norm (#20160)
2026-03-06 18:03:05 -08:00
ggml-rpc
rpc : use unordered_map::reserve and emplace (#18513)
2026-01-02 12:09:36 +02:00
ggml-sycl
[SYCL] supprt Flash Attention for fp32/fp16/Q4/Q5/Q8 (#20190)
2026-03-08 12:00:07 +08:00
ggml-virtgpu
ggml-virtgpu: improve the reliability of the code (#19846)
2026-02-26 20:00:57 +08:00
ggml-vulkan
ggml-vulkan: add SGN operator, auto-generate Vulkan.csv and ops.md (#20219)
2026-03-09 07:24:16 +01:00
ggml-webgpu
[WebGPU] Fix wait logic for inflight jobs (#20096)
2026-03-04 11:54:55 -08:00
ggml-zdnn
ggml-zdnn : mark zDNN buffers as non-host (#18967)
2026-01-22 01:16:21 +01:00
ggml-zendnn
ggml-zendnn: update code for latest ZenDNN API (#19923)
2026-02-27 08:43:41 +08:00
CMakeLists.txt
hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)
2026-01-29 12:33:21 -08:00
ggml-alloc.c
ggml : make ggml_is_view as API (#19539)
2026-02-16 17:43:34 +02:00
ggml-backend-dl.cpp
hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)
2026-01-29 12:33:21 -08:00
ggml-backend-dl.h
hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)
2026-01-29 12:33:21 -08:00
ggml-backend-impl.h
llama: use host memory if device reports 0 memory (#18587)
2026-01-09 05:34:56 +08:00
ggml-backend-reg.cpp
ggml : use noexcept overload for is_regular_file in backend registration (#19452)
2026-02-10 10:57:48 +01:00
ggml-backend.cpp
CUDA: Improve performance via less synchronizations between token (#17795)
2026-03-05 13:53:21 +02:00
ggml-common.h
llama : add gpt-oss (#15091)
2025-08-05 22:10:36 +03:00
ggml-impl.h
ggml : make ggml_is_view as API (#19539)
2026-02-16 17:43:34 +02:00
ggml-opt.cpp
finetune: SGD optimizer, more CLI args (#13873)
2025-08-14 12:03:57 +02:00
ggml-quants.c
quants : Add memsets and other fixes for IQ quants (#19861)
2026-03-06 23:06:56 +02:00
ggml-quants.h
llama : add gpt-oss (#15091)
2025-08-05 22:10:36 +03:00
ggml-threading.cpp
ggml : build backends as libraries (#10256)
2024-11-14 18:04:35 +01:00
ggml-threading.h
remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)
2024-12-12 19:02:49 +01:00
ggml.c
ggml: add GATED_DELTA_NET op (#19504)
2026-03-07 15:41:10 +08:00
ggml.cpp
ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)
2025-06-01 13:43:57 +03:00
gguf.cpp
gguf : avoid too many file size calls (#19919)
2026-02-26 12:46:32 +02:00