llama.cpp/examples/speculative at 467e307931ef353676f092be4bb3b2bb3c7d3bbf - llama.cpp - Gitea: Git with a cup of tea

sdgoij/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-05-11 03:24:21 +00:00

Files

History

Georgi Gerganov 897caccdf4 fixes : speculative KV cache + llama worst-case graph

2023-09-18 22:32:28 +03:00

..

CMakeLists.txt

speculative : PoC for speeding-up inference via speculative sampling (#2926 )

2023-09-03 15:12:08 +03:00

speculative.cpp

fixes : speculative KV cache + llama worst-case graph

2023-09-18 22:32:28 +03:00