sdgoij/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-05-05 00:24:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
94de74e7b1b9ee6404b54ebb0df273a3ef35a555
llama.cpp/tools/server/server-models.cpp
Xuan-Son Nguyen f5acfb2ffa server: (router) add stop-timeout option (#18350) 
* server: (router) add stop-timeout option

* also allow stop while loading

* add docs

* unload_lru: also wait for unload to complete
2025-12-24 23:47:49 +01:00

36 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink