llama.cpp/tools/server/server-context.cpp at c632ea82702992648d259d0d321322b6a2184e4d - llama.cpp - Gitea: Git with a cup of tea

sdgoij/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-05-16 22:14:07 +00:00

Files

Ruben Ortlam c632ea8270 server: add --models-memory-max parameter to allow dynamically unloading models when they exceed a memory size threshold

2026-05-15 09:06:01 +02:00

181 KiB

Raw Blame History

View Raw