Georgi Gerganov 4640060cd6 llama : add option to save memory in device buffers

2026-05-04 15:34:27 +03:00

..

batched-bench

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

cli

cli: Remove redundant local sampling variables (#20429) (#22264)

2026-04-24 00:53:23 +02:00

completion

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

cvector-generator

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

export-lora

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

fit-params

fit-params : refactor + add option to output estimated memory per device (#22171)

2026-04-21 09:54:36 +03:00

gguf-split

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

imatrix

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

llama-bench

spec : refactor params (#22397)

2026-04-28 09:07:33 +03:00

mtmd

common: fix missing exports in llama-common (#22340)

2026-04-27 08:06:39 +03:00

parser

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

perplexity

fit-params : refactor + add option to output estimated memory per device (#22171)

2026-04-21 09:54:36 +03:00

quantize

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

results

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

rpc

fix: rpc-server cache may not work in Windows environments (#22394)

2026-04-27 17:25:09 +03:00

server

llama : add option to save memory in device buffers

2026-05-04 15:34:27 +03:00

tokenize

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

tts

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

CMakeLists.txt

llama: end-to-end tests (#19802)

2026-03-08 12:30:21 +01:00