Commit Graph

4 Commits

Author SHA1 Message Date
Georgi Gerganov
c062ffd18c batched-bench : init warm-up batch 2023-10-11 19:24:59 +03:00
Georgi Gerganov
026bb1b1cd batched-bench : add readme + n_kv_max is now configurable 2023-10-11 19:10:35 +03:00
Georgi Gerganov
7438728d51 batched : minor fix table 2023-10-08 16:35:54 +03:00
Georgi Gerganov
bf06d654de batched : add bench tool 2023-10-08 15:57:16 +03:00