Commit Graph

5 Commits

Author SHA1 Message Date
Sascha Rogmann
cb3a40277a common: moved self-spec impl to ngram-map 2026-01-25 01:16:06 +01:00
Sascha Rogmann
a1584ac80f server: cleanup (remove slot.batch_spec, rename) 2026-01-24 15:55:02 +01:00
Sascha Rogmann
eb43748b05 common: add vector of speculative states 2026-01-24 15:55:02 +01:00
Sascha Rogmann
b38eb5907c common: add enum common_speculative_type 2026-01-24 15:55:02 +01:00
Sascha Rogmann
456268fa7f common: ngram map, config self-speculative decoding 2026-01-24 15:36:44 +01:00