Radoslav Gerganov 553a5c3a9f rpc : do not wait for response when sending RPC_CMD_SET_TENSOR (#12943) ...

RPC_CMD_SET_TENSOR always returns an empty response and we send this 4
times per token. We can improve TG speed if we don't wait for this empty
response.

The performance impact of this change depends on the network latency.

2025-04-25 10:08:08 +03:00

..

ggml-alloc.h

ggml : upgrade init_tensor API to return a ggml_status (#11854)

2025-02-28 14:41:47 +01:00

ggml-backend.h

ggml : upgrade init_tensor API to return a ggml_status (#11854)

2025-02-28 14:41:47 +01:00

ggml-blas.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-cann.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-cpp.h

GGUF: C++ refactor, backend support, misc fixes (#11030)

2025-01-07 18:01:58 +01:00

ggml-cpu.h

ggml-cpu: Faster IQ1 mul_mat_vec on AVX2 using BMI2 instructions (#12154)

2025-03-06 02:26:10 +01:00

ggml-cuda.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-kompute.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-metal.h

repo : update links to new url (#11886)

2025-02-15 16:40:57 +02:00

ggml-opencl.h

Introducing experimental OpenCL backend with support for Qualcomm Adreno GPUs (#10693)

2024-12-13 12:23:52 -08:00

ggml-opt.h

ggml: new optimization interface (ggml/988)

2024-11-17 08:30:29 +02:00

ggml-rpc.h

rpc : do not wait for response when sending RPC_CMD_SET_TENSOR (#12943)

2025-04-25 10:08:08 +03:00

ggml-sycl.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-vulkan.h

vulkan: Make Vulkan optional at runtime (#11493). (#11494)

2025-02-10 07:17:21 +01:00

ggml.h

ggml : Depthwise 2D convolution (ggml/1152)

2025-04-24 17:32:47 +03:00

gguf.h

GGUF: C++ refactor, backend support, misc fixes (#11030)

2025-01-07 18:01:58 +01:00