sdgoij/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-05-01 22:54:05 +00:00
Code Issues Packages Projects Releases Wiki Activity

llama : clarify nemotron-h.cpp comment about RoPE [no ci] (#18997)

Browse Source 
This commit removes the mention of RoPE in the comment for the Q and K
computation as RoPE is not applied.
This commit is contained in:
Daniel Bevenius
2026-01-21 18:31:34 +01:00
committed by GitHub
parent bd544c94a3
commit 9da3dcd753
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
src/models/nemotron-h.cpp
View File

@@ -67,7 +67,7 @@ ggml_tensor * llm_build_nemotron_h::build_attention_layer(ggml_tensor *
const llama_model & model,
const int64_t n_embd_head,
const int il) {
// compute Q and K and (optionally) RoPE them
// compute Q and K
ggml_tensor * Qcur = build_lora_mm(model.layers[il].wq, cur);
cb(Qcur, "Qcur", il);
if (model.layers[il].bq) {