gitea/k3s-manifests
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

adjust llama gpu params

Browse Source
This commit is contained in:
Alexander Rogov
2026-06-09 20:28:21 +03:00
parent 866a2d19de
commit d160219c6b
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
manifests/llama/main.yaml
View File

@@ -93,9 +93,9 @@ spec:
# performance tuning # performance tuning
- "--ctx-size" - "--ctx-size"
- "32768" - "24576"
- "--parallel" - "--parallel"
- "4" - "2"
# KV cache quantization # KV cache quantization
- "--cache-type-k" - "--cache-type-k"