We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent d45ee13 commit d293603Copy full SHA for d293603
notes/llama.cpp/gpu-sampling.md
@@ -95,7 +95,6 @@ the graph with the operations they need to perform.
95
To be able to perform the GPU sampling operations on the GPU this will be done
96
in a similar manner to how pooling is currently applied. To enable this a
97
llama_sampler has been added to llama_context_params:
98
-```c++
99
```c++
100
struct llama_sampler_chain_params gpu_sampler_params = llama_sampler_chain_default_params();
101
struct llama_sampler * gpu_sampler_chain = llama_sampler_chain_init(gpu_sampler_params);
0 commit comments