byteCoderIf you're running Deepseek (or any Ollama model) with more than 32 cores, you'll want to do this: /...
Shared by Dave W Plummer @davepl1968 on X
If you're running Deepseek (or any Ollama model) with more than 32 cores, you'll want to do this: /set parameter num_thread 192 ...or whatever number of threads you have. This isn't a command line switch, you type it directly into the CLI. It will reload the model and then
If you're running Deepseek (or any Ollama model) with more than 32 cores, you'll want to do this: /set parameter num_thread 192 ...or whatever number of threads you have. This isn't a command line switch, you type it directly into the CLI. It will reload the model and then