Skip to content

Commit dcc4e36

Browse files
committed
gptel-ollama: Set num_ctx to 8192
* gptel-ollama.el (gptel--request-data): Set Ollama's default context to 8192, which is what Llama 3 supports (#330). This is currently not customizable, but is intended to be in the future.
1 parent 2736706 commit dcc4e36

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

gptel-ollama.el

+2-1
Original file line numberDiff line numberDiff line change
@@ -80,7 +80,8 @@ Intended for internal use only.")
8080
:stream ,(or (and gptel-stream gptel-use-curl
8181
(gptel-backend-stream gptel-backend))
8282
:json-false)))
83-
options-plist)
83+
;; TODO num_ctx chosen according to #330, make customizable
84+
(options-plist '(:num_ctx 8192)))
8485
(when gptel-temperature
8586
(setq options-plist
8687
(plist-put options-plist :temperature

0 commit comments

Comments
 (0)