Plugin Type
VSCode Extension
App Version
5.12.0
Description
After context condensation, the model will sometimes be sent a package far exceeding expectation.
In the most recent situation, the context condensed to 30k tokens, yet every request past that failed because the model was being sent a context package of 600k+ tokens. I have not determined more than this, but it has happened 4 times in the last week, so it's worth mentioning.
Reproduction steps
Intermittent issue that is only partially reproducible so far.
wait for context condensation to occur, or trigger it manually.
Model switching or session rollback may have an impact but I haven't been able to isolate these variables just yet.
Provider
All
Model
Any
System Information
No response
Plugin Type
VSCode Extension
App Version
5.12.0
Description
After context condensation, the model will sometimes be sent a package far exceeding expectation.
In the most recent situation, the context condensed to 30k tokens, yet every request past that failed because the model was being sent a context package of 600k+ tokens. I have not determined more than this, but it has happened 4 times in the last week, so it's worth mentioning.
Reproduction steps
Intermittent issue that is only partially reproducible so far.
wait for context condensation to occur, or trigger it manually.
Model switching or session rollback may have an impact but I haven't been able to isolate these variables just yet.
Provider
All
Model
Any
System Information
No response