Overview
By default, the shared model mixing interface should be able to automatically compress or forget the oldest context in memory if it overflows the context window allowed. The feature should be an opt-out behavior (default: true).
Requirements
- The feature is implemented as described.
- The feature is documented.
- Tests must prove compatibility for all of all changes across all impacted flows.
Overview
By default, the shared model mixing interface should be able to automatically compress or forget the oldest context in memory if it overflows the context window allowed. The feature should be an opt-out behavior (default: true).
Requirements