Skip to content

add cache_last_values_memory_budget_in_byte and related params #938

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
CritasWang merged 1 commit into from
Dec 26, 2025
Merged

add cache_last_values_memory_budget_in_byte and related params #938

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 29 additions & 0 deletions src/UserGuide/Master/Table/Reference/System-Config-Manual.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3251,6 +3251,35 @@ The `iotdb-system.properties` file contains various configurations for managing
| Default | 5 |
| Effective | Restart required. |


* last_cache_operation_on_load

|Name| last_cache_operation_on_load |
|:---:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|Description| The operation performed to LastCache when a TsFile is successfully loaded. `UPDATE`: use the data in the TsFile to update LastCache; `UPDATE_NO_BLOB`: similar to UPDATE, but will invalidate LastCache for blob series; `CLEAN_DEVICE`: invalidate LastCache of devices contained in the TsFile; `CLEAN_ALL`: clean the whole LastCache. |
|Type| String |
|Default| UPDATE_NO_BLOB |
|Effective| Effective after restart |

* cache_last_values_for_load

|Name| cache_last_values_for_load |
|:---:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|Description| Whether to cache last values before loading a TsFile. Only effective when `last_cache_operation_on_load=UPDATE_NO_BLOB` or `last_cache_operation_on_load=UPDATE`. When set to true, blob series will be ignored even with `last_cache_operation_on_load=UPDATE`. Enabling this will increase the memory footprint during loading TsFiles. |
|Type| Boolean |
|Default| true |
|Effective| Effective after restart |

* cache_last_values_memory_budget_in_byte

|Name| cache_last_values_memory_budget_in_byte |
|:---:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|Description| When `cache_last_values_for_load=true`, the maximum memory that can be used to cache last values. If this value is exceeded, the cached values will be abandoned and last values will be read from the TsFile in a streaming manner. |
|Type| int32 |
|Default| 4194304 |
|Effective| Effective after restart |


### 4.38 Dispatch Retry Configuration

- enable_retry_for_unknown_error
Expand Down
31 changes: 30 additions & 1 deletion src/UserGuide/Master/Tree/Reference/Common-Config-Manual.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2210,4 +2210,33 @@ Different configuration parameters take effect in the following three ways:
|Description| Active listening polling interval in seconds. The function of actively listening to tsfile is achieved by polling the folder. This configuration specifies the time interval between two checks of load_active_listening_dirs, and the next check will be executed after load_active_listening_check_interval_seconds seconds of each check. When the user sets the polling interval to less than 1, it will be set to the default value of 5 seconds. |
|Type| Long |
|Default| 5|
|Effective|Effective after restart|
|Effective|Effective after restart|


* last\_cache\_operation\_on\_load

|Name| last\_cache\_operation\_on\_load |
|:---:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|Description| The operation performed to LastCache when a TsFile is successfully loaded. `UPDATE`: use the data in the TsFile to update LastCache; `UPDATE_NO_BLOB`: similar to UPDATE, but will invalidate LastCache for blob series; `CLEAN_DEVICE`: invalidate LastCache of devices contained in the TsFile; `CLEAN_ALL`: clean the whole LastCache. |
|Type| String |
|Default| UPDATE_NO_BLOB |
|Effective| Effective after restart |

* cache\_last\_values\_for\_load

|Name| cache\_last\_values\_for\_load |
|:---:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|Description| Whether to cache last values before loading a TsFile. Only effective when `last_cache_operation_on_load=UPDATE_NO_BLOB` or `last_cache_operation_on_load=UPDATE`. When set to true, blob series will be ignored even with `last_cache_operation_on_load=UPDATE`. Enabling this will increase the memory footprint during loading TsFiles. |
|Type| Boolean |
|Default| true |
|Effective| Effective after restart |

* cache\_last\_values\_memory\_budget\_in\_byte

|Name| cache\_last\_values\_memory\_budget\_in\_byte |
|:---:|:----------------------------------------------------------------------------------------------------|
|Description| When `cache_last_values_for_load=true`, the maximum memory that can be used to cache last values. If this value is exceeded, the cached values will be abandoned and last values will be read from the TsFile in a streaming manner. |
|Type| int32 |
|Default| 4194304 |
|Effective| Effective after restart |

28 changes: 28 additions & 0 deletions src/UserGuide/latest-Table/Reference/System-Config-Manual.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3251,6 +3251,34 @@ The `iotdb-system.properties` file contains various configurations for managing
| Default | 5 |
| Effective | Restart required. |

* last_cache_operation_on_load

|Name| last_cache_operation_on_load |
|:---:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|Description| The operation performed to LastCache when a TsFile is successfully loaded. `UPDATE`: use the data in the TsFile to update LastCache; `UPDATE_NO_BLOB`: similar to UPDATE, but will invalidate LastCache for blob series; `CLEAN_DEVICE`: invalidate LastCache of devices contained in the TsFile; `CLEAN_ALL`: clean the whole LastCache. |
|Type| String |
|Default| UPDATE_NO_BLOB |
|Effective| Effective after restart |

* cache_last_values_for_load

|Name| cache_last_values_for_load |
|:---:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|Description| Whether to cache last values before loading a TsFile. Only effective when `last_cache_operation_on_load=UPDATE_NO_BLOB` or `last_cache_operation_on_load=UPDATE`. When set to true, blob series will be ignored even with `last_cache_operation_on_load=UPDATE`. Enabling this will increase the memory footprint during loading TsFiles. |
|Type| Boolean |
|Default| true |
|Effective| Effective after restart |

* cache_last_values_memory_budget_in_byte

|Name| cache_last_values_memory_budget_in_byte |
|:---:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|Description| When `cache_last_values_for_load=true`, the maximum memory that can be used to cache last values. If this value is exceeded, the cached values will be abandoned and last values will be read from the TsFile in a streaming manner. |
|Type| int32 |
|Default| 4194304 |
|Effective| Effective after restart |


### 4.38 Dispatch Retry Configuration

- enable_retry_for_unknown_error
Expand Down
Loading