Skip to content

Commit 2d78c63

Browse files
leto-bleto-b
committed
add cache_last_values_memory_budget_in_byte and related params
1 parent abfab96 commit 2d78c63

File tree

8 files changed

+234
-4
lines changed

8 files changed

+234
-4
lines changed

‎src/UserGuide/Master/Table/Reference/System-Config-Manual.md‎

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3251,6 +3251,35 @@ The `iotdb-system.properties` file contains various configurations for managing
32513251
| Default | 5 |
32523252
| Effective | Restart required. |
32533253

3254+
3255+
* last_cache_operation_on_load
3256+
3257+
|Name| last_cache_operation_on_load |
3258+
|:---:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
3259+
|Description| The operation performed to LastCache when a TsFile is successfully loaded. `UPDATE`: use the data in the TsFile to update LastCache; `UPDATE_NO_BLOB`: similar to UPDATE, but will invalidate LastCache for blob series; `CLEAN_DEVICE`: invalidate LastCache of devices contained in the TsFile; `CLEAN_ALL`: clean the whole LastCache. |
3260+
|Type| String |
3261+
|Default| UPDATE_NO_BLOB |
3262+
|Effective| Effective after restart |
3263+
3264+
* cache_last_values_for_load
3265+
3266+
|Name| cache_last_values_for_load |
3267+
|:---:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
3268+
|Description| Whether to cache last values before loading a TsFile. Only effective when `last_cache_operation_on_load=UPDATE_NO_BLOB` or `last_cache_operation_on_load=UPDATE`. When set to true, blob series will be ignored even with `last_cache_operation_on_load=UPDATE`. Enabling this will increase the memory footprint during loading TsFiles. |
3269+
|Type| Boolean |
3270+
|Default| true |
3271+
|Effective| Effective after restart |
3272+
3273+
* cache_last_values_memory_budget_in_byte
3274+
3275+
|Name| cache_last_values_memory_budget_in_byte |
3276+
|:---:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
3277+
|Description| When `cache_last_values_for_load=true`, the maximum memory that can be used to cache last values. If this value is exceeded, the cached values will be abandoned and last values will be read from the TsFile in a streaming manner. |
3278+
|Type| int32 |
3279+
|Default| 4194304 |
3280+
|Effective| Effective after restart |
3281+
3282+
32543283
### 4.38 Dispatch Retry Configuration
32553284

32563285
- enable_retry_for_unknown_error

‎src/UserGuide/Master/Tree/Reference/Common-Config-Manual.md‎

Lines changed: 30 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2210,4 +2210,33 @@ Different configuration parameters take effect in the following three ways:
22102210
|Description| Active listening polling interval in seconds. The function of actively listening to tsfile is achieved by polling the folder. This configuration specifies the time interval between two checks of load_active_listening_dirs, and the next check will be executed after load_active_listening_check_interval_seconds seconds of each check. When the user sets the polling interval to less than 1, it will be set to the default value of 5 seconds. |
22112211
|Type| Long |
22122212
|Default| 5|
2213-
|Effective|Effective after restart|
2213+
|Effective|Effective after restart|
2214+
2215+
2216+
* last\_cache\_operation\_on\_load
2217+
2218+
|Name| last\_cache\_operation\_on\_load |
2219+
|:---:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
2220+
|Description| The operation performed to LastCache when a TsFile is successfully loaded. `UPDATE`: use the data in the TsFile to update LastCache; `UPDATE_NO_BLOB`: similar to UPDATE, but will invalidate LastCache for blob series; `CLEAN_DEVICE`: invalidate LastCache of devices contained in the TsFile; `CLEAN_ALL`: clean the whole LastCache. |
2221+
|Type| String |
2222+
|Default| UPDATE_NO_BLOB |
2223+
|Effective| Effective after restart |
2224+
2225+
* cache\_last\_values\_for\_load
2226+
2227+
|Name| cache\_last\_values\_for\_load |
2228+
|:---:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
2229+
|Description| Whether to cache last values before loading a TsFile. Only effective when `last_cache_operation_on_load=UPDATE_NO_BLOB` or `last_cache_operation_on_load=UPDATE`. When set to true, blob series will be ignored even with `last_cache_operation_on_load=UPDATE`. Enabling this will increase the memory footprint during loading TsFiles. |
2230+
|Type| Boolean |
2231+
|Default| true |
2232+
|Effective| Effective after restart |
2233+
2234+
* cache\_last\_values\_memory\_budget\_in\_byte
2235+
2236+
|Name| cache\_last\_values\_memory\_budget\_in\_byte |
2237+
|:---:|:----------------------------------------------------------------------------------------------------|
2238+
|Description| When `cache_last_values_for_load=true`, the maximum memory that can be used to cache last values. If this value is exceeded, the cached values will be abandoned and last values will be read from the TsFile in a streaming manner. |
2239+
|Type| int32 |
2240+
|Default| 4194304 |
2241+
|Effective| Effective after restart |
2242+

‎src/UserGuide/latest-Table/Reference/System-Config-Manual.md‎

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3251,6 +3251,34 @@ The `iotdb-system.properties` file contains various configurations for managing
32513251
| Default | 5 |
32523252
| Effective | Restart required. |
32533253

3254+
* last_cache_operation_on_load
3255+
3256+
|Name| last_cache_operation_on_load |
3257+
|:---:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
3258+
|Description| The operation performed to LastCache when a TsFile is successfully loaded. `UPDATE`: use the data in the TsFile to update LastCache; `UPDATE_NO_BLOB`: similar to UPDATE, but will invalidate LastCache for blob series; `CLEAN_DEVICE`: invalidate LastCache of devices contained in the TsFile; `CLEAN_ALL`: clean the whole LastCache. |
3259+
|Type| String |
3260+
|Default| UPDATE_NO_BLOB |
3261+
|Effective| Effective after restart |
3262+
3263+
* cache_last_values_for_load
3264+
3265+
|Name| cache_last_values_for_load |
3266+
|:---:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
3267+
|Description| Whether to cache last values before loading a TsFile. Only effective when `last_cache_operation_on_load=UPDATE_NO_BLOB` or `last_cache_operation_on_load=UPDATE`. When set to true, blob series will be ignored even with `last_cache_operation_on_load=UPDATE`. Enabling this will increase the memory footprint during loading TsFiles. |
3268+
|Type| Boolean |
3269+
|Default| true |
3270+
|Effective| Effective after restart |
3271+
3272+
* cache_last_values_memory_budget_in_byte
3273+
3274+
|Name| cache_last_values_memory_budget_in_byte |
3275+
|:---:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
3276+
|Description| When `cache_last_values_for_load=true`, the maximum memory that can be used to cache last values. If this value is exceeded, the cached values will be abandoned and last values will be read from the TsFile in a streaming manner. |
3277+
|Type| int32 |
3278+
|Default| 4194304 |
3279+
|Effective| Effective after restart |
3280+
3281+
32543282
### 4.38 Dispatch Retry Configuration
32553283

32563284
- enable_retry_for_unknown_error

0 commit comments

Comments
 (0)