This is an automated email from the ASF dual-hosted git repository.
critas pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/iotdb-docs.git
The following commit(s) were added to refs/heads/main by this push:
new e465c3d9 Multi level storage adapted to non AWS object storage systems
compliant with S3 protocol (#676)
e465c3d9 is described below
commit e465c3d9f9b4af40706dfc14d11615970b3f2e7d
Author: W1y1r <[email protected]>
AuthorDate: Fri Mar 28 11:52:19 2025 +0800
Multi level storage adapted to non AWS object storage systems compliant
with S3 protocol (#676)
---
.../Master/Table/User-Manual/Tiered-Storage_timecho.md | 8 ++++++--
.../Master/Tree/User-Manual/Tiered-Storage_timecho.md | 10 +++++++---
.../latest-Table/User-Manual/Tiered-Storage_timecho.md | 8 ++++++--
src/UserGuide/latest/User-Manual/Tiered-Storage_timecho.md | 10 +++++++---
.../Master/Table/User-Manual/Tiered-Storage_timecho.md | 10 +++++++---
.../Master/Tree/User-Manual/Tiered-Storage_timecho.md | 10 +++++++---
.../latest-Table/User-Manual/Tiered-Storage_timecho.md | 10 +++++++---
src/zh/UserGuide/latest/User-Manual/Tiered-Storage_timecho.md | 10 +++++++---
8 files changed, 54 insertions(+), 22 deletions(-)
diff --git a/src/UserGuide/Master/Table/User-Manual/Tiered-Storage_timecho.md
b/src/UserGuide/Master/Table/User-Manual/Tiered-Storage_timecho.md
index 587d87d2..eab13549 100644
--- a/src/UserGuide/Master/Table/User-Manual/Tiered-Storage_timecho.md
+++ b/src/UserGuide/Master/Table/User-Manual/Tiered-Storage_timecho.md
@@ -41,11 +41,13 @@ The specific parameter definitions and their descriptions
are as follows.
| `dn_data_dirs` | `data/datanode/data` |
Specifies storage directories grouped into tiers.
| Tiers are separated by
`;`, directories within the same tier are separated by `,`. <br>Cloud storage
(e.g., AWS S3) can only be the last tier. <br>Use `OBJECT_STORAGE` to denote
cloud storage. <br>Only [...]
| `tier_ttl_in_ms` | `-1` |
Defines the TTL (in milliseconds) for each tier to determine the data range it
manages.
| Tiers are separated by
`;`. <br>The number of tiers must match `dn_data_dirs`. <br>`-1` means "no
limit".
[...]
| `dn_default_space_usage_thresholds` | `0.85` |
Defines the minimum remaining space threshold (as a ratio) for each tier. When
a tier’s remaining space falls below this threshold, data is migrated to the
next tier. <br>The last tier triggers `READ_ONLY` mode. | -Tiers are separated
by `;`.The number of tiers must match `dn_data_dirs`.
[...]
-| `object_storage_type` | `AWS_S3` |
Cloud storage type.
| Only `AWS_S3` is
supported.
[...]
+| `object_storage_type`
| `AWS_S3` | Cloud storage type.
| all `AWS_S3` is supported.
[...]
| `object_storage_bucket` | `iotdb_data` |
Cloud storage bucket name.
| Required only if cloud
storage is used.
[...]
| `object_storage_endpoiont` | (Empty) |
Cloud storage endpoint.
| Required only if cloud
storage is used.
[...]
+| `object_storage_region` | (Empty) | Cloud
storage Region.
| Required only if cloud storage is
used.
[...]
| `object_storage_access_key` | (Empty) |
Cloud storage access key.
| Required only if cloud
storage is used.
[...]
| `object_storage_access_secret` | (Empty) |
Cloud storage access secret.
| Required only if cloud
storage is used.
[...]
+| `enable_path_style_access` | false | Whether
to enable path style access for object storage service.
|
Required only if cloud storage is used.
[...]
| `remote_tsfile_cache_dirs` | `data/datanode/data/cache` |
Local cache directory for cloud storage.
| Required only if cloud
storage is used.
[...]
| `remote_tsfile_cache_page_size_in_kb` | `20480` |
Page size (in KB) for cloud storage local cache.
| Required only if cloud
storage is used.
[...]
| `remote_tsfile_cache_max_disk_usage_in_mb` | `51200` |
Maximum disk space (in MB) allocated for cloud storage local cache.
| Required only if cloud
storage is used.
[...]
@@ -79,11 +81,13 @@ tier_ttl_in_ms=86400000;864000000;-1
dn_default_space_usage_thresholds=0.2;0.15;0.1
object_storage_type=AWS_S3
object_storage_bucket=iotdb
+object_storage_region=<your_region>
object_storage_endpoiont=<your_endpoint>
object_storage_access_key=<your_access_key>
object_storage_access_secret=<your_access_secret>
# Optional configurations
+enable_path_style_access=false
remote_tsfile_cache_dirs=data/datanode/data/cache
remote_tsfile_cache_page_size_in_kb=20971520
remote_tsfile_cache_max_disk_usage_in_mb=53687091200
@@ -95,4 +99,4 @@ remote_tsfile_cache_max_disk_usage_in_mb=53687091200
| :------- | :--------------------------- | :----------------------------- |
:---------------------------- |
| Tier 1 | `/data1/data` | Last 1 day of data |
20% |
| Tier 2 | `/data2/data`, `/data3/data` | Data from 1 day to 10 days ago |
15% |
-| Tier 3 | AWS S3 Cloud Storage | Data older than 10 days |
10% |
\ No newline at end of file
+| Tier 3 | S3 Cloud Storage | Data older than 10 days | 10%
|
\ No newline at end of file
diff --git a/src/UserGuide/Master/Tree/User-Manual/Tiered-Storage_timecho.md
b/src/UserGuide/Master/Tree/User-Manual/Tiered-Storage_timecho.md
index 3826db94..b05ec491 100644
--- a/src/UserGuide/Master/Tree/User-Manual/Tiered-Storage_timecho.md
+++ b/src/UserGuide/Master/Tree/User-Manual/Tiered-Storage_timecho.md
@@ -39,11 +39,13 @@ The specific parameter definitions and their descriptions
are as follows.
| dn_data_dirs | data/datanode/data
| specify different storage directories and divide the storage
directories into tiers | Each level of storage uses a semicolon to
separate, and commas to separate within a single level; cloud (OBJECT_STORAGE)
configuration can only be used as the last level of storage and the first level
can't be used as cloud storage; a cloud object at most; the remote storage
directory is denoted by OBJEC [...]
| tier_ttl_in_ms | -1 | Define
the maximum age of data for which each tier is responsible |
Each level of storage is separated by a semicolon; the number of levels should
match the number of levels defined by dn_data_dirs;"-1" means "unlimited". |
| dn_default_space_usage_thresholds | 0.85 |
Define the minimum remaining space ratio for each tier data catalogue; when the
remaining space is less than this ratio, the data will be automatically
migrated to the next tier; when the remaining storage space of the last tier
falls below this threshold, the system will be set to READ_ONLY | Each level of
storage is separated by a semicolon; the number of levels should match the
number of levels defined by dn_data_dirs |
-| object_storage_type | AWS_S3 | Cloud
Storage Type | IoTDB currently
only supports AWS S3 as a remote storage type, and this parameter can't be
modified |
+| object_storage_type | `AWS_S3` |
Cloud storage type. | all `AWS_S3` is supported.
|
| object_storage_bucket | iotdb_data
| Name of cloud storage bucket | Bucket
definition in AWS S3; no need to configure if remote storage is not used
|
| object_storage_endpoiont | |
endpoint of cloud storage | endpoint
of AWS S3;If remote storage is not used, no configuration required |
+| object_storage_region | (Empty) | Cloud
storage Region. | Required only if cloud storage is used.
|
| object_storage_access_key | |
Authentication information stored in the cloud: key
| AWS S3 credential key;If remote storage is not used, no
configuration required |
| object_storage_access_secret | |
Authentication information stored in the cloud: secret
| AWS S3 credential secret;If remote storage is not used, no
configuration required |
+| enable_path_style_access | false | Whether to
enable path style access for object storage service. | Required only if
cloud storage is used. |
| remote_tsfile_cache_dirs | data/datanode/data/cache | Cache
directory stored locally in the cloud | If
remote storage is not used, no configuration required
|
| remote_tsfile_cache_page_size_in_kb | 20480 |Block
size of locally cached files stored in the cloud
| If remote storage is not used, no configuration required
|
| remote_tsfile_cache_max_disk_usage_in_mb | 51200 |
Maximum Disk Occupancy Size for Cloud Storage Local Cache
| If remote storage is not used, no configuration required
|
@@ -75,13 +77,15 @@ The following takes three-level storage as an example:
dn_data_dirs=/data1/data;/data2/data,/data3/data;OBJECT_STORAGE
tier_ttl_in_ms=86400000;864000000;-1
dn_default_space_usage_thresholds=0.2;0.15;0.1
-object_storage_name=AWS_S3
+object_storage_type=AWS_S3
object_storage_bucket=iotdb
+object_storage_region=<your_region>
object_storage_endpoiont=<your_endpoint>
object_storage_access_key=<your_access_key>
object_storage_access_secret=<your_access_secret>
// Optional configuration items
+enable_path_style_access=false
remote_tsfile_cache_dirs=data/datanode/data/cache
remote_tsfile_cache_page_size_in_kb=20971520
remote_tsfile_cache_max_disk_usage_in_mb=53687091200
@@ -93,4 +97,4 @@ In this example, a total of three levels of storage are
configured, specifically
| -------- | -------------------------------------- |
---------------------------- | ------------------------ |
| tier1 | path 1:/data1/data | data for last 1 day
| 20% |
| tier2 | path 1:/data2/data path 2:/data3/data | data from past 1 day to
past 10 days | 15% |
-| tier3 | Remote AWS S3 Storage | data from 10 days
ago | 10% |
+| tier 3 | S3 Cloud Storage | Data older than 10 days | 10%
|
diff --git a/src/UserGuide/latest-Table/User-Manual/Tiered-Storage_timecho.md
b/src/UserGuide/latest-Table/User-Manual/Tiered-Storage_timecho.md
index 587d87d2..9a7d29de 100644
--- a/src/UserGuide/latest-Table/User-Manual/Tiered-Storage_timecho.md
+++ b/src/UserGuide/latest-Table/User-Manual/Tiered-Storage_timecho.md
@@ -41,11 +41,13 @@ The specific parameter definitions and their descriptions
are as follows.
| `dn_data_dirs` | `data/datanode/data` |
Specifies storage directories grouped into tiers.
| Tiers are separated by
`;`, directories within the same tier are separated by `,`. <br>Cloud storage
(e.g., AWS S3) can only be the last tier. <br>Use `OBJECT_STORAGE` to denote
cloud storage. <br>Only [...]
| `tier_ttl_in_ms` | `-1` |
Defines the TTL (in milliseconds) for each tier to determine the data range it
manages.
| Tiers are separated by
`;`. <br>The number of tiers must match `dn_data_dirs`. <br>`-1` means "no
limit".
[...]
| `dn_default_space_usage_thresholds` | `0.85` |
Defines the minimum remaining space threshold (as a ratio) for each tier. When
a tier’s remaining space falls below this threshold, data is migrated to the
next tier. <br>The last tier triggers `READ_ONLY` mode. | -Tiers are separated
by `;`.The number of tiers must match `dn_data_dirs`.
[...]
-| `object_storage_type` | `AWS_S3` |
Cloud storage type.
| Only `AWS_S3` is
supported.
[...]
+| `object_storage_type` | `AWS_S3` |
Cloud storage type.
| all `AWS_S3` is
supported.
[...]
| `object_storage_bucket` | `iotdb_data` |
Cloud storage bucket name.
| Required only if cloud
storage is used.
[...]
| `object_storage_endpoiont` | (Empty) |
Cloud storage endpoint.
| Required only if cloud
storage is used.
[...]
+| `object_storage_region` | (Empty) | Cloud
storage Region.
| Required only if cloud storage is
used.
[...]
| `object_storage_access_key` | (Empty) |
Cloud storage access key.
| Required only if cloud
storage is used.
[...]
| `object_storage_access_secret` | (Empty) |
Cloud storage access secret.
| Required only if cloud
storage is used.
[...]
+| `enable_path_style_access` | false | Whether
to enable path style access for object storage service.
|
Required only if cloud storage is used.
[...]
| `remote_tsfile_cache_dirs` | `data/datanode/data/cache` |
Local cache directory for cloud storage.
| Required only if cloud
storage is used.
[...]
| `remote_tsfile_cache_page_size_in_kb` | `20480` |
Page size (in KB) for cloud storage local cache.
| Required only if cloud
storage is used.
[...]
| `remote_tsfile_cache_max_disk_usage_in_mb` | `51200` |
Maximum disk space (in MB) allocated for cloud storage local cache.
| Required only if cloud
storage is used.
[...]
@@ -79,11 +81,13 @@ tier_ttl_in_ms=86400000;864000000;-1
dn_default_space_usage_thresholds=0.2;0.15;0.1
object_storage_type=AWS_S3
object_storage_bucket=iotdb
+object_storage_region=<your_region>
object_storage_endpoiont=<your_endpoint>
object_storage_access_key=<your_access_key>
object_storage_access_secret=<your_access_secret>
# Optional configurations
+enable_path_style_access=false
remote_tsfile_cache_dirs=data/datanode/data/cache
remote_tsfile_cache_page_size_in_kb=20971520
remote_tsfile_cache_max_disk_usage_in_mb=53687091200
@@ -95,4 +99,4 @@ remote_tsfile_cache_max_disk_usage_in_mb=53687091200
| :------- | :--------------------------- | :----------------------------- |
:---------------------------- |
| Tier 1 | `/data1/data` | Last 1 day of data |
20% |
| Tier 2 | `/data2/data`, `/data3/data` | Data from 1 day to 10 days ago |
15% |
-| Tier 3 | AWS S3 Cloud Storage | Data older than 10 days |
10% |
\ No newline at end of file
+| Tier 3 | S3 Cloud Storage | Data older than 10 days | 10%
|
\ No newline at end of file
diff --git a/src/UserGuide/latest/User-Manual/Tiered-Storage_timecho.md
b/src/UserGuide/latest/User-Manual/Tiered-Storage_timecho.md
index 3826db94..b05ec491 100644
--- a/src/UserGuide/latest/User-Manual/Tiered-Storage_timecho.md
+++ b/src/UserGuide/latest/User-Manual/Tiered-Storage_timecho.md
@@ -39,11 +39,13 @@ The specific parameter definitions and their descriptions
are as follows.
| dn_data_dirs | data/datanode/data
| specify different storage directories and divide the storage
directories into tiers | Each level of storage uses a semicolon to
separate, and commas to separate within a single level; cloud (OBJECT_STORAGE)
configuration can only be used as the last level of storage and the first level
can't be used as cloud storage; a cloud object at most; the remote storage
directory is denoted by OBJEC [...]
| tier_ttl_in_ms | -1 | Define
the maximum age of data for which each tier is responsible |
Each level of storage is separated by a semicolon; the number of levels should
match the number of levels defined by dn_data_dirs;"-1" means "unlimited". |
| dn_default_space_usage_thresholds | 0.85 |
Define the minimum remaining space ratio for each tier data catalogue; when the
remaining space is less than this ratio, the data will be automatically
migrated to the next tier; when the remaining storage space of the last tier
falls below this threshold, the system will be set to READ_ONLY | Each level of
storage is separated by a semicolon; the number of levels should match the
number of levels defined by dn_data_dirs |
-| object_storage_type | AWS_S3 | Cloud
Storage Type | IoTDB currently
only supports AWS S3 as a remote storage type, and this parameter can't be
modified |
+| object_storage_type | `AWS_S3` |
Cloud storage type. | all `AWS_S3` is supported.
|
| object_storage_bucket | iotdb_data
| Name of cloud storage bucket | Bucket
definition in AWS S3; no need to configure if remote storage is not used
|
| object_storage_endpoiont | |
endpoint of cloud storage | endpoint
of AWS S3;If remote storage is not used, no configuration required |
+| object_storage_region | (Empty) | Cloud
storage Region. | Required only if cloud storage is used.
|
| object_storage_access_key | |
Authentication information stored in the cloud: key
| AWS S3 credential key;If remote storage is not used, no
configuration required |
| object_storage_access_secret | |
Authentication information stored in the cloud: secret
| AWS S3 credential secret;If remote storage is not used, no
configuration required |
+| enable_path_style_access | false | Whether to
enable path style access for object storage service. | Required only if
cloud storage is used. |
| remote_tsfile_cache_dirs | data/datanode/data/cache | Cache
directory stored locally in the cloud | If
remote storage is not used, no configuration required
|
| remote_tsfile_cache_page_size_in_kb | 20480 |Block
size of locally cached files stored in the cloud
| If remote storage is not used, no configuration required
|
| remote_tsfile_cache_max_disk_usage_in_mb | 51200 |
Maximum Disk Occupancy Size for Cloud Storage Local Cache
| If remote storage is not used, no configuration required
|
@@ -75,13 +77,15 @@ The following takes three-level storage as an example:
dn_data_dirs=/data1/data;/data2/data,/data3/data;OBJECT_STORAGE
tier_ttl_in_ms=86400000;864000000;-1
dn_default_space_usage_thresholds=0.2;0.15;0.1
-object_storage_name=AWS_S3
+object_storage_type=AWS_S3
object_storage_bucket=iotdb
+object_storage_region=<your_region>
object_storage_endpoiont=<your_endpoint>
object_storage_access_key=<your_access_key>
object_storage_access_secret=<your_access_secret>
// Optional configuration items
+enable_path_style_access=false
remote_tsfile_cache_dirs=data/datanode/data/cache
remote_tsfile_cache_page_size_in_kb=20971520
remote_tsfile_cache_max_disk_usage_in_mb=53687091200
@@ -93,4 +97,4 @@ In this example, a total of three levels of storage are
configured, specifically
| -------- | -------------------------------------- |
---------------------------- | ------------------------ |
| tier1 | path 1:/data1/data | data for last 1 day
| 20% |
| tier2 | path 1:/data2/data path 2:/data3/data | data from past 1 day to
past 10 days | 15% |
-| tier3 | Remote AWS S3 Storage | data from 10 days
ago | 10% |
+| tier 3 | S3 Cloud Storage | Data older than 10 days | 10%
|
diff --git
a/src/zh/UserGuide/Master/Table/User-Manual/Tiered-Storage_timecho.md
b/src/zh/UserGuide/Master/Table/User-Manual/Tiered-Storage_timecho.md
index 1bc65232..8f386a5a 100644
--- a/src/zh/UserGuide/Master/Table/User-Manual/Tiered-Storage_timecho.md
+++ b/src/zh/UserGuide/Master/Table/User-Manual/Tiered-Storage_timecho.md
@@ -39,11 +39,13 @@
| dn_data_dirs | data/datanode/data
| 用来指定不同的存储目录,并将存储目录进行层级划分 |
每级存储使用分号分隔,单级内使用逗号分隔;云端配置只能作为最后一级存储且第一级不能作为云端存储;最多配置一个云端对象;远端存储目录使用
OBJECT_STORAGE 来表示 |
| tier_ttl_in_ms | -1 |
定义每个层级负责的数据范围,通过 TTL 表示 | 每级存储使用分号分隔;层级数量需与 dn_data_dirs
定义的层级数一致;"-1" 表示"无限制" |
| dn_default_space_usage_thresholds | 0.85 |
定义每个层级数据目录的最小剩余空间比例;当剩余空间少于该比例时,数据会被自动迁移至下一个层级;当最后一个层级的剩余存储空间到低于此阈值时,会将系统置为
READ_ONLY | 每级存储使用分号分隔;层级数量需与 dn_data_dirs 定义的层级数一致 |
-| object_storage_type | AWS_S3 | 云端存储类型
| IoTDB 当前只支持 AWS S3
作为远端存储类型,此参数不支持修改 |
+| object_storage_type | AWS_S3 | 云端存储类型
| IoTDB 支持 S3 协议作为远端存储类型 |
| object_storage_bucket | iotdb_data
| 云端存储 bucket 的名称 | AWS S3 中的 bucket
定义;如果未使用远端存储,无需配置 |
+| object_storage_region | |
云端存储的服务区域 | AWS S3 中的 region
定义;如果未使用远端存储,无需配置 |
| object_storage_endpoiont | | 云端存储的
endpoint | AWS S3 的
endpoint;如果未使用远端存储,无需配置 |
| object_storage_access_key | |
云端存储的验证信息 key | AWS S3 的 credential
key;如果未使用远端存储,无需配置 |
| object_storage_access_secret | |
云端存储的验证信息 secret | AWS S3 的 credential
secret;如果未使用远端存储,无需配置 |
+| enable_path_style_access | false |
是否启用云端存储服务路径访问 | 如果未使用远端存储,无需配置 |
| remote_tsfile_cache_dirs | data/datanode/data/cache |
云端存储在本地的缓存目录 | 如果未使用远端存储,无需配置
|
| remote_tsfile_cache_page_size_in_kb | 20480 |
云端存储在本地缓存文件的块大小 | 如果未使用远端存储,无需配置
|
| remote_tsfile_cache_max_disk_usage_in_mb | 51200 |
云端存储本地缓存的最大磁盘占用大小 | 如果未使用远端存储,无需配置
|
@@ -76,13 +78,15 @@ dn_default_space_usage_thresholds=0.2;0.1
dn_data_dirs=/data1/data;/data2/data,/data3/data;OBJECT_STORAGE
tier_ttl_in_ms=86400000;864000000;-1
dn_default_space_usage_thresholds=0.2;0.15;0.1
-object_storage_name=AWS_S3
+object_storage_type=AWS_S3
object_storage_bucket=iotdb
+object_storage_region=<your_region>
object_storage_endpoiont=<your_endpoint>
object_storage_access_key=<your_access_key>
object_storage_access_secret=<your_access_secret>
// 可选配置项
+enable_path_style_access=false
remote_tsfile_cache_dirs=data/datanode/data/cache
remote_tsfile_cache_page_size_in_kb=20971520
remote_tsfile_cache_max_disk_usage_in_mb=53687091200
@@ -94,4 +98,4 @@ remote_tsfile_cache_max_disk_usage_in_mb=53687091200
| -------- | -------------------------------------- |
---------------------------- | ------------------------ |
| 层级一 | 目录一:/data1/data | 最近 1 天的数据 | 20%
|
| 层级二 | 目录一:/data2/data目录二:/data3/data | 过去1 天至过去 10 天内的数据 | 15%
|
-| 层级三 | 远端 AWS S3 存储 | 过去 10 天以前的数据 | 10%
|
\ No newline at end of file
+| 层级三 | 远端 S3 协议存储 | 过去 10 天以前的数据 | 10%
|
\ No newline at end of file
diff --git a/src/zh/UserGuide/Master/Tree/User-Manual/Tiered-Storage_timecho.md
b/src/zh/UserGuide/Master/Tree/User-Manual/Tiered-Storage_timecho.md
index 1bc65232..8f386a5a 100644
--- a/src/zh/UserGuide/Master/Tree/User-Manual/Tiered-Storage_timecho.md
+++ b/src/zh/UserGuide/Master/Tree/User-Manual/Tiered-Storage_timecho.md
@@ -39,11 +39,13 @@
| dn_data_dirs | data/datanode/data
| 用来指定不同的存储目录,并将存储目录进行层级划分 |
每级存储使用分号分隔,单级内使用逗号分隔;云端配置只能作为最后一级存储且第一级不能作为云端存储;最多配置一个云端对象;远端存储目录使用
OBJECT_STORAGE 来表示 |
| tier_ttl_in_ms | -1 |
定义每个层级负责的数据范围,通过 TTL 表示 | 每级存储使用分号分隔;层级数量需与 dn_data_dirs
定义的层级数一致;"-1" 表示"无限制" |
| dn_default_space_usage_thresholds | 0.85 |
定义每个层级数据目录的最小剩余空间比例;当剩余空间少于该比例时,数据会被自动迁移至下一个层级;当最后一个层级的剩余存储空间到低于此阈值时,会将系统置为
READ_ONLY | 每级存储使用分号分隔;层级数量需与 dn_data_dirs 定义的层级数一致 |
-| object_storage_type | AWS_S3 | 云端存储类型
| IoTDB 当前只支持 AWS S3
作为远端存储类型,此参数不支持修改 |
+| object_storage_type | AWS_S3 | 云端存储类型
| IoTDB 支持 S3 协议作为远端存储类型 |
| object_storage_bucket | iotdb_data
| 云端存储 bucket 的名称 | AWS S3 中的 bucket
定义;如果未使用远端存储,无需配置 |
+| object_storage_region | |
云端存储的服务区域 | AWS S3 中的 region
定义;如果未使用远端存储,无需配置 |
| object_storage_endpoiont | | 云端存储的
endpoint | AWS S3 的
endpoint;如果未使用远端存储,无需配置 |
| object_storage_access_key | |
云端存储的验证信息 key | AWS S3 的 credential
key;如果未使用远端存储,无需配置 |
| object_storage_access_secret | |
云端存储的验证信息 secret | AWS S3 的 credential
secret;如果未使用远端存储,无需配置 |
+| enable_path_style_access | false |
是否启用云端存储服务路径访问 | 如果未使用远端存储,无需配置 |
| remote_tsfile_cache_dirs | data/datanode/data/cache |
云端存储在本地的缓存目录 | 如果未使用远端存储,无需配置
|
| remote_tsfile_cache_page_size_in_kb | 20480 |
云端存储在本地缓存文件的块大小 | 如果未使用远端存储,无需配置
|
| remote_tsfile_cache_max_disk_usage_in_mb | 51200 |
云端存储本地缓存的最大磁盘占用大小 | 如果未使用远端存储,无需配置
|
@@ -76,13 +78,15 @@ dn_default_space_usage_thresholds=0.2;0.1
dn_data_dirs=/data1/data;/data2/data,/data3/data;OBJECT_STORAGE
tier_ttl_in_ms=86400000;864000000;-1
dn_default_space_usage_thresholds=0.2;0.15;0.1
-object_storage_name=AWS_S3
+object_storage_type=AWS_S3
object_storage_bucket=iotdb
+object_storage_region=<your_region>
object_storage_endpoiont=<your_endpoint>
object_storage_access_key=<your_access_key>
object_storage_access_secret=<your_access_secret>
// 可选配置项
+enable_path_style_access=false
remote_tsfile_cache_dirs=data/datanode/data/cache
remote_tsfile_cache_page_size_in_kb=20971520
remote_tsfile_cache_max_disk_usage_in_mb=53687091200
@@ -94,4 +98,4 @@ remote_tsfile_cache_max_disk_usage_in_mb=53687091200
| -------- | -------------------------------------- |
---------------------------- | ------------------------ |
| 层级一 | 目录一:/data1/data | 最近 1 天的数据 | 20%
|
| 层级二 | 目录一:/data2/data目录二:/data3/data | 过去1 天至过去 10 天内的数据 | 15%
|
-| 层级三 | 远端 AWS S3 存储 | 过去 10 天以前的数据 | 10%
|
\ No newline at end of file
+| 层级三 | 远端 S3 协议存储 | 过去 10 天以前的数据 | 10%
|
\ No newline at end of file
diff --git
a/src/zh/UserGuide/latest-Table/User-Manual/Tiered-Storage_timecho.md
b/src/zh/UserGuide/latest-Table/User-Manual/Tiered-Storage_timecho.md
index 1bc65232..8f386a5a 100644
--- a/src/zh/UserGuide/latest-Table/User-Manual/Tiered-Storage_timecho.md
+++ b/src/zh/UserGuide/latest-Table/User-Manual/Tiered-Storage_timecho.md
@@ -39,11 +39,13 @@
| dn_data_dirs | data/datanode/data
| 用来指定不同的存储目录,并将存储目录进行层级划分 |
每级存储使用分号分隔,单级内使用逗号分隔;云端配置只能作为最后一级存储且第一级不能作为云端存储;最多配置一个云端对象;远端存储目录使用
OBJECT_STORAGE 来表示 |
| tier_ttl_in_ms | -1 |
定义每个层级负责的数据范围,通过 TTL 表示 | 每级存储使用分号分隔;层级数量需与 dn_data_dirs
定义的层级数一致;"-1" 表示"无限制" |
| dn_default_space_usage_thresholds | 0.85 |
定义每个层级数据目录的最小剩余空间比例;当剩余空间少于该比例时,数据会被自动迁移至下一个层级;当最后一个层级的剩余存储空间到低于此阈值时,会将系统置为
READ_ONLY | 每级存储使用分号分隔;层级数量需与 dn_data_dirs 定义的层级数一致 |
-| object_storage_type | AWS_S3 | 云端存储类型
| IoTDB 当前只支持 AWS S3
作为远端存储类型,此参数不支持修改 |
+| object_storage_type | AWS_S3 | 云端存储类型
| IoTDB 支持 S3 协议作为远端存储类型 |
| object_storage_bucket | iotdb_data
| 云端存储 bucket 的名称 | AWS S3 中的 bucket
定义;如果未使用远端存储,无需配置 |
+| object_storage_region | |
云端存储的服务区域 | AWS S3 中的 region
定义;如果未使用远端存储,无需配置 |
| object_storage_endpoiont | | 云端存储的
endpoint | AWS S3 的
endpoint;如果未使用远端存储,无需配置 |
| object_storage_access_key | |
云端存储的验证信息 key | AWS S3 的 credential
key;如果未使用远端存储,无需配置 |
| object_storage_access_secret | |
云端存储的验证信息 secret | AWS S3 的 credential
secret;如果未使用远端存储,无需配置 |
+| enable_path_style_access | false |
是否启用云端存储服务路径访问 | 如果未使用远端存储,无需配置 |
| remote_tsfile_cache_dirs | data/datanode/data/cache |
云端存储在本地的缓存目录 | 如果未使用远端存储,无需配置
|
| remote_tsfile_cache_page_size_in_kb | 20480 |
云端存储在本地缓存文件的块大小 | 如果未使用远端存储,无需配置
|
| remote_tsfile_cache_max_disk_usage_in_mb | 51200 |
云端存储本地缓存的最大磁盘占用大小 | 如果未使用远端存储,无需配置
|
@@ -76,13 +78,15 @@ dn_default_space_usage_thresholds=0.2;0.1
dn_data_dirs=/data1/data;/data2/data,/data3/data;OBJECT_STORAGE
tier_ttl_in_ms=86400000;864000000;-1
dn_default_space_usage_thresholds=0.2;0.15;0.1
-object_storage_name=AWS_S3
+object_storage_type=AWS_S3
object_storage_bucket=iotdb
+object_storage_region=<your_region>
object_storage_endpoiont=<your_endpoint>
object_storage_access_key=<your_access_key>
object_storage_access_secret=<your_access_secret>
// 可选配置项
+enable_path_style_access=false
remote_tsfile_cache_dirs=data/datanode/data/cache
remote_tsfile_cache_page_size_in_kb=20971520
remote_tsfile_cache_max_disk_usage_in_mb=53687091200
@@ -94,4 +98,4 @@ remote_tsfile_cache_max_disk_usage_in_mb=53687091200
| -------- | -------------------------------------- |
---------------------------- | ------------------------ |
| 层级一 | 目录一:/data1/data | 最近 1 天的数据 | 20%
|
| 层级二 | 目录一:/data2/data目录二:/data3/data | 过去1 天至过去 10 天内的数据 | 15%
|
-| 层级三 | 远端 AWS S3 存储 | 过去 10 天以前的数据 | 10%
|
\ No newline at end of file
+| 层级三 | 远端 S3 协议存储 | 过去 10 天以前的数据 | 10%
|
\ No newline at end of file
diff --git a/src/zh/UserGuide/latest/User-Manual/Tiered-Storage_timecho.md
b/src/zh/UserGuide/latest/User-Manual/Tiered-Storage_timecho.md
index 1bc65232..8f386a5a 100644
--- a/src/zh/UserGuide/latest/User-Manual/Tiered-Storage_timecho.md
+++ b/src/zh/UserGuide/latest/User-Manual/Tiered-Storage_timecho.md
@@ -39,11 +39,13 @@
| dn_data_dirs | data/datanode/data
| 用来指定不同的存储目录,并将存储目录进行层级划分 |
每级存储使用分号分隔,单级内使用逗号分隔;云端配置只能作为最后一级存储且第一级不能作为云端存储;最多配置一个云端对象;远端存储目录使用
OBJECT_STORAGE 来表示 |
| tier_ttl_in_ms | -1 |
定义每个层级负责的数据范围,通过 TTL 表示 | 每级存储使用分号分隔;层级数量需与 dn_data_dirs
定义的层级数一致;"-1" 表示"无限制" |
| dn_default_space_usage_thresholds | 0.85 |
定义每个层级数据目录的最小剩余空间比例;当剩余空间少于该比例时,数据会被自动迁移至下一个层级;当最后一个层级的剩余存储空间到低于此阈值时,会将系统置为
READ_ONLY | 每级存储使用分号分隔;层级数量需与 dn_data_dirs 定义的层级数一致 |
-| object_storage_type | AWS_S3 | 云端存储类型
| IoTDB 当前只支持 AWS S3
作为远端存储类型,此参数不支持修改 |
+| object_storage_type | AWS_S3 | 云端存储类型
| IoTDB 支持 S3 协议作为远端存储类型 |
| object_storage_bucket | iotdb_data
| 云端存储 bucket 的名称 | AWS S3 中的 bucket
定义;如果未使用远端存储,无需配置 |
+| object_storage_region | |
云端存储的服务区域 | AWS S3 中的 region
定义;如果未使用远端存储,无需配置 |
| object_storage_endpoiont | | 云端存储的
endpoint | AWS S3 的
endpoint;如果未使用远端存储,无需配置 |
| object_storage_access_key | |
云端存储的验证信息 key | AWS S3 的 credential
key;如果未使用远端存储,无需配置 |
| object_storage_access_secret | |
云端存储的验证信息 secret | AWS S3 的 credential
secret;如果未使用远端存储,无需配置 |
+| enable_path_style_access | false |
是否启用云端存储服务路径访问 | 如果未使用远端存储,无需配置 |
| remote_tsfile_cache_dirs | data/datanode/data/cache |
云端存储在本地的缓存目录 | 如果未使用远端存储,无需配置
|
| remote_tsfile_cache_page_size_in_kb | 20480 |
云端存储在本地缓存文件的块大小 | 如果未使用远端存储,无需配置
|
| remote_tsfile_cache_max_disk_usage_in_mb | 51200 |
云端存储本地缓存的最大磁盘占用大小 | 如果未使用远端存储,无需配置
|
@@ -76,13 +78,15 @@ dn_default_space_usage_thresholds=0.2;0.1
dn_data_dirs=/data1/data;/data2/data,/data3/data;OBJECT_STORAGE
tier_ttl_in_ms=86400000;864000000;-1
dn_default_space_usage_thresholds=0.2;0.15;0.1
-object_storage_name=AWS_S3
+object_storage_type=AWS_S3
object_storage_bucket=iotdb
+object_storage_region=<your_region>
object_storage_endpoiont=<your_endpoint>
object_storage_access_key=<your_access_key>
object_storage_access_secret=<your_access_secret>
// 可选配置项
+enable_path_style_access=false
remote_tsfile_cache_dirs=data/datanode/data/cache
remote_tsfile_cache_page_size_in_kb=20971520
remote_tsfile_cache_max_disk_usage_in_mb=53687091200
@@ -94,4 +98,4 @@ remote_tsfile_cache_max_disk_usage_in_mb=53687091200
| -------- | -------------------------------------- |
---------------------------- | ------------------------ |
| 层级一 | 目录一:/data1/data | 最近 1 天的数据 | 20%
|
| 层级二 | 目录一:/data2/data目录二:/data3/data | 过去1 天至过去 10 天内的数据 | 15%
|
-| 层级三 | 远端 AWS S3 存储 | 过去 10 天以前的数据 | 10%
|
\ No newline at end of file
+| 层级三 | 远端 S3 协议存储 | 过去 10 天以前的数据 | 10%
|
\ No newline at end of file