[jira] [Created] (IOTDB-5559) Implement proxy for Ratis existing metrics
Song Ziyang created IOTDB-5559: -- Summary: Implement proxy for Ratis existing metrics Key: IOTDB-5559 URL: https://issues.apache.org/jira/browse/IOTDB-5559 Project: Apache IoTDB Issue Type: Sub-task Reporter: Song Ziyang Assignee: Song Ziyang -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (IOTDB-5558) Introduce metrics into RatisConsensus
Song Ziyang created IOTDB-5558: -- Summary: Introduce metrics into RatisConsensus Key: IOTDB-5558 URL: https://issues.apache.org/jira/browse/IOTDB-5558 Project: Apache IoTDB Issue Type: Epic Reporter: Song Ziyang Assignee: Song Ziyang -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Reopened] (IOTDB-5131) [rel/1.0] 1rep1C1D， Follower is generated in the schema region, and "count devices" report an error
[
https://issues.apache.org/jira/browse/IOTDB-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
刘珍 reopened IOTDB-5131:
---
测试版本：master_0219_0cd4461
测试流程：
1.启动3副本3C5D 集群 ，记为集群1
私有云1期 5DataNode 172.16.2.2/3/4/5/6
3ConfigNode 172.16.2.23/24/25
2. Benchmark 执行附件中配置（连172.16.2.2）
在执行过程中，停止172.16.2.3的datanode。
172.16.2.3 *启动自己的单节点集群，记为集群2*，start-standalone.sh
在集群1查看集群状态，可以看到：
另外，集群2 没有执行任何操作，可以看到日志：
> [rel/1.0] 1rep1C1D， Follower is generated in the schema region, and "count
> devices" report an error
> ---
>
> Key: IOTDB-5131
> URL: https://issues.apache.org/jira/browse/IOTDB-5131
> Project: Apache IoTDB
> Issue Type: Bug
> Components: mpp-cluster
>Affects Versions: 1.0.0
>Reporter: 刘珍
>Assignee: Yongzao Dan
>Priority: Major
> Attachments: image-2022-12-06-19-08-02-946.png,
> image-2022-12-06-19-08-38-711.png, image-2022-12-08-09-07-51-007.png,
> iotdb_5131.conf
>
>
> rel/1.0 20221206
> cbf7291
> 1. ./sbin/start-standalone.sh 启动1副本1C1D集群
> 2. BM运行附件中的配置
> GROUP_NUMBER=10
> DEVICE_NUMBER=50
> SENSOR_NUMBER=20
> BATCH_SIZE_PER_WRITE=1
> LOOP=1000
> 3. {color:#de350b}问题1 schema region 出现Follower{color}
> !image-2022-12-06-19-08-02-946.png|width=848,height=381!
> 4.{color:#de350b} 问题2 count devices 立即返回错误{color}
> !image-2022-12-06-19-08-38-711.png!
> 后台 log
> 2022-12-06 18:55:56,256
> [pool-32-IoTDB-MPPCoordinator-19$20221206_105556_71267_1.1.0] ERROR
> o.a.i.d.m.e.e.RegionReadExecutor:54 - Execute FragmentInstance in
> ConsensusGroup SchemaRegion[0] failed.
> org.apache.iotdb.consensus.exception.RatisRequestFailedException: Ratis
> request failed
> at
> org.apache.iotdb.consensus.ratis.RatisConsensus.read(RatisConsensus.java:323)
> at
> org.apache.iotdb.db.mpp.execution.executor.RegionReadExecutor.execute(RegionReadExecutor.java:46)
> at
> org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchLocally(FragmentInstanceDispatcherImpl.java:224)
> at
> org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchOneInstance(FragmentInstanceDispatcherImpl.java:137)
> at
> org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.lambda$dispatchRead$0(FragmentInstanceDispatcherImpl.java:102)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.ratis.protocol.exceptions.ServerNotReadyException:
> 1@group-0002 is not in [RUNNING]: current state is CLOSED
> at
> org.apache.ratis.server.impl.RaftServerImpl.lambda$assertLifeCycleState$9(RaftServerImpl.java:733)
> at org.apache.ratis.util.LifeCycle.assertCurrentState(LifeCycle.java:253)
> at
> org.apache.ratis.server.impl.RaftServerImpl.assertLifeCycleState(RaftServerImpl.java:732)
> at
> org.apache.ratis.server.impl.RaftServerImpl.submitClientRequestAsync(RaftServerImpl.java:822)
> at
> org.apache.ratis.server.impl.RaftServerImpl.submitClientRequest(RaftServerImpl.java:944)
> at
> org.apache.ratis.server.impl.RaftServerProxy.submitClientRequest(RaftServerProxy.java:442)
> at
> org.apache.iotdb.consensus.ratis.RatisConsensus.read(RatisConsensus.java:318)
> ... 8 common frames omitted
> 测试环境
> 1. fit 机器 192.168.130.1 8C32GB
> 安装目录：/data1/relv1_1206_cbf7291
> ConfigNode 配置
> MAX_HEAP_SIZE="2G"
> DataNode配置
> MAX_HEAP_SIZE="20G"
> MAX_DIRECT_MEMORY_SIZE="6G"
> dn_wal_dirs=/data2/wal,/data3/wal
> 2. BM配置见附件
> 192.168.130.2 /data1/bm_v1
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (IOTDB-5557) [ metadata ] The metadata query results are inconsistent
刘珍 created IOTDB-5557:
-
Summary: [ metadata ] The metadata query results are inconsistent
Key: IOTDB-5557
URL: https://issues.apache.org/jira/browse/IOTDB-5557
Project: Apache IoTDB
Issue Type: Bug
Components: Core/Schema Manager, mpp-cluster
Affects Versions: 1.1.0-SNAPSHOT
Reporter: 刘珍
Assignee: Yukun Zhou
Attachments: image-2023-02-20-14-04-32-611.png
master : 0219_0cd4461
启动集群，log_datanode_all.log出现enjoy后，查询元数据，出现查询结果不一致（动态增加，直到全部元数据加载到内存）。
期望：只要集群已经开始提供查询服务，就要保证查询结果的一致性。
测试环境：
1. 192.168.10.76 48cpu 384GB 内存
元数据信息：1db，1万设备，600序列/dev。
ConfigNode：
MAX_HEAP_SIZE="8G"
DataNode：
MAX_HEAP_SIZE="256G"
MAX_DIRECT_MEMORY_SIZE="32G"
COMMON配置
time_partition_interval=6048000
query_timeout_threshold=3600
enable_seq_space_compaction=false
enable_unseq_space_compaction=false
enable_cross_space_compaction=false
2. 清操作系统缓存，启动数据库，出现enjoy后，执行count devices查看结果
cat check_device_count.sh
while true
do
v_start=`grep enjoy logs/log_datanode_all.log|wc -l`
if [[ ${v_start} = "1" ]];then
for i in {1..100}
do
./sbin/start-cli.sh -h 192.168.10.76 -e "count devices;" >>
dev_count_during_start.out
done
break
fi
done
下图结果，可以看出，count devices的结果在动态增加，直至1，完全加载到内存中：
!image-2023-02-20-14-04-32-611.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Assigned] (IOTDB-5552) No permissions when a non-root user inserts data into a timeseries with illegal path
[ https://issues.apache.org/jira/browse/IOTDB-5552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yukun Zhou reassigned IOTDB-5552: - Assignee: Hongyin Zhang (was: Yukun Zhou) > No permissions when a non-root user inserts data into a timeseries with > illegal path > > > Key: IOTDB-5552 > URL: https://issues.apache.org/jira/browse/IOTDB-5552 > Project: Apache IoTDB > Issue Type: Bug >Affects Versions: 1.0.0 >Reporter: Haonan Hou >Assignee: Hongyin Zhang >Priority: Major > Attachments: image-2023-02-17-18-21-36-717.png, > image-2023-02-17-18-48-41-530.png > > > !image-2023-02-17-18-21-36-717.png|width=556,height=422! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (IOTDB-5556) Gracefully exit DataNode throug stop script
Yongzao Dan created IOTDB-5556: -- Summary: Gracefully exit DataNode throug stop script Key: IOTDB-5556 URL: https://issues.apache.org/jira/browse/IOTDB-5556 Project: Apache IoTDB Issue Type: New Feature Reporter: Yongzao Dan Assignee: Yongzao Dan We can take some operation to ensure cluster security if we shutdown DataNode by stop-datanode script. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (IOTDB-5555) Enable modify external RPC EndPoint of DataNode
[ https://issues.apache.org/jira/browse/IOTDB-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongzao Dan reassigned IOTDB-: -- Assignee: Yongzao Dan > Enable modify external RPC EndPoint of DataNode > --- > > Key: IOTDB- > URL: https://issues.apache.org/jira/browse/IOTDB- > Project: Apache IoTDB > Issue Type: New Feature >Reporter: Yongzao Dan >Assignee: Yongzao Dan >Priority: Major > > Including: > * dn_rpc_address > * dn_rpc_port -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (IOTDB-5555) Enable modify external RPC EndPoint of DataNode
Yongzao Dan created IOTDB-: -- Summary: Enable modify external RPC EndPoint of DataNode Key: IOTDB- URL: https://issues.apache.org/jira/browse/IOTDB- Project: Apache IoTDB Issue Type: New Feature Reporter: Yongzao Dan Including: * dn_rpc_address * dn_rpc_port -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (IOTDB-5554) Support group by session in aggregation query.
yang caiyin created IOTDB-5554: -- Summary: Support group by session in aggregation query. Key: IOTDB-5554 URL: https://issues.apache.org/jira/browse/IOTDB-5554 Project: Apache IoTDB Issue Type: New Feature Reporter: yang caiyin Assignee: yang caiyin -- This message was sent by Atlassian Jira (v8.20.10#820010)
