[jira] [Created] (IOTDB-5209) Limit the read rate of compaction

2022-12-13 Thread Liuxuxin (Jira)
Liuxuxin created IOTDB-5209:
---

 Summary: Limit the read rate of compaction
 Key: IOTDB-5209
 URL: https://issues.apache.org/jira/browse/IOTDB-5209
 Project: Apache IoTDB
  Issue Type: Improvement
Reporter: Liuxuxin
Assignee: Liuxuxin
 Fix For: master branch, 1.0.1


Currently we only limit the write speed of compaction, but the read rate is not 
limited. This may have a bad effect on the system performance.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5208) Fix fast cross space compaction causes file handle leaks

2022-12-13 Thread Jira
周沛辰 created IOTDB-5208:
--

 Summary: Fix fast cross space compaction causes file handle leaks
 Key: IOTDB-5208
 URL: https://issues.apache.org/jira/browse/IOTDB-5208
 Project: Apache IoTDB
  Issue Type: Bug
Affects Versions: master branch, 1.0.0
Reporter: 周沛辰
Assignee: 周沛辰
 Attachments: image-2022-12-14-15-02-02-961.png, 
image-2022-12-14-15-03-14-990.png

 

!image-2022-12-14-15-02-02-961.png|width=1400,height=787!

!image-2022-12-14-15-03-14-990.png|width=1819,height=1253!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5207) Modify the package name of related classes in FastCompaction

2022-12-13 Thread Jira
周沛辰 created IOTDB-5207:
--

 Summary: Modify the package name of related classes in 
FastCompaction
 Key: IOTDB-5207
 URL: https://issues.apache.org/jira/browse/IOTDB-5207
 Project: Apache IoTDB
  Issue Type: Improvement
Reporter: 周沛辰
Assignee: 周沛辰
 Fix For: master branch, 1.0.1


In the new compaction, many classes that are shared by cross space and inner 
space compaction are placed under the cross package, which is easy to cause 
misunderstandings and should be placed under the public package



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5206) Fix when target file is deleted in Compaction exception handler and recover

2022-12-13 Thread Jira
周沛辰 created IOTDB-5206:
--

 Summary: Fix when target file is deleted in Compaction exception 
handler and recover
 Key: IOTDB-5206
 URL: https://issues.apache.org/jira/browse/IOTDB-5206
 Project: Apache IoTDB
  Issue Type: Bug
Affects Versions: master branch, 1.0.0
Reporter: 周沛辰
Assignee: 周沛辰


After compaction, if the target file is empty, its corresponding disk file will 
be deleted. If an exception or system interruption occurs, there will be 
problems in exception handling and restart recovery.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5205) Add Cluster Node verify protocol

2022-12-13 Thread Yongzao Dan (Jira)
Yongzao Dan created IOTDB-5205:
--

 Summary: Add Cluster Node verify protocol
 Key: IOTDB-5205
 URL: https://issues.apache.org/jira/browse/IOTDB-5205
 Project: Apache IoTDB
  Issue Type: Improvement
Reporter: Yongzao Dan
Assignee: Yongzao Dan






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5204) start-cli.sh -timeout does not work

2022-12-13 Thread Jira
刘珍 created IOTDB-5204:
-

 Summary: start-cli.sh  -timeout does not work
 Key: IOTDB-5204
 URL: https://issues.apache.org/jira/browse/IOTDB-5204
 Project: Apache IoTDB
  Issue Type: Bug
  Components: mpp-cluster
Affects Versions: master branch, 1.0.1
Reporter: 刘珍
 Attachments: image-2022-12-14-11-55-26-408.png

rel/1.0 1214 b7516d4 1rep 1C1D 
1. start 1rep 1C1D cluster
config_node_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
data_region_consensus_protocol_class=org.apache.iotdb.consensus.iot.IoTConsensus

2. cli query specified -timeout 36000 second ,
In fact, the timeout is still 60 seconds
在配置文件中指定超时时间,没这个问题。
 !image-2022-12-14-11-55-26-408.png! 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5203) Use try-catch with Files.walk in Consensus/common

2022-12-13 Thread Song Ziyang (Jira)
Song Ziyang created IOTDB-5203:
--

 Summary: Use try-catch with Files.walk in Consensus/common
 Key: IOTDB-5203
 URL: https://issues.apache.org/jira/browse/IOTDB-5203
 Project: Apache IoTDB
  Issue Type: Bug
Reporter: Song Ziyang
Assignee: Song Ziyang






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5202) Show regions support database sql

2022-12-13 Thread Gaofei Cao (Jira)
Gaofei Cao created IOTDB-5202:
-

 Summary: Show regions support database sql
 Key: IOTDB-5202
 URL: https://issues.apache.org/jira/browse/IOTDB-5202
 Project: Apache IoTDB
  Issue Type: Bug
Reporter: Gaofei Cao
Assignee: 伊丹翔
 Attachments: image-2022-12-13-21-39-45-590.png

 

We only support show regions of storage group now.

 

!image-2022-12-13-21-39-45-590.png|width=1664,height=64!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5201) Extracting getConfig from the registerDataNode interface

2022-12-13 Thread yanze chen (Jira)
yanze chen created IOTDB-5201:
-

 Summary: Extracting getConfig from the registerDataNode interface
 Key: IOTDB-5201
 URL: https://issues.apache.org/jira/browse/IOTDB-5201
 Project: Apache IoTDB
  Issue Type: Improvement
Reporter: yanze chen
Assignee: yanze chen
 Attachments: image-2022-12-13-20-59-57-380.png

Extracting getConfig from the registerDataNode interface

 

!image-2022-12-13-20-59-57-380.png|width=591,height=308!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5200) Need additional judgement in getDoublue of IoTDBJDBCResultSet in IT

2022-12-13 Thread yang caiyin (Jira)
yang caiyin created IOTDB-5200:
--

 Summary: Need additional judgement in getDoublue of 
IoTDBJDBCResultSet in IT
 Key: IOTDB-5200
 URL: https://issues.apache.org/jira/browse/IOTDB-5200
 Project: Apache IoTDB
  Issue Type: Bug
Reporter: yang caiyin
Assignee: yang caiyin


getInt、getDouble、getLong and getFloat in IoTDBJDBCResultSet will return 0 when 
the value is null which need an additional judgement on lastReadWasNull 
variable in IoTDBOrderByWithAlignByDeviceIT.,



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5199) NPE in StorageExector inLoading process

2022-12-13 Thread yusicheng (Jira)
yusicheng created IOTDB-5199:


 Summary: NPE in StorageExector inLoading process
 Key: IOTDB-5199
 URL: https://issues.apache.org/jira/browse/IOTDB-5199
 Project: Apache IoTDB
  Issue Type: Bug
Affects Versions: 1.0.0
Reporter: yusicheng
Assignee: 李伟豪


split.getRegionReplicaSet() can be null in LoadSingleTsFileNode
So WriteFragmentParallelPlanner#parallelPlan will produce NPE.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5198) IoTDB PyUDF: Show Functions

2022-12-13 Thread Steve Yurong Su (Jira)
Steve Yurong Su created IOTDB-5198:
--

 Summary: IoTDB PyUDF: Show Functions
 Key: IOTDB-5198
 URL: https://issues.apache.org/jira/browse/IOTDB-5198
 Project: Apache IoTDB
  Issue Type: Sub-task
Reporter: Steve Yurong Su






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5196) IoTDB PyUDF: Create Function

2022-12-13 Thread Steve Yurong Su (Jira)
Steve Yurong Su created IOTDB-5196:
--

 Summary: IoTDB PyUDF: Create Function
 Key: IOTDB-5196
 URL: https://issues.apache.org/jira/browse/IOTDB-5196
 Project: Apache IoTDB
  Issue Type: Sub-task
Reporter: Steve Yurong Su






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5197) IoTDB PyUDF: Drop Function

2022-12-13 Thread Steve Yurong Su (Jira)
Steve Yurong Su created IOTDB-5197:
--

 Summary: IoTDB PyUDF: Drop Function
 Key: IOTDB-5197
 URL: https://issues.apache.org/jira/browse/IOTDB-5197
 Project: Apache IoTDB
  Issue Type: Sub-task
Reporter: Steve Yurong Su






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5195) IoTDB PyUDF: Runtime Core

2022-12-13 Thread Steve Yurong Su (Jira)
Steve Yurong Su created IOTDB-5195:
--

 Summary: IoTDB PyUDF: Runtime Core
 Key: IOTDB-5195
 URL: https://issues.apache.org/jira/browse/IOTDB-5195
 Project: Apache IoTDB
  Issue Type: Sub-task
Reporter: Steve Yurong Su






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5194) IoTDB PyUDF: Python API Package

2022-12-13 Thread Steve Yurong Su (Jira)
Steve Yurong Su created IOTDB-5194:
--

 Summary: IoTDB PyUDF: Python API Package
 Key: IOTDB-5194
 URL: https://issues.apache.org/jira/browse/IOTDB-5194
 Project: Apache IoTDB
  Issue Type: Sub-task
  Components: Core/Query
Reporter: Steve Yurong Su






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5193) IoTDB PyUDF: Python User Defined Function Framework

2022-12-13 Thread Steve Yurong Su (Jira)
Steve Yurong Su created IOTDB-5193:
--

 Summary: IoTDB PyUDF: Python User Defined Function Framework
 Key: IOTDB-5193
 URL: https://issues.apache.org/jira/browse/IOTDB-5193
 Project: Apache IoTDB
  Issue Type: New Feature
  Components: Core/Query
Reporter: Steve Yurong Su






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (IOTDB-5142) go-client connection resetting and empty TimeZoneID problem

2022-12-13 Thread Xingyu Liu (Jira)


[ 
https://issues.apache.org/jira/browse/IOTDB-5142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17646498#comment-17646498
 ] 

Xingyu Liu commented on IOTDB-5142:
---

增加了这些更新之后,没有再遇到新的问题。有可能是对GetTimeZone的调用,并没有处理可能发生的错误而导致的。

在旧的代码中,对GetTimeZone调用后会直接执行TimeZoneId的更新,而不会检查该函数是否会报错。

> go-client connection resetting and empty TimeZoneID problem
> ---
>
> Key: IOTDB-5142
> URL: https://issues.apache.org/jira/browse/IOTDB-5142
> Project: Apache IoTDB
>  Issue Type: Bug
>  Components: Client/Others
>Reporter: Xingyu Liu
>Assignee: Xingyu Liu
>Priority: Major
> Attachments: image-2022-12-08-11-07-55-398.png, 
> image-2022-12-08-11-09-00-848.png, image-2022-12-08-11-09-05-286.png
>
>
> 现在有台服务器大量报连接重置
>  !image-2022-12-08-11-07-55-398.png! 
>  !image-2022-12-08-11-09-00-848.png! 
>  !image-2022-12-08-11-09-05-286.png! 
> 问题:go client会在每天0点左右重连,但是其中zoneId参数为空,前几天是0点左右,刚发现了9点也有一条,看来和时间无关



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (IOTDB-5142) go-client connection resetting and empty TimeZoneID problem

2022-12-13 Thread Xingyu Liu (Jira)


[ 
https://issues.apache.org/jira/browse/IOTDB-5142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17646495#comment-17646495
 ] 

Xingyu Liu commented on IOTDB-5142:
---

iotdb增加了这些PR:

和进master的:https://github.com/apache/iotdb/pull/8425
和进1.0的:https://github.com/apache/iotdb/pull/8426
和进0.13的:https://github.com/apache/iotdb/pull/8390

> go-client connection resetting and empty TimeZoneID problem
> ---
>
> Key: IOTDB-5142
> URL: https://issues.apache.org/jira/browse/IOTDB-5142
> Project: Apache IoTDB
>  Issue Type: Bug
>  Components: Client/Others
>Reporter: Xingyu Liu
>Assignee: Xingyu Liu
>Priority: Major
> Attachments: image-2022-12-08-11-07-55-398.png, 
> image-2022-12-08-11-09-00-848.png, image-2022-12-08-11-09-05-286.png
>
>
> 现在有台服务器大量报连接重置
>  !image-2022-12-08-11-07-55-398.png! 
>  !image-2022-12-08-11-09-00-848.png! 
>  !image-2022-12-08-11-09-05-286.png! 
> 问题:go client会在每天0点左右重连,但是其中zoneId参数为空,前几天是0点左右,刚发现了9点也有一条,看来和时间无关



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (IOTDB-5142) go-client connection resetting and empty TimeZoneID problem

2022-12-13 Thread Xingyu Liu (Jira)


[ 
https://issues.apache.org/jira/browse/IOTDB-5142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17646494#comment-17646494
 ] 

Xingyu Liu commented on IOTDB-5142:
---

go客户端增加了这个PR:[cleanup invalid codes from session by manlge · Pull Request #68 · 
apache/iotdb-client-go 
(github.com)|https://github.com/apache/iotdb-client-go/pull/68]

> go-client connection resetting and empty TimeZoneID problem
> ---
>
> Key: IOTDB-5142
> URL: https://issues.apache.org/jira/browse/IOTDB-5142
> Project: Apache IoTDB
>  Issue Type: Bug
>  Components: Client/Others
>Reporter: Xingyu Liu
>Assignee: Xingyu Liu
>Priority: Major
> Attachments: image-2022-12-08-11-07-55-398.png, 
> image-2022-12-08-11-09-00-848.png, image-2022-12-08-11-09-05-286.png
>
>
> 现在有台服务器大量报连接重置
>  !image-2022-12-08-11-07-55-398.png! 
>  !image-2022-12-08-11-09-00-848.png! 
>  !image-2022-12-08-11-09-05-286.png! 
> 问题:go client会在每天0点左右重连,但是其中zoneId参数为空,前几天是0点左右,刚发现了9点也有一条,看来和时间无关



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (IOTDB-5192) [CrossSpaceCompaction] The level of compaction file is too large

2022-12-13 Thread Jira
刘珍 created IOTDB-5192:
-

 Summary: [CrossSpaceCompaction] The level of compaction file  is 
too large
 Key: IOTDB-5192
 URL: https://issues.apache.org/jira/browse/IOTDB-5192
 Project: Apache IoTDB
  Issue Type: Improvement
  Components: mpp-cluster
Reporter: 刘珍
Assignee: 周沛辰
 Attachments: image-2022-12-13-16-06-23-875.png

master 1208  7f2218b
跨空间合并,合并文件层级过大(32层):
 !image-2022-12-13-16-06-23-875.png! 

日志:
2022-12-13 14:37:09,832 [pool-64-IoTDB-Compaction-1] INFO  
o.a.i.d.e.c.c.CrossSpaceCompactionTask:219 - root.test.g_1-10 [Compaction] 
CrossSpaceCompaction task finishes successfully, time cost is 
{color:#DE350B}*18029 *{color}s, compaction speed is 3.2967052791379006 MB/s 

备份数据:
fit 机器 192.168.10.72 
/data/mpp_test/m_1207_a0b2c8c/data

备份数据生成方式:
BM配置文件见附件。



--
This message was sent by Atlassian Jira
(v8.20.10#820010)