[jira] [Created] (IOTDB-5851) Using limit clause in show devices query will throw NPE
Yuan Tian created IOTDB-5851: Summary: Using limit clause in show devices query will throw NPE Key: IOTDB-5851 URL: https://issues.apache.org/jira/browse/IOTDB-5851 Project: Apache IoTDB Issue Type: Bug Components: Core/Query Reporter: Yuan Tian Assignee: liaolanyu Attachments: image-2023-05-09-13-39-24-716.png, image-2023-05-09-13-39-52-032.png show devices root.ca.** limit 10 will throw the following exception: !image-2023-05-09-13-39-24-716.png! the detailed thread stack is: !image-2023-05-09-13-39-52-032.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (IOTDB-5780) Let users know a node was successfully removed and data is recovered
[ https://issues.apache.org/jira/browse/IOTDB-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17720765#comment-17720765 ] 刘珍 commented on IOTDB-5780: --- 缩容时，没写入，缩容完成，confignode日志 ： !screenshot-2.png! > Let users know a node was successfully removed and data is recovered > > > Key: IOTDB-5780 > URL: https://issues.apache.org/jira/browse/IOTDB-5780 > Project: Apache IoTDB > Issue Type: Improvement >Reporter: Jialin Qiao >Assignee: Xinyu Tan >Priority: Minor > Attachments: 0509_ip14_aft_bm_finish_stack.out, > image-2023-05-09-10-30-42-045.png, image-2023-05-09-10-51-14-063.png, > image-2023-05-09-10-52-57-557.png, iotdb_5780.conf, > ip14_remove-node_logs.tar.gz, ip26_dn_logs.tar.gz, > ip5_confignode_logs.tar.gz, screenshot-1.png, screenshot-2.png > > > When the datanode is removed, we will copy the data asynchronously to a new > node to keep the replication_factor. Here users need to know how the > asynchronous job is finished. We need to provide the inspection. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (IOTDB-5780) Let users know a node was successfully removed and data is recovered
[ https://issues.apache.org/jira/browse/IOTDB-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17720750#comment-17720750 ] 刘珍 commented on IOTDB-5780: --- 测试版本：Enterprise version 1.1.1-SNAPSHOT (Build: 62a1f5d) 1.缩容时，bm写入不停。 2.集群信息 3副本1C5D > Let users know a node was successfully removed and data is recovered > > > Key: IOTDB-5780 > URL: https://issues.apache.org/jira/browse/IOTDB-5780 > Project: Apache IoTDB > Issue Type: Improvement >Reporter: Jialin Qiao >Assignee: Xinyu Tan >Priority: Minor > Attachments: screenshot-1.png > > > When the datanode is removed, we will copy the data asynchronously to a new > node to keep the replication_factor. Here users need to know how the > asynchronous job is finished. We need to provide the inspection. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (IOTDB-5836) [Compaction] Meet errors in cross space compaction.Caused by: java.nio.BufferUnderflowException: null
[ https://issues.apache.org/jira/browse/IOTDB-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17720490#comment-17720490 ] 周沛辰 commented on IOTDB-5836: 报错的两条序列正好都是采用 FREQ 的编码方式，而采用其他编码方式的序列则不存在此问题（解码报 BufferUnderFlow 异常）。FREQ 编码方式是有损编码，当经过多次编解码的时候误差会增大，导致解码的位移量存在错误，因此，猜测是 FREQ 编码算法本身存在缺陷导致跨空间合并在对一层顺序文件进行解码时报错。 > [Compaction] Meet errors in cross space compaction.Caused by: > java.nio.BufferUnderflowException: null > - > > Key: IOTDB-5836 > URL: https://issues.apache.org/jira/browse/IOTDB-5836 > Project: Apache IoTDB > Issue Type: Bug > Components: Core/Compaction, mpp-cluster >Affects Versions: 1.1.0 >Reporter: 刘珍 >Assignee: 周沛辰 >Priority: Major > Attachments: 0427_aligned_compress.conf, > 0427_aligned_compress_unseq.conf, image-2023-05-08-20-17-31-168.png, > image-2023-05-08-20-18-11-646.png, image-2023-05-08-20-19-19-673.png, > image-2023-05-08-20-19-33-158.png, insert.sh > > > 测试版本： iotdb master 0427_ed8d539 > 日志路径：192.168.130.2 16C32G /data2/i_m_0427_ed8d539/logs > 问题描述： > 2023-04-27 19:51:27,391 [pool-16-IoTDB-Compaction-1] ERROR > o.a.i.d.e.c.e.t.CrossSpaceCompactionTask:251 - root.test.g_0-2 [Compaction] > Meet errors in cross space compaction. > java.lang.RuntimeException: java.nio.BufferUnderflowException > at > org.apache.iotdb.db.engine.compaction.execute.performer.impl.FastCompactionPerformer.perform(FastCompactionPerformer.java:152) > at > org.apache.iotdb.db.engine.compaction.execute.task.CrossSpaceCompactionTask.doCompaction(CrossSpaceCompactionTask.java:160) > at > org.apache.iotdb.db.engine.compaction.execute.task.AbstractCompactionTask.start(AbstractCompactionTask.java:80) > at > org.apache.iotdb.db.engine.compaction.schedule.CompactionWorker.run(CompactionWorker.java:65) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > Caused by: java.nio.BufferUnderflowException: null > at java.nio.Buffer.nextGetIndex(Buffer.java:524) > at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:138) > at org.apache.iotdb.tsfile.utils.BitReader.next(BitReader.java:67) > at org.apache.iotdb.tsfile.utils.BitReader.next(BitReader.java:36) > at > org.apache.iotdb.tsfile.encoding.decoder.FreqDecoder.decodeIndex(FreqDecoder.java:129) > at > org.apache.iotdb.tsfile.encoding.decoder.FreqDecoder.loadBlock(FreqDecoder.java:86) > at > org.apache.iotdb.tsfile.encoding.decoder.FreqDecoder.readDouble(FreqDecoder.java:45) > at > org.apache.iotdb.tsfile.read.reader.page.ValuePageReader.writeColumnBuilderWithNextBatch(ValuePageReader.java:306) > at > org.apache.iotdb.tsfile.read.reader.page.AlignedPageReader.getAllSatisfiedData(AlignedPageReader.java:226) > at > org.apache.iotdb.tsfile.read.reader.chunk.AlignedChunkReader.readPageData(AlignedChunkReader.java:320) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.element.PageElement.deserializePage(PageElement.java:96) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.element.PointElement.(PointElement.java:35) > at > org.apache.iotdb.db.engine.compaction.execute.utils.reader.PointPriorityReader.addNewPage(PointPriorityReader.java:175) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.SeriesCompactionExecutor.checkAndCompactOverlapPage(SeriesCompactionExecutor.java:341) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.SeriesCompactionExecutor.compactWithOverlapPages(SeriesCompactionExecutor.java:307) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.SeriesCompactionExecutor.compactPages(SeriesCompactionExecutor.java:236) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.SeriesCompactionExecutor.compactWithOverlapChunks(SeriesCompactionExecutor.java:167) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.SeriesCompactionExecutor.compactChunks(SeriesCompactionExecutor.java:147) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.AlignedSeriesCompactionExecutor.compactFiles(AlignedSeriesCompactionExecutor.java:97) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.AlignedSeriesCompactionExecutor.execute(AlignedSeriesCompactionEx
[jira] [Commented] (IOTDB-5836) [Compaction] Meet errors in cross space compaction.Caused by: java.nio.BufferUnderflowException: null
[ https://issues.apache.org/jira/browse/IOTDB-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17720486#comment-17720486 ] 周沛辰 commented on IOTDB-5836: 获取到合并报错的文件，是顺序空间内合并了一层的顺序文件，使用TsFileSequenceRead工具进行排查，发现该文件里总共有200个设备，每个设备有12个序列，其中有两条序列存在解码时报BufferUnderFlow异常： # 序列 root.test.g_0.d_404.s_4 在该文件里同一个chunkgroup里的第二个 chunk里的第一个page里第1024个点 报错： !image-2023-05-08-20-17-31-168.png|width=487,height=333! !image-2023-05-08-20-18-11-646.png|width=582,height=537! 2. 序列 root.test.g_0.d_599.s_4 在该文件里同一个chunkgroup里的第二个 chunk里的第21个page里第1024个点 报错： !image-2023-05-08-20-19-19-673.png|width=497,height=289! !image-2023-05-08-20-19-33-158.png|width=535,height=509! > [Compaction] Meet errors in cross space compaction.Caused by: > java.nio.BufferUnderflowException: null > - > > Key: IOTDB-5836 > URL: https://issues.apache.org/jira/browse/IOTDB-5836 > Project: Apache IoTDB > Issue Type: Bug > Components: Core/Compaction, mpp-cluster >Affects Versions: 1.1.0 >Reporter: 刘珍 >Assignee: 周沛辰 >Priority: Major > Attachments: 0427_aligned_compress.conf, > 0427_aligned_compress_unseq.conf, image-2023-05-08-20-17-31-168.png, > image-2023-05-08-20-18-11-646.png, image-2023-05-08-20-19-19-673.png, > image-2023-05-08-20-19-33-158.png, insert.sh > > > 测试版本： iotdb master 0427_ed8d539 > 日志路径：192.168.130.2 16C32G /data2/i_m_0427_ed8d539/logs > 问题描述： > 2023-04-27 19:51:27,391 [pool-16-IoTDB-Compaction-1] ERROR > o.a.i.d.e.c.e.t.CrossSpaceCompactionTask:251 - root.test.g_0-2 [Compaction] > Meet errors in cross space compaction. > java.lang.RuntimeException: java.nio.BufferUnderflowException > at > org.apache.iotdb.db.engine.compaction.execute.performer.impl.FastCompactionPerformer.perform(FastCompactionPerformer.java:152) > at > org.apache.iotdb.db.engine.compaction.execute.task.CrossSpaceCompactionTask.doCompaction(CrossSpaceCompactionTask.java:160) > at > org.apache.iotdb.db.engine.compaction.execute.task.AbstractCompactionTask.start(AbstractCompactionTask.java:80) > at > org.apache.iotdb.db.engine.compaction.schedule.CompactionWorker.run(CompactionWorker.java:65) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > Caused by: java.nio.BufferUnderflowException: null > at java.nio.Buffer.nextGetIndex(Buffer.java:524) > at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:138) > at org.apache.iotdb.tsfile.utils.BitReader.next(BitReader.java:67) > at org.apache.iotdb.tsfile.utils.BitReader.next(BitReader.java:36) > at > org.apache.iotdb.tsfile.encoding.decoder.FreqDecoder.decodeIndex(FreqDecoder.java:129) > at > org.apache.iotdb.tsfile.encoding.decoder.FreqDecoder.loadBlock(FreqDecoder.java:86) > at > org.apache.iotdb.tsfile.encoding.decoder.FreqDecoder.readDouble(FreqDecoder.java:45) > at > org.apache.iotdb.tsfile.read.reader.page.ValuePageReader.writeColumnBuilderWithNextBatch(ValuePageReader.java:306) > at > org.apache.iotdb.tsfile.read.reader.page.AlignedPageReader.getAllSatisfiedData(AlignedPageReader.java:226) > at > org.apache.iotdb.tsfile.read.reader.chunk.AlignedChunkReader.readPageData(AlignedChunkReader.java:320) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.element.PageElement.deserializePage(PageElement.java:96) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.element.PointElement.(PointElement.java:35) > at > org.apache.iotdb.db.engine.compaction.execute.utils.reader.PointPriorityReader.addNewPage(PointPriorityReader.java:175) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.SeriesCompactionExecutor.checkAndCompactOverlapPage(SeriesCompactionExecutor.java:341) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.SeriesCompactionExecutor.compactWithOverlapPages(SeriesCompactionExecutor.java:307) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.SeriesCompactionExecutor.compactPages(SeriesCompactionExecutor.java:236) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.SeriesCompactionExecutor.compactWithOverlapChunks(SeriesCompactionExecutor.java:167) > at > org.apache.iotdb.db.engine.compaction.execute.utils.executor.fast.SeriesCompactionExecutor.compactChunks(S
[jira] [Created] (IOTDB-5850) [CI stability] Write error becasue failed to get replicaSet of consensus group
Xinyu Tan created IOTDB-5850: Summary: [CI stability] Write error becasue failed to get replicaSet of consensus group Key: IOTDB-5850 URL: https://issues.apache.org/jira/browse/IOTDB-5850 Project: Apache IoTDB Issue Type: Improvement Reporter: Xinyu Tan Attachments: IoTDBSortedShowTimeseriesIT_showTimeseriesOrderByHeatWithLimitTest[SchemaEngineMode=SchemaFile].zip, image-2023-05-08-19-29-44-282.png, image-2023-05-08-19-30-06-447.png, image-2023-05-08-19-30-27-561.png !image-2023-05-08-19-29-44-282.png|thumbnail! !image-2023-05-08-19-30-06-447.png|thumbnail! !image-2023-05-08-19-30-27-561.png|thumbnail! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (IOTDB-5740) [schema] drop database does not delete its template
[ https://issues.apache.org/jira/browse/IOTDB-5740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yukun Zhou reassigned IOTDB-5740: - Assignee: yanze chen (was: Yukun Zhou) > [schema] drop database does not delete its template > --- > > Key: IOTDB-5740 > URL: https://issues.apache.org/jira/browse/IOTDB-5740 > Project: Apache IoTDB > Issue Type: Bug > Components: Core/Schema Manager, mpp-cluster >Affects Versions: 1.1.0-SNAPSHOT >Reporter: 刘珍 >Assignee: yanze chen >Priority: Major > Attachments: image-2023-03-29-14-34-05-872.png > > > drop database 没有删除其template。 > create schema template t1 (s_0 FLOAT) > create database root.db1; > set schema template t1 to root.db1; > create timeseries of schema template on root.db1.t1; > create database root.db2; > set schema template t1 to root.db2; > create aligned timeseries of schema template on root.db2.t1; //报错，正常 > insert into root.db2.t1(time,s_0) aligned values(1,1); //报错，正常 > drop database root.db2; > create database root.db2; > create aligned timeseries root.db2.t1(s_0 FLOAT ); // 预期成功，实际报错 > Msg: 516: Path [root.db2.t1.s_0] overlaps with [t1] on [s_0] > !image-2023-03-29-14-34-05-872.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)
