刘珍 created IOTDB-5394: ------------------------- Summary: Error happened while reading tsfile from position xxxxx Key: IOTDB-5394 URL: https://issues.apache.org/jira/browse/IOTDB-5394 Project: Apache IoTDB Issue Type: Bug Components: mpp-cluster Affects Versions: 1.0.1 Reporter: 刘珍 Assignee: Haonan Hou Attachments: 1673348664765-22224-0-0.tsfile, lt_fast.conf
rc/1.0.1 2023-01-07_09dd173 IoT协议,读tsfile 报错 (见附件) 2023-01-11 00:03:34,583 [Query-Worker-Thread-44$20230110_160324_67079_3.1.0] ERROR o.a.i.t.r.r.LocalTsFileInput:101 - Error happened while reading /data/mpp_test/r_0107_09dd173/sbin/../data/datanode/data/unsequence/root.test.g_0/51/2538/1673348664765-22224-0-0.tsfile from position 490728 2023-01-11 00:03:34,584 [Query-Worker-Thread-44$20230110_160324_67079_3.1.0] ERROR o.a.i.d.e.c.ChunkCache:80 - Something wrong happened in reading measurementId: s_501, datatype: FLOAT, version: 22224, Statistics: startTime: 1535559503187 endTime: 1535564087240 count: 10 [minValue:49.9543,maxValue:50.01069,firstValue:49.970222,lastValue:49.96979,sumValue:499.8036880493164], deleteIntervalList: null, filePath: /data/mpp_test/r_0107_09dd173/sbin/../data/datanode/data/unsequence/root.test.g_0/51/2538/1673348664765-22224-0-0.tsfile java.nio.channels.ClosedChannelException: null at java.base/sun.nio.ch.FileChannelImpl.ensureOpen(FileChannelImpl.java:150) at java.base/sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:790) at org.apache.iotdb.tsfile.read.reader.LocalTsFileInput.read(LocalTsFileInput.java:95) at org.apache.iotdb.tsfile.utils.ReadWriteIOUtils.readAsPossible(ReadWriteIOUtils.java:806) at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readData(TsFileSequenceReader.java:1448) at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readChunk(TsFileSequenceReader.java:1268) at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readMemChunk(TsFileSequenceReader.java:1286) at org.apache.iotdb.db.engine.cache.ChunkCache.lambda$new$1(ChunkCache.java:78) at com.github.benmanes.caffeine.cache.LocalLoadingCache.lambda$newMappingFunction$2(LocalLoadingCache.java:145) at com.github.benmanes.caffeine.cache.LocalCache.lambda$statsAware$0(LocalCache.java:139) at com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda$doComputeIfAbsent$14(BoundedLocalCache.java:2406) at java.base/java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1947) at com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:2404) at com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:2387) at com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:108) at com.github.benmanes.caffeine.cache.LocalLoadingCache.get(LocalLoadingCache.java:56) at org.apache.iotdb.db.engine.cache.ChunkCache.get(ChunkCache.java:114) at org.apache.iotdb.db.query.reader.chunk.DiskChunkLoader.getChunkReader(DiskChunkLoader.java:55) at org.apache.iotdb.db.utils.FileLoaderUtils.loadPageReaderList(FileLoaderUtils.java:289) at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanUtil.unpackOneChunkMetaData(SeriesScanUtil.java:518) at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanUtil.unpackAllOverlappedChunkMetadataToPageReaders(SeriesScanUtil.java:507) at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanUtil.hasNextPage(SeriesScanUtil.java:427) at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanOperator.readPageData(SeriesScanOperator.java:162) at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanOperator.readChunkData(SeriesScanOperator.java:154) at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanOperator.readFileData(SeriesScanOperator.java:145) at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanOperator.hasNext(SeriesScanOperator.java:108) at org.apache.iotdb.db.mpp.execution.driver.Driver.processInternal(Driver.java:192) at org.apache.iotdb.db.mpp.execution.driver.Driver.lambda$processFor$1(Driver.java:131) at org.apache.iotdb.db.mpp.execution.driver.Driver.tryWithLock(Driver.java:277) at org.apache.iotdb.db.mpp.execution.driver.Driver.processFor(Driver.java:112) at org.apache.iotdb.db.mpp.execution.schedule.DriverTaskThread.execute(DriverTaskThread.java:64) at org.apache.iotdb.db.mpp.execution.schedule.AbstractDriverThread.run(AbstractDriverThread.java:74) 测试环境 1. 192.168.10.72/73/74 48CPU 384GB 3副本3C3D config/schema/data 协议分别是ratis/ratis/IoT ConfigNode 显式配置 MAX_HEAP_SIZE="8G" cn_target_config_node_list=192.168.10.72:10710 DataNode 显式配置 MAX_HEAP_SIZE="8G" MAX_DIRECT_MEMORY_SIZE="8G" dn_target_config_node_list=192.168.10.72:10710,192.168.10.73:10710,192.168.10.74:10710 COMMON 显式配置 schema_replication_factor=3 data_replication_factor=3 avg_series_point_number_threshold=10000 cross_performer=fast inner_seq_performer=fast inner_unseq_performer=fast 2.运行BM 配置见附件 24小时后,报错。 -- This message was sent by Atlassian Jira (v8.20.10#820010)