Xiangdong Huang created IOTDB-443: ------------------------------------- Summary: ReadOnlyMemChunk round float\double data incorrectly Key: IOTDB-443 URL: https://issues.apache.org/jira/browse/IOTDB-443 Project: Apache IoTDB Issue Type: Bug Components: Core/Engine Affects Versions: 0.9.1 Reporter: Xiangdong Huang
In our design, only RLE and TS_2DIFF need float_precision to round the value. However, when we read data from memory, all float\double data will be rounded, even if it uses Gorilla encoding. e.g., suppose root.sg1.d1.s1 is double datatype and Gorilla encoding. The float_precision=1. If we insert a value (t,s1) = 1, 1.123, and select the data, we will get 1.1. However, if we run `flush` after insert the data, and then select the data, we will get 1.123. How to fix: we need to modify the init() method in ReadOnlyMemChunk to check the encoding method first. -- This message was sent by Atlassian Jira (v8.3.4#803005)