Considering lossy encoding/compression?
Hi, Now IoTDB only supports lossless encoding method, like RLE, delta-of-delta, etc.. I'd like to know is there a requirement that using a lossy encoding method for storing IoT data? If so, we can add some lossy encoding options. Best, --- Xiangdong Huang School of Software, Tsinghua University
Re: Considering lossy encoding/compression?
Hi, I know PI has Spinning Door Transformation compress algorithm which is a lossy encoding method, and it has been used in many cement factories. Thanks. Chao Wang BONC Ltd From: Xiangdong Huang Date: 2020-09-09 10:46 To: dev Subject: Considering lossy encoding/compression? Hi, Now IoTDB only supports lossless encoding method, like RLE, delta-of-delta, etc.. I'd like to know is there a requirement that using a lossy encoding method for storing IoT data? If so, we can add some lossy encoding options. Best, --- Xiangdong Huang School of Software, Tsinghua University
Re: Considering lossy encoding/compression?
Hi, > I know PI has Spinning Door Transformation compress algorithm which is a lossy encoding method, and it has been used in many cement factories. Yes, if we have demand to implement a lossy encoding, I'd like to also choose SDT... Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 runhus...@foxmail.com 于2020年9月9日周三 上午10:53写道: > Hi, > > I know PI has Spinning Door Transformation compress algorithm which is > a lossy encoding method, and it has been used in many cement factories. > > > > Thanks. > > Chao Wang > BONC Ltd > > > From: Xiangdong Huang > Date: 2020-09-09 10:46 > To: dev > Subject: Considering lossy encoding/compression? > Hi, > > Now IoTDB only supports lossless encoding method, like RLE, delta-of-delta, > etc.. > > I'd like to know is there a requirement that using a lossy encoding method > for storing IoT data? > > If so, we can add some lossy encoding options. > > Best, > --- > Xiangdong Huang > School of Software, Tsinghua University >
Re: Considering lossy encoding/compression?
Hi, I think it's good to support lossy encoding method as some companies want it, and there are more lossy encoding methods in paper, it is also a good work to implement them to improve system performance. Thanks, --- Lingzhe Zhang -- -- ??: "dev"
Re: Considering lossy encoding/compression?
Hi, another common pattern is just to downsample the datasets (as Influx does it for example). This is technically also a lossless encoding (but not as fancy). Julian Am 09.09.20, 05:09 schrieb "Xiangdong Huang" : Hi, > I know PI has Spinning Door Transformation compress algorithm which is a lossy encoding method, and it has been used in many cement factories. Yes, if we have demand to implement a lossy encoding, I'd like to also choose SDT... Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 runhus...@foxmail.com 于2020年9月9日周三 上午10:53写道: > Hi, > > I know PI has Spinning Door Transformation compress algorithm which is > a lossy encoding method, and it has been used in many cement factories. > > > > Thanks. > > Chao Wang > BONC Ltd > > > From: Xiangdong Huang > Date: 2020-09-09 10:46 > To: dev > Subject: Considering lossy encoding/compression? > Hi, > > Now IoTDB only supports lossless encoding method, like RLE, delta-of-delta, > etc.. > > I'd like to know is there a requirement that using a lossy encoding method > for storing IoT data? > > If so, we can add some lossy encoding options. > > Best, > --- > Xiangdong Huang > School of Software, Tsinghua University >