Considering lossy encoding/compression?

2020-09-08 Thread Xiangdong Huang
Hi,

Now IoTDB only supports lossless encoding method, like RLE, delta-of-delta,
etc..

I'd like to know is there a requirement that using a lossy encoding method
for storing IoT data?

If so, we can add some lossy encoding options.

Best,
---
Xiangdong Huang
School of Software, Tsinghua University


Re: Considering lossy encoding/compression?

2020-09-08 Thread runhus...@foxmail.com
Hi,

I know PI has Spinning Door Transformation compress algorithm which is a 
lossy encoding method, and it has been used in many cement factories.



Thanks.

Chao Wang
BONC Ltd

 
From: Xiangdong Huang
Date: 2020-09-09 10:46
To: dev
Subject: Considering lossy encoding/compression?
Hi,
 
Now IoTDB only supports lossless encoding method, like RLE, delta-of-delta,
etc..
 
I'd like to know is there a requirement that using a lossy encoding method
for storing IoT data?
 
If so, we can add some lossy encoding options.
 
Best,
---
Xiangdong Huang
School of Software, Tsinghua University


Re: Considering lossy encoding/compression?

2020-09-08 Thread Xiangdong Huang
Hi,

> I know PI has Spinning Door Transformation compress algorithm which is a
lossy encoding method, and it has been used in many cement factories.

Yes, if we have demand to implement a lossy encoding, I'd like to also
choose SDT...

Best,
---
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


runhus...@foxmail.com  于2020年9月9日周三 上午10:53写道:

> Hi,
>
> I know PI has Spinning Door Transformation compress algorithm which is
> a lossy encoding method, and it has been used in many cement factories.
>
>
>
> Thanks.
>
> Chao Wang
> BONC Ltd
>
>
> From: Xiangdong Huang
> Date: 2020-09-09 10:46
> To: dev
> Subject: Considering lossy encoding/compression?
> Hi,
>
> Now IoTDB only supports lossless encoding method, like RLE, delta-of-delta,
> etc..
>
> I'd like to know is there a requirement that using a lossy encoding method
> for storing IoT data?
>
> If so, we can add some lossy encoding options.
>
> Best,
> ---
> Xiangdong Huang
> School of Software, Tsinghua University
>


Re: Considering lossy encoding/compression?

2020-09-08 Thread Lingzhe Zhang
Hi,


I think it's good to support lossy encoding method as some companies want it,
and there are more lossy encoding methods in paper, it is also a good
work to implement them to improve system performance.


Thanks,
---
Lingzhe Zhang




--  --
??: 
   "dev"


Re: Considering lossy encoding/compression?

2020-09-09 Thread Julian Feinauer
Hi,

another common pattern is just to downsample the datasets (as Influx does it 
for example). This is technically also a lossless encoding (but not as fancy).

Julian

Am 09.09.20, 05:09 schrieb "Xiangdong Huang" :

Hi,

> I know PI has Spinning Door Transformation compress algorithm which is a
lossy encoding method, and it has been used in many cement factories.

Yes, if we have demand to implement a lossy encoding, I'd like to also
choose SDT...

Best,
---
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


runhus...@foxmail.com  于2020年9月9日周三 上午10:53写道:

> Hi,
>
> I know PI has Spinning Door Transformation compress algorithm which is
> a lossy encoding method, and it has been used in many cement factories.
>
>
>
> Thanks.
>
> Chao Wang
> BONC Ltd
>
>
> From: Xiangdong Huang
> Date: 2020-09-09 10:46
> To: dev
> Subject: Considering lossy encoding/compression?
> Hi,
>
> Now IoTDB only supports lossless encoding method, like RLE, 
delta-of-delta,
> etc..
>
> I'd like to know is there a requirement that using a lossy encoding method
> for storing IoT data?
>
> If so, we can add some lossy encoding options.
>
> Best,
> ---
> Xiangdong Huang
> School of Software, Tsinghua University
>