[SUGGESTION]Support Decoder based fallback mechanism in local dictionary

2018-08-26 Thread Akash Nilugal
Hi all, Currently, when the fallback is initiated for a column page in case of local dictionary, we are keeping both encoded data and actual data in memory and then we form the new column page without dictionary encoding and then at last we free the Encoded Column Page. Because of this offheap mem

Re: [DISCUSSION] Implement file-level Min/Max index for streaming segment

2018-08-26 Thread Kumar Vishal
+1 Regards Kumar Vishal On Mon, 27 Aug 2018 at 07:15, xm_zzc <441586...@qq.com> wrote: > +1. > > > > -- > Sent from: > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/ >

Support Zstd as Column Compressor

2018-08-26 Thread xuchuanyin
Hi all, Here I am to explain the modification of 'Support Zstd as Column Compressor'(PR2628). Please give your feedback if you have problems. # BACKGROUND Zstd is compressor that have higher ratio than Snappy while has similar compression/decompression speed (litte worse than snappy). This compre

Re: [DISCUSSION] Implement file-level Min/Max index for streaming segment

2018-08-26 Thread xm_zzc
+1. -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: [DISCUSSION] Implement file-level Min/Max index for streaming segment

2018-08-26 Thread Raghunandan S
+1. this would improve the query performance on streaming tables On Sun, Aug 26, 2018 at 4:12 PM Liang Chen wrote: > Hi > > +1 for this proposal. > > Regards > Liang > > > David CaiQiang wrote > > Hi All, > > Currently, the filter queries on the streaming table always scan all > > streaming

Re: [DISCUSSION] Implement file-level Min/Max index for streaming segment

2018-08-26 Thread Liang Chen
Hi +1 for this proposal. Regards Liang David CaiQiang wrote > Hi All, > Currently, the filter queries on the streaming table always scan all > streaming files, even though there are no data in streaming files that > meet > the filter conditions. > So I try to support file-level min/max