+1 It is a good feature to have. Once the design document is uploaded we will get a better idea of how it will be implemented.
Regards Manish Gupta On Tue, Jun 5, 2018 at 11:18 AM, Kumar Vishal <kumarvishal1...@gmail.com> wrote: > Hi Xuchuanyin, > > I am working on design document, and all the points you have mentioned I > have already captured. I will share once it is finished. > > -Regards > Kumar Vishal > > On Tue, Jun 5, 2018 at 9:22 AM, xuchuanyin <xuchuan...@hust.edu.cn> wrote: > > > Hi, Kumar： > > Local dictionary will be nice feature and other formats like parquet > all > > support this. > > > > My concern is that: How will you implement this feature? > > > > 1. What's the scope of the `local`? Page level (for all containing > rows), > > Blocklet level (for all containing pages), Block level(for all containing > > blocklets)? > > > > 2. Where will you store the local dictionary? > > > > 3. How do you decide to enable the local dictionary for a column? > > > > 4. Have you considered to fall back to plain encoding if the local > > dictionary encoding consumes more space? > > > > 5. Will you still work on V3 format or start a new V4 (or v3.1) > version? > > > > Anyway, I'm concerning about the data loading performance. Please pay > > attention to it while you are implementing this feature. > > > > > > > > -- > > Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556. > > n5.nabble.com/ > > >
