Hi Vishal, +1
Thank you for starting a discussion on it. It will be a very helpful feature to improve query performance and reduces the memory footprint. Please add the design document for the same. Regards, Ravindra. On 5 June 2018 at 09:22, xuchuanyin <xuchuan...@hust.edu.cn> wrote: > Hi, Kumar： > Local dictionary will be nice feature and other formats like parquet all > support this. > > My concern is that: How will you implement this feature? > > 1. What's the scope of the `local`? Page level (for all containing rows), > Blocklet level (for all containing pages), Block level(for all containing > blocklets)? > > 2. Where will you store the local dictionary? > > 3. How do you decide to enable the local dictionary for a column? > > 4. Have you considered to fall back to plain encoding if the local > dictionary encoding consumes more space? > > 5. Will you still work on V3 format or start a new V4 (or v3.1) version? > > Anyway, I'm concerning about the data loading performance. Please pay > attention to it while you are implementing this feature. > > > > -- > Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556. > n5.nabble.com/ > -- Thanks & Regards, Ravi
