Hi, To make .carbondata file as a self sufficient file we added partition column as a data column . Partition suppose to be a Low cardinality column and we are applying RLE on top of that so size difference suppose to be in bytes. How much difference you are getting in terms of size after removing it??
Regards Kumar Vishal On Thu, 29 Oct 2020 at 5:04 PM, akashrn5 <akashr...@gmail.com> wrote: > Hi, > > +1. > > Its a long time pending work, good to complete it now. > > As ajantha said you can have a look at iceberg hidden partitioning, but > this > is just about not storing partition data in files and faster query and low > storage. > You can analyze and suggest the improvement in another discussion like > time and date relation in partitioning etc. > > Thanks, > > Regards, > Akash R Nilugal > > > > -- > Sent from: > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/ >
