Dear Jacky, It was purposefully done like that.the table status need to give the history of the transactions that happened on the system.This is like an audit point.
Dear xm_zzc what is your use case? In any case we cannot permanently remove the entries from our system.based on use case we can consider to move it to a separate file.we can also check what the size would be and optimising reading it from multiple places. Regards Raghu On Wed, 14 Mar 2018 at 12:18 PM, Jacky Li <jacky.li...@qq.com> wrote: > Hi, > > Yes, I think you are right. Currently CLEAN FILES command only delete the > segment data folder, but not deleting metadata entries in table_status > file, I think this is the problem. > Please feel free to open a JIRA ticket and improve it. Thanks. > > Regards, > Jacky > > > 在 2018年3月14日，上午10:28，xm_zzc <441586...@qq.com> 写道： > > > > Hi dev: > > The size of the tablestatus file is getting larger, does it impact the > > performance of reading this file, for example 1 million segment info in > this > > file? There are many places will scan this file. > > Why not delete the invisible segment info to reduce the size of > > tablestatus file? will they be used later? > > > > > > -- > > Sent from: > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/ > > > >
