?????? add vm(hot compaction) in tsfile processor

2020-07-20 Thread 445073309
Hi, OK??I will do not use any rich-format Suppose the parameter is 5. Then in level 2, will you merge 4 new VM files to the bigger one, or merge 5 VM files? I will merge 5 VM files to a bigger one in level 2. ---- ??:

Re: add vm(hot compaction) in tsfile processor

2020-07-20 Thread 445073309
Hi, OK??I will do not use any rich-format Suppose the parameter is 5. Then in level 2, will you merge 4 new VM files to the bigger one, or merge 5 VM files? I will merge 5 VM files to a bigger one in level 2. -- -- ??:

Re: add vm(hot compaction) in tsfile processor

2020-07-20 Thread Xiangdong Huang
软件学院 > --原始邮件-- > 发件人: > "dev" > < > saint...@gmail.com; > 发送时间:2020年7月20日(星期一) 下午3:39 > 收件人:"dev" > 主题:Re: add vm(hot compaction) in tsfile processor > > > > Hi, >

Re: add vm(hot compaction) in tsfile processor

2020-07-20 Thread 445073309
Hi, I convert figure to symbolic.. * when we flush 5(max_vm_num) times, the current level will do compaction to the next level 1 1 1 1 1 | / / / / 5 * when we flush all 11 times, the compaction procedure is 1 1 1 1 1 1 1 1 1 1 1 | / / / / | / / / / 5 5 * if we close the tsfile, the

Re: add vm(hot compaction) in tsfile processor

2020-07-20 Thread Xiangdong Huang
发件人:* "dev" ; > *发送时间:* 2020年7月20日(星期一) 下午3:10 > *收件人:* "dev"; > *主题:* Re: add vm(hot compaction) in tsfile processor > > Hi Lingzhe, > > >max_vm_num: indicates that a TsFileProcessor has at most the number of > virtual memory files > &

Re: add vm(hot compaction) in tsfile processor

2020-07-20 Thread Jialin Qiao
School of Software, Tsinghua University 乔嘉林 清华大学 软件学院 -原始邮件- 发件人:445073309 发送时间:2020-07-20 15:30:46 (星期一) 收件人: dev 抄送: 主题: Re: add vm(hot compaction) in tsfile processor Hi, max_vm_num means that the most number of vm files relation to a tsfile's level. for example, we set max_vm_num=5

Re: add vm(hot compaction) in tsfile processor

2020-07-20 Thread 445073309
Hi, max_vm_num means that the most number of vm files relation to a tsfile's level. for example, we set max_vm_num=5 and we flush 11 times, then the compaction procedure can be described as below: * when we flush 5(max_vm_num)times, the current level will do compaction to the next level * when

Re: add vm(hot compaction) in tsfile processor

2020-07-20 Thread Xiangdong Huang
Hi Lingzhe, >max_vm_num: indicates that a TsFileProcessor has at most the number of virtual memory files what does this mean? and how do I know what value is suitable? (For example, if I set it as 1, is there any impact?) Best, --- Xiangdong Huang School of

add vm(hot compaction) in tsfile processor

2020-07-19 Thread 445073309
Hi, I met a problem that iotdb will write small chunk data when lack of memtable num, this causes the system to query hot data more slowly. So I create a new type of file -- vm file, and use it to do hot compaction in flush processor. With this, we can flexiblily controll the size of each