[jira] [Created] (IOTDB-3045) [ schema recovery ] The query result contains some timeseries that have been deleted

[Jira]

刘珍 created IOTDB-3045:
-------------------------

             Summary: [ schema recovery ] The query result contains some 
timeseries that have been deleted
                 Key: IOTDB-3045
                 URL: https://issues.apache.org/jira/browse/IOTDB-3045
             Project: Apache IoTDB
          Issue Type: Bug
          Components: Core/Schema Manager
    Affects Versions: 0.14.0-SNAPSHOT
            Reporter: 刘珍
            Assignee: Jialin Qiao
         Attachments: config.properties, d1.log

master_0428_ca4f3cf
问题描述：
50 sg，100 dev，200000 sensors/dev, 共2000万序列。
100个设备名称记录在文件中，
遍历文件，10个用户并发 delete ts，1个设备上delete 1条序列。
重复10次，也就是这100个dev，每个dev共delete 10个ts。
delete 后，执行count timeseries dev.* ；结果符合预期。

备份数据。

{color:#DE350B}重启iotdb，恢复元数据后，再查询 100个dev的序列数，有14个设备的序列数都是20万，
期望是199990，delete的ts，又查询到了。{color}

详细测试流程：
1. 私有云 192.168.130.2 
2. benchmark 配置见附件
3. 获取dev 名称，记录到文件dev_name.txt
 cat get_dev_name.sh
#!/bin/bash
./sbin/start-cli.sh  -e "show devices;" |grep root|awk -F '|' '{print $2}' > 
dev_name.txt

4. 并发delete
cat del_1_ts.sh
#!/bin/bash
function delete_ts()
{
   del_ts=$1
   dev_name=$2
   exp_count=$3
   count_ts ${exp_count} ${dev_name}
   ./sbin/start-cli.sh -e "delete timeseries ${del_ts};"
   let exp_count--
   count_ts ${exp_count} ${dev_name}
}

function count_ts()
{
    exp_c_ts=$1
    dev_name=$2
    cur_c_ts=`./sbin/start-cli.sh -e "count timeseries ${dev_name};"|sed -n 
"4,4p"|awk -F '|' '{print $2}'`
    if [ "${cur_c_ts}" -eq "${exp_c_ts}" ];then
        echo "ok"
    else
        echo "fail. ${dev_name}  ${exp_c_ts} ${cur_c_ts}" >>./fail.log
    fi
}

function execute()
{
    in_file=$1
    i=$2
    exp_count=$3
    n=0
    cat ${in_file} | while read line
    do
       del_ts="${line}.s_${i}"
       dev_name="${line}.*";
       delete_ts ${del_ts} ${dev_name} ${exp_count} &
       let i++
       let n++
       b=$(( $n % 10 ))
       if [ "$b" -eq "0" ];then
          wait
       fi
    done
    wait
}

# 循环几轮
count_ts_base=200000

for loop in {1..10}
do
    execute "dev_name.txt" ${loop} ${count_ts_base}
    let count_ts_base--
done

并发delete脚本的日志文件见附件。
执行count_ts.sh，查看每个dev的count timeseries，是否都是199990。
有14个dev的结果是200000，不符合预期结果。




--
This message was sent by Atlassian Jira
(v8.20.7#820007)