Hi Xiangzhi, Thank you for your work! Load function is something I frequently use when testing, and your optimization should greatly enhance my user experience!
By the way, I would like to know what the general causes of failure might be, and whether there is an option to retry or handle the failed TsFile? Best CaiyinYang > 2024年5月30日 11:11，孟祥志 <[email protected]> 写道： > > Hello everyone, > > I am Xiangzhi Meng, a new contributor to Apache IoTDB. I am excited to share > with you a feature that I have been working on for the past few months. > > load tsfile has always been an important feature for IoTDB, but due to the > original design, he has some flaws in it, when load a folder fails to import > some tsfile, it may cause the whole task fails, which is obviously a not very > user-friendly design, so I decided to modify his. > > I'll modify the original load tsfile script to traverse the entire folder > first, find all the files, and then use the LOAD function to import > individual files; and I've added a few interesting changes along the way, > modifying the successful operation parameter to make it easier for people to > deal with successful files, and added a parameter for failed files to make it > easier for people to find those failed files, and finally added a new number > of threads to make the LOAD function work more quickly. > > > I hope you are interested in this feature and would like to participate in > the development and testing. You can also leave your comments and suggestions > in this thread. Appreciate any suggestion/feedback & contribution. > > Thank you for your attention and support. > > Best regards, > > Xiangzhi Meng > > Reference: > https://github.com/apache/iotdb/pull/12541
