Fetch query result iteratively to avoid OOM

Hi, Currently, Haihang and Yuan Tian added an improvement to fetch the results of show timeseries iteratively to avoid OOM [1]. For data queries, we use the QueryDataSet which provides the hasNext & next iterator. Then the client could fetch result by fetchSize. However, for most metadata q

Re: Fetch query result iteratively to avoid OOM

Hi Jialin, this is a very good point, indeed. I remember in Calcite there was the Linq4j Module which was based on an extension of an "Iterable / Iterator" which was basically Lazy Loading / Computation. This object was assembled throughout the query and finally given to the Servers handler who

Re: [Experiment sharing] How chunk size(number of points) impact the query performance

Hi Jialin, Great experiment! Thanks for your sharing. Looking forward to the function of hot compaction. Best, --- Zesong Sun School of Software, Tsinghua University 孙泽嵩 清华大学 软件学院 > 2020年7月8日 16:39，Jialin Qiao 写道： > > Hi, > > > I'd like to share with you so

Re: [Experiment sharing] How chunk size(number of points) impact the query performance

Hey, very interesting experiment. Did you use something like JMH fort he Benchmark or did you perform it directly? Julian Am 09.07.20, 09:29 schrieb "孙泽嵩" : Hi Jialin, Great experiment! Thanks for your sharing. Looking forward to the function of hot compaction. Best, --

Re: [Experiment sharing] How chunk size(number of points) impact the query performance

Hi, I perform it directly. Some supplements: - The version I used is the 0.11.0-SNAPSHOT in master branch. The specific commit does not matter because we do not modify the query engine much after 0.10.0. - Each time I execute the query, I restart the IoTDB to avoid the influence of cache in

[BUILD-FAILURE]: Job 'IoTDB-Pipeline/master [master] [416]'

BUILD-FAILURE: Job 'IoTDB-Pipeline/master [master] [416]': Check console output at "https://builds.apache.org/job/IoTDB-Pipeline/job/master/416/";>IoTDB-Pipeline/master [master] [416]"

Change the base_dir to system_dir

Hi,       I submit this pr [1] to fix issue [2]. The naming of base_dir is likely to mislead users that it is the parent folder of data_dirs and wal_dirs. However, they are independent. The base_dir is just responsible for the system data folder (schema, version files...), so I changed the conf

Re:Courses /Trainings for Open Source Projects

Hi， This website opens very, very slowly on my computer. Can others open it? Best ——— Dawei Liu On 07/5/2020 20:04，Julian Feinauer wrote： Hi folks, as some may have noticed on other lists Chris, myself and some others are starting something together (and also with other Partners from the comm

Re: Courses /Trainings for Open Source Projects

Dawei, sadly you are totally right. We curently have pretty poor loading times and do not yet know why. Last week(s) we focused on setup and content but next step is definetly improve loading times and performance as ist currently pretty inactceptable. Julian Am 10.07.20, 04:12 schrieb "Dawei

Re: Courses /Trainings for Open Source Projects

Hi Julian， Fortunately, I opened it and filled it out. Thanks --- Dawei Liu On 07/10/2020 14:01，Julian Feinauer wrote： Dawei, sadly you are totally right. We curently have pretty poor loading times and do not yet know why. Last week(s) we focused on setup and content but next step is def