Hi, I totally support treat time-based data partition as an experimental feature in 0.10.0.
Thanks Jialin for organizing such a long feature list! Really looking forward to 0.10.0 : ) Best, ----------------------------------- Zesong Sun School of Software, Tsinghua University 孙泽嵩 清华大学 软件学院 > 2020年5月26日 09:20，runhus...@foxmail.com 写道： > > Wow，so many useful features! Looking forward to the version 0.10.0. > > > > Thanks! > > runhus...@foxmail.com > > > From: Jialin Qiao > Date: 2020-05-25 23:46 > To: dev > Subject: Re: [Discuss] Release of 0.10.0 > Hi, > > The highly anticipated version 0.10.0 is coming soon! > > I summarize the release notes, please have a check :) > > # Apache IoTDB (incubating) 0.10.0 > > ## New Features > > * IOTDB-217 A new GROUPBY syntax, e.g., select avg(s1) from root.sg.d1.s1 > GROUP BY ([1, 50), 5ms) > * IOTDB-220 Add hot-load configuration function > * IOTDB-275 allow using user defined JAVA_HOME and allow blank space in the > JAVA_HOME > * IOTDB-287 Allow domain in JDBC URL > * IOTDB-292 Add load external tsfile feature > * IOTDB-297 Support "show flush task info" > * IOTDB-298 Support new Last point query. e.g, select last * from root > * IOTDB-305 Add value filter function while executing align by device > * IOTDB-309 add Dockerfiles for 0.8.1, 0.9.0, and 0.9.1 > * IOTDB-313 Add RandomOnDiskUsableSpaceStrategy > * IOTDB-323 Support insertRecords in session > * IOTDB-337 Add timestamp precision properties for grafana > * IOTDB-343 Add test method in session > * IOTDB-396 Support new query clause: disable align, e.g., select * from root > disable align > * IOTDB-447 Support querying non-existing measurement and constant measurement > * IOTDB-448 Add IN operation, e.g., where time in (1,2,3) > * IOTDB-456 Support GroupByFill Query, e.g., select last_value(s1) from > root.sg.d1 GROUP BY ([1, 10), 2ms) FILL(int32[previousUntilLast]) > * IOTDB-467 The CLI displays query results in a batch manner > * IOTDB-497 Support Apache Flink Connector with IoTDB > * IOTDB-558 add text support for grafana > * IOTDB-560 Support Apache Flink connecter with TsFile > * IOTDB-565 MQTT Protocol Support, disabled by default, open in > iotdb-engine.properties > * IOTDB-574 Specify configuration when start iotdb > * IOTDB-588 Add tags and attributes management > * IOTDB-607 add batch create timeseries in native interface > * IOTDB-612 add limit&offset to show timeseries > * IOTDB-617 Support alter one time series's tag/attribute > * IOTDB-630 Add a jdbc-like way to fetch data in session > * IOTDB-640 Enable system admin sql (flush/merge) in JDBC or Other API > * IOTDB-671 Add clear cache command > * Support open and close time range in group by, e.g, [), (] > * Online upgrade from 0.9.x > * Support speical characters in path: -/+&%$#@ > * IOTDB-446 Support path start with a digit, e.g., root.sg.12a > * enable rpc compression in session pool > * Make JDBC OSGi usable and added a feature file > * Python: Support pypi distribution for Python Client > > ## Incompatible changes > > * IOTDB-138 Move All metadata query to usual query > * IOTDB-322 upgrade to thrift 0.12.0-0.13.0 > * IOTDB-325 Refactor Statistics in TsFile > * IOTDB-419 Refactor the 'last' and 'first' aggregators to 'last_value' and > 'first_value' > * IOTDB-506 upgrade the rpc protocol to v2 to reject clients or servers that > version < 0.10 > * IOTDB-587 TsFile is upgraded to version 2 > * IOTDB-593 add metaOffset in TsFileMetadata > * IOTDB-597 Rename methods in Session: insertBatch to insertTablet, > insertInBatch to insertRecords, insert to insertRecord > * RPC is incompatible, you can not use client-v0.9 to connect with > server-v0.10 > * TsFile format is incompatible, will be upgraded when starting 0.10 > * Refine exception code in narive api > > ## Miscellaneous changes > > * IOTDB-190 upgrade from antlr3 to antlr4 > * IOTDB-418 new query engine > * IOTDB-429 return empty dataset instead of throw exception, e.g., show child > paths root.* > * IOTDB-445 Unify the keyword of "timestamp" and "time" > * IOTDB-450 Add design documents > * IOTDB-498 Support date format "2020-02-10" > * IOTDB-503 Add checkTimeseriesExists in java native api > * IOTDB-605 Add more levels of index in TsFileMetadata for handling too many > series in one device > * IOTDB-625 Change default level number: root is level 0 > * IOTDB-628 rename client to cli > * IOTDB-621 Add Check isNull in Field for querying using session > * IOTDB-632 Performance improve for PreviousFill/LinearFill > * Allow "count timeseries" without a prefix path > * Add max backup log file number > * add rpc compression api in client and session module > * Continue writing the last unclosed file > * Move the vulnera-checks section into the apache-release profile to > accelerate compile > * Add metaquery in python example > > ## Bug Fixes > > * IOTDB-125 Potential Concurrency bug while deleting and inserting happen > together > * IOTDB-185 fix start-client failed on WinOS if there is blank space in the > file path; let start-server.bat suport jdk12,13 etc > * IOTDB-304 Fix bug of incomplete HDFS URI > * IOTDB-341 Fix data type bug in grafana > * IOTDB-346 Fix a bug of renaming tsfile in loading function > * IOTDB-370 fix a concurrent problem in parsing sql > * IOTDB-376 fix metric to show executeQuery > * IOTDB-392 fix export CSV > * IOTDB-393 Fix unclear error message for no privilege users > * IOTDB-401 Correct the calculation of a chunk if there is no data in the > chunk, do not flush empty chunk > * IOTDB-412 Paths are not correctly deduplicated > * IOTDB-420 Avoid encoding task dying silently > * IOTDB-425 fix can't change the root password. > * IOTDB-459 Fix calmem tool bug > * IOTDB-470fix IllegalArgumentException when there exists 0 byte TsFile > * IOTDB-529 Relative times and NOW() operator cannot be used in Group By > * IOTDB-531 fix issue when grafana visualize boolean data > * IOTDB-546 Fix show child paths statement doesn't show quotation marks > * IOTDB-643 Concurrent queries cause BufferUnderflowException when storage in > HDFS > * IOTDB-663 Fix query cache OOM while executing query > * IOTDB-664 Win -e option > * IOTDB-669 fix getting two columns bug while ”show devices“ in session > * fix concurrent auto create schema conflict bug > * fix meet incompatible file error in restart > * Fix bugs of set core-site.xml and hdfs-site.xml paths in HDFS storage > * fix execute flush command while inserting bug > * Fix sync schema pos bug > * Fix batch execution bug, the following sqls will all fail after one error > sql > > > Thanks, > -- > Jialin Qiao > School of Software, Tsinghua University > > 乔嘉林 > 清华大学 软件学院 > >> -----原始邮件----- >> 发件人: "Xiangdong Huang" <saint...@gmail.com> >> 发送时间: 2020-05-25 23:36:42 (星期一) >> 收件人: dev@iotdb.apache.org >> 抄送: >> 主题: Re: [Discuss] Release of 0.10.0 >> >> Hi all, >> >> Though we introduced the feature that supporting time-based data partition, >> it may have some side-effect for query performance in some cases. >> So, I'd like to mark this feature as experimental and disable it by >> default. We can enable it by default until we fixed the performance issue >> in next version. >> >> Then, I'd like to start to organize the change list of v0.10 with @Jialin. >> >> Best, >> ----------------------------------- >> Xiangdong Huang >> School of Software, Tsinghua University >> >> 黄向东 >> 清华大学 软件学院 >> >> >> Xiangdong Huang <saint...@gmail.com> 于2020年5月21日周四 上午9:34写道： >> >>> Hi, >>> >>> I suggest to run a performance comparison for v0.9 and v0.10 first and >>> then start the release. >>> We are doing that. >>> >>> Best, >>> ----------------------------------- >>> Xiangdong Huang >>> School of Software, Tsinghua University >>> >>> 黄向东 >>> 清华大学 软件学院 >>> >>> >>> Xiangdong Huang <saint...@gmail.com> 于2020年5月20日周三 下午3:08写道： >>> >>>> Hi, >>>> >>>>> Are there any features left that one NEEDS in 0.10 that are currently >>>> in work? >>>> >>>> IMO, we do not need to wait for developing other features anymore before >>>> releasing v0.10.0, but we can "merge as many PRs as possible" especially >>>> for those bug-fix PRs. >>>> >>>> Best, >>>> >>>> ----------------------------------- >>>> Xiangdong Huang >>>> School of Software, Tsinghua University >>>> >>>> 黄向东 >>>> 清华大学 软件学院 >>>> >>>> >>>> Julian Feinauer <j.feina...@pragmaticminds.de> 于2020年5月20日周三 下午2:33写道： >>>> >>>>> Hi, >>>>> >>>>> I suggest to always to a release branch as best practice as it always >>>>> help you if you need to create a fix release like 0.10.1 (if you want to >>>>> keep working on features on master branch). >>>>> But yes I agree, we should try to merge as many PRs as possible. >>>>> >>>>> Are there any features left that one NEEDS in 0.10 that are currently in >>>>> work? >>>>> >>>>> Julian >>>>> >>>>> Am 20.05.20, 08:29 schrieb "Xiangdong Huang" <saint...@gmail.com>: >>>>> >>>>> Hi, >>>>> >>>>> The grafana issue has been fixed. >>>>> >>>>> As we have so many PRs opened now, we need to check when to fork a >>>>> new >>>>> branch rel/0.10. >>>>> >>>>> Actually, only one PR needs to be pay attention [1]. >>>>> >>>>> IMO, I want to merge it into the master ASAP to avoid more conflicts. >>>>> Otherwise, there will be too many differences between rel/0.10 and >>>>> master. >>>>> But as it modified many codes and not all of them are tested, I am >>>>> afraid >>>>> whether it brings unstable factors. >>>>> >>>>> [1] https://github.com/apache/incubator-iotdb/pull/1169 >>>>> >>>>> Best, >>>>> ----------------------------------- >>>>> Xiangdong Huang >>>>> School of Software, Tsinghua University >>>>> >>>>> 黄向东 >>>>> 清华大学 软件学院 >>>>> >>>>> >>>>> Julian Feinauer <j.feina...@pragmaticminds.de> 于2020年5月18日周一 >>>>> 下午6:44写道： >>>>> >>>>>> Hey, >>>>>> >>>>>> that looks pretty cool indeed. >>>>>> Has anyone tested the IoTDB Grafana Bridge? >>>>>> I had issues with it at some point in master branch, not sure >>>>> about the >>>>>> latest version? >>>>>> >>>>>> But sounds really cool! >>>>>> >>>>>> Julian >>>>>> >>>>>> Am 18.05.20, 12:08 schrieb "Haonan Hou" <hhao...@outlook.com>: >>>>>> >>>>>> Hi, >>>>>> >>>>>> Right now the upgrade tool for upgrading IoTDB v0.9.x to v0.10 >>>>> has >>>>>> been developed. We have also finished the tests about it and >>>>> everything >>>>>> works great. I think it’s the right time to release the v0.10.0. >>>>>> >>>>>> Anyone hope to be the RM of 0.10.0? >>>>>> >>>>>> Best, >>>>>> Haonan Hou >>>>>> >>>>>> >>>>> >>>>> -- >> ----------------------------------- >> Xiangdong Huang >> School of Software, Tsinghua University >> >> 黄向东 >> 清华大学 软件学院
