Re: [Weekly Report] IoTDB Weekly News (2020-06-12~2020-06-19)

2020-06-19 Thread Jialin Qiao
Thanks DaWei! -- Jialin Qiao School of Software, Tsinghua University 乔嘉林 清华大学 软件学院 > -原始邮件- > 发件人: "孙泽嵩" > 发送时间: 2020-06-20 07:07:44 (星期六) > 收件人: dev@iotdb.apache.org > 抄送: > 主题: Re: [Weekly Report] IoTDB Weekly News (2020-06-12~2020-06-19) > > Hi Dawei, > > Welcome back! > >

Re: [Weekly Report] IoTDB Weekly News (2020-06-12~2020-06-19)

2020-06-19 Thread 孙泽嵩
Hi Dawei, Welcome back! Thanks for ur sharing : ) Best, --- Zesong Sun School of Software, Tsinghua University 孙泽嵩 清华大学 软件学院 > 2020年6月20日 01:23,Dawei Liu 写道: > > 大家好, > 很开心又一次与大家分享 IoTDB 社区周报。 > > > [本周大事件] > * 我们计划每2-3周举行一次在线讨论,以便让更多的贡献者能够深入交流。 > * IoTDB

Re:[Weekly Report] IoTDB Weekly News (2020-06-12~2020-06-19)

2020-06-19 Thread Dawei Liu
大家好, 很开心又一次与大家分享 IoTDB 社区周报。 [本周大事件] * 我们计划每2-3周举行一次在线讨论,以便让更多的贡献者能够深入交流。 * IoTDB 社区的成熟度评估(draft)已经发布,欢迎各位审阅[1]. * 0.10.0-RC4 正在投票,欢迎检查并发表意见和建议! * 新增加了 "show latest timeseries"功能, 该功能按照timeseries中最后一个点的时间戳降序输出,可以更方便地知道哪些时序还在写数据. * 优化了 MTree * 分享一个内存开销的实验结果,在MTree中保存2千万的时序元数据大约需要 7G 内存.

[Weekly Report] IoTDB Weekly News (2020-06-12~2020-06-19)

2020-06-19 Thread Dawei Liu
Dear community, I'd like to share the weekly report for you this week. [Big Event] * We plan to hold online-discussion every 2-3 weeks to let contributors communicate more deeply. * Maturity Evaluation draft of IoTDB is published, please have a review [1] * We are voting the 0.10.0-RC4 now,

Re: [IOTDB-726] CheckPoint of MTree

2020-06-19 Thread 孙泽嵩
Hi Julian and Xiangdong, > Another thing we could consider is to chunk them according to their > namespaces in folders / files or any other struct. > according to the Storage group names, for example. Good opinions! I think I’ll consider it as a future sub-task. Now I’m focusing on the scenario

Re: Help for CSharp client integration

2020-06-19 Thread Giorgio Zoppi
Yes i have all the scripts. BR, Giorgio. El vie., 19 jun. 2020 a las 16:56, Xiangdong Huang () escribió: > Hi Chris, > > Many thanks! > I should have thought of that PLC4x has already many such succesful > experiences. > > Best, > --- > Xiangdong Huang > School of

Re: Help for CSharp client integration

2020-06-19 Thread Xiangdong Huang
Hi Chris, Many thanks! I should have thought of that PLC4x has already many such succesful experiences. Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Christofer Dutz 于2020年6月19日周五 下午10:10写道: > Hi all, > > I already sent

Re: Help for CSharp client integration

2020-06-19 Thread Christofer Dutz
Hi all, I already sent Giorgio the links to how we did it in PLC4X. Should be pretty easy to setup. And definitely possible to integrate it perfectly into Maven without calling platform dependent scripts. Chris Am 19.06.20, 14:46 schrieb "Xiangdong Huang" : Hi Giorgio, I add a

Re: [discuss] Apache IoTDB 0.10.0 (incubating) RC4 release

2020-06-19 Thread Xiangdong Huang
Hi, > The binary NOTICE is very likely to be missing content from other Apache licensed NOTICE files. Are there some more hints for this? Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Xiangdong Huang 于2020年6月17日周三 下午8:08写道:

Re: Help for CSharp client integration

2020-06-19 Thread Xiangdong Huang
Hi Giorgio, I add a comment on the PR to show how to use maven to generate thrift's csharp codes. Maybe it can do better than using `compile.sh`. Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Giorgio Zoppi 于2020年6月19日周五

Re: Help for CSharp client integration

2020-06-19 Thread Giorgio Zoppi
Yes, i provide code and test it both on Linux/Mac/Win32. Best Regards, Giorgio

Re: Help for CSharp client integration

2020-06-19 Thread Xiangdong Huang
Hi Giorgio, Many thanks. I just want to guarantee the integration is more complete so that we can guarantee compatibility and make sure users can run it easily after downloading codes. Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学

Re: Help for CSharp client integration

2020-06-19 Thread Giorgio Zoppi
Hello, I will take care after work, I promise. The version of thrift you have is obsolete. I have the maven links to thrift. Thnx, Giorgio.

Re: [IOTDB-726] CheckPoint of MTree

2020-06-19 Thread Julian Feinauer
Yes, we could then also use all cores for deserialization (if thats the bottleneck) for reloading all of them. Or generally store only some K in one file and then open another one then we could again take care of parallelism. J Am 19.06.20, 11:35 schrieb "Xiangdong Huang" : > Another

Re: [IOTDB-726] CheckPoint of MTree

2020-06-19 Thread Xiangdong Huang
> Another thing we could consider is to chunk them according to their namespaces in folders / files or any other struct. according to the Storage group names, for example. --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Julian

Help for CSharp client integration

2020-06-19 Thread Xiangdong Huang
Hi, Giorgio contributed an example to use Csharp to operate IoTDB. But before we merge the PR to the master, there are several things to do: 1. current PR uses a 'compile.sh' script to generate c# codes from thrift. Actually we can use maven generate it easily by just modifying pom.xml (it is

Re: [IOTDB-726] CheckPoint of MTree

2020-06-19 Thread Julian Feinauer
Another thing we could consider is to chunk them according to their namespaces in folders / files or any other struct. Then we could efficiently do lazy loading and only pick what we really need. WDYT? Am 19.06.20, 10:36 schrieb "Xiangdong Huang" : > I did an experiment for 1M

Re: [IOTDB-726] CheckPoint of MTree

2020-06-19 Thread Jialin Qiao
Hi, The goal of checkpoint of MTree is accelerating the deserialization when restarting. So, just find an idle time of MTree and snapshot it asynchronously is ok. Thanks, -- Jialin Qiao School of Software, Tsinghua University 乔嘉林 清华大学 软件学院 > -原始邮件- > 发件人: "Xiangdong Huang" > 发送时间:

Re: [IOTDB-726] CheckPoint of MTree

2020-06-19 Thread Xiangdong Huang
> I did an experiment for 1M timeseries, and the serialization process costs 971ms. 971ms for Serializing 1M timeseries, but 6 seconds for deserializing? > I didn’t time this … I’ll do an experiment after fixing the suggested changes in current PR [1] The problem of current PR is that your

Re: [IOTDB-726] CheckPoint of MTree

2020-06-19 Thread 孙泽嵩
Wow, thanks, Julian! Let me try and do experiments to get the best result : ) Best, --- Zesong Sun School of Software, Tsinghua University 孙泽嵩 清华大学 软件学院 > 2020年6月19日 14:14,Julian Feinauer 写道: > > Oh and another note. By using a faster serialization Lib than

Re: [IOTDB-726] CheckPoint of MTree

2020-06-19 Thread Julian Feinauer
Oh and another note. By using a faster serialization Lib than Java default we could ideally speed up the process up to 10x. See eg here https://github.com/RuedigerMoeller/fast-serialization Julian Holen Sie sich Outlook für Android From:

Re: [IOTDB-726] CheckPoint of MTree

2020-06-19 Thread Julian Feinauer
What about using some kind of cache that spills to disk. That way we would be up in no time and just lazy load devices when needed. I remember that eh cache has such features (https://www.baeldung.com/ehcache) but there are other implementations as well. Julian Holen Sie sich Outlook für