Re: About the design and development of merge.

2019-07-08 Thread Xiangdong Huang
Hi, Q1: you change the order of Chunks in a TsFile. Does that break the time-ordering characteristic? Q2: Do you mean handling time series one by one (An unseq file may consists of many devices and measurements)? Do we need to make some marks on an unseq file if only the data of a part of device

Re: About the design and development of merge.

2019-07-08 Thread 江天
A1: Yes. However, in IoTDB queries, the order of chunks is not that important as a simple sort by startTime can make them ordered again once they are loaded into memory. A2: Yes, but not necessarily. We handle time series one by one to minimize the memory burden, but if memory is abundant, we c

Re: Start the release train

2019-07-08 Thread Julian Feinauer
Hi Xiangdong, thanks for your response (which I personally value a lot). It's good that you agree and hopefully some others will join the discussion soon. I just spoke with Chris who did a lot for the maven build. And as it is conceptually the same build (from the maven side) than we used in PL

Re: Start the release train

2019-07-08 Thread Justin Mclean
Hi, > The only problem is that I am no committer so I would need the support of > someone from the PMC to help with release branch / release tags. I'm unsure > if the rest (nexus and stuff) works as I'm PMC elsewhere. Anyone can be the releasee manager, but not being a committer may make it a

Re: About the design and development of merge.

2019-07-08 Thread 江天
Merge log for fast recovery after system failure: 1. At the beginning of a merge, a file named “merge.log” is created. 2. All files’ names involved in this merge are written into “merge.log”. 3. A line “merge start” is written into “merge.log” indicating that all files in this merge are listed abo

Re: Start the release train

2019-07-08 Thread Xiangdong Huang
Hi Julian, Thanks for your suggestion. We are trying to nominating new contributors as committers now... Actually we really need experienced guys to guide us the release process. If we cannot solve the committer identity in a short time, how about guiding us and I can follow your instruction. It

Re: Start the release train

2019-07-08 Thread Julian Feinauer
Hi Xiangdong, that sounds reasonable and can be done. I think first, some preparation has to be done so or so. There already has been a discussion about the branching model to used [1]. Although master and develop are kind of the same thing I would advice to totally stick to the naming conventio

Re: Start the release train

2019-07-08 Thread Xiangdong Huang
Thanks Julian, The info is quite helpful. I will start the vote process. Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Julian Feinauer 于2019年7月8日周一 下午8:33写道: > Hi Xiangdong, > > that sounds reasonable and can be done. > I thi

Re: Start the release train

2019-07-08 Thread Xiangdong Huang
Hi all, Does anyone has opinions for putting the releasing process at the top of the agendas? If there is no more opinions, I will start the first step: open a vote for moving the `master` branch into the `dev`. Best, --- Xiangdong Huang School of Software, Tsingh

Re: Start the release train

2019-07-08 Thread Julian Feinauer
Just a short notice we should call it `develop` not `dev`. At least my opiniton : ) Am 08.07.19, 15:19 schrieb "Xiangdong Huang" : Hi all, Does anyone has opinions for putting the releasing process at the top of the agendas? If there is no more opinions, I will start th

Re: Re: Start the release train

2019-07-08 Thread Jialin Qiao
Hi, Though the current version is stable, it introduces some new parameters (e.g., the number of memtables in the pool) which users should set carefully. I think we can make these parameters dynamically adapting the workload. It does not need to change many codes (but need to design carefully

Re: Start the release train

2019-07-08 Thread Justin Mclean
Hi, > Actually we really need experienced guys to guide us the release process. I may of reviewed a release or two (I’m guessing around the 400 mark!) and have been release manager many times so can certainly help out there. Thanks, Justin

Re: Start the release train

2019-07-08 Thread Justin Mclean
Hi, > So I suggest to start a formal VOTE for the rename. IMO - There is no need for a vote just discuss and reach consensus. they may even be lazy consensus i.e. speak up and if no one objects lets do it. Thanks, Justin

Re: Start the release train

2019-07-08 Thread Xiangdong Huang
Hi, Many Thanks. Once again I have to appeal to all authors of existing PRs propel their PRs be merged (e.g., answering the review comments). It is important before we move the branch. Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件

Re: Start the release train

2019-07-08 Thread Julian Feinauer
Hey all, dont get me wrong.. not need to hurry : ) But, from my experience the first (ASF) release is tough for a lot of rather formal reasons than functionality. So I would consider it valuable to have a (functionally mediocre) initial release where all of the formal stuff is sorted out. Then f

Re: Start the release train

2019-07-08 Thread Christofer Dutz
Hi Julian and others, there's no need to rename and create some zombie "master" ... for PLC4X we decided to create deveop and simply stopped pushing to master (The Jenkins job of IoTDB even has the hook to send emails if someone pushes to master commented out). I would suggest to simply create

Re: Start the release train

2019-07-08 Thread Christofer Dutz
Which "agendas" by the way? Is there any official agenda available anywhere? Chris Am 08.07.19, 15:19 schrieb "Xiangdong Huang" : Hi all, Does anyone has opinions for putting the releasing process at the top of the agendas? If there is no more opinions, I will start t

Re: Start the release train

2019-07-08 Thread Xiangdong Huang
Hi Chris, > Is there any official agenda available anywhere? I think it is my misnomer. In fact, now we just write TODO tasks on JIRA. Some of them are reported by users, some of them are reported by a test team in our lab, while others are ideas proposed by us. We do not distinguish the priori

Re: Re: Re: Start the release train

2019-07-08 Thread 李天安
Hi, Recently I'm working on adjusting parameters dynamically according to different workloads. I have the following ideas: There are three dynamically adjustable parameters in the IoTD: the number of MemTables, the size of per MemTable and the threshold size of TsFile. 1. the number of MemTabl

回覆: 回覆: A new encoding method for regular timestamp column

2019-07-08 Thread Jack Tsai
Hi, I have made some improvement in the new encoding method I created before, which I think the one I've done initially was not fully meet the user's usage for invoking the encoder's API. The following is the detail for the new implementation: Write (Encode) 1. Invoke the RegularDataEncode