How to release/distribute the plugins of IoTDB (garafana-connector, spark-connector, hive-connector etc.)
Hi, We have source-release.zip and binary.zip files, but the binary distribution zip file does not contains the grafana-connector, spark-connector and hive-connector, as these modules are not required for all users. And, including them may cause the binary zip file very large, which is not friendly for users who want to run IoTDB on a raspberry pi or some other embedded devices.. So, can we release these plugins in separate? If so, what is the process? Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院
Re: [jira] [Created] (IOTDB-314) Partition the data in a storage group by time.
Hi, +1! After doing this, The index building is also simple. Thanks, -- Jialin Qiao School of Software, Tsinghua University 乔嘉林 清华大学 软件学院 > -原始邮件- > 发件人: "Tian Jiang (Jira)" > 发送时间: 2019-11-22 12:23:00 (星期五) > 收件人: dev@iotdb.apache.org > 抄送: > 主题: [jira] [Created] (IOTDB-314) Partition the data in a storage group by > time. > > Tian Jiang created IOTDB-314: > > > Summary: Partition the data in a storage group by time. > Key: IOTDB-314 > URL: https://issues.apache.org/jira/browse/IOTDB-314 > Project: Apache IoTDB > Issue Type: Improvement > Reporter: Tian Jiang > > > In many analytic applications, reports are generated daily, weekly or > monthly. If the data files are naturally partitioned by such intervals, such > applications will be able to find the target data more easily. Other > functionalities like daily replication or transfers also benefit from this. > > As a result, we should support embedded storage-group-level time > partitioning in IoTDB, which allows each TsFile generated by IoTDB will not > have data exceeds a configurable interval (e.g. a day). > > By the way, this is also the fundamental support needed by the distributed > version. > > > > -- > This message was sent by Atlassian Jira > (v8.3.4#803005)
[jira] [Created] (IOTDB-314) Partition the data in a storage group by time.
Tian Jiang created IOTDB-314: Summary: Partition the data in a storage group by time. Key: IOTDB-314 URL: https://issues.apache.org/jira/browse/IOTDB-314 Project: Apache IoTDB Issue Type: Improvement Reporter: Tian Jiang In many analytic applications, reports are generated daily, weekly or monthly. If the data files are naturally partitioned by such intervals, such applications will be able to find the target data more easily. Other functionalities like daily replication or transfers also benefit from this. As a result, we should support embedded storage-group-level time partitioning in IoTDB, which allows each TsFile generated by IoTDB will not have data exceeds a configurable interval (e.g. a day). By the way, this is also the fundamental support needed by the distributed version. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (IOTDB-313) Need for new strategy of choosing directory
Dongfang Mao created IOTDB-313: -- Summary: Need for new strategy of choosing directory Key: IOTDB-313 URL: https://issues.apache.org/jira/browse/IOTDB-313 Project: Apache IoTDB Issue Type: New Feature Reporter: Dongfang Mao When usable space of one certain directory is much more than the others (when adding a new disk), all new files will be written to this directory, which is not optimal. Therefore, a new Strategy is needed here, which can randomly choose directory based on usable space. The more usable space the directory contains, the greater the chance of being chosen. -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: [VOTE] Apache IoTDB 0.9.0 (incubating) RC4 release
Hi,
+1 (PPMC vote)
The followings are successfully verified:
Source release:
1. ASC sinature
2. Hashes
3. LICENSE, NOTICE, README, RELEASE_NOTES
4. RAT
5. mvn clean package
6. start server and client
7. execute basic operations and reboot
8. python client
Binary distribution:
1. ASC sinature
2. Hashes
3. start server and client
4. execute basic operations and reboot
5. python client
Best,
Tian Jiang
| |
Tian Jiang
|
|
jt2594...@163.com
|
签名由网易邮箱大师定制
On 11/22/2019 09:44，Lei Rui wrote：
My vote is +1 (PPMC binding).
1. download staged artifacts. Check their signature and hashes.
✔ [RM] verify the reported signature is for an "apache.org" address ("gpg: Good
signature from ...")
✔ [RM] verify the reported hashes
2. extract src bundle
✔ verify the existence of LICENSE, NOTICE, README, RELEASE_NOTES files in the
extracted source bundle
✔ [RM] verify the staged source README, RELEASE_NOTE files correspond to those
in the extracted source bundle
3. staged src bundle items: content, can compile & test
✔ check the contents of LICENSE, NOTICE, README, RELEASE_NOTES
✔ UNPACK the binary artefact and check the contents of LICENSE-binary and
NOTICE-binary
✔ build from directions in README with an empty maven local repo: mvn clean
package -DskipTests -Dmaven.repo.local=../.m2
✔ [RM] review target/rat.txt (though the build should fail if RAT constraints
aren't met)
- mvn clean apache-rat:check
- Find and files containing binary content with this command: find . -type f
-name 'rat.txt' -exec grep -l " B " {} \;
- Then review for B (binary) content in those files:
grep " B " ./grafana/target/rat.txt
grep " B " ./server/target/rat.txt
I find:
B
/home/ruilei/tools/downloaded-iotdb-0.9.0rc4/0.9.0/rc4/apache-iotdb-0.9.0-incubating/grafana/img/add_data_source.png
B
/home/ruilei/tools/downloaded-iotdb-0.9.0rc4/0.9.0/rc4/apache-iotdb-0.9.0-incubating/grafana/img/edit_data_source.png
B
/home/ruilei/tools/downloaded-iotdb-0.9.0rc4/0.9.0/rc4/apache-iotdb-0.9.0-incubating/grafana/img/add_graph.png
B
/home/ruilei/tools/downloaded-iotdb-0.9.0rc4/0.9.0/rc4/apache-iotdb-0.9.0-incubating/server/src/main/resources/iotdb/ui/static/iotdb-logo.png
✔ Search for SNAPSHOT references: find . -type f -name 'pom.xml' -exec grep -l
"SNAPSHOT" {} \;
✔ ./mvnw.sh install
✔ ./mvnw.sh site:site
Best,
Lei Rui
On 11/21/2019 12:41，Jialin Qiao wrote：
Hi all,
Now I open a new ticket for Apache IoTDB (incubating) 0.9.0 RC4, which fixs
some issues comparing with RC3. You can find the details at the end of this
email.
Apache IoTDB (incubating) 0.9.0 is a major version with many exciting features.
You can get the release notes in [5].
Apache IoTDB (Incubating) 0.9.0 has been staged under [2] and it’s time to
vote on accepting it for release. All Maven artifacts are available under [1].
If approved we will seek final release approval from the IPMC.
Voting will be open for 72hr.
A minimum of 3 binding +1 votes and more binding +1 than binding -1 are
required to pass.
Release tag: release/0.9.0
Hash for the release tag: eedfec84462c0f574f9d6ade5ac53801cb3bc869
Per [3] "Before voting +1 PMC/PPMC members are required to download the
signed source code package, compile it as provided, and test the resulting
executable on their own platform, along with also verifying that the package
meets the requirements of the ASF policy on releases."
Difference with RC3:
Remove the .tsfile
You can achieve the above by following [4].
[ ] +1 accept (indicate what you validated - e.g. performed the non-RM items
in [4])
[ ] -1 reject (explanation required)
[1] https://repository.apache.org/content/repositories/orgapacheiotdb-1016
[2] https://dist.apache.org/repos/dist/dev/incubator/iotdb/0.9.0/rc4
[3] https://www.apache.org/dev/release.html#approving-a-release
[4]
https://cwiki.apache.org/confluence/display/IOTDB/Validating+a+staged+Release
[5]
https://dist.apache.org/repos/dist/dev/incubator/iotdb/0.9.0/rc4/RELEASE_NOTES.md
Thanks,
--
Jialin Qiao
School of Software, Tsinghua University
乔嘉林
清华大学 软件学院
Re: [VOTE] Apache IoTDB 0.9.0 (incubating) RC4 release
Hi, My vote is +1 (PPMC) I have checked following items: Source release: 1. Verify the existence of LICENSE, NOTICE, README, RELEASE_NOTES files in the extracted source bundle (Correct) 2. Compile and build code with command: mvn clean package. (Correct) 3. Verifying the signature (ASC) (Correct) 4. Verifying the hashes (SHA512) (Correct) 5. Running RAT(mvn apache-rat:check) (Correct) Binary distribution: 1. Verifying the signature (ASC) (Correct) 2. Verifying the hashes (SHA512) (Correct) 3. Verify the existence of LICENSE, NOTICE, README, RELEASE_NOTES files (Correct) Functionality： 1. Run server and client script: sh start-server.sh, start-client.sh -h 127.0.0.1 -p 6667 -u root -pw root (Correct) 2. REBOOT 3. Execuet some basic operations: (Correct) 1) SET STORAGE GROUP TO root.vehicle 2) CREATE TIMESERIES root.vehicle.d0.s0 WITH DATATYPE=INT32, ENCODING=RLE 3) insert into root.vehicle.d0(timestamp,s0) values(10,100) 4) insert into root.vehicle.d0(timestamp,s0) values(1,101) 5) select * from root.vehicle 6) select * from root.vehicle where time > 5 7) show timeseries 8) show timeseries root.* 9) delete from root.vehicle.d0.s0 where time < 9 10) select * from root.vehicle Best Regards, — Tianan Li School of Software, Tsinghua University 李天安 清华大学 软件学院 > 2019年11月21日 下午12:41，Jialin Qiao 写道： > > Hi all, > > > Now I open a new ticket for Apache IoTDB (incubating) 0.9.0 RC4, which fixs > some issues comparing with RC3. You can find the details at the end of this > email. > > > Apache IoTDB (incubating) 0.9.0 is a major version with many exciting > features. > You can get the release notes in [5]. > > > Apache IoTDB (Incubating) 0.9.0 has been staged under [2] and it’s time to > vote on accepting it for release. All Maven artifacts are available under > [1]. > If approved we will seek final release approval from the IPMC. > > > Voting will be open for 72hr. > > > A minimum of 3 binding +1 votes and more binding +1 than binding -1 are > required to pass. > > > Release tag: release/0.9.0 > > > Hash for the release tag: eedfec84462c0f574f9d6ade5ac53801cb3bc869 > > > Per [3] "Before voting +1 PMC/PPMC members are required to download the > signed source code package, compile it as provided, and test the resulting > executable on their own platform, along with also verifying that the package > meets the requirements of the ASF policy on releases." > > > Difference with RC3: > > > Remove the .tsfile > > > > > You can achieve the above by following [4]. > > > [ ] +1 accept (indicate what you validated - e.g. performed the non-RM items > in [4]) > [ ] -1 reject (explanation required) > > > [1] https://repository.apache.org/content/repositories/orgapacheiotdb-1016 > [2] https://dist.apache.org/repos/dist/dev/incubator/iotdb/0.9.0/rc4 > [3] https://www.apache.org/dev/release.html#approving-a-release > [4] > https://cwiki.apache.org/confluence/display/IOTDB/Validating+a+staged+Release > [5] > https://dist.apache.org/repos/dist/dev/incubator/iotdb/0.9.0/rc4/RELEASE_NOTES.md > > > Thanks, > -- > Jialin Qiao > School of Software, Tsinghua University > > > 乔嘉林 > 清华大学 软件学院
Re: [VOTE] Apache IoTDB 0.9.0 (incubating) RC3 release
Hi, +1 (PPMC vote) The followings are successfully verified: Source release: 1. ASC sinature 2. Hashes 3. LICENSE, NOTICE, README, RELEASE_NOTES 4. RAT 5. mvn clean package 6. start server and client 7. execute basic operations and reboot 8. python client Binary distribution: 1. ASC sinature 2. Hashes 3. start server and client 4. execute basic operations and reboot 5. python client Best, Tian Jiang | | Tian Jiang | | jt2594...@163.com | 签名由网易邮箱大师定制 On 11/21/2019 19:07，Jialin Qiao wrote： Hi, I created two issues for these suggestions: https://issues.apache.org/jira/browse/IOTDB-311 : generate anything in test to target folder https://issues.apache.org/jira/browse/IOTDB-312 : polish our source release plugin Thanks, -- Jialin Qiao School of Software, Tsinghua University 乔嘉林 清华大学 软件学院 -原始邮件- 发件人: "Christofer Dutz" 发送时间: 2019-11-21 17:45:38 (星期四) 收件人: "dev@iotdb.apache.org" 抄送: 主题: Re: [VOTE] Apache IoTDB 0.9.0 (incubating) RC3 release That's one of the reasons why it' a best practice to generate anything in unit/integration-tests to the target directory. Chris Am 21.11.19, 03:05 schrieb "Xiangdong Huang" : Hi, Sorry I want to -1 "./tsfile/read_write_rle.tsfile" is not needed, it is generated by some UT. This file is to large, ~40MB, that is why I want to -1. Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Justin Mclean 于2019年11月21日周四 上午9:34写道： Hi, +1 (binding) I checked: - incubating in name - signature and hash fine - DISCLAIMER exists - LICENSE and NOTICE good - no unexpected binary files in course release, although there is this [1] is this needed? - all ASF files have ASF source headers - can compile from source Thanks, Justin 1. ./tsfile/read_write_rle.tsfile
Re: [VOTE] Apache IoTDB 0.9.0 (incubating) RC4 release
My vote is +1 (PPMC binding).
1. download staged artifacts. Check their signature and hashes.
✔ [RM] verify the reported signature is for an "apache.org" address ("gpg: Good
signature from ...")
✔ [RM] verify the reported hashes
2. extract src bundle
✔ verify the existence of LICENSE, NOTICE, README, RELEASE_NOTES files in the
extracted source bundle
✔ [RM] verify the staged source README, RELEASE_NOTE files correspond to those
in the extracted source bundle
3. staged src bundle items: content, can compile & test
✔ check the contents of LICENSE, NOTICE, README, RELEASE_NOTES
✔ UNPACK the binary artefact and check the contents of LICENSE-binary and
NOTICE-binary
✔ build from directions in README with an empty maven local repo: mvn clean
package -DskipTests -Dmaven.repo.local=../.m2
✔ [RM] review target/rat.txt (though the build should fail if RAT constraints
aren't met)
- mvn clean apache-rat:check
- Find and files containing binary content with this command: find .
-type f -name 'rat.txt' -exec grep -l " B " {} \;
- Then review for B (binary) content in those files:
grep " B " ./grafana/target/rat.txt
grep " B " ./server/target/rat.txt
I find:
B
/home/ruilei/tools/downloaded-iotdb-0.9.0rc4/0.9.0/rc4/apache-iotdb-0.9.0-incubating/grafana/img/add_data_source.png
B
/home/ruilei/tools/downloaded-iotdb-0.9.0rc4/0.9.0/rc4/apache-iotdb-0.9.0-incubating/grafana/img/edit_data_source.png
B
/home/ruilei/tools/downloaded-iotdb-0.9.0rc4/0.9.0/rc4/apache-iotdb-0.9.0-incubating/grafana/img/add_graph.png
B
/home/ruilei/tools/downloaded-iotdb-0.9.0rc4/0.9.0/rc4/apache-iotdb-0.9.0-incubating/server/src/main/resources/iotdb/ui/static/iotdb-logo.png
✔ Search for SNAPSHOT references: find . -type f -name 'pom.xml' -exec grep -l
"SNAPSHOT" {} \;
✔ ./mvnw.sh install
✔ ./mvnw.sh site:site
Best,
Lei Rui
On 11/21/2019 12:41，Jialin Qiao wrote：
Hi all,
Now I open a new ticket for Apache IoTDB (incubating) 0.9.0 RC4, which fixs
some issues comparing with RC3. You can find the details at the end of this
email.
Apache IoTDB (incubating) 0.9.0 is a major version with many exciting features.
You can get the release notes in [5].
Apache IoTDB (Incubating) 0.9.0 has been staged under [2] and it’s time to
vote on accepting it for release. All Maven artifacts are available under [1].
If approved we will seek final release approval from the IPMC.
Voting will be open for 72hr.
A minimum of 3 binding +1 votes and more binding +1 than binding -1 are
required to pass.
Release tag: release/0.9.0
Hash for the release tag: eedfec84462c0f574f9d6ade5ac53801cb3bc869
Per [3] "Before voting +1 PMC/PPMC members are required to download the
signed source code package, compile it as provided, and test the resulting
executable on their own platform, along with also verifying that the package
meets the requirements of the ASF policy on releases."
Difference with RC3:
Remove the .tsfile
You can achieve the above by following [4].
[ ] +1 accept (indicate what you validated - e.g. performed the non-RM items
in [4])
[ ] -1 reject (explanation required)
[1] https://repository.apache.org/content/repositories/orgapacheiotdb-1016
[2] https://dist.apache.org/repos/dist/dev/incubator/iotdb/0.9.0/rc4
[3] https://www.apache.org/dev/release.html#approving-a-release
[4]
https://cwiki.apache.org/confluence/display/IOTDB/Validating+a+staged+Release
[5]
https://dist.apache.org/repos/dist/dev/incubator/iotdb/0.9.0/rc4/RELEASE_NOTES.md
Thanks,
--
Jialin Qiao
School of Software, Tsinghua University
乔嘉林
清华大学 软件学院
Podling Iotdb Report Reminder - December 2019
Dear podling, This email was sent by an automated system on behalf of the Apache Incubator PMC. It is an initial reminder to give you plenty of time to prepare your quarterly board report. The board meeting is scheduled for Wed, 18 December 2019, 10:30 am PDT. The report for your podling will form a part of the Incubator PMC report. The Incubator PMC requires your report to be submitted 2 weeks before the board meeting, to allow sufficient time for review and submission (Wed, December 04). Please submit your report with sufficient time to allow the Incubator PMC, and subsequently board members to review and digest. Again, the very latest you should submit your report is 2 weeks prior to the board meeting. Candidate names should not be made public before people are actually elected, so please do not include the names of potential committers or PPMC members in your report. Thanks, The Apache Incubator PMC Submitting your Report -- Your report should contain the following: * Your project name * A brief description of your project, which assumes no knowledge of the project or necessarily of its field * A list of the three most important issues to address in the move towards graduation. * Any issues that the Incubator PMC or ASF Board might wish/need to be aware of * How has the community developed since the last report * How has the project developed since the last report. * How does the podling rate their own maturity. This should be appended to the Incubator Wiki page at: https://cwiki.apache.org/confluence/display/INCUBATOR/December2019 Note: This is manually populated. You may need to wait a little before this page is created from a template. Note: The format of the report has changed to use markdown. Mentors --- Mentors should review reports for their project(s) and sign them off on the Incubator wiki page. Signing off reports shows that you are following the project - projects that are not signed may raise alarms for the Incubator PMC. Incubator PMC
Re: How to add a "search" function on the website for retrievaling documents
I think you could do this as a simple interim solution: https://support.google.com/customsearch/answer/4513903?hl=en On Thu, Nov 21, 2019, 00:12 Xiangdong Huang wrote: > Hi, > > Can our website support search content among the documents? Is that > possible and easy to do technically? > > E.g., if I want to find out how to set the TTL (because it is a new feature > and I just know that we have the function but I didn't used it), a search > button will help me a lot. > > Best, > --- > Xiangdong Huang > School of Software, Tsinghua University > > 黄向东 > 清华大学 软件学院 >
Re: [VOTE] Apache IoTDB 0.9.0 (incubating) RC3 release
Hi, I created two issues for these suggestions: https://issues.apache.org/jira/browse/IOTDB-311 : generate anything in test to target folder https://issues.apache.org/jira/browse/IOTDB-312 : polish our source release plugin Thanks, -- Jialin Qiao School of Software, Tsinghua University 乔嘉林 清华大学 软件学院 > -原始邮件- > 发件人: "Christofer Dutz" > 发送时间: 2019-11-21 17:45:38 (星期四) > 收件人: "dev@iotdb.apache.org" > 抄送: > 主题: Re: [VOTE] Apache IoTDB 0.9.0 (incubating) RC3 release > > That's one of the reasons why it' a best practice to generate anything in > unit/integration-tests to the target directory. > > Chris > > Am 21.11.19, 03:05 schrieb "Xiangdong Huang" : > > Hi, > > Sorry I want to -1 > > "./tsfile/read_write_rle.tsfile" is not needed, it is generated by some > UT. > This file is to large, ~40MB, that is why I want to -1. > > Best, > --- > Xiangdong Huang > School of Software, Tsinghua University > > 黄向东 > 清华大学 软件学院 > > > Justin Mclean 于2019年11月21日周四 上午9:34写道： > > > Hi, > > > > +1 (binding) > > > > I checked: > > - incubating in name > > - signature and hash fine > > - DISCLAIMER exists > > - LICENSE and NOTICE good > > - no unexpected binary files in course release, although there is this > [1] > > is this needed? > > - all ASF files have ASF source headers > > - can compile from source > > > > Thanks, > > Justin > > > > 1. ./tsfile/read_write_rle.tsfile > >
Re: [VOTE] Apache IoTDB 0.9.0 (incubating) RC3 release
That's one of the reasons why it' a best practice to generate anything in unit/integration-tests to the target directory. Chris Am 21.11.19, 03:05 schrieb "Xiangdong Huang" : Hi, Sorry I want to -1 "./tsfile/read_write_rle.tsfile" is not needed, it is generated by some UT. This file is to large, ~40MB, that is why I want to -1. Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Justin Mclean 于2019年11月21日周四 上午9:34写道： > Hi, > > +1 (binding) > > I checked: > - incubating in name > - signature and hash fine > - DISCLAIMER exists > - LICENSE and NOTICE good > - no unexpected binary files in course release, although there is this [1] > is this needed? > - all ASF files have ASF source headers > - can compile from source > > Thanks, > Justin > > 1. ./tsfile/read_write_rle.tsfile
Re: [VOTE] Apache IoTDB 0.9.0 (incubating) RC3 release
yeah, we need to polish our release setting to avoid this kind of issue. Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Thu, Nov 21, 2019 at 12:47 PM Jialin Qiao wrote: > > Hi, > > In case of that .tsfile. I would like to close this voting. A new voting for > RC4 is opened. Sorry for causing trouble. > It is generated due to an interruption of "mvn release:prepare", which > terminate some test that generates the file. > We could add some exclusion rules to the assembly plugin for the source > release, in the 0.9.1 version... > > Thanks, > -- > Jialin Qiao > School of Software, Tsinghua University > > 乔嘉林 > 清华大学 软件学院 > > > -原始邮件- > > 发件人: "Xiangdong Huang" > > 发送时间: 2019-11-21 10:38:07 (星期四) > > 收件人: dev@iotdb.apache.org > > 抄送: > > 主题: Re: [VOTE] Apache IoTDB 0.9.0 (incubating) RC3 release > > > > Hi, > > > > I have no other issues. look forward to rc4. > > > > - signature and hash fine > > - DISCLAIMER exists > > - LICENSE and NOTICE ok for me > > - all ASF files have ASF source headers > > - can compile from source > > > > Best, > > --- > > Xiangdong Huang > > School of Software, Tsinghua University > > > > 黄向东 > > 清华大学 软件学院 > > > > > > Kevin A. McGrail 于2019年11月21日周四 上午10:07写道： > > > > > Any other issues that you see? That way we can streamline an rc4. > > > > > > On Wed, Nov 20, 2019, 21:05 Xiangdong Huang wrote: > > > > > > > Hi, > > > > > > > > Sorry I want to -1 > > > > > > > > "./tsfile/read_write_rle.tsfile" is not needed, it is generated by some > > > UT. > > > > This file is to large, ~40MB, that is why I want to -1. > > > > > > > > Best, > > > > --- > > > > Xiangdong Huang > > > > School of Software, Tsinghua University > > > > > > > > 黄向东 > > > > 清华大学 软件学院 > > > > > > > > > > > > Justin Mclean 于2019年11月21日周四 上午9:34写道： > > > > > > > > > Hi, > > > > > > > > > > +1 (binding) > > > > > > > > > > I checked: > > > > > - incubating in name > > > > > - signature and hash fine > > > > > - DISCLAIMER exists > > > > > - LICENSE and NOTICE good > > > > > - no unexpected binary files in course release, although there is this > > > > [1] > > > > > is this needed? > > > > > - all ASF files have ASF source headers > > > > > - can compile from source > > > > > > > > > > Thanks, > > > > > Justin > > > > > > > > > > 1. ./tsfile/read_write_rle.tsfile > > > > > > >
