[GitHub] [orc] dongjoon-hyun merged pull request #906: ORC-993: Bump junit.version from 5.7.2 to 5.8.0
dongjoon-hyun merged pull request #906: URL: https://github.com/apache/orc/pull/906 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@orc.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (ORC-993) Bump junit.version from 5.7.2 to 5.8.0
Dongjoon Hyun created ORC-993: - Summary: Bump junit.version from 5.7.2 to 5.8.0 Key: ORC-993 URL: https://issues.apache.org/jira/browse/ORC-993 Project: ORC Issue Type: Improvement Components: Java Affects Versions: 1.8.0 Reporter: Dongjoon Hyun -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [orc] guiyanakuang opened a new pull request #907: ORC-992: Reached max repeat length, we can directly decide to use DELTA encoding
guiyanakuang opened a new pull request #907: URL: https://github.com/apache/orc/pull/907 ### What changes were proposed in this pull request? Reached max repeat length, we can directly decide to use DELTA encoding. The computeZigZagLiterals, zzBits100p, and determine isFixedDelta within the determineEncoding method are all redundant in the current case. Similar practices. RunLengthIntegerWriterV2.java 767-775 ```java if (fixedRunLength >= MIN_REPEAT) { if (fixedRunLength <= MAX_SHORT_REPEAT_LENGTH) { encoding = EncodingType.SHORT_REPEAT; } else { encoding = EncodingType.DELTA; isFixedDelta = true; } writeValues(); } ``` ### Why are the changes needed? Optimization for reached max repeat length. ### How was this patch tested? Pass the CIs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@orc.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (ORC-992) Reached max repeat length, we can directly decide to use DELTA encoding
Yiqun Zhang created ORC-992: --- Summary: Reached max repeat length, we can directly decide to use DELTA encoding Key: ORC-992 URL: https://issues.apache.org/jira/browse/ORC-992 Project: ORC Issue Type: Improvement Components: Java Affects Versions: 1.7.0 Reporter: Yiqun Zhang Fix For: 1.7.0 Reached max repeat length, we can directly decide to use DELTA encoding. RunLengthIntegerWriterV2.java 756-760 {code:java} // if fixed runs reached max repeat length then write values if (fixedRunLength == MAX_SCOPE) { determineEncoding(); writeValues(); } {code} If fixed runs reached max repeat length. We have been able to determine the use of the DELTA code, fixedDelta is zero. The computeZigZagLiterals, zzBits100p, and determine isFixedDelta within the determineEncoding method are all redundant in the current case. Similar practices. RunLengthIntegerWriterV2.java 767-775 {code:java} if (fixedRunLength >= MIN_REPEAT) { if (fixedRunLength <= MAX_SHORT_REPEAT_LENGTH) { encoding = EncodingType.SHORT_REPEAT; } else { encoding = EncodingType.DELTA; isFixedDelta = true; } writeValues(); } {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: [VOTE] Release Apache ORC 1.6.11 (RC0)
+1 1. Shasum and gpg sig checked. 2. Built and ran the C++/Java tests (including tools/example/bench) from the source Test project /Users/dongjoon/RC/orc-1.6.11/build Start 1: orc-test 1/7 Test #1: orc-test . Passed4.06 sec Start 2: java-test 2/7 Test #2: java-test Passed 60.54 sec Start 3: java-examples-test 3/7 Test #3: java-examples-test ... Passed0.67 sec Start 4: java-tools-test 4/7 Test #4: java-tools-test .. Passed0.23 sec Start 5: java-bench-gen-test 5/7 Test #5: java-bench-gen-test .. Passed1.48 sec Start 6: java-bench-scan-test 6/7 Test #6: java-bench-scan-test . Passed1.32 sec Start 7: tool-test 7/7 Test #7: tool-test Passed 12.97 sec 100% tests passed, 0 tests failed out of 7 3. Docker tests passed. (on the branch-1.6) 4. Apache Spark integration test passed (RC0 staging + Spark 3.3.0-SNAPSHOT) https://github.com/apache/spark/pull/33971 Dongjoon On 2021/09/13 03:04:54, Dongjoon Hyun wrote: > Please vote on releasing the following candidate as Apache ORC version > 1.6.11. > > [ ] +1 Release this package as Apache ORC 1.6.11 > [ ] -1 Do not release this package because ... > > TAG: > https://github.com/apache/orc/releases/tag/release-1.6.11rc0 > > RELEASE FILES: > https://dist.apache.org/repos/dist/dev/orc/orc-1.6.11-rc0 > > STAGING REPOSITORY: > https://repository.apache.org/content/repositories/orgapacheorc-1049 > > LIST OF JIRA ISSUES: > https://issues.apache.org/jira/projects/ORC/versions/12350499 > > This vote will be open for 72 hours. > > Thanks, > Dongjoon. >
Re: [VOTE] Release Apache ORC 1.5.13 (RC0)
+1 1. Shasum and gpg sig checked. 2. Built and ran the C++/Java unit tests. 3. Tested Java tools uber jar manually. 4. Tested Java example uber jar manually. 5. Apache Spark integration test passed (RC0 staging + Spark 3.1.3-SNAPSHOT) https://github.com/apache/spark/pull/33972 Dongjoon On 2021/09/13 03:53:54, Dongjoon Hyun wrote: > Please vote on releasing the following candidate as Apache ORC version > 1.5.13. > > [ ] +1 Release this package as Apache ORC 1.5.13 > [ ] -1 Do not release this package because ... > > TAG: > https://github.com/apache/orc/releases/tag/release-1.5.13rc0 > > RELEASE FILES: > https://dist.apache.org/repos/dist/dev/orc/orc-1.5.13-rc0 > > STAGING REPOSITORY: > https://repository.apache.org/content/repositories/orgapacheorc-1050 > > LIST OF JIRA ISSUES: > https://issues.apache.org/jira/projects/ORC/versions/12349322 > > This vote will be open for 72 hours. > > Thanks, > Dongjoon. >