[GitHub] [orc] dongjoon-hyun merged pull request #906: ORC-993: Bump junit.version from 5.7.2 to 5.8.0

2021-09-13 Thread GitBox


dongjoon-hyun merged pull request #906:
URL: https://github.com/apache/orc/pull/906


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@orc.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Created] (ORC-993) Bump junit.version from 5.7.2 to 5.8.0

2021-09-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created ORC-993:
-

 Summary: Bump junit.version from 5.7.2 to 5.8.0
 Key: ORC-993
 URL: https://issues.apache.org/jira/browse/ORC-993
 Project: ORC
  Issue Type: Improvement
  Components: Java
Affects Versions: 1.8.0
Reporter: Dongjoon Hyun






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [orc] guiyanakuang opened a new pull request #907: ORC-992: Reached max repeat length, we can directly decide to use DELTA encoding

2021-09-13 Thread GitBox


guiyanakuang opened a new pull request #907:
URL: https://github.com/apache/orc/pull/907


   
   
   ### What changes were proposed in this pull request?
   
   Reached max repeat length, we can directly decide to use DELTA encoding.
   The computeZigZagLiterals, zzBits100p, and determine isFixedDelta within the 
determineEncoding method are all redundant in the current case.
   
   Similar practices.
   RunLengthIntegerWriterV2.java 767-775
   ```java
 if (fixedRunLength >= MIN_REPEAT) {
   if (fixedRunLength <= MAX_SHORT_REPEAT_LENGTH) {
 encoding = EncodingType.SHORT_REPEAT;
   } else {
 encoding = EncodingType.DELTA;
 isFixedDelta = true;
   }
   writeValues();
 }
   ```
   
   ### Why are the changes needed?
   
   Optimization for reached max repeat length.
   
   ### How was this patch tested?
   
   Pass the CIs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@orc.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Created] (ORC-992) Reached max repeat length, we can directly decide to use DELTA encoding

2021-09-13 Thread Yiqun Zhang (Jira)
Yiqun Zhang created ORC-992:
---

 Summary: Reached max repeat length, we can directly decide to use 
DELTA encoding
 Key: ORC-992
 URL: https://issues.apache.org/jira/browse/ORC-992
 Project: ORC
  Issue Type: Improvement
  Components: Java
Affects Versions: 1.7.0
Reporter: Yiqun Zhang
 Fix For: 1.7.0


Reached max repeat length, we can directly decide to use DELTA encoding.
RunLengthIntegerWriterV2.java  756-760
{code:java}
  // if fixed runs reached max repeat length then write values
  if (fixedRunLength == MAX_SCOPE) {
determineEncoding();
writeValues();
  }
{code}
If fixed runs reached max repeat length. We have been able to determine the use 
of the DELTA code, fixedDelta is zero. 

The computeZigZagLiterals, zzBits100p, and determine isFixedDelta within the 
determineEncoding method are all redundant in the current case.

Similar practices.
RunLengthIntegerWriterV2.java  767-775

{code:java}
  if (fixedRunLength >= MIN_REPEAT) {
if (fixedRunLength <= MAX_SHORT_REPEAT_LENGTH) {
  encoding = EncodingType.SHORT_REPEAT;
} else {
  encoding = EncodingType.DELTA;
  isFixedDelta = true;
}
writeValues();
  }
{code}





--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: [VOTE] Release Apache ORC 1.6.11 (RC0)

2021-09-13 Thread Dongjoon Hyun
+1

1. Shasum and gpg sig checked.
2. Built and ran the C++/Java tests (including tools/example/bench) from the 
source

Test project /Users/dongjoon/RC/orc-1.6.11/build
Start 1: orc-test
1/7 Test #1: orc-test .   Passed4.06 sec
Start 2: java-test
2/7 Test #2: java-test    Passed   60.54 sec
Start 3: java-examples-test
3/7 Test #3: java-examples-test ...   Passed0.67 sec
Start 4: java-tools-test
4/7 Test #4: java-tools-test ..   Passed0.23 sec
Start 5: java-bench-gen-test
5/7 Test #5: java-bench-gen-test ..   Passed1.48 sec
Start 6: java-bench-scan-test
6/7 Test #6: java-bench-scan-test .   Passed1.32 sec
Start 7: tool-test
7/7 Test #7: tool-test    Passed   12.97 sec

100% tests passed, 0 tests failed out of 7

3. Docker tests passed. (on the branch-1.6)
4. Apache Spark integration test passed
   (RC0 staging + Spark 3.3.0-SNAPSHOT)
   https://github.com/apache/spark/pull/33971

Dongjoon

On 2021/09/13 03:04:54, Dongjoon Hyun  wrote: 
> Please vote on releasing the following candidate as Apache ORC version
> 1.6.11.
> 
> [ ] +1 Release this package as Apache ORC 1.6.11
> [ ] -1 Do not release this package because ...
> 
> TAG:
> https://github.com/apache/orc/releases/tag/release-1.6.11rc0
> 
> RELEASE FILES:
> https://dist.apache.org/repos/dist/dev/orc/orc-1.6.11-rc0
> 
> STAGING REPOSITORY:
> https://repository.apache.org/content/repositories/orgapacheorc-1049
> 
> LIST OF JIRA ISSUES:
> https://issues.apache.org/jira/projects/ORC/versions/12350499
> 
> This vote will be open for 72 hours.
> 
> Thanks,
> Dongjoon.
> 


Re: [VOTE] Release Apache ORC 1.5.13 (RC0)

2021-09-13 Thread Dongjoon Hyun
+1

1. Shasum and gpg sig checked.
2. Built and ran the C++/Java unit tests.
3. Tested Java tools uber jar manually.
4. Tested Java example uber jar manually.
5. Apache Spark integration test passed
   (RC0 staging + Spark 3.1.3-SNAPSHOT)
   https://github.com/apache/spark/pull/33972

Dongjoon

On 2021/09/13 03:53:54, Dongjoon Hyun  wrote: 
> Please vote on releasing the following candidate as Apache ORC version
> 1.5.13.
> 
> [ ] +1 Release this package as Apache ORC 1.5.13
> [ ] -1 Do not release this package because ...
> 
> TAG:
> https://github.com/apache/orc/releases/tag/release-1.5.13rc0
> 
> RELEASE FILES:
> https://dist.apache.org/repos/dist/dev/orc/orc-1.5.13-rc0
> 
> STAGING REPOSITORY:
> https://repository.apache.org/content/repositories/orgapacheorc-1050
> 
> LIST OF JIRA ISSUES:
> https://issues.apache.org/jira/projects/ORC/versions/12349322
> 
> This vote will be open for 72 hours.
> 
> Thanks,
> Dongjoon.
>