[VOTE] Release Apache Parquet Format 2.4.0 RC1

2017-10-16 Thread Ryan Blue
Hi everyone, I propose the following RC to be released as official Apache Parquet Format 2.4.0 release. The commit id is 3fb6b391db7f369de8b4114ae071f5725db7247c - This corresponds to the tag: apache-parquet-format-2.4.0 - https://github.com/apache/parquet-format/tree/3fb6b39 -

[jira] [Updated] (PARQUET-1032) Change link in Encodings.md for variable length encoding

2017-10-16 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated PARQUET-1032: --- Fix Version/s: (was: format-2.3.2) format-2.4.0 > Change link in

[jira] [Updated] (PARQUET-1091) Wrong and broken links in README

2017-10-16 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated PARQUET-1091: --- Fix Version/s: (was: format-2.3.2) format-2.4.0 > Wrong and broken links in

[jira] [Updated] (PARQUET-1049) Make thrift version a property in pom.xml

2017-10-16 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated PARQUET-1049: --- Fix Version/s: (was: format-2.3.2) format-2.4.0 > Make thrift version a

[jira] [Updated] (PARQUET-1050) The comment of Parquet Format Thrift definition file error

2017-10-16 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated PARQUET-1050: --- Fix Version/s: (was: format-2.3.2) format-2.4.0 > The comment of Parquet

[jira] [Updated] (PARQUET-1076) [Format] Switch to long key ids in KEYs file

2017-10-16 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated PARQUET-1076: --- Fix Version/s: (was: format-2.3.2) format-2.4.0 > [Format] Switch to long

[jira] [Updated] (PARQUET-609) Add Brotli compression to Parquet format

2017-10-16 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated PARQUET-609: -- Fix Version/s: (was: format-2.3.2) format-2.4.0 > Add Brotli compression to

[jira] [Updated] (PARQUET-322) Document ENUM as a logical type

2017-10-16 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated PARQUET-322: -- Fix Version/s: (was: format-2.3.2) format-2.4.0 > Document ENUM as a logical

[jira] [Updated] (PARQUET-255) Typo in decimal type specification

2017-10-16 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated PARQUET-255: -- Fix Version/s: (was: format-2.3.2) > Typo in decimal type specification >

[jira] [Updated] (PARQUET-1125) Add UUID logical type

2017-10-16 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated PARQUET-1125: --- Fix Version/s: format-2.4.0 > Add UUID logical type > - > >

[jira] [Updated] (PARQUET-1102) Travis CI builds are failing for parquet-format PRs

2017-10-16 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated PARQUET-1102: --- Fix Version/s: (was: format-2.3.2) format-2.4.0 > Travis CI builds are

[jira] [Updated] (PARQUET-1124) Add new compression codecs to the Parquet spec

2017-10-16 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated PARQUET-1124: --- Fix Version/s: (was: format-2.3.2) format-2.4.0 > Add new compression codecs

[jira] [Resolved] (PARQUET-922) Add index pages to the format to support efficient page skipping

2017-10-16 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue resolved PARQUET-922. --- Resolution: Fixed Fix Version/s: format-2.4.0 Merged format PR #72. Thanks for getting this

[jira] [Commented] (PARQUET-1065) Deprecate type-defined sort ordering for INT96 type

2017-10-16 Thread Deepak Majeti (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206424#comment-16206424 ] Deepak Majeti commented on PARQUET-1065: If we treat Int96 as a primitive data type, then we

[jira] [Resolved] (PARQUET-1138) [C++] Fix compilation with Arrow 0.7.1

2017-10-16 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-1138. -- Resolution: Fixed Issue resolved by pull request 410

[jira] [Commented] (PARQUET-1139) Add license to cmake_modules/parquet-cppConfig.cmake.in

2017-10-16 Thread Lars Volker (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206350#comment-16206350 ] Lars Volker commented on PARQUET-1139: -- https://github.com/apache/parquet-cpp/pull/411 > Add

[jira] [Updated] (PARQUET-1139) Add license to cmake_modules/parquet-cppConfig.cmake.in

2017-10-16 Thread Lars Volker (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Volker updated PARQUET-1139: - Affects Version/s: cpp-1.3.0 > Add license to cmake_modules/parquet-cppConfig.cmake.in >

[jira] [Updated] (PARQUET-1140) [C++] Fail on RAT errors in CI

2017-10-16 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn updated PARQUET-1140: - Fix Version/s: (was: cpp-1.4.0) cpp-1.3.1 > [C++] Fail on RAT errors in

[jira] [Assigned] (PARQUET-1140) [C++] Fail on RAT errors in CI

2017-10-16 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn reassigned PARQUET-1140: Assignee: Uwe L. Korn > [C++] Fail on RAT errors in CI > --

[jira] [Updated] (PARQUET-1140) [C++] Fail on RAT errors in CI

2017-10-16 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn updated PARQUET-1140: - Summary: [C++] Fail on RAT errors in CI (was: [C++] Run RAT checks in CI) > [C++] Fail on RAT

Re: [VOTE] Release Apache Parquet C++ 1.3.1 RC0

2017-10-16 Thread Uwe L. Korn
I will cancel the release and post a new one once the PRs are merged. I'm a bit confused though why the CI has not catched this, we have an automatic RAT check in our chain: https://github.com/apache/parquet-cpp/blob/master/ci/travis_script_cpp.sh#L20 On Mon, Oct 16, 2017, at 07:23 PM, Ryan

Re: [VOTE] Release Apache Parquet C++ 1.3.1 RC0

2017-10-16 Thread Ryan Blue
I agree that we should have a new RC. All files that can have license headers should have them. On Mon, Oct 16, 2017 at 10:16 AM, Lars Volker wrote: > I think it'd be good to create a new RC, but I don't feel strongly about it > and my vote is non-binding. Maybe someone with

Re: [VOTE] Release Apache Parquet C++ 1.3.1 RC0

2017-10-16 Thread Lars Volker
I think it'd be good to create a new RC, but I don't feel strongly about it and my vote is non-binding. Maybe someone with more experience in the strictness that's expected from ASF projects can weigh in. On Mon, Oct 16, 2017 at 10:08 AM, Wes McKinney wrote: > Thanks Lars

[jira] [Commented] (PARQUET-1140) [C++] Run RAT checks in CI

2017-10-16 Thread Lars Volker (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206226#comment-16206226 ] Lars Volker commented on PARQUET-1140: -- parquet-format also runs RAT, see there for another

Re: [VOTE] Release Apache Parquet C++ 1.3.1 RC0

2017-10-16 Thread Wes McKinney
Thanks Lars for catching that. I also created about PARQUET-1140 so we can be more vigilant about RAT issues. Do we need an RC1? On Mon, Oct 16, 2017 at 12:54 PM, Lars Volker wrote: > 0 (non-binding) > > * Verified the sha512 sum > * Verified the .asc and that it matches

[jira] [Created] (PARQUET-1140) [C++] Run RAT checks in CI

2017-10-16 Thread Wes McKinney (JIRA)
Wes McKinney created PARQUET-1140: - Summary: [C++] Run RAT checks in CI Key: PARQUET-1140 URL: https://issues.apache.org/jira/browse/PARQUET-1140 Project: Parquet Issue Type: Improvement

Re: [VOTE] Release Apache Parquet C++ 1.3.1 RC0

2017-10-16 Thread Lars Volker
0 (non-binding) * Verified the sha512 sum * Verified the .asc and that it matches Uwe's key * Built and ran the unittests manually on macOS Sierra * Ran the rat tool over the tarball. All warnings looked expected to me except for apache-parquet-cpp-1.3.1/cmake_modules/parquet-cppConfig.cmake.in,

[jira] [Created] (PARQUET-1139) Add license to cmake_modules/parquet-cppConfig.cmake.in

2017-10-16 Thread Lars Volker (JIRA)
Lars Volker created PARQUET-1139: Summary: Add license to cmake_modules/parquet-cppConfig.cmake.in Key: PARQUET-1139 URL: https://issues.apache.org/jira/browse/PARQUET-1139 Project: Parquet

[jira] [Comment Edited] (PARQUET-1065) Deprecate type-defined sort ordering for INT96 type

2017-10-16 Thread Zoltan Ivanfi (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205986#comment-16205986 ] Zoltan Ivanfi edited comment on PARQUET-1065 at 10/16/17 3:59 PM: --

[jira] [Comment Edited] (PARQUET-1065) Deprecate type-defined sort ordering for INT96 type

2017-10-16 Thread Zoltan Ivanfi (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205986#comment-16205986 ] Zoltan Ivanfi edited comment on PARQUET-1065 at 10/16/17 3:57 PM: --

[jira] [Comment Edited] (PARQUET-1065) Deprecate type-defined sort ordering for INT96 type

2017-10-16 Thread Zoltan Ivanfi (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205986#comment-16205986 ] Zoltan Ivanfi edited comment on PARQUET-1065 at 10/16/17 3:56 PM: --

[jira] [Commented] (PARQUET-1065) Deprecate type-defined sort ordering for INT96 type

2017-10-16 Thread Zoltan Ivanfi (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205986#comment-16205986 ] Zoltan Ivanfi commented on PARQUET-1065: Unfortunately, since INT96 timestamps are stored in

Re: [VOTE] Release Apache Parquet C++ 1.3.1 RC0

2017-10-16 Thread Uwe L. Korn
+1 * Ran verify-release-candidate on Ubuntu 16.04 * Ran verify-release-candidate on macOS Sierra -- Uwe L. Korn uw...@xhochy.com On Mon, Oct 16, 2017, at 02:16 AM, Wes McKinney wrote: > +1 > > * Ran verify-release-candidate on Ubuntu 14.04 > > In trying to verify the release candidate