Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Andrew Palumbo]

SGTM.  Happy to.

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Kouhei Sutou]

Hi,

> I was verifying RC2.  Seems that commit was not included in RC2.
> 
> ~/arrow$ git log | grep be663c14637b2bdfef935946b6e91b6317219332
> ~/arrow$
> 
> So maybe this is the culprit?

Yes. The commit was pushed after RC2.


Thanks for verifying RC2. We'll release RC3. I hope that
you verify RC3 too.


--
kou

In 

  "Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Tue, 15 Jan 2019 
17:42:57 +,
  Andrew Palumbo  wrote:

> Wes,
> /tmp doesnt seem to be the issue.  it seems this machine has ~295 G. (I'll 
> try to eye-verify that there is not some massive memory leak a bit later, 
> seems unlikely though).
> 
> ~$ df -Th /tmp
> Filesystem Type  Size  Used Avail Use% Mounted on
> /dev/xvda1 ext4  291G  4.6G  287G   2% /
> 
> 
> 
> 
> Kouhei,
> I was verifying RC2.  Seems that commit was not included in RC2.
> 
> ~/arrow$ git log | grep be663c14637b2bdfef935946b6e91b6317219332
> ~/arrow$
> 
> 
> So maybe this is the culprit?
> 
> 
> 
> 
> I see that this commit is in master (from my local after a `git pull origin 
> master`):
> 
> $ git log | grep -A20 be663c14637b2bdfef935946b6e91b6317219332
> commit be663c14637b2bdfef935946b6e91b6317219332
> Author: Kouhei Sutou 
> Date:   Sun Jan 13 11:14:51 2019 +0100
> 
> ARROW-4247: [Release] Update verify script for 0.12.0
> 
>   * C++: -DARROW_GPU -> -DARROW_CUDA
>   * C++: Enable Gandiva
>   * C++: default: -DARROW_BUILD_TESTS=ON -> OFF
>   * Ruby: red-plasma, red-gandiva and red-parquet are added
>   * Rust: The top-level Cargo.toml is a virtual manifest
> 
> Author: Kouhei Sutou 
> 
> Closes #3389 from kou/release-update-verify-script and squashes the 
> following commits:
> 
> f019a3fc   Update verify script for 0.12.0
> 
> 
> Thanks Very Much,
> 
> Andy
> 
> 
> From: Wes McKinney 
> Sent: Tuesday, January 15, 2019 12:47 AM
> To: dev@arrow.apache.org
> Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
> 
> I'm working on getting ARROW-4258 merged right now. ARROW-4260 also
> should be fixed before another RC is cut
> 
> https://issues.apache.org/jira/browse/ARROW-4260
> 
> On Mon, Jan 14, 2019 at 11:36 PM Kouhei Sutou  wrote:
>>
>> Hi,
>>
>> Does your verify-release-candidate.sh include
>> https://github.com/apache/arrow/commit/be663c14637b2bdfef935946b6e91b6317219332
>> ?
>>
>> arrow-json-integration-test needs -DARROW_BUILD_TESTS=ON.
>>
>>
>> Thanks,
>> --
>> kou
>>
>> In 
>> 
>>   "Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Tue, 15 Jan 2019 
>> 02:30:13 +,
>>   Andrew Palumbo  wrote:
>>
>> > After following all setup and install steps from: 
>> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> >
>> >
>> > apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ 
>> > verify-release-candidate.sh source 0.12.0 2
>> >
>> >
>> >
>> > fails with this stack trace:
>> >
>> >
>> >
>> >
>> > #
>> > C++ producing, C++ consuming
>> > ##
>> > ==
>> > Testing file 
>> > /tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
>> > ==
>> > -- Creating binary inputs
>> > Traceback (most recent call last):
>> >   File "integration_test.py", line 1216, in 
>> > run_all_tests(debug=args.debug, tempdir=args.tempdir)
>> >   File "integration_test.py", line 1179, in run_all_tests
>> > runner.run()
>> >   File "integration_test.py", line 937, in run
>> > self._compare_implementations(producer, consumer)
>> >   File "integration_test.py", line 959, in _compare_implementations
>> > producer.json_to_file(json_path, producer_file_path)
>> >   File "integration_test.py", line 1086, in json_to_file
>> > return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
>> >   File "integration_test.py", line 1080, in _run
>> > run_cmd(cmd)
>> >   File "integration_test.py", line 87, in run_cmd
>> > output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
>> >   File 
>> > "

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Andrew Palumbo]

Apologies for spamming this [VOTE] Thread with my build results.  After pulling 
the newest master, upgrading to LLVM 6.0 and clang 6.0  I am able to get a 
complete build with all tests passing:


~/arrow/dev/release$ ./verify-release-candidate.sh source 0.12.0 2

{snip}

   Doc-tests parquet


test result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out

+ popd
/tmp/arrow-0.12.0.WgsaB/apache-arrow-0.12.0
+ echo 'Release candidate looks good!'
Release candidate looks good!
+ exit 0
+ cleanup
+ rm -fr /tmp/arrow-0.12.0.WgsaB


Thanks,


Andy

From: Andrew Palumbo 
Sent: Tuesday, January 15, 2019 12:42 PM
To: dev@arrow.apache.org
Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

Wes,
/tmp doesnt seem to be the issue.  it seems this machine has ~295 G. (I'll try 
to eye-verify that there is not some massive memory leak a bit later, seems 
unlikely though).

~$ df -Th /tmp
Filesystem Type  Size  Used Avail Use% Mounted on
/dev/xvda1 ext4  291G  4.6G  287G   2% /




Kouhei,
I was verifying RC2.  Seems that commit was not included in RC2.

~/arrow$ git log | grep be663c14637b2bdfef935946b6e91b6317219332
~/arrow$


So maybe this is the culprit?




I see that this commit is in master (from my local after a `git pull origin 
master`):

$ git log | grep -A20 be663c14637b2bdfef935946b6e91b6317219332
commit be663c14637b2bdfef935946b6e91b6317219332
Author: Kouhei Sutou 
Date:   Sun Jan 13 11:14:51 2019 +0100

ARROW-4247: [Release] Update verify script for 0.12.0

  * C++: -DARROW_GPU -> -DARROW_CUDA
  * C++: Enable Gandiva
  * C++: default: -DARROW_BUILD_TESTS=ON -> OFF
  * Ruby: red-plasma, red-gandiva and red-parquet are added
  * Rust: The top-level Cargo.toml is a virtual manifest

Author: Kouhei Sutou 

Closes #3389 from kou/release-update-verify-script and squashes the 
following commits:

f019a3fc   Update verify script for 0.12.0


Thanks Very Much,

Andy


From: Wes McKinney 
Sent: Tuesday, January 15, 2019 12:47 AM
To: dev@arrow.apache.org
Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

I'm working on getting ARROW-4258 merged right now. ARROW-4260 also
should be fixed before another RC is cut

https://issues.apache.org/jira/browse/ARROW-4260

On Mon, Jan 14, 2019 at 11:36 PM Kouhei Sutou  wrote:
>
> Hi,
>
> Does your verify-release-candidate.sh include
> https://github.com/apache/arrow/commit/be663c14637b2bdfef935946b6e91b6317219332
> ?
>
> arrow-json-integration-test needs -DARROW_BUILD_TESTS=ON.
>
>
> Thanks,
> --
> kou
>
> In 
> 
>   "Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Tue, 15 Jan 2019 
> 02:30:13 +,
>   Andrew Palumbo  wrote:
>
> > After following all setup and install steps from: 
> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >
> >
> > apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ 
> > verify-release-candidate.sh source 0.12.0 2
> >
> >
> >
> > fails with this stack trace:
> >
> >
> >
> >
> > #
> > C++ producing, C++ consuming
> > ##
> > ==
> > Testing file 
> > /tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
> > ==
> > -- Creating binary inputs
> > Traceback (most recent call last):
> >   File "integration_test.py", line 1216, in 
> > run_all_tests(debug=args.debug, tempdir=args.tempdir)
> >   File "integration_test.py", line 1179, in run_all_tests
> > runner.run()
> >   File "integration_test.py", line 937, in run
> > self._compare_implementations(producer, consumer)
> >   File "integration_test.py", line 959, in _compare_implementations
> > producer.json_to_file(json_path, producer_file_path)
> >   File "integration_test.py", line 1086, in json_to_file
> > return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
> >   File "integration_test.py", line 1080, in _run
> > run_cmd(cmd)
> >   File "integration_test.py", line 87, in run_cmd
> > output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
> >   File 
> > "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
> >  line 336, in chec
> > k_output
> > **kwargs).stdout
> >   File 
> > "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arr

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Andrew Palumbo]

Wes,
/tmp doesnt seem to be the issue.  it seems this machine has ~295 G. (I'll try 
to eye-verify that there is not some massive memory leak a bit later, seems 
unlikely though).

~$ df -Th /tmp
Filesystem Type  Size  Used Avail Use% Mounted on
/dev/xvda1 ext4  291G  4.6G  287G   2% /




Kouhei,
I was verifying RC2.  Seems that commit was not included in RC2.

~/arrow$ git log | grep be663c14637b2bdfef935946b6e91b6317219332
~/arrow$


So maybe this is the culprit?




I see that this commit is in master (from my local after a `git pull origin 
master`):

$ git log | grep -A20 be663c14637b2bdfef935946b6e91b6317219332
commit be663c14637b2bdfef935946b6e91b6317219332
Author: Kouhei Sutou 
Date:   Sun Jan 13 11:14:51 2019 +0100

ARROW-4247: [Release] Update verify script for 0.12.0

  * C++: -DARROW_GPU -> -DARROW_CUDA
  * C++: Enable Gandiva
  * C++: default: -DARROW_BUILD_TESTS=ON -> OFF
  * Ruby: red-plasma, red-gandiva and red-parquet are added
  * Rust: The top-level Cargo.toml is a virtual manifest

Author: Kouhei Sutou 

Closes #3389 from kou/release-update-verify-script and squashes the 
following commits:

f019a3fc   Update verify script for 0.12.0


Thanks Very Much,

Andy


From: Wes McKinney 
Sent: Tuesday, January 15, 2019 12:47 AM
To: dev@arrow.apache.org
Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

I'm working on getting ARROW-4258 merged right now. ARROW-4260 also
should be fixed before another RC is cut

https://issues.apache.org/jira/browse/ARROW-4260

On Mon, Jan 14, 2019 at 11:36 PM Kouhei Sutou  wrote:
>
> Hi,
>
> Does your verify-release-candidate.sh include
> https://github.com/apache/arrow/commit/be663c14637b2bdfef935946b6e91b6317219332
> ?
>
> arrow-json-integration-test needs -DARROW_BUILD_TESTS=ON.
>
>
> Thanks,
> --
> kou
>
> In 
> 
>   "Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Tue, 15 Jan 2019 
> 02:30:13 +,
>   Andrew Palumbo  wrote:
>
> > After following all setup and install steps from: 
> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >
> >
> > apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ 
> > verify-release-candidate.sh source 0.12.0 2
> >
> >
> >
> > fails with this stack trace:
> >
> >
> >
> >
> > #
> > C++ producing, C++ consuming
> > ##
> > ==
> > Testing file 
> > /tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
> > ==
> > -- Creating binary inputs
> > Traceback (most recent call last):
> >   File "integration_test.py", line 1216, in 
> > run_all_tests(debug=args.debug, tempdir=args.tempdir)
> >   File "integration_test.py", line 1179, in run_all_tests
> > runner.run()
> >   File "integration_test.py", line 937, in run
> > self._compare_implementations(producer, consumer)
> >   File "integration_test.py", line 959, in _compare_implementations
> > producer.json_to_file(json_path, producer_file_path)
> >   File "integration_test.py", line 1086, in json_to_file
> > return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
> >   File "integration_test.py", line 1080, in _run
> > run_cmd(cmd)
> >   File "integration_test.py", line 87, in run_cmd
> > output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
> >   File 
> > "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
> >  line 336, in chec
> > k_output
> > **kwargs).stdout
> >   File 
> > "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
> >  line 403, in run
> > with Popen(*popenargs, **kwargs) as process:
> >   File 
> > "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
> >  line 709, in __in
> > it__
> > restore_signals, start_new_session)
> >   File 
> > "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
> >  line 1344, in _ex
> > ecute_child
> > raise child_exception_type(errno_num, err_msg, err_filename)
> > FileNotFoundError: [Errno 2] No such file or directory: 
> > '/tmp/arrow-0.12.0.5xTVS/apache-arrow-

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Wes McKinney]

I'm working on getting ARROW-4258 merged right now. ARROW-4260 also
should be fixed before another RC is cut

https://issues.apache.org/jira/browse/ARROW-4260

On Mon, Jan 14, 2019 at 11:36 PM Kouhei Sutou  wrote:
>
> Hi,
>
> Does your verify-release-candidate.sh include
> https://github.com/apache/arrow/commit/be663c14637b2bdfef935946b6e91b6317219332
> ?
>
> arrow-json-integration-test needs -DARROW_BUILD_TESTS=ON.
>
>
> Thanks,
> --
> kou
>
> In 
> 
>   "Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Tue, 15 Jan 2019 
> 02:30:13 +,
>   Andrew Palumbo  wrote:
>
> > After following all setup and install steps from: 
> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >
> >
> > apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ 
> > verify-release-candidate.sh source 0.12.0 2
> >
> >
> >
> > fails with this stack trace:
> >
> >
> >
> >
> > #
> > C++ producing, C++ consuming
> > ##
> > ==
> > Testing file 
> > /tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
> > ==
> > -- Creating binary inputs
> > Traceback (most recent call last):
> >   File "integration_test.py", line 1216, in 
> > run_all_tests(debug=args.debug, tempdir=args.tempdir)
> >   File "integration_test.py", line 1179, in run_all_tests
> > runner.run()
> >   File "integration_test.py", line 937, in run
> > self._compare_implementations(producer, consumer)
> >   File "integration_test.py", line 959, in _compare_implementations
> > producer.json_to_file(json_path, producer_file_path)
> >   File "integration_test.py", line 1086, in json_to_file
> > return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
> >   File "integration_test.py", line 1080, in _run
> > run_cmd(cmd)
> >   File "integration_test.py", line 87, in run_cmd
> > output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
> >   File 
> > "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
> >  line 336, in chec
> > k_output
> > **kwargs).stdout
> >   File 
> > "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
> >  line 403, in run
> > with Popen(*popenargs, **kwargs) as process:
> >   File 
> > "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
> >  line 709, in __in
> > it__
> > restore_signals, start_new_session)
> >   File 
> > "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
> >  line 1344, in _ex
> > ecute_child
> > raise child_exception_type(errno_num, err_msg, err_filename)
> > FileNotFoundError: [Errno 2] No such file or directory: 
> > '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-
> > integration-test': 
> > '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-integration-test'
> > + cleanup
> > + rm -fr /tmp/arrow-0.12.0.5xTVS
> >
> >
> >
> >
> > Jira or is this something obvious that i missed?
> >
> > Thank you.
> >
> > --Andy
> >
> > 
> > From: Andrew Palumbo 
> > Sent: Monday, January 14, 2019 9:23 PM
> > To: dev@arrow.apache.org
> > Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
> >
> > Hello, I've just run the verify scipt on the 0.12.0 tag after configuring 
> > an Ubuntu machine per the instructions.  I'm  crashing at "c++ producing, 
> > c++ consuming". With a no such file or directory... 
> > Arrow-json-integration-test.
> >
> > When I was trying to build straight from that submodule there was a
> >
> > git submodule update --init command that I had to run.
> >
> > Just taking a wild guess that it could be the cause.
> >
> > I have to let this message go through to show the stack trace, because I 
> > hadn't confirmed my dev@a.a.o acct.

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Kouhei Sutou]

Hi,

Does your verify-release-candidate.sh include
https://github.com/apache/arrow/commit/be663c14637b2bdfef935946b6e91b6317219332
?

arrow-json-integration-test needs -DARROW_BUILD_TESTS=ON.


Thanks,
--
kou

In 

  "Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Tue, 15 Jan 2019 
02:30:13 +,
  Andrew Palumbo  wrote:

> After following all setup and install steps from: 
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> 
> 
> apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ verify-release-candidate.sh 
> source 0.12.0 2
> 
> 
> 
> fails with this stack trace:
> 
> 
> 
> 
> #
> C++ producing, C++ consuming
> ##
> ==
> Testing file 
> /tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
> ==
> -- Creating binary inputs
> Traceback (most recent call last):
>   File "integration_test.py", line 1216, in 
> run_all_tests(debug=args.debug, tempdir=args.tempdir)
>   File "integration_test.py", line 1179, in run_all_tests
> runner.run()
>   File "integration_test.py", line 937, in run
> self._compare_implementations(producer, consumer)
>   File "integration_test.py", line 959, in _compare_implementations
> producer.json_to_file(json_path, producer_file_path)
>   File "integration_test.py", line 1086, in json_to_file
> return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
>   File "integration_test.py", line 1080, in _run
> run_cmd(cmd)
>   File "integration_test.py", line 87, in run_cmd
> output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
>   File 
> "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
>  line 336, in chec
> k_output
> **kwargs).stdout
>   File 
> "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
>  line 403, in run
> with Popen(*popenargs, **kwargs) as process:
>   File 
> "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
>  line 709, in __in
> it__
> restore_signals, start_new_session)
>   File 
> "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
>  line 1344, in _ex
> ecute_child
> raise child_exception_type(errno_num, err_msg, err_filename)
> FileNotFoundError: [Errno 2] No such file or directory: 
> '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-
> integration-test': 
> '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-integration-test'
> + cleanup
> + rm -fr /tmp/arrow-0.12.0.5xTVS
> 
> 
> 
> 
> Jira or is this something obvious that i missed?
> 
> Thank you.
> 
> --Andy
> 
> 
> From: Andrew Palumbo 
> Sent: Monday, January 14, 2019 9:23 PM
> To: dev@arrow.apache.org
> Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
> 
> Hello, I've just run the verify scipt on the 0.12.0 tag after configuring an 
> Ubuntu machine per the instructions.  I'm  crashing at "c++ producing, c++ 
> consuming". With a no such file or directory... Arrow-json-integration-test.
> 
> When I was trying to build straight from that submodule there was a
> 
> git submodule update --init command that I had to run.
> 
> Just taking a wild guess that it could be the cause.
> 
> I have to let this message go through to show the stack trace, because I 
> hadn't confirmed my dev@a.a.o acct.

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Wes McKinney]

hi Andy,

We'd need to see a more complete log of the verification script run to
see what's going on.

If I had to venture a guess if you are working on EC2 you might be
running out of /tmp space. The build produces well over a gigabyte of
artifacts. If this is the case, we might add an environment variable
option to configure where to run the build (something instead of /tmp)

- Wes

On Mon, Jan 14, 2019 at 8:30 PM Andrew Palumbo  wrote:
>
> After following all setup and install steps from: 
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>
>
> apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ verify-release-candidate.sh 
> source 0.12.0 2
>
>
>
> fails with this stack trace:
>
>
>
>
> #
> C++ producing, C++ consuming
> ##
> ==
> Testing file 
> /tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
> ==
> -- Creating binary inputs
> Traceback (most recent call last):
>   File "integration_test.py", line 1216, in 
> run_all_tests(debug=args.debug, tempdir=args.tempdir)
>   File "integration_test.py", line 1179, in run_all_tests
> runner.run()
>   File "integration_test.py", line 937, in run
> self._compare_implementations(producer, consumer)
>   File "integration_test.py", line 959, in _compare_implementations
> producer.json_to_file(json_path, producer_file_path)
>   File "integration_test.py", line 1086, in json_to_file
> return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
>   File "integration_test.py", line 1080, in _run
> run_cmd(cmd)
>   File "integration_test.py", line 87, in run_cmd
> output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
>   File 
> "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
>  line 336, in chec
> k_output
> **kwargs).stdout
>   File 
> "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
>  line 403, in run
> with Popen(*popenargs, **kwargs) as process:
>   File 
> "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
>  line 709, in __in
> it__
> restore_signals, start_new_session)
>   File 
> "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
>  line 1344, in _ex
> ecute_child
> raise child_exception_type(errno_num, err_msg, err_filename)
> FileNotFoundError: [Errno 2] No such file or directory: 
> '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-
> integration-test': 
> '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-integration-test'
> + cleanup
> + rm -fr /tmp/arrow-0.12.0.5xTVS
>
>
>
>
> Jira or is this something obvious that i missed?
>
> Thank you.
>
> --Andy
>
> 
> From: Andrew Palumbo 
> Sent: Monday, January 14, 2019 9:23 PM
> To: dev@arrow.apache.org
> Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
>
> Hello, I've just run the verify scipt on the 0.12.0 tag after configuring an 
> Ubuntu machine per the instructions.  I'm  crashing at "c++ producing, c++ 
> consuming". With a no such file or directory... Arrow-json-integration-test.
>
> When I was trying to build straight from that submodule there was a
>
> git submodule update --init command that I had to run.
>
> Just taking a wild guess that it could be the cause.
>
> I have to let this message go through to show the stack trace, because I 
> hadn't confirmed my dev@a.a.o acct.

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Andrew Palumbo]

After following all setup and install steps from: 
https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates


apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ verify-release-candidate.sh 
source 0.12.0 2



fails with this stack trace:




#
C++ producing, C++ consuming
##
==
Testing file 
/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
==
-- Creating binary inputs
Traceback (most recent call last):
  File "integration_test.py", line 1216, in 
run_all_tests(debug=args.debug, tempdir=args.tempdir)
  File "integration_test.py", line 1179, in run_all_tests
runner.run()
  File "integration_test.py", line 937, in run
self._compare_implementations(producer, consumer)
  File "integration_test.py", line 959, in _compare_implementations
producer.json_to_file(json_path, producer_file_path)
  File "integration_test.py", line 1086, in json_to_file
return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
  File "integration_test.py", line 1080, in _run
run_cmd(cmd)
  File "integration_test.py", line 87, in run_cmd
output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
  File 
"/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
 line 336, in chec
k_output
**kwargs).stdout
  File 
"/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
 line 403, in run
with Popen(*popenargs, **kwargs) as process:
  File 
"/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
 line 709, in __in
it__
restore_signals, start_new_session)
  File 
"/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py",
 line 1344, in _ex
ecute_child
raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: 
'/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-
integration-test': 
'/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-integration-test'
+ cleanup
+ rm -fr /tmp/arrow-0.12.0.5xTVS




Jira or is this something obvious that i missed?

Thank you.

--Andy

________________
From: Andrew Palumbo 
Sent: Monday, January 14, 2019 9:23 PM
To: dev@arrow.apache.org
Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

Hello, I've just run the verify scipt on the 0.12.0 tag after configuring an 
Ubuntu machine per the instructions.  I'm  crashing at "c++ producing, c++ 
consuming". With a no such file or directory... Arrow-json-integration-test.

When I was trying to build straight from that submodule there was a

git submodule update --init command that I had to run.

Just taking a wild guess that it could be the cause.

I have to let this message go through to show the stack trace, because I hadn't 
confirmed my dev@a.a.o acct.

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Andrew Palumbo]

Hello, I've just run the verify scipt on the 0.12.0 tag after configuring an 
Ubuntu machine per the instructions.  I'm  crashing at "c++ producing, c++ 
consuming". With a no such file or directory... Arrow-json-integration-test.

When I was trying to build straight from that submodule there was a

git submodule update --init command that I had to run.

Just taking a wild guess that it could be the cause.

I have to let this message go through to show the stack trace, because I hadn't 
confirmed my dev@a.a.o acct.

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Kouhei Sutou]

Hi,

> There is a problem in Plasma + Python + CUDA:
> 
>   https://issues.apache.org/jira/browse/ARROW-4246

I've created a pull request for this:

  https://github.com/apache/arrow/pull/3398


Thanks,
--
kou

In <20190113.124329.44772517181197518@clear-code.com>
  "Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Sun, 13 Jan 2019 
12:43:29 +0900 (JST),
  Kouhei Sutou  wrote:

> +1 (binding) with a trivial fix.
> 
> The following checksum files use absolute paths:
> 
>   
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/apache-arrow-0.12.0.tar.gz.sha256
>   
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/apache-arrow-0.12.0.tar.gz.sha512
> 
> I think that we need to replace the files with basename only
> path.
> 
> I verified checksums with the following change:
> 
> 
> diff --git a/dev/release/verify-release-candidate.sh 
> b/dev/release/verify-release-candidate.sh
> index c8b9c54c..d992c43c 100755
> --- a/dev/release/verify-release-candidate.sh
> +++ b/dev/release/verify-release-candidate.sh
> @@ -83,8 +83,8 @@ fetch_archive() {
>download_rc_file ${dist_name}.tar.gz.sha256
>download_rc_file ${dist_name}.tar.gz.sha512
>gpg --verify ${dist_name}.tar.gz.asc ${dist_name}.tar.gz
> -  shasum -a 256 -c ${dist_name}.tar.gz.sha256
> -  shasum -a 512 -c ${dist_name}.tar.gz.sha512
> +  sed -E -e 's,/+.+/,,g' ${dist_name}.tar.gz.sha256 | shasum -a 256 -c
> +  sed -E -e 's,/+.+/,,g' ${dist_name}.tar.gz.sha512 | shasum -a 512 -c
>  }
>  
>  verify_binary_artifacts() {
> 
> 
> We need to update verify script for changes between 0.11.1
> and 0.12.0:
> 
>   https://github.com/apache/arrow/pull/3389
> 
> I ran the followings on Debian GNU/Linux sid:
> 
>   * ARROW_HAVE_CUDA=no CC=gcc-7 CXX=g++-7 
> dev/release/verify-release-candidate.sh binaries 0.12.0 2
>   * ARROW_HAVE_CUDA=yes CC=gcc-7 CXX=g++-7 
> dev/release/verify-release-candidate.sh binaries 0.12.0 2
> 
> with:
> 
>   * gcc-7 (Debian 7.4.0-2) 7.4.0
>   * openjdk version "1.8.0_191"
>   * ruby 2.7.0dev (2019-01-05 trunk 66719) [x86_64-linux]
>   * Node.js v10.15.0
> 
> 
> There is a problem in Plasma + Python + CUDA:
> 
>   https://issues.apache.org/jira/browse/ARROW-4246
> 
> I don't think that this is a blocker.
> 
> Other modules work well with ARROW_HAVE_GPU=yes.
> 
> 
> There is a problem with GCC 8:
> 
>   https://issues.apache.org/jira/browse/ARROW-4242
> 
> I don't think that this is a blocker.
> 
> 
> Thanks,
> --
> kou
> 
> In 
>   "[VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Sat, 12 Jan 2019 
> 20:56:28 +0100,
>   Krisztián Szűcs  wrote:
> 
>> Hi,
>> 
>> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
>> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
>> The previous RCs were not voted, because:
>> - RC0: the source archive didn't include required files to build
>> gandiva-glib
>>   documents, also causing failed binary build for Debian Stretch [6].
>> - RC1: compatibility issues with the just released pandas version 0.24.rc1
>> [8]
>> 
>> This release candidate is based on commit:
>> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
>> 
>> The source release rc2 is hosted at [3].
>> The binary artifacts are hosted at [4].
>> The changelog is located at [5].
>> 
>> Please download, verify checksums and signatures, run the unit tests,
>> and vote on the release. See [7] for how to validate a release candidate.
>> 
>> The vote will be open for at least 72 hours.
>> 
>> [ ] +1 Release this as Apache Arrow 0.12.0
>> [ ] +0
>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
>> 
>> Special thanks to @kou for helping with the uprising issues!
>> 
>> - Krisztian
>> 
>> [1]:
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
>> [2]:
>> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
>> <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
>> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
>> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
>> [5]:
>> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
>> [7]:
>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Kouhei Sutou]

Hi,

I've created a pull request for verifying binaries on Bintray:

  https://github.com/apache/arrow/pull/3397


Thanks,
--
kou

In <0a69afdb-2c15-2d7d-1d56-5333bf12b...@python.org>
  "Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Mon, 14 Jan 2019 
09:34:06 +0100,
  Antoine Pitrou  wrote:

> 
> Apparently the binaries verification script attempts to download from
> dist.apache.org?
> 
> $ dev/release/verify-release-candidate.sh binaries 0.12.0 rc2
> [...]
> + wget -P apache-arrow-0.12.0-rcrc2 --quiet --no-host-directories
> --cut-dirs=5 --no-parent --reject 'index.html*' --recursive
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rcrc2/binaries/
> 
> 
> 
> Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
>> Hi,
>> 
>> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
>> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
>> The previous RCs were not voted, because:
>> - RC0: the source archive didn't include required files to build
>> gandiva-glib
>>   documents, also causing failed binary build for Debian Stretch [6].
>> - RC1: compatibility issues with the just released pandas version 0.24.rc1
>> [8]
>> 
>> This release candidate is based on commit:
>> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
>> 
>> The source release rc2 is hosted at [3].
>> The binary artifacts are hosted at [4].
>> The changelog is located at [5].
>> 
>> Please download, verify checksums and signatures, run the unit tests,
>> and vote on the release. See [7] for how to validate a release candidate.
>> 
>> The vote will be open for at least 72 hours.
>> 
>> [ ] +1 Release this as Apache Arrow 0.12.0
>> [ ] +0
>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
>> 
>> Special thanks to @kou for helping with the uprising issues!
>> 
>> - Krisztian
>> 
>> [1]:
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
>> [2]:
>> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
>> <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
>> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
>> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
>> [5]:
>> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
>> [7]:
>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
>> 

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Wes McKinney]

Does anything need to change in the verification scripts to run the
JavaScript parts of the integration tests? The build was passing when
I merged the refactor. We aren't pushing any npm artifacts from this
release so as long as the tests run it is OK

I would be OK with merging the patch for ARROW-4258 and then
immediately cutting another RC (so long as the verification script
isn't broken -- modulo the known issues reported in this thread
already)

On Mon, Jan 14, 2019 at 2:55 PM Krisztián Szűcs
 wrote:
>
> I'm fine with cutting an RC3. ARROW-4258 seems pretty bad.
> If We decide to create a new RC how should We deal with the
> recent JS refactoring [1]?
>
> On OSX the verification worked well though, except a plasma issue.
> Uwe, if You have time please verify it on OSX too.
>
> [1]
> https://github.com/apache/arrow/commit/5598d2f42573ed19e7db4aae7adb02af2cd4ccd0
>
> On Mon, Jan 14, 2019 at 8:01 PM Antoine Pitrou  wrote:
>
> >
> > Ok, it worked, except that I got the classical test_plasma_list() failure.
> >
> > Regards
> >
> > Antoine.
> >
> >
> > Le 14/01/2019 à 17:50, Wes McKinney a écrit :
> > > How about using the conda-forge package?
> > >
> > > conda create -y -p $HOME/release-0.12-toolchain brotli -c conda-forge
> > > export BROTLI_HOME=$HOME/release-0.12-toolchain
> > >
> > >
> > > On Mon, Jan 14, 2019 at 10:46 AM Antoine Pitrou 
> > wrote:
> > >>
> > >>
> > >> Unfortunately, Ubuntu only provides shared library versions of
> > >> Brotli but we're looking for a statically-linked brotli:
> > >>
> > >> make[2]: *** No rule to make target
> > '/usr/lib/x86_64-linux-gnu/libbrotlidec.a', needed by
> > 'release/libarrow.so.12.0.0'.  Stop.
> > >> CMakeFiles/Makefile2:2013: recipe for target
> > 'src/arrow/CMakeFiles/arrow_shared.dir/all' failed
> > >>
> > >>
> > >>
> > >>
> > >> Le 14/01/2019 à 16:46, Wes McKinney a écrit :
> > >>> Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
> > >>> packages for Ubuntu Bionic it's an annoyance for source-builders but
> > >>> not a deal breaker (IMHO) for the RC
> > >>>
> > >>> On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou 
> > wrote:
> > 
> > 
> >  Unfortunately I cannot validate the source release on Ubuntu 18.04,
> >  as brotli fails compiling with a internal compiler error
> >  (this is gcc 7.3.0):
> > 
> > 
> > /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:
> > In function ‘BrotliCompressFragmentFastImpl13’:
> > 
> > /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1:
> > internal compiler error: Erreur de segmentation
> >   FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
> >   ^~~
> >  Please submit a full bug report,
> >  with preprocessed source if appropriate.
> >  See  for instructions.
> >  make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o]
> > Error 1
> >  make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
> >  make[3]: *** [all] Error 2
> > 
> > 
> >  Regards
> > 
> >  Antoine.
> > 
> > 
> >  Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> > > Hi,
> > >
> > > I'd like to propose the 1st release candidate (RC2) of Apache Arrow
> > version
> > > 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > > The previous RCs were not voted, because:
> > > - RC0: the source archive didn't include required files to build
> > > gandiva-glib
> > >   documents, also causing failed binary build for Debian Stretch [6].
> > > - RC1: compatibility issues with the just released pandas version
> > 0.24.rc1
> > > [8]
> > >
> > > This release candidate is based on commit:
> > > 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> > >
> > > The source release rc2 is hosted at [3].
> > > The binary artifacts are hosted at [4].
> > > The changelog is located at [5].
> > >
> > > Please download, verify checksums and signatures, run the unit tests,
> > > and vote on the release. See [7] for how to validate a release
> > candidate.
> > >
> > > The vote will be open for at least 72 hours.
> > >
> > > [ ] +1 Release this as Apache Arrow 0.12.0
> > > [ ] +0
> > > [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> > >
> > > Special thanks to @kou for helping with the uprising issues!
> > >
> > > - Krisztian
> > >
> > > [1]:
> > >
> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > > [2]:
> > >
> > https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > > <
> > https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359
> > >
> > > [3]:
> > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > 

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Krisztián Szűcs]

I'm fine with cutting an RC3. ARROW-4258 seems pretty bad.
If We decide to create a new RC how should We deal with the
recent JS refactoring [1]?

On OSX the verification worked well though, except a plasma issue.
Uwe, if You have time please verify it on OSX too.

[1]
https://github.com/apache/arrow/commit/5598d2f42573ed19e7db4aae7adb02af2cd4ccd0

On Mon, Jan 14, 2019 at 8:01 PM Antoine Pitrou  wrote:

>
> Ok, it worked, except that I got the classical test_plasma_list() failure.
>
> Regards
>
> Antoine.
>
>
> Le 14/01/2019 à 17:50, Wes McKinney a écrit :
> > How about using the conda-forge package?
> >
> > conda create -y -p $HOME/release-0.12-toolchain brotli -c conda-forge
> > export BROTLI_HOME=$HOME/release-0.12-toolchain
> >
> >
> > On Mon, Jan 14, 2019 at 10:46 AM Antoine Pitrou 
> wrote:
> >>
> >>
> >> Unfortunately, Ubuntu only provides shared library versions of
> >> Brotli but we're looking for a statically-linked brotli:
> >>
> >> make[2]: *** No rule to make target
> '/usr/lib/x86_64-linux-gnu/libbrotlidec.a', needed by
> 'release/libarrow.so.12.0.0'.  Stop.
> >> CMakeFiles/Makefile2:2013: recipe for target
> 'src/arrow/CMakeFiles/arrow_shared.dir/all' failed
> >>
> >>
> >>
> >>
> >> Le 14/01/2019 à 16:46, Wes McKinney a écrit :
> >>> Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
> >>> packages for Ubuntu Bionic it's an annoyance for source-builders but
> >>> not a deal breaker (IMHO) for the RC
> >>>
> >>> On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou 
> wrote:
> 
> 
>  Unfortunately I cannot validate the source release on Ubuntu 18.04,
>  as brotli fails compiling with a internal compiler error
>  (this is gcc 7.3.0):
> 
> 
> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:
> In function ‘BrotliCompressFragmentFastImpl13’:
> 
> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1:
> internal compiler error: Erreur de segmentation
>   FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
>   ^~~
>  Please submit a full bug report,
>  with preprocessed source if appropriate.
>  See  for instructions.
>  make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o]
> Error 1
>  make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
>  make[3]: *** [all] Error 2
> 
> 
>  Regards
> 
>  Antoine.
> 
> 
>  Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> > Hi,
> >
> > I'd like to propose the 1st release candidate (RC2) of Apache Arrow
> version
> > 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > The previous RCs were not voted, because:
> > - RC0: the source archive didn't include required files to build
> > gandiva-glib
> >   documents, also causing failed binary build for Debian Stretch [6].
> > - RC1: compatibility issues with the just released pandas version
> 0.24.rc1
> > [8]
> >
> > This release candidate is based on commit:
> > 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> >
> > The source release rc2 is hosted at [3].
> > The binary artifacts are hosted at [4].
> > The changelog is located at [5].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [7] for how to validate a release
> candidate.
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow 0.12.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> >
> > Special thanks to @kou for helping with the uprising issues!
> >
> > - Krisztian
> >
> > [1]:
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > [2]:
> >
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > <
> https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359
> >
> > [3]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > [5]:
> >
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > [7]:
> >
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> >
>

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Antoine Pitrou]

Ok, it worked, except that I got the classical test_plasma_list() failure.

Regards

Antoine.


Le 14/01/2019 à 17:50, Wes McKinney a écrit :
> How about using the conda-forge package?
> 
> conda create -y -p $HOME/release-0.12-toolchain brotli -c conda-forge
> export BROTLI_HOME=$HOME/release-0.12-toolchain
> 
> 
> On Mon, Jan 14, 2019 at 10:46 AM Antoine Pitrou  wrote:
>>
>>
>> Unfortunately, Ubuntu only provides shared library versions of
>> Brotli but we're looking for a statically-linked brotli:
>>
>> make[2]: *** No rule to make target 
>> '/usr/lib/x86_64-linux-gnu/libbrotlidec.a', needed by 
>> 'release/libarrow.so.12.0.0'.  Stop.
>> CMakeFiles/Makefile2:2013: recipe for target 
>> 'src/arrow/CMakeFiles/arrow_shared.dir/all' failed
>>
>>
>>
>>
>> Le 14/01/2019 à 16:46, Wes McKinney a écrit :
>>> Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
>>> packages for Ubuntu Bionic it's an annoyance for source-builders but
>>> not a deal breaker (IMHO) for the RC
>>>
>>> On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou  wrote:


 Unfortunately I cannot validate the source release on Ubuntu 18.04,
 as brotli fails compiling with a internal compiler error
 (this is gcc 7.3.0):

 /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:
  In function ‘BrotliCompressFragmentFastImpl13’:
 /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1:
  internal compiler error: Erreur de segmentation
  FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
  ^~~
 Please submit a full bug report,
 with preprocessed source if appropriate.
 See  for instructions.
 make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
 make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
 make[3]: *** [all] Error 2


 Regards

 Antoine.


 Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> Hi,
>
> I'd like to propose the 1st release candidate (RC2) of Apache Arrow 
> version
> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> The previous RCs were not voted, because:
> - RC0: the source archive didn't include required files to build
> gandiva-glib
>   documents, also causing failed binary build for Debian Stretch [6].
> - RC1: compatibility issues with the just released pandas version 0.24.rc1
> [8]
>
> This release candidate is based on commit:
> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
>
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4].
> The changelog is located at [5].
>
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [7] for how to validate a release candidate.
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Release this as Apache Arrow 0.12.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
>
> Special thanks to @kou for helping with the uprising issues!
>
> - Krisztian
>
> [1]:
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> [2]:
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> 
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> [5]:
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> [7]:
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
>

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Wes McKinney]

In light of the severity of ARROW-4258
(https://github.com/apache/arrow/pull/3395) and some of the other
rough edges in this RC, I would suggest making some fixes today and
cutting an RC3. I'm revising my vote to -0

@Krisztian -- you are the RM, so it is up to you whether you want to
cancel the release vote

On Mon, Jan 14, 2019 at 10:50 AM Wes McKinney  wrote:
>
> How about using the conda-forge package?
>
> conda create -y -p $HOME/release-0.12-toolchain brotli -c conda-forge
> export BROTLI_HOME=$HOME/release-0.12-toolchain
>
>
> On Mon, Jan 14, 2019 at 10:46 AM Antoine Pitrou  wrote:
> >
> >
> > Unfortunately, Ubuntu only provides shared library versions of
> > Brotli but we're looking for a statically-linked brotli:
> >
> > make[2]: *** No rule to make target 
> > '/usr/lib/x86_64-linux-gnu/libbrotlidec.a', needed by 
> > 'release/libarrow.so.12.0.0'.  Stop.
> > CMakeFiles/Makefile2:2013: recipe for target 
> > 'src/arrow/CMakeFiles/arrow_shared.dir/all' failed
> >
> >
> >
> >
> > Le 14/01/2019 à 16:46, Wes McKinney a écrit :
> > > Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
> > > packages for Ubuntu Bionic it's an annoyance for source-builders but
> > > not a deal breaker (IMHO) for the RC
> > >
> > > On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou  wrote:
> > >>
> > >>
> > >> Unfortunately I cannot validate the source release on Ubuntu 18.04,
> > >> as brotli fails compiling with a internal compiler error
> > >> (this is gcc 7.3.0):
> > >>
> > >> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:
> > >>  In function ‘BrotliCompressFragmentFastImpl13’:
> > >> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1:
> > >>  internal compiler error: Erreur de segmentation
> > >>  FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
> > >>  ^~~
> > >> Please submit a full bug report,
> > >> with preprocessed source if appropriate.
> > >> See  for instructions.
> > >> make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
> > >> make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
> > >> make[3]: *** [all] Error 2
> > >>
> > >>
> > >> Regards
> > >>
> > >> Antoine.
> > >>
> > >>
> > >> Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> > >>> Hi,
> > >>>
> > >>> I'd like to propose the 1st release candidate (RC2) of Apache Arrow 
> > >>> version
> > >>> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > >>> The previous RCs were not voted, because:
> > >>> - RC0: the source archive didn't include required files to build
> > >>> gandiva-glib
> > >>>   documents, also causing failed binary build for Debian Stretch [6].
> > >>> - RC1: compatibility issues with the just released pandas version 
> > >>> 0.24.rc1
> > >>> [8]
> > >>>
> > >>> This release candidate is based on commit:
> > >>> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> > >>>
> > >>> The source release rc2 is hosted at [3].
> > >>> The binary artifacts are hosted at [4].
> > >>> The changelog is located at [5].
> > >>>
> > >>> Please download, verify checksums and signatures, run the unit tests,
> > >>> and vote on the release. See [7] for how to validate a release 
> > >>> candidate.
> > >>>
> > >>> The vote will be open for at least 72 hours.
> > >>>
> > >>> [ ] +1 Release this as Apache Arrow 0.12.0
> > >>> [ ] +0
> > >>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> > >>>
> > >>> Special thanks to @kou for helping with the uprising issues!
> > >>>
> > >>> - Krisztian
> > >>>
> > >>> [1]:
> > >>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > >>> [2]:
> > >>> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > >>> 
> > >>> [3]: 
> > >>> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > >>> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > >>> [5]:
> > >>> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > >>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > >>> [7]:
> > >>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > >>> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> > >>>

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Wes McKinney]

How about using the conda-forge package?

conda create -y -p $HOME/release-0.12-toolchain brotli -c conda-forge
export BROTLI_HOME=$HOME/release-0.12-toolchain


On Mon, Jan 14, 2019 at 10:46 AM Antoine Pitrou  wrote:
>
>
> Unfortunately, Ubuntu only provides shared library versions of
> Brotli but we're looking for a statically-linked brotli:
>
> make[2]: *** No rule to make target 
> '/usr/lib/x86_64-linux-gnu/libbrotlidec.a', needed by 
> 'release/libarrow.so.12.0.0'.  Stop.
> CMakeFiles/Makefile2:2013: recipe for target 
> 'src/arrow/CMakeFiles/arrow_shared.dir/all' failed
>
>
>
>
> Le 14/01/2019 à 16:46, Wes McKinney a écrit :
> > Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
> > packages for Ubuntu Bionic it's an annoyance for source-builders but
> > not a deal breaker (IMHO) for the RC
> >
> > On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou  wrote:
> >>
> >>
> >> Unfortunately I cannot validate the source release on Ubuntu 18.04,
> >> as brotli fails compiling with a internal compiler error
> >> (this is gcc 7.3.0):
> >>
> >> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:
> >>  In function ‘BrotliCompressFragmentFastImpl13’:
> >> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1:
> >>  internal compiler error: Erreur de segmentation
> >>  FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
> >>  ^~~
> >> Please submit a full bug report,
> >> with preprocessed source if appropriate.
> >> See  for instructions.
> >> make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
> >> make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
> >> make[3]: *** [all] Error 2
> >>
> >>
> >> Regards
> >>
> >> Antoine.
> >>
> >>
> >> Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> >>> Hi,
> >>>
> >>> I'd like to propose the 1st release candidate (RC2) of Apache Arrow 
> >>> version
> >>> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> >>> The previous RCs were not voted, because:
> >>> - RC0: the source archive didn't include required files to build
> >>> gandiva-glib
> >>>   documents, also causing failed binary build for Debian Stretch [6].
> >>> - RC1: compatibility issues with the just released pandas version 0.24.rc1
> >>> [8]
> >>>
> >>> This release candidate is based on commit:
> >>> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> >>>
> >>> The source release rc2 is hosted at [3].
> >>> The binary artifacts are hosted at [4].
> >>> The changelog is located at [5].
> >>>
> >>> Please download, verify checksums and signatures, run the unit tests,
> >>> and vote on the release. See [7] for how to validate a release candidate.
> >>>
> >>> The vote will be open for at least 72 hours.
> >>>
> >>> [ ] +1 Release this as Apache Arrow 0.12.0
> >>> [ ] +0
> >>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> >>>
> >>> Special thanks to @kou for helping with the uprising issues!
> >>>
> >>> - Krisztian
> >>>
> >>> [1]:
> >>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> >>> [2]:
> >>> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> >>> 
> >>> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> >>> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> >>> [5]:
> >>> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> >>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> >>> [7]:
> >>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >>> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> >>>

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Antoine Pitrou]

Unfortunately, Ubuntu only provides shared library versions of
Brotli but we're looking for a statically-linked brotli:

make[2]: *** No rule to make target '/usr/lib/x86_64-linux-gnu/libbrotlidec.a', 
needed by 'release/libarrow.so.12.0.0'.  Stop.
CMakeFiles/Makefile2:2013: recipe for target 
'src/arrow/CMakeFiles/arrow_shared.dir/all' failed




Le 14/01/2019 à 16:46, Wes McKinney a écrit :
> Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
> packages for Ubuntu Bionic it's an annoyance for source-builders but
> not a deal breaker (IMHO) for the RC
> 
> On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou  wrote:
>>
>>
>> Unfortunately I cannot validate the source release on Ubuntu 18.04,
>> as brotli fails compiling with a internal compiler error
>> (this is gcc 7.3.0):
>>
>> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:
>>  In function ‘BrotliCompressFragmentFastImpl13’:
>> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1:
>>  internal compiler error: Erreur de segmentation
>>  FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
>>  ^~~
>> Please submit a full bug report,
>> with preprocessed source if appropriate.
>> See  for instructions.
>> make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
>> make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
>> make[3]: *** [all] Error 2
>>
>>
>> Regards
>>
>> Antoine.
>>
>>
>> Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
>>> Hi,
>>>
>>> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
>>> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
>>> The previous RCs were not voted, because:
>>> - RC0: the source archive didn't include required files to build
>>> gandiva-glib
>>>   documents, also causing failed binary build for Debian Stretch [6].
>>> - RC1: compatibility issues with the just released pandas version 0.24.rc1
>>> [8]
>>>
>>> This release candidate is based on commit:
>>> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
>>>
>>> The source release rc2 is hosted at [3].
>>> The binary artifacts are hosted at [4].
>>> The changelog is located at [5].
>>>
>>> Please download, verify checksums and signatures, run the unit tests,
>>> and vote on the release. See [7] for how to validate a release candidate.
>>>
>>> The vote will be open for at least 72 hours.
>>>
>>> [ ] +1 Release this as Apache Arrow 0.12.0
>>> [ ] +0
>>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
>>>
>>> Special thanks to @kou for helping with the uprising issues!
>>>
>>> - Krisztian
>>>
>>> [1]:
>>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
>>> [2]:
>>> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
>>> 
>>> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
>>> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
>>> [5]:
>>> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
>>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
>>> [7]:
>>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>>> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
>>>

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Wes McKinney]

I forgot to add that I also hit known issue
https://issues.apache.org/jira/browse/ARROW-3344 on Ubuntu 14.04

On Mon, Jan 14, 2019 at 9:46 AM Wes McKinney  wrote:
>
> Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
> packages for Ubuntu Bionic it's an annoyance for source-builders but
> not a deal breaker (IMHO) for the RC
>
> On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou  wrote:
> >
> >
> > Unfortunately I cannot validate the source release on Ubuntu 18.04,
> > as brotli fails compiling with a internal compiler error
> > (this is gcc 7.3.0):
> >
> > /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:
> >  In function ‘BrotliCompressFragmentFastImpl13’:
> > /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1:
> >  internal compiler error: Erreur de segmentation
> >  FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
> >  ^~~
> > Please submit a full bug report,
> > with preprocessed source if appropriate.
> > See  for instructions.
> > make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
> > make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
> > make[3]: *** [all] Error 2
> >
> >
> > Regards
> >
> > Antoine.
> >
> >
> > Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> > > Hi,
> > >
> > > I'd like to propose the 1st release candidate (RC2) of Apache Arrow 
> > > version
> > > 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > > The previous RCs were not voted, because:
> > > - RC0: the source archive didn't include required files to build
> > > gandiva-glib
> > >   documents, also causing failed binary build for Debian Stretch [6].
> > > - RC1: compatibility issues with the just released pandas version 0.24.rc1
> > > [8]
> > >
> > > This release candidate is based on commit:
> > > 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> > >
> > > The source release rc2 is hosted at [3].
> > > The binary artifacts are hosted at [4].
> > > The changelog is located at [5].
> > >
> > > Please download, verify checksums and signatures, run the unit tests,
> > > and vote on the release. See [7] for how to validate a release candidate.
> > >
> > > The vote will be open for at least 72 hours.
> > >
> > > [ ] +1 Release this as Apache Arrow 0.12.0
> > > [ ] +0
> > > [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> > >
> > > Special thanks to @kou for helping with the uprising issues!
> > >
> > > - Krisztian
> > >
> > > [1]:
> > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > > [2]:
> > > https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > > 
> > > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > > [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > > [5]:
> > > https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > > [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > > [7]:
> > > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > > [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> > >

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Wes McKinney]

Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
packages for Ubuntu Bionic it's an annoyance for source-builders but
not a deal breaker (IMHO) for the RC

On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou  wrote:
>
>
> Unfortunately I cannot validate the source release on Ubuntu 18.04,
> as brotli fails compiling with a internal compiler error
> (this is gcc 7.3.0):
>
> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:
>  In function ‘BrotliCompressFragmentFastImpl13’:
> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1:
>  internal compiler error: Erreur de segmentation
>  FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
>  ^~~
> Please submit a full bug report,
> with preprocessed source if appropriate.
> See  for instructions.
> make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
> make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
> make[3]: *** [all] Error 2
>
>
> Regards
>
> Antoine.
>
>
> Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> > Hi,
> >
> > I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> > 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > The previous RCs were not voted, because:
> > - RC0: the source archive didn't include required files to build
> > gandiva-glib
> >   documents, also causing failed binary build for Debian Stretch [6].
> > - RC1: compatibility issues with the just released pandas version 0.24.rc1
> > [8]
> >
> > This release candidate is based on commit:
> > 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> >
> > The source release rc2 is hosted at [3].
> > The binary artifacts are hosted at [4].
> > The changelog is located at [5].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [7] for how to validate a release candidate.
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow 0.12.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> >
> > Special thanks to @kou for helping with the uprising issues!
> >
> > - Krisztian
> >
> > [1]:
> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > [2]:
> > https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > 
> > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > [5]:
> > https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > [7]:
> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> >

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Antoine Pitrou]

Unfortunately I cannot validate the source release on Ubuntu 18.04,
as brotli fails compiling with a internal compiler error
(this is gcc 7.3.0):

/tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:
 In function ‘BrotliCompressFragmentFastImpl13’:
/tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1:
 internal compiler error: Erreur de segmentation
 FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
 ^~~
Please submit a full bug report,
with preprocessed source if appropriate.
See  for instructions.
make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
make[3]: *** [all] Error 2


Regards

Antoine.


Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> Hi,
> 
> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> The previous RCs were not voted, because:
> - RC0: the source archive didn't include required files to build
> gandiva-glib
>   documents, also causing failed binary build for Debian Stretch [6].
> - RC1: compatibility issues with the just released pandas version 0.24.rc1
> [8]
> 
> This release candidate is based on commit:
> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> 
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4].
> The changelog is located at [5].
> 
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [7] for how to validate a release candidate.
> 
> The vote will be open for at least 72 hours.
> 
> [ ] +1 Release this as Apache Arrow 0.12.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> 
> Special thanks to @kou for helping with the uprising issues!
> 
> - Krisztian
> 
> [1]:
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> [2]:
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> 
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> [5]:
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> [7]:
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> 

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Antoine Pitrou]

Apparently the binaries verification script attempts to download from
dist.apache.org?

$ dev/release/verify-release-candidate.sh binaries 0.12.0 rc2
[...]
+ wget -P apache-arrow-0.12.0-rcrc2 --quiet --no-host-directories
--cut-dirs=5 --no-parent --reject 'index.html*' --recursive
https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rcrc2/binaries/



Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> Hi,
> 
> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> The previous RCs were not voted, because:
> - RC0: the source archive didn't include required files to build
> gandiva-glib
>   documents, also causing failed binary build for Debian Stretch [6].
> - RC1: compatibility issues with the just released pandas version 0.24.rc1
> [8]
> 
> This release candidate is based on commit:
> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> 
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4].
> The changelog is located at [5].
> 
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [7] for how to validate a release candidate.
> 
> The vote will be open for at least 72 hours.
> 
> [ ] +1 Release this as Apache Arrow 0.12.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> 
> Special thanks to @kou for helping with the uprising issues!
> 
> - Krisztian
> 
> [1]:
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> [2]:
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> 
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> [5]:
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> [7]:
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> 

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Philipp Moritz]

+1 (non-binding)

I didn't do very exhaustive tests, but the full Ray test suite passes based
on that commit.

On Sun, Jan 13, 2019 at 8:59 PM Wes McKinney  wrote:

> +1 (binding)
>
> Ran release verification scripts (for source release) on Ubuntu 14.04
> (with ARROW_HAVE_CUDA=yes) and Windows / Visual Studio 2015 with some
> caveats
>
> * ARROW-4250: Gandiva test failing due to exact floating point
> comparison on Ubuntu 14.04
> * ARROW-4253: GLib cannot use a non-system Boost
> * ARROW-4254: Ubuntu 14.04 Boost from apt has compilation errors in
> Gandiva unit tests
> * ARROW-4256: Windows verification script fix (patch up)
> * ARROW-4257: Update release verification script now that the staged
> binaries are on Bintray
>
> None of these issues are very significant. I hope we can work toward a
> more smooth 0.13 release
>
> On Sun, Jan 13, 2019 at 10:14 AM Andy Grove  wrote:
> >
> > Speaking for the Rust implementation only ...
> >
> > - The code compiles and tests pass
> > - The version number of both crates (arrow and parquet) is correctly set
> to
> > 0.12.0
> > - The parquet crate still depends on the arrow crate using a local path
> > (../arrow) rather than depending on the published 0.12.0 (which doesn't
> > exist yet) so technically cannot be published as is (but we can manually
> > change that dependency when publishing, so I don't see it as a big deal
> at
> > all)
> >
> > So it's a +1 from me.
> >
> > Andy.
> >
> > On Sat, Jan 12, 2019 at 12:56 PM Krisztián Szűcs <
> szucs.kriszt...@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > I'd like to propose the 1st release candidate (RC2) of Apache Arrow
> version
> > > 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > > The previous RCs were not voted, because:
> > > - RC0: the source archive didn't include required files to build
> > > gandiva-glib
> > >   documents, also causing failed binary build for Debian Stretch [6].
> > > - RC1: compatibility issues with the just released pandas version
> 0.24.rc1
> > > [8]
> > >
> > > This release candidate is based on commit:
> > > 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> > >
> > > The source release rc2 is hosted at [3].
> > > The binary artifacts are hosted at [4].
> > > The changelog is located at [5].
> > >
> > > Please download, verify checksums and signatures, run the unit tests,
> > > and vote on the release. See [7] for how to validate a release
> candidate.
> > >
> > > The vote will be open for at least 72 hours.
> > >
> > > [ ] +1 Release this as Apache Arrow 0.12.0
> > > [ ] +0
> > > [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> > >
> > > Special thanks to @kou for helping with the uprising issues!
> > >
> > > - Krisztian
> > >
> > > [1]:
> > >
> > >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > > [2]:
> > >
> > >
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > > <
> > >
> https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359
> > > >
> > > [3]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > > [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > > [5]:
> > >
> > >
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > > [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > > [7]:
> > >
> > >
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > > [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> > >
>

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Wes McKinney]

+1 (binding)

Ran release verification scripts (for source release) on Ubuntu 14.04
(with ARROW_HAVE_CUDA=yes) and Windows / Visual Studio 2015 with some
caveats

* ARROW-4250: Gandiva test failing due to exact floating point
comparison on Ubuntu 14.04
* ARROW-4253: GLib cannot use a non-system Boost
* ARROW-4254: Ubuntu 14.04 Boost from apt has compilation errors in
Gandiva unit tests
* ARROW-4256: Windows verification script fix (patch up)
* ARROW-4257: Update release verification script now that the staged
binaries are on Bintray

None of these issues are very significant. I hope we can work toward a
more smooth 0.13 release

On Sun, Jan 13, 2019 at 10:14 AM Andy Grove  wrote:
>
> Speaking for the Rust implementation only ...
>
> - The code compiles and tests pass
> - The version number of both crates (arrow and parquet) is correctly set to
> 0.12.0
> - The parquet crate still depends on the arrow crate using a local path
> (../arrow) rather than depending on the published 0.12.0 (which doesn't
> exist yet) so technically cannot be published as is (but we can manually
> change that dependency when publishing, so I don't see it as a big deal at
> all)
>
> So it's a +1 from me.
>
> Andy.
>
> On Sat, Jan 12, 2019 at 12:56 PM Krisztián Szűcs 
> wrote:
>
> > Hi,
> >
> > I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> > 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > The previous RCs were not voted, because:
> > - RC0: the source archive didn't include required files to build
> > gandiva-glib
> >   documents, also causing failed binary build for Debian Stretch [6].
> > - RC1: compatibility issues with the just released pandas version 0.24.rc1
> > [8]
> >
> > This release candidate is based on commit:
> > 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> >
> > The source release rc2 is hosted at [3].
> > The binary artifacts are hosted at [4].
> > The changelog is located at [5].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [7] for how to validate a release candidate.
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow 0.12.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> >
> > Special thanks to @kou for helping with the uprising issues!
> >
> > - Krisztian
> >
> > [1]:
> >
> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > [2]:
> >
> > https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > <
> > https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359
> > >
> > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > [5]:
> >
> > https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > [7]:
> >
> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> >

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Andy Grove]

Speaking for the Rust implementation only ...

- The code compiles and tests pass
- The version number of both crates (arrow and parquet) is correctly set to
0.12.0
- The parquet crate still depends on the arrow crate using a local path
(../arrow) rather than depending on the published 0.12.0 (which doesn't
exist yet) so technically cannot be published as is (but we can manually
change that dependency when publishing, so I don't see it as a big deal at
all)

So it's a +1 from me.

Andy.

On Sat, Jan 12, 2019 at 12:56 PM Krisztián Szűcs 
wrote:

> Hi,
>
> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> The previous RCs were not voted, because:
> - RC0: the source archive didn't include required files to build
> gandiva-glib
>   documents, also causing failed binary build for Debian Stretch [6].
> - RC1: compatibility issues with the just released pandas version 0.24.rc1
> [8]
>
> This release candidate is based on commit:
> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
>
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4].
> The changelog is located at [5].
>
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [7] for how to validate a release candidate.
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Release this as Apache Arrow 0.12.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
>
> Special thanks to @kou for helping with the uprising issues!
>
> - Krisztian
>
> [1]:
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> [2]:
>
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> <
> https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359
> >
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> [5]:
>
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> [7]:
>
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
>

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Krisztián Szűcs]

On Sun, Jan 13, 2019 at 4:43 AM Kouhei Sutou  wrote:

> +1 (binding) with a trivial fix.
>
> The following checksum files use absolute paths:
>
>
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/apache-arrow-0.12.0.tar.gz.sha256
>
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/apache-arrow-0.12.0.tar.gz.sha512

Updated.

>
> We need to update verify script for changes between 0.11.1
> and 0.12.0:
>
>   https://github.com/apache/arrow/pull/3389

Merged.

Thanks Kou!

>
>
> I ran the followings on Debian GNU/Linux sid:
>
>   * ARROW_HAVE_CUDA=no CC=gcc-7 CXX=g++-7
> dev/release/verify-release-candidate.sh binaries 0.12.0 2
>   * ARROW_HAVE_CUDA=yes CC=gcc-7 CXX=g++-7
> dev/release/verify-release-candidate.sh binaries 0.12.0 2
>
> with:
>
>   * gcc-7 (Debian 7.4.0-2) 7.4.0
>   * openjdk version "1.8.0_191"
>   * ruby 2.7.0dev (2019-01-05 trunk 66719) [x86_64-linux]
>   * Node.js v10.15.0
>
>
> There is a problem in Plasma + Python + CUDA:
>
>   https://issues.apache.org/jira/browse/ARROW-4246
>
> I don't think that this is a blocker.
>
> Other modules work well with ARROW_HAVE_GPU=yes.
>
>
> There is a problem with GCC 8:
>
>   https://issues.apache.org/jira/browse/ARROW-4242
>
> I don't think that this is a blocker.
>
>
> Thanks,
> --
> kou
>
> In 
>   "[VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Sat, 12 Jan 2019
> 20:56:28 +0100,
>   Krisztián Szűcs  wrote:
>
> > Hi,
> >
> > I'd like to propose the 1st release candidate (RC2) of Apache Arrow
> version
> > 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > The previous RCs were not voted, because:
> > - RC0: the source archive didn't include required files to build
> > gandiva-glib
> >   documents, also causing failed binary build for Debian Stretch [6].
> > - RC1: compatibility issues with the just released pandas version
> 0.24.rc1
> > [8]
> >
> > This release candidate is based on commit:
> > 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> >
> > The source release rc2 is hosted at [3].
> > The binary artifacts are hosted at [4].
> > The changelog is located at [5].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [7] for how to validate a release candidate.
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow 0.12.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> >
> > Special thanks to @kou for helping with the uprising issues!
> >
> > - Krisztian
> >
> > [1]:
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > [2]:
> >
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > <
> https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359
> >
> > [3]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > [5]:
> >
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > [7]:
> >
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
>

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Kouhei Sutou]

+1 (binding) with a trivial fix.

The following checksum files use absolute paths:

  
https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/apache-arrow-0.12.0.tar.gz.sha256
  
https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/apache-arrow-0.12.0.tar.gz.sha512

I think that we need to replace the files with basename only
path.

I verified checksums with the following change:


diff --git a/dev/release/verify-release-candidate.sh 
b/dev/release/verify-release-candidate.sh
index c8b9c54c..d992c43c 100755
--- a/dev/release/verify-release-candidate.sh
+++ b/dev/release/verify-release-candidate.sh
@@ -83,8 +83,8 @@ fetch_archive() {
   download_rc_file ${dist_name}.tar.gz.sha256
   download_rc_file ${dist_name}.tar.gz.sha512
   gpg --verify ${dist_name}.tar.gz.asc ${dist_name}.tar.gz
-  shasum -a 256 -c ${dist_name}.tar.gz.sha256
-  shasum -a 512 -c ${dist_name}.tar.gz.sha512
+  sed -E -e 's,/+.+/,,g' ${dist_name}.tar.gz.sha256 | shasum -a 256 -c
+  sed -E -e 's,/+.+/,,g' ${dist_name}.tar.gz.sha512 | shasum -a 512 -c
 }
 
 verify_binary_artifacts() {


We need to update verify script for changes between 0.11.1
and 0.12.0:

  https://github.com/apache/arrow/pull/3389

I ran the followings on Debian GNU/Linux sid:

  * ARROW_HAVE_CUDA=no CC=gcc-7 CXX=g++-7 
dev/release/verify-release-candidate.sh binaries 0.12.0 2
  * ARROW_HAVE_CUDA=yes CC=gcc-7 CXX=g++-7 
dev/release/verify-release-candidate.sh binaries 0.12.0 2

with:

  * gcc-7 (Debian 7.4.0-2) 7.4.0
  * openjdk version "1.8.0_191"
  * ruby 2.7.0dev (2019-01-05 trunk 66719) [x86_64-linux]
  * Node.js v10.15.0


There is a problem in Plasma + Python + CUDA:

  https://issues.apache.org/jira/browse/ARROW-4246

I don't think that this is a blocker.

Other modules work well with ARROW_HAVE_GPU=yes.


There is a problem with GCC 8:

  https://issues.apache.org/jira/browse/ARROW-4242

I don't think that this is a blocker.


Thanks,
--
kou

In 
  "[VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Sat, 12 Jan 2019 20:56:28 
+0100,
  Krisztián Szűcs  wrote:

> Hi,
> 
> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> The previous RCs were not voted, because:
> - RC0: the source archive didn't include required files to build
> gandiva-glib
>   documents, also causing failed binary build for Debian Stretch [6].
> - RC1: compatibility issues with the just released pandas version 0.24.rc1
> [8]
> 
> This release candidate is based on commit:
> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> 
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4].
> The changelog is located at [5].
> 
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [7] for how to validate a release candidate.
> 
> The vote will be open for at least 72 hours.
> 
> [ ] +1 Release this as Apache Arrow 0.12.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> 
> Special thanks to @kou for helping with the uprising issues!
> 
> - Krisztian
> 
> [1]:
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> [2]:
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> [5]:
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> [7]:
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640

[VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

[Krisztián Szűcs]

Hi,

I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
The previous RCs were not voted, because:
- RC0: the source archive didn't include required files to build
gandiva-glib
  documents, also causing failed binary build for Debian Stretch [6].
- RC1: compatibility issues with the just released pandas version 0.24.rc1
[8]

This release candidate is based on commit:
0bbaef451ae9d59799e693df9b2383808516a326 [2]

The source release rc2 is hosted at [3].
The binary artifacts are hosted at [4].
The changelog is located at [5].

Please download, verify checksums and signatures, run the unit tests,
and vote on the release. See [7] for how to validate a release candidate.

The vote will be open for at least 72 hours.

[ ] +1 Release this as Apache Arrow 0.12.0
[ ] +0
[ ] -1 Do not release this as Apache Arrow 0.12.0 because...

Special thanks to @kou for helping with the uprising issues!

- Krisztian

[1]:
https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
[2]:
https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326

[3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
[4]: https://bintray.com/beta/#/apache/arrow?tab=packages
[5]:
https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
[6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
[7]:
https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
[8]: https://travis-ci.org/kszucs/crossbow/builds/478558640