Re: [ANNOUNCE] New Arrow committer: Xuwei Fu

2023-10-24 Thread Ian Joiner 
Congrats!

On Mon, Oct 23, 2023 at 2:33 AM Sutou Kouhei  wrote:

> On behalf of the Arrow PMC, I'm happy to announce that Xuwei Fu
> has accepted an invitation to become a committer on Apache
> Arrow. Welcome, and thank you for your contributions!
>
> --
> kou
>

Re: [VOTE] Release Apache Arrow 14.0.0 - RC2

2023-10-24 Thread Sutou Kouhei 
Hi,

https://github.com/apache/arrow/pull/38450 should fix it.
This is not a blocker because this is a verification script
problem not source archive problem.


Thanks,
-- 
kou

In 
  "Re: [VOTE] Release Apache Arrow 14.0.0 - RC2" on Tue, 24 Oct 2023 20:13:57 
+0200,
  Raúl Cumplido  wrote:

> Hi Bryce,
> 
> This happened on the verification tasks and is related to this issue [1].
> 
> It should be solved if you pull the latest main and the related
> testing submodules.
> 
> Thanks,
> Raúl
> 
> [1] https://github.com/apache/arrow/issues/38345
> 
> El mar, 24 oct 2023 a las 20:02, Bryce Mecum () 
> escribió:
>>
>> I've failed to verify this release candidate on macOS M1, running
>> "dev/release/verify-release-candidate.sh 14.0.0 2" [1]. The failure
>> looks related to the Go implementation's "parquet-encryption-test".
>> Can anyone on a similar machine verify?
>>
>> [1] https://gist.github.com/amoeba/f47534bea44d78a7ee79e4b44ed0e4ff
>>
>>
>> On Mon, Oct 23, 2023 at 11:19 PM Raúl Cumplido  wrote:
>> >
>> > Hi,
>> >
>> > I would like to propose the following release candidate (RC2) of Apache
>> > Arrow version 14.0.0. This is a release consisting of 461
>> > resolved GitHub issues[1].
>> >
>> > This release candidate is based on commit:
>> > 2dcee3f82c6cf54b53a64729fd81840efa583244 [2]
>> >
>> > The source release rc2 is hosted at [3].
>> > The binary artifacts are hosted at [4][5][6][7][8][9][10][11].
>> > The changelog is located at [12].
>> >
>> > Please download, verify checksums and signatures, run the unit tests,
>> > and vote on the release. See [13] for how to validate a release candidate.
>> >
>> > See also a verification result on GitHub pull request [14].
>> >
>> > The vote will be open for at least 72 hours.
>> >
>> > [ ] +1 Release this as Apache Arrow 14.0.0
>> > [ ] +0
>> > [ ] -1 Do not release this as Apache Arrow 14.0.0 because...
>> >
>> > [1]: 
>> > https://github.com/apache/arrow/issues?q=is%3Aissue+milestone%3A14.0.0+is%3Aclosed
>> > [2]: 
>> > https://github.com/apache/arrow/tree/2dcee3f82c6cf54b53a64729fd81840efa583244
>> > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-14.0.0-rc2
>> > [4]: https://apache.jfrog.io/artifactory/arrow/almalinux-rc/
>> > [5]: https://apache.jfrog.io/artifactory/arrow/amazon-linux-rc/
>> > [6]: https://apache.jfrog.io/artifactory/arrow/centos-rc/
>> > [7]: https://apache.jfrog.io/artifactory/arrow/debian-rc/
>> > [8]: https://apache.jfrog.io/artifactory/arrow/java-rc/14.0.0-rc2
>> > [9]: https://apache.jfrog.io/artifactory/arrow/nuget-rc/14.0.0-rc2
>> > [10]: https://apache.jfrog.io/artifactory/arrow/python-rc/14.0.0-rc2
>> > [11]: https://apache.jfrog.io/artifactory/arrow/ubuntu-rc/
>> > [12]: 
>> > https://github.com/apache/arrow/blob/2dcee3f82c6cf54b53a64729fd81840efa583244/CHANGELOG.md
>> > [13]: 
>> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> > [14]: https://github.com/apache/arrow/pull/38343

Re: [VOTE] Release Apache Arrow 14.0.0 - RC2

2023-10-24 Thread Sutou Kouhei 
Hi,

Hmm. It's strange. It's succeeded on my environment:


::group::Test Apache Arrow Flight
+ dnf install -y arrow-flight-glib-devel-14.0.0
Last metadata expiration check: 0:01:19 ago on Wed Oct 25 04:32:56 2023.
Dependencies resolved.
===
 PackageArchVersion   Repository
   Size
===
Installing:
 arrow-flight-glib-develx86_64  14.0.0-1.amzn2023 
apache-arrow-amazon-linux-2023  105 k
Installing dependencies:
 abseil-cpp x86_64  20220623.1-4.amzn2023.0.1 amazonlinux   
  550 k
 abseil-cpp-devel   x86_64  20220623.1-4.amzn2023.0.1 amazonlinux   
  656 k
 arrow-flight-devel x86_64  14.0.0-1.amzn2023 
apache-arrow-amazon-linux-2023  591 k
 arrow14-flight-glib-libs   x86_64  14.0.0-1.amzn2023 
apache-arrow-amazon-linux-2023   74 k
 arrow14-flight-libsx86_64  14.0.0-1.amzn2023 
apache-arrow-amazon-linux-2023  337 k
 c-ares x86_64  1.19.0-1.amzn2023 amazonlinux   
  110 k
 c-ares-devel   x86_64  1.19.0-1.amzn2023 amazonlinux   
  100 k
 gmock  x86_64  1.11.0-1.amzn2023.0.3 amazonlinux   
   60 k
 gmock-develx86_64  1.11.0-1.amzn2023.0.3 amazonlinux   
  205 k
 grpc   x86_64  1.56.2-10.amzn2023amazonlinux   
  4.1 M
 grpc-cpp   x86_64  1.56.2-10.amzn2023amazonlinux   
  677 k
 grpc-data  noarch  1.56.2-10.amzn2023amazonlinux   
   18 k
 grpc-devel x86_64  1.56.2-10.amzn2023amazonlinux   
  214 k
 grpc-plugins   x86_64  1.56.2-10.amzn2023amazonlinux   
   41 k
 gtest  x86_64  1.11.0-1.amzn2023.0.3 amazonlinux   
  164 k
 gtest-develx86_64  1.11.0-1.amzn2023.0.3 amazonlinux   
  237 k
 protobuf-compiler  x86_64  3.19.6-1.amzn2023.0.1 amazonlinux   
  750 k
 protobuf-devel x86_64  3.19.6-1.amzn2023.0.1 amazonlinux   
  370 k

Transaction Summary
===
Install  19 Packages
...



Thanks,
-- 
kou

In 
  "Re: [VOTE] Release Apache Arrow 14.0.0 - RC2" on Tue, 24 Oct 2023 18:58:39 
+0200,
  Raúl Cumplido  wrote:

> I've verified successfully the sources and the following binaries:
> 
> TEST_DEFAULT=0 TEST_SOURCE=1 dev/release/verify-release-candidate.sh 14.0.0 2
> TEST_DEFAULT=0 TEST_APT=1 dev/release/verify-release-candidate.sh 14.0.0 2
> TEST_DEFAULT=0 TEST_BINARY=1 dev/release/verify-release-candidate.sh 14.0.0 2
> TEST_DEFAULT=0 TEST_JARS=1 dev/release/verify-release-candidate.sh 14.0.0 2
> TEST_DEFAULT=0 TEST_WHEELS=1 dev/release/verify-release-candidate.sh 14.0.0 2
> 
> When verifying the yum packages I am having an issue with the Amazon
> Linux 2023 packages. If I remove the Amazon Linux 2023 from the
> verification all the rest of yum packages are successful.
> TEST_DEFAULT=0 TEST_YUM=1 dev/release/verify-release-candidate.sh 14.0.0 2
> 
> + echo '::group::Test Apache Arrow Flight'
> + dnf install -y arrow-flight-glib-devel-14.0.0
> Last metadata expiration check: 0:00:53 ago on Tue Oct 24 14:37:42 2023.
> (try to add '--skip-broken' to skip uninstallable packages)
> Error:
>  Problem: package arrow-flight-glib-devel-14.0.0-1.amzn2023.x86_64
> requires arrow-flight-devel = 14.0.0-1.amzn2023, but none of the
> providers can be installed
>   - package arrow-flight-devel-14.0.0-1.amzn2023.x86_64 requires
> arrow14-flight-libs = 14.0.0-1.amzn2023, but none of the providers can
> be installed
>   - package arrow-flight-devel-14.0.0-1.amzn2023.x86_64 requires
> libarrow_flight.so.1400()(64bit), but none of the providers can be
> installed
>   - conflicting requests
>   - nothing provides libabsl_cord.so.2206.0.0()(64bit) needed by
> arrow14-flight-libs-14.0.0-1.amzn2023.x86_64
>   - nothing provides libabsl_cordz_functions.so.2206.0.0()(64bit)
> needed by arrow14-flight-libs-14.0.0-1.amzn2023.x86_64
>   - nothing provides libabsl_cordz_info.so.2206.0.0()(64bit) needed by
> arrow14-flight-libs-14.0.0-1.amzn2023.x86_64
>   - nothing provides libabsl_synchronization.so.2206.0.0()(64bit)
> needed by arrow14-flight-libs-14.0.0-1.amzn2023.x86_64
>   - nothing provides libgpr.so.33()(64bit) needed by
> arrow14-flight-libs-14.0.0-1.amzn2023.x86_64
>   - nothing provides libgrpc++.so.1.56()(64bit) needed by
> arrow14-flight-libs-14.0.0-1.amzn2023.x86_64
>   - nothing provides libgrpc.so.33()(

Re: [VOTE] Release Apache Arrow 14.0.0 - RC2

2023-10-24 Thread Sutou Kouhei 
+1

I ran the followings on Debian GNU/Linux sid:

  * TEST_DEFAULT=0 \
  TEST_SOURCE=1 \
  LANG=C \
  TZ=UTC \
  CUDAToolkit_ROOT=/usr \
  ARROW_CMAKE_OPTIONS="-DBoost_NO_BOOST_CMAKE=ON -Dxsimd_SOURCE=BUNDLED" \
  dev/release/verify-release-candidate.sh 14.0.0 2

  * TEST_DEFAULT=0 \
  TEST_APT=1 \
  LANG=C \
  dev/release/verify-release-candidate.sh 14.0.0 2

  * TEST_DEFAULT=0 \
  TEST_BINARY=1 \
  LANG=C \
  dev/release/verify-release-candidate.sh 14.0.0 2

  * TEST_DEFAULT=0 \
  TEST_JARS=1 \
  LANG=C \
  dev/release/verify-release-candidate.sh 14.0.0 2

  * TEST_DEFAULT=0 \
  TEST_PYTHON_VERSIONS=3.11 \
  TEST_WHEELS=1 \
  LANG=C \
  dev/release/verify-release-candidate.sh 14.0.0 2

  * TEST_DEFAULT=0 \
  TEST_YUM=1 \
  LANG=C \
  dev/release/verify-release-candidate.sh 14.0.0 2

with:

  * .NET SDK (7.0.401)
  * Python 3.11.5
  * gcc (Debian 13.2.0-4) 13.2.0
  * nvidia-cuda-dev 12.0.146~12.0.1-2
  * openjdk version "17.0.9-ea" 2023-10-17
  * ruby 3.1.2p20 (2022-04-12 revision 4491bb740a) [x86_64-linux-gnu]


Thanks,
-- 
kou


In 
  "[VOTE] Release Apache Arrow 14.0.0 - RC2" on Tue, 24 Oct 2023 09:17:59 +0200,
  Raúl Cumplido  wrote:

> Hi,
> 
> I would like to propose the following release candidate (RC2) of Apache
> Arrow version 14.0.0. This is a release consisting of 461
> resolved GitHub issues[1].
> 
> This release candidate is based on commit:
> 2dcee3f82c6cf54b53a64729fd81840efa583244 [2]
> 
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4][5][6][7][8][9][10][11].
> The changelog is located at [12].
> 
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [13] for how to validate a release candidate.
> 
> See also a verification result on GitHub pull request [14].
> 
> The vote will be open for at least 72 hours.
> 
> [ ] +1 Release this as Apache Arrow 14.0.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 14.0.0 because...
> 
> [1]: 
> https://github.com/apache/arrow/issues?q=is%3Aissue+milestone%3A14.0.0+is%3Aclosed
> [2]: 
> https://github.com/apache/arrow/tree/2dcee3f82c6cf54b53a64729fd81840efa583244
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-14.0.0-rc2
> [4]: https://apache.jfrog.io/artifactory/arrow/almalinux-rc/
> [5]: https://apache.jfrog.io/artifactory/arrow/amazon-linux-rc/
> [6]: https://apache.jfrog.io/artifactory/arrow/centos-rc/
> [7]: https://apache.jfrog.io/artifactory/arrow/debian-rc/
> [8]: https://apache.jfrog.io/artifactory/arrow/java-rc/14.0.0-rc2
> [9]: https://apache.jfrog.io/artifactory/arrow/nuget-rc/14.0.0-rc2
> [10]: https://apache.jfrog.io/artifactory/arrow/python-rc/14.0.0-rc2
> [11]: https://apache.jfrog.io/artifactory/arrow/ubuntu-rc/
> [12]: 
> https://github.com/apache/arrow/blob/2dcee3f82c6cf54b53a64729fd81840efa583244/CHANGELOG.md
> [13]: 
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> [14]: https://github.com/apache/arrow/pull/38343

Re: [VOTE] Release Apache Arrow 14.0.0 - RC2

2023-10-24 Thread Jacob Wujciak-Jens 
+1 (non-binding)

pop_os 22.04

On Tue, Oct 24, 2023 at 8:14 PM Raúl Cumplido 
wrote:

> Hi Bryce,
>
> This happened on the verification tasks and is related to this issue [1].
>
> It should be solved if you pull the latest main and the related
> testing submodules.
>
> Thanks,
> Raúl
>
> [1] https://github.com/apache/arrow/issues/38345
>
> El mar, 24 oct 2023 a las 20:02, Bryce Mecum ()
> escribió:
> >
> > I've failed to verify this release candidate on macOS M1, running
> > "dev/release/verify-release-candidate.sh 14.0.0 2" [1]. The failure
> > looks related to the Go implementation's "parquet-encryption-test".
> > Can anyone on a similar machine verify?
> >
> > [1] https://gist.github.com/amoeba/f47534bea44d78a7ee79e4b44ed0e4ff
> >
> >
> > On Mon, Oct 23, 2023 at 11:19 PM Raúl Cumplido 
> wrote:
> > >
> > > Hi,
> > >
> > > I would like to propose the following release candidate (RC2) of Apache
> > > Arrow version 14.0.0. This is a release consisting of 461
> > > resolved GitHub issues[1].
> > >
> > > This release candidate is based on commit:
> > > 2dcee3f82c6cf54b53a64729fd81840efa583244 [2]
> > >
> > > The source release rc2 is hosted at [3].
> > > The binary artifacts are hosted at [4][5][6][7][8][9][10][11].
> > > The changelog is located at [12].
> > >
> > > Please download, verify checksums and signatures, run the unit tests,
> > > and vote on the release. See [13] for how to validate a release
> candidate.
> > >
> > > See also a verification result on GitHub pull request [14].
> > >
> > > The vote will be open for at least 72 hours.
> > >
> > > [ ] +1 Release this as Apache Arrow 14.0.0
> > > [ ] +0
> > > [ ] -1 Do not release this as Apache Arrow 14.0.0 because...
> > >
> > > [1]:
> https://github.com/apache/arrow/issues?q=is%3Aissue+milestone%3A14.0.0+is%3Aclosed
> > > [2]:
> https://github.com/apache/arrow/tree/2dcee3f82c6cf54b53a64729fd81840efa583244
> > > [3]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-14.0.0-rc2
> > > [4]: https://apache.jfrog.io/artifactory/arrow/almalinux-rc/
> > > [5]: https://apache.jfrog.io/artifactory/arrow/amazon-linux-rc/
> > > [6]: https://apache.jfrog.io/artifactory/arrow/centos-rc/
> > > [7]: https://apache.jfrog.io/artifactory/arrow/debian-rc/
> > > [8]: https://apache.jfrog.io/artifactory/arrow/java-rc/14.0.0-rc2
> > > [9]: https://apache.jfrog.io/artifactory/arrow/nuget-rc/14.0.0-rc2
> > > [10]: https://apache.jfrog.io/artifactory/arrow/python-rc/14.0.0-rc2
> > > [11]: https://apache.jfrog.io/artifactory/arrow/ubuntu-rc/
> > > [12]:
> https://github.com/apache/arrow/blob/2dcee3f82c6cf54b53a64729fd81840efa583244/CHANGELOG.md
> > > [13]:
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > > [14]: https://github.com/apache/arrow/pull/38343
>

Re: Request for Assistance with MATLAB CI Workflow Issue

2023-10-24 Thread Divyansh Khatri 
Hi Kevin,

I appreciate the detailed code review comments you've provided on
addressing the CI failures. I will carefully review your feedback and reach
out on the PR if I have any specific questions.

-Divyansh

On Wed, Oct 25, 2023, 1:40 AM Kevin Gurney 
wrote:

> Hi Divyansh,
>
> As Dane pointed out, I did leave some code review comments earlier today
> on the PR that may provide some guidance on how to address the CI failures.
>
> If you have any specific questions about any of the code review feedback,
> please feel free to continue the discussion on the PR, and I will be happy
> to provide further assistance.
>
> Best Regards,
>
> Kevin Gurney
>
> 
>
>

Re: [VOTE][RUST][DataFusion] Release DataFusion Python Bindings 32.0.0 RC1

2023-10-24 Thread Andrew Lamb 
+1 (binding) on x86 mac

Thank you Andy -- I know this takes effort to keep going, but it is really
valuable to keep these releases flowing

Andrew

On Sat, Oct 21, 2023 at 4:48 PM L. C. Hsieh  wrote:

> +1 (binding)
>
> Verified on M1 Mac.
>
> Thanks Andy.
>
> On Sat, Oct 21, 2023 at 1:42 PM Andy Grove  wrote:
> >
> > Hi,
> >
> > I would like to propose a release of Apache Arrow DataFusion Python
> > Bindings,
> > version 32.0.0.
> >
> > This release candidate is based on commit:
> > fc3c24b52e8bfa1e170fb9f3708fe014e41b3e9e [1]
> > The proposed release tarball and signatures are hosted at [2].
> > The changelog is located at [3].
> > The Python wheels are located at [4].
> >
> > Please download, verify checksums and signatures, run the unit tests, and
> > vote
> > on the release. The vote will be open for at least 72 hours.
> >
> > Only votes from PMC members are binding, but all members of the community
> > are
> > encouraged to test the release and vote with "(non-binding)".
> >
> > The standard verification procedure is documented at
> >
> https://github.com/apache/arrow-datafusion-python/blob/main/dev/release/README.md#verifying-release-candidates
> > .
> >
> > [ ] +1 Release this as Apache Arrow DataFusion Python 32.0.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow DataFusion Python 32.0.0
> > because...
> >
> > Here is my vote:
> >
> > +1
> >
> > [1]:
> >
> https://github.com/apache/arrow-datafusion-python/tree/fc3c24b52e8bfa1e170fb9f3708fe014e41b3e9e
> > [2]:
> >
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-datafusion-python-32.0.0-rc1
> > [3]:
> >
> https://github.com/apache/arrow-datafusion-python/blob/fc3c24b52e8bfa1e170fb9f3708fe014e41b3e9e/CHANGELOG.md
> > [4]: https://test.pypi.org/project/datafusion/32.0.0/
>

Re: Request for Assistance with MATLAB CI Workflow Issue

2023-10-24 Thread Kevin Gurney 
Hi Divyansh,

As Dane pointed out, I did leave some code review comments earlier today on the 
PR that may provide some guidance on how to address the CI failures.

If you have any specific questions about any of the code review feedback, 
please feel free to continue the discussion on the PR, and I will be happy to 
provide further assistance.

Best Regards,

Kevin Gurney


From: Dane Pitkin 
Sent: Tuesday, October 24, 2023 3:49 PM
To: dev@arrow.apache.org 
Subject: Re: Request for Assistance with MATLAB CI Workflow Issue

Hey Divyansh,

I suggest discussing this on the PR[1] itself. You will get the best
discussion there, where comments can be added to the code review directly.
It looks like there is a MATLAB reviewer that has already left feedback
that may be helpful.

[1]https://github.com/apache/arrow/pull/38274

On Tue, Oct 24, 2023 at 2:28 PM Divyansh Khatri 
wrote:

> I am currently working on GitHub Issue #38211, titled "[MATLAB] Add support
> for creating an empty arrow.tabular.RecordBatch by calling
> arrow.recordBatch with no input arguments." As a beginner in MATLAB
> development, I am facing challenges with the failing MATLAB CI workflow
> associated with this issue. We need to ensure that all the appropriate test
> cases pass as expected.
> If you have any insights or suggestions on how to fix this issue, please
> share them with me.
>
> -Divyansh
>

Re: [ANNOUNCE] New Arrow committer: Xuwei Fu

2023-10-24 Thread Andrew Lamb 
Congratulations and welcome!

On Mon, Oct 23, 2023 at 5:07 PM David Li  wrote:

> Welcome, Xuwei!
>
> On Mon, Oct 23, 2023, at 11:41, Kevin Gurney wrote:
> > Congratulations, Xuwei!
> > 
> > From: Jacob Wujciak-Jens 
> > Sent: Monday, October 23, 2023 11:13 AM
> > To: dev@arrow.apache.org 
> > Subject: Re: [ANNOUNCE] New Arrow committer: Xuwei Fu
> >
> > Congrats and welcome!
> >
> > On Mon, Oct 23, 2023 at 5:02 PM Ian Cook  wrote:
> >
> >> Congratulations Xuwei!
> >>
> >> On Mon, Oct 23, 2023 at 12:46 AM Sutou Kouhei 
> wrote:
> >> >
> >> > On behalf of the Arrow PMC, I'm happy to announce that Xuwei Fu
> >> > has accepted an invitation to become a committer on Apache
> >> > Arrow. Welcome, and thank you for your contributions!
> >> >
> >> > --
> >> > kou
> >>
>

Re: Request for Assistance with MATLAB CI Workflow Issue

2023-10-24 Thread Dane Pitkin 
Hey Divyansh,

I suggest discussing this on the PR[1] itself. You will get the best
discussion there, where comments can be added to the code review directly.
It looks like there is a MATLAB reviewer that has already left feedback
that may be helpful.

[1]https://github.com/apache/arrow/pull/38274

On Tue, Oct 24, 2023 at 2:28 PM Divyansh Khatri 
wrote:

> I am currently working on GitHub Issue #38211, titled "[MATLAB] Add support
> for creating an empty arrow.tabular.RecordBatch by calling
> arrow.recordBatch with no input arguments." As a beginner in MATLAB
> development, I am facing challenges with the failing MATLAB CI workflow
> associated with this issue. We need to ensure that all the appropriate test
> cases pass as expected.
> If you have any insights or suggestions on how to fix this issue, please
> share them with me.
>
> -Divyansh
>

Request for Assistance with MATLAB CI Workflow Issue

2023-10-24 Thread Divyansh Khatri 
I am currently working on GitHub Issue #38211, titled "[MATLAB] Add support
for creating an empty arrow.tabular.RecordBatch by calling
arrow.recordBatch with no input arguments." As a beginner in MATLAB
development, I am facing challenges with the failing MATLAB CI workflow
associated with this issue. We need to ensure that all the appropriate test
cases pass as expected.
If you have any insights or suggestions on how to fix this issue, please
share them with me.

-Divyansh

Re: [VOTE] Release Apache Arrow 14.0.0 - RC2

2023-10-24 Thread Raúl Cumplido 
Hi Bryce,

This happened on the verification tasks and is related to this issue [1].

It should be solved if you pull the latest main and the related
testing submodules.

Thanks,
Raúl

[1] https://github.com/apache/arrow/issues/38345

El mar, 24 oct 2023 a las 20:02, Bryce Mecum () escribió:
>
> I've failed to verify this release candidate on macOS M1, running
> "dev/release/verify-release-candidate.sh 14.0.0 2" [1]. The failure
> looks related to the Go implementation's "parquet-encryption-test".
> Can anyone on a similar machine verify?
>
> [1] https://gist.github.com/amoeba/f47534bea44d78a7ee79e4b44ed0e4ff
>
>
> On Mon, Oct 23, 2023 at 11:19 PM Raúl Cumplido  wrote:
> >
> > Hi,
> >
> > I would like to propose the following release candidate (RC2) of Apache
> > Arrow version 14.0.0. This is a release consisting of 461
> > resolved GitHub issues[1].
> >
> > This release candidate is based on commit:
> > 2dcee3f82c6cf54b53a64729fd81840efa583244 [2]
> >
> > The source release rc2 is hosted at [3].
> > The binary artifacts are hosted at [4][5][6][7][8][9][10][11].
> > The changelog is located at [12].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [13] for how to validate a release candidate.
> >
> > See also a verification result on GitHub pull request [14].
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow 14.0.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow 14.0.0 because...
> >
> > [1]: 
> > https://github.com/apache/arrow/issues?q=is%3Aissue+milestone%3A14.0.0+is%3Aclosed
> > [2]: 
> > https://github.com/apache/arrow/tree/2dcee3f82c6cf54b53a64729fd81840efa583244
> > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-14.0.0-rc2
> > [4]: https://apache.jfrog.io/artifactory/arrow/almalinux-rc/
> > [5]: https://apache.jfrog.io/artifactory/arrow/amazon-linux-rc/
> > [6]: https://apache.jfrog.io/artifactory/arrow/centos-rc/
> > [7]: https://apache.jfrog.io/artifactory/arrow/debian-rc/
> > [8]: https://apache.jfrog.io/artifactory/arrow/java-rc/14.0.0-rc2
> > [9]: https://apache.jfrog.io/artifactory/arrow/nuget-rc/14.0.0-rc2
> > [10]: https://apache.jfrog.io/artifactory/arrow/python-rc/14.0.0-rc2
> > [11]: https://apache.jfrog.io/artifactory/arrow/ubuntu-rc/
> > [12]: 
> > https://github.com/apache/arrow/blob/2dcee3f82c6cf54b53a64729fd81840efa583244/CHANGELOG.md
> > [13]: 
> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > [14]: https://github.com/apache/arrow/pull/38343

Re: [VOTE] Release Apache Arrow 14.0.0 - RC2

2023-10-24 Thread Bryce Mecum 
I've failed to verify this release candidate on macOS M1, running
"dev/release/verify-release-candidate.sh 14.0.0 2" [1]. The failure
looks related to the Go implementation's "parquet-encryption-test".
Can anyone on a similar machine verify?

[1] https://gist.github.com/amoeba/f47534bea44d78a7ee79e4b44ed0e4ff


On Mon, Oct 23, 2023 at 11:19 PM Raúl Cumplido  wrote:
>
> Hi,
>
> I would like to propose the following release candidate (RC2) of Apache
> Arrow version 14.0.0. This is a release consisting of 461
> resolved GitHub issues[1].
>
> This release candidate is based on commit:
> 2dcee3f82c6cf54b53a64729fd81840efa583244 [2]
>
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4][5][6][7][8][9][10][11].
> The changelog is located at [12].
>
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [13] for how to validate a release candidate.
>
> See also a verification result on GitHub pull request [14].
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Release this as Apache Arrow 14.0.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 14.0.0 because...
>
> [1]: 
> https://github.com/apache/arrow/issues?q=is%3Aissue+milestone%3A14.0.0+is%3Aclosed
> [2]: 
> https://github.com/apache/arrow/tree/2dcee3f82c6cf54b53a64729fd81840efa583244
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-14.0.0-rc2
> [4]: https://apache.jfrog.io/artifactory/arrow/almalinux-rc/
> [5]: https://apache.jfrog.io/artifactory/arrow/amazon-linux-rc/
> [6]: https://apache.jfrog.io/artifactory/arrow/centos-rc/
> [7]: https://apache.jfrog.io/artifactory/arrow/debian-rc/
> [8]: https://apache.jfrog.io/artifactory/arrow/java-rc/14.0.0-rc2
> [9]: https://apache.jfrog.io/artifactory/arrow/nuget-rc/14.0.0-rc2
> [10]: https://apache.jfrog.io/artifactory/arrow/python-rc/14.0.0-rc2
> [11]: https://apache.jfrog.io/artifactory/arrow/ubuntu-rc/
> [12]: 
> https://github.com/apache/arrow/blob/2dcee3f82c6cf54b53a64729fd81840efa583244/CHANGELOG.md
> [13]: 
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> [14]: https://github.com/apache/arrow/pull/38343

Re: [VOTE] Release Apache Arrow 14.0.0 - RC2

2023-10-24 Thread Raúl Cumplido 
I've verified successfully the sources and the following binaries:

TEST_DEFAULT=0 TEST_SOURCE=1 dev/release/verify-release-candidate.sh 14.0.0 2
TEST_DEFAULT=0 TEST_APT=1 dev/release/verify-release-candidate.sh 14.0.0 2
TEST_DEFAULT=0 TEST_BINARY=1 dev/release/verify-release-candidate.sh 14.0.0 2
TEST_DEFAULT=0 TEST_JARS=1 dev/release/verify-release-candidate.sh 14.0.0 2
TEST_DEFAULT=0 TEST_WHEELS=1 dev/release/verify-release-candidate.sh 14.0.0 2

When verifying the yum packages I am having an issue with the Amazon
Linux 2023 packages. If I remove the Amazon Linux 2023 from the
verification all the rest of yum packages are successful.
TEST_DEFAULT=0 TEST_YUM=1 dev/release/verify-release-candidate.sh 14.0.0 2

+ echo '::group::Test Apache Arrow Flight'
+ dnf install -y arrow-flight-glib-devel-14.0.0
Last metadata expiration check: 0:00:53 ago on Tue Oct 24 14:37:42 2023.
(try to add '--skip-broken' to skip uninstallable packages)
Error:
 Problem: package arrow-flight-glib-devel-14.0.0-1.amzn2023.x86_64
requires arrow-flight-devel = 14.0.0-1.amzn2023, but none of the
providers can be installed
  - package arrow-flight-devel-14.0.0-1.amzn2023.x86_64 requires
arrow14-flight-libs = 14.0.0-1.amzn2023, but none of the providers can
be installed
  - package arrow-flight-devel-14.0.0-1.amzn2023.x86_64 requires
libarrow_flight.so.1400()(64bit), but none of the providers can be
installed
  - conflicting requests
  - nothing provides libabsl_cord.so.2206.0.0()(64bit) needed by
arrow14-flight-libs-14.0.0-1.amzn2023.x86_64
  - nothing provides libabsl_cordz_functions.so.2206.0.0()(64bit)
needed by arrow14-flight-libs-14.0.0-1.amzn2023.x86_64
  - nothing provides libabsl_cordz_info.so.2206.0.0()(64bit) needed by
arrow14-flight-libs-14.0.0-1.amzn2023.x86_64
  - nothing provides libabsl_synchronization.so.2206.0.0()(64bit)
needed by arrow14-flight-libs-14.0.0-1.amzn2023.x86_64
  - nothing provides libgpr.so.33()(64bit) needed by
arrow14-flight-libs-14.0.0-1.amzn2023.x86_64
  - nothing provides libgrpc++.so.1.56()(64bit) needed by
arrow14-flight-libs-14.0.0-1.amzn2023.x86_64
  - nothing provides libgrpc.so.33()(64bit) needed by
arrow14-flight-libs-14.0.0-1.amzn2023.x86_64
Failed to verify the Yum repository for amazonlinux:2023
Failed to verify release candidate. See /tmp/arrow-14.0.0.vCwgv for details.

>From my understanding flight-devel should provide grpc-devel:
%if %{have_grpc}
Requires:grpc-devel
Requires:grpc-plugins
%endif
So I am not sure what the problem is.

El mar, 24 oct 2023 a las 17:10, Jean-Baptiste Onofré
() escribió:
>
> +1 (non binding)
>
> I'm working on some PRs coming (reproducible build, several updates,
> etc), but definitely not blocker for this release.
>
> Thanks !
> Regards
> JB
>
> On Tue, Oct 24, 2023 at 9:17 AM Raúl Cumplido  wrote:
> >
> > Hi,
> >
> > I would like to propose the following release candidate (RC2) of Apache
> > Arrow version 14.0.0. This is a release consisting of 461
> > resolved GitHub issues[1].
> >
> > This release candidate is based on commit:
> > 2dcee3f82c6cf54b53a64729fd81840efa583244 [2]
> >
> > The source release rc2 is hosted at [3].
> > The binary artifacts are hosted at [4][5][6][7][8][9][10][11].
> > The changelog is located at [12].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [13] for how to validate a release candidate.
> >
> > See also a verification result on GitHub pull request [14].
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow 14.0.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow 14.0.0 because...
> >
> > [1]: 
> > https://github.com/apache/arrow/issues?q=is%3Aissue+milestone%3A14.0.0+is%3Aclosed
> > [2]: 
> > https://github.com/apache/arrow/tree/2dcee3f82c6cf54b53a64729fd81840efa583244
> > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-14.0.0-rc2
> > [4]: https://apache.jfrog.io/artifactory/arrow/almalinux-rc/
> > [5]: https://apache.jfrog.io/artifactory/arrow/amazon-linux-rc/
> > [6]: https://apache.jfrog.io/artifactory/arrow/centos-rc/
> > [7]: https://apache.jfrog.io/artifactory/arrow/debian-rc/
> > [8]: https://apache.jfrog.io/artifactory/arrow/java-rc/14.0.0-rc2
> > [9]: https://apache.jfrog.io/artifactory/arrow/nuget-rc/14.0.0-rc2
> > [10]: https://apache.jfrog.io/artifactory/arrow/python-rc/14.0.0-rc2
> > [11]: https://apache.jfrog.io/artifactory/arrow/ubuntu-rc/
> > [12]: 
> > https://github.com/apache/arrow/blob/2dcee3f82c6cf54b53a64729fd81840efa583244/CHANGELOG.md
> > [13]: 
> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > [14]: https://github.com/apache/arrow/pull/38343

Re: [VOTE] Release Apache Arrow 14.0.0 - RC2

2023-10-24 Thread Jean-Baptiste Onofré 
+1 (non binding)

I'm working on some PRs coming (reproducible build, several updates,
etc), but definitely not blocker for this release.

Thanks !
Regards
JB

On Tue, Oct 24, 2023 at 9:17 AM Raúl Cumplido  wrote:
>
> Hi,
>
> I would like to propose the following release candidate (RC2) of Apache
> Arrow version 14.0.0. This is a release consisting of 461
> resolved GitHub issues[1].
>
> This release candidate is based on commit:
> 2dcee3f82c6cf54b53a64729fd81840efa583244 [2]
>
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4][5][6][7][8][9][10][11].
> The changelog is located at [12].
>
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [13] for how to validate a release candidate.
>
> See also a verification result on GitHub pull request [14].
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Release this as Apache Arrow 14.0.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 14.0.0 because...
>
> [1]: 
> https://github.com/apache/arrow/issues?q=is%3Aissue+milestone%3A14.0.0+is%3Aclosed
> [2]: 
> https://github.com/apache/arrow/tree/2dcee3f82c6cf54b53a64729fd81840efa583244
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-14.0.0-rc2
> [4]: https://apache.jfrog.io/artifactory/arrow/almalinux-rc/
> [5]: https://apache.jfrog.io/artifactory/arrow/amazon-linux-rc/
> [6]: https://apache.jfrog.io/artifactory/arrow/centos-rc/
> [7]: https://apache.jfrog.io/artifactory/arrow/debian-rc/
> [8]: https://apache.jfrog.io/artifactory/arrow/java-rc/14.0.0-rc2
> [9]: https://apache.jfrog.io/artifactory/arrow/nuget-rc/14.0.0-rc2
> [10]: https://apache.jfrog.io/artifactory/arrow/python-rc/14.0.0-rc2
> [11]: https://apache.jfrog.io/artifactory/arrow/ubuntu-rc/
> [12]: 
> https://github.com/apache/arrow/blob/2dcee3f82c6cf54b53a64729fd81840efa583244/CHANGELOG.md
> [13]: 
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> [14]: https://github.com/apache/arrow/pull/38343

Re: Help regarding setting up the r package in arrow apache

2023-10-24 Thread Divyansh Khatri 
Hello Bryce,
Gistfile1 includes my result when I tried building  (
https://arrow.apache.org/docs/r/articles/developers/docker.html#example---the-manual-way)
from scratch.Before getting to the part of running the docker container I
made changes in line endings of 4 files(as seen in the gist).After that I
when I applied the container command I encountered the error in line 219 of
gistfile1(which i think is again related to CRLF line ending and since I
was not able to figure out the problem I changed all the script files to
the LF line endings which was a mistake on my part .So I think the real
problem started from line 219 of gistfle1.

https://gist.github.com/Divyansh200102/655c80a7a8c31d3f1a68a860c5f24872

On Mon, 23 Oct 2023 at 23:50, Bryce Mecum  wrote:

> Is the `docker-compose run r` output before or after you changed the
> line endings in build_arrow_static.sh? This error:
>
> inst/build_arrow_static.sh: line 38: $'\r': command not found
>
> makes it look like you may have written the file out with
> Windows-style line endings which I suspect MinGW is having a hard time
> with. If that's the case, do you get a different output from
> `docker-compose run r` before you rewrite the file? Are you running
> this with (1) recent checkout and (2) with a completely clean working
> copy? If you're not sure, include the output of `git rev-parse HEAD`
> and `git status` in an updated gist.
>
> On Sun, Oct 22, 2023 at 11:25 PM Divyansh Khatri
>  wrote:
> >
> > Hi Jonathan,
> > So,first of all regarding the previous message I sent I thought I setup
> the
> > R correctly but when i ran the container it was exiting immediately so I
> > did the process again.I followed the developer documentation [1] (
> >
> https://arrow.apache.org/docs/r/articles/developers/docker.html#example---the-manual-way
> > ).but i am encountering an error (I think it's regarding the line ending
> > of inst/build_arrow_static.sh).but even after changing the line ending I
> am
> > still encountering the same error. Can you tell me what's the problem?
> >
> > https://gist.github.com/Divyansh200102/dd7fc370e39818796c58df44badcc1b8
> >
> > I have attached the terminal output of the documentation [1] and the 4
> > files containing "inst/build_arrow_static.sh"(If I need to make any
> changes
> > in the line ending of any of  them please tell me which one).
> >
> > Thanks
> >
> > On Mon, 23 Oct 2023 at 00:59, Divyansh Khatri <
> divyanshkhatri...@gmail.com>
> > wrote:
> >
> > > Thanks for the help Jonathan,Nic and Bryce I was able to setup R  and
> the
> > >> docs.
> > >
> > >
>

Re: [VOTE] Release Apache Arrow 14.0.0 - RC2

2023-10-24 Thread Raúl Cumplido 
Hi,

We have also been working on generating this benchmark report
comparing the previous release with the new Release Candidate [1].
The baseline commit used is the 13.0.0:
b7d2f7ffca66c868bd2fce5b3749c6caa002a7f0 [2]
The contender commit is the 14.0.0 RC2 commit:
2dcee3f82c6cf54b53a64729fd81840efa583244 [3]

Thanks Sam Albers for creating the report. We might continue tweaking
some details of the report. Please, do open issues on the crossbow
repository if you find any issues or would like any feature added [4].

Thanks,
Raúl

[1] 
http://crossbow.voltrondata.com/release_reports/arrow-release-report-14.0.0-rc2.html
[2] 
https://github.com/apache/arrow/commit/b7d2f7ffca66c868bd2fce5b3749c6caa002a7f0
[3] 
https://github.com/apache/arrow/commit/2dcee3f82c6cf54b53a64729fd81840efa583244
[4] https://github.com/ursacomputing/crossbow/issues

El mar, 24 oct 2023 a las 9:17, Raúl Cumplido () escribió:
>
> Hi,
>
> I would like to propose the following release candidate (RC2) of Apache
> Arrow version 14.0.0. This is a release consisting of 461
> resolved GitHub issues[1].
>
> This release candidate is based on commit:
> 2dcee3f82c6cf54b53a64729fd81840efa583244 [2]
>
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4][5][6][7][8][9][10][11].
> The changelog is located at [12].
>
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [13] for how to validate a release candidate.
>
> See also a verification result on GitHub pull request [14].
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Release this as Apache Arrow 14.0.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 14.0.0 because...
>
> [1]: 
> https://github.com/apache/arrow/issues?q=is%3Aissue+milestone%3A14.0.0+is%3Aclosed
> [2]: 
> https://github.com/apache/arrow/tree/2dcee3f82c6cf54b53a64729fd81840efa583244
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-14.0.0-rc2
> [4]: https://apache.jfrog.io/artifactory/arrow/almalinux-rc/
> [5]: https://apache.jfrog.io/artifactory/arrow/amazon-linux-rc/
> [6]: https://apache.jfrog.io/artifactory/arrow/centos-rc/
> [7]: https://apache.jfrog.io/artifactory/arrow/debian-rc/
> [8]: https://apache.jfrog.io/artifactory/arrow/java-rc/14.0.0-rc2
> [9]: https://apache.jfrog.io/artifactory/arrow/nuget-rc/14.0.0-rc2
> [10]: https://apache.jfrog.io/artifactory/arrow/python-rc/14.0.0-rc2
> [11]: https://apache.jfrog.io/artifactory/arrow/ubuntu-rc/
> [12]: 
> https://github.com/apache/arrow/blob/2dcee3f82c6cf54b53a64729fd81840efa583244/CHANGELOG.md
> [13]: 
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> [14]: https://github.com/apache/arrow/pull/38343

[VOTE] Release Apache Arrow 14.0.0 - RC2

2023-10-24 Thread Raúl Cumplido 
Hi,

I would like to propose the following release candidate (RC2) of Apache
Arrow version 14.0.0. This is a release consisting of 461
resolved GitHub issues[1].

This release candidate is based on commit:
2dcee3f82c6cf54b53a64729fd81840efa583244 [2]

The source release rc2 is hosted at [3].
The binary artifacts are hosted at [4][5][6][7][8][9][10][11].
The changelog is located at [12].

Please download, verify checksums and signatures, run the unit tests,
and vote on the release. See [13] for how to validate a release candidate.

See also a verification result on GitHub pull request [14].

The vote will be open for at least 72 hours.

[ ] +1 Release this as Apache Arrow 14.0.0
[ ] +0
[ ] -1 Do not release this as Apache Arrow 14.0.0 because...

[1]: 
https://github.com/apache/arrow/issues?q=is%3Aissue+milestone%3A14.0.0+is%3Aclosed
[2]: 
https://github.com/apache/arrow/tree/2dcee3f82c6cf54b53a64729fd81840efa583244
[3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-14.0.0-rc2
[4]: https://apache.jfrog.io/artifactory/arrow/almalinux-rc/
[5]: https://apache.jfrog.io/artifactory/arrow/amazon-linux-rc/
[6]: https://apache.jfrog.io/artifactory/arrow/centos-rc/
[7]: https://apache.jfrog.io/artifactory/arrow/debian-rc/
[8]: https://apache.jfrog.io/artifactory/arrow/java-rc/14.0.0-rc2
[9]: https://apache.jfrog.io/artifactory/arrow/nuget-rc/14.0.0-rc2
[10]: https://apache.jfrog.io/artifactory/arrow/python-rc/14.0.0-rc2
[11]: https://apache.jfrog.io/artifactory/arrow/ubuntu-rc/
[12]: 
https://github.com/apache/arrow/blob/2dcee3f82c6cf54b53a64729fd81840efa583244/CHANGELOG.md
[13]: 
https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
[14]: https://github.com/apache/arrow/pull/38343