RE: [EXTERNAL] Re: Missing absl symbols from 6.0 arrow bundled static lib
It builds fine if I add all the missing libraries manually but I haven't been able to test it with GCS enabled (that flag breaks for me for independent reasons) -Original Message- From: David Li Sent: Thursday, November 11, 2021 7:35 PM To: dev@arrow.apache.org Subject: [EXTERNAL] Re: Missing absl symbols from 6.0 arrow bundled static lib I don't believe this was intentional. IIRC, we refactored how we deal with Abseil in order to support integrating the Google Cloud SDK (since both it and gRPC use Abseil) and that (or perhaps some other change?) might have changed which libraries we include. Is it workable to explicitly link Abseil into your final application? In general it seems we have some work to do around dependencies, in both the Flight SQL C++ PR [1] and this GitHub issue [2] we've seen issues around linking gRPC and Protobuf as well (where even if all our tests build and pass, it may not be easy to consume the artifacts once installed). [1]: https://github.com/apache/arrow/pull/11507 [2]: https://github.com/apache/arrow/issues/11657 -David On Thu, Nov 11, 2021, at 18:50, Teodorescu, Radu (WorldQuant) wrote: > Hi, > We are building with arrow as a CMake external project and using > arrow_bundled lib for the third party dependencies. > As of 6.0 we noticed a number of link errors and I tracked it down to > a number of absl libraries no longer being included (5.0 has 21 absl > libraries in the bundle while 6.0 only 7) In particular > absl::strings_internal missing is giving us missing symbol for > absl::lts_20210324::str_format_internal::FormatPack. > Is this a bug or a change in the inclusion process coming with 6.0 > Thank you Radu > > > ## > # > > The information contained in this communication is confidential, may > be > > subject to legal privilege, and is intended only for the individual named. > > If you are not the named addressee, please notify the sender > immediately and > > delete this email from your system. The views expressed in this email > are > > the views of the sender only. Outgoing and incoming electronic > communications > > to this address are electronically archived and subject to review > and/or disclosure > > to someone other than the recipient. > > ## > # > ### The information contained in this communication is confidential, may be subject to legal privilege, and is intended only for the individual named. If you are not the named addressee, please notify the sender immediately and delete this email from your system. The views expressed in this email are the views of the sender only. Outgoing and incoming electronic communications to this address are electronically archived and subject to review and/or disclosure to someone other than the recipient. ###
Re: Missing absl symbols from 6.0 arrow bundled static lib
I don't believe this was intentional. IIRC, we refactored how we deal with Abseil in order to support integrating the Google Cloud SDK (since both it and gRPC use Abseil) and that (or perhaps some other change?) might have changed which libraries we include. Is it workable to explicitly link Abseil into your final application? In general it seems we have some work to do around dependencies, in both the Flight SQL C++ PR [1] and this GitHub issue [2] we've seen issues around linking gRPC and Protobuf as well (where even if all our tests build and pass, it may not be easy to consume the artifacts once installed). [1]: https://github.com/apache/arrow/pull/11507 [2]: https://github.com/apache/arrow/issues/11657 -David On Thu, Nov 11, 2021, at 18:50, Teodorescu, Radu (WorldQuant) wrote: > Hi, > We are building with arrow as a CMake external project and using > arrow_bundled lib for the third party dependencies. > As of 6.0 we noticed a number of link errors and I tracked it down to a > number of absl libraries no longer being included (5.0 has 21 absl libraries > in the bundle while 6.0 only 7) > In particular absl::strings_internal missing is giving us missing symbol for > absl::lts_20210324::str_format_internal::FormatPack. > Is this a bug or a change in the inclusion process coming with 6.0 > Thank you > Radu > > > ### > > The information contained in this communication is confidential, may be > > subject to legal privilege, and is intended only for the individual named. > > If you are not the named addressee, please notify the sender immediately and > > delete this email from your system. The views expressed in this email are > > the views of the sender only. Outgoing and incoming electronic communications > > to this address are electronically archived and subject to review and/or > disclosure > > to someone other than the recipient. > > ### >
Missing absl symbols from 6.0 arrow bundled static lib
Hi, We are building with arrow as a CMake external project and using arrow_bundled lib for the third party dependencies. As of 6.0 we noticed a number of link errors and I tracked it down to a number of absl libraries no longer being included (5.0 has 21 absl libraries in the bundle while 6.0 only 7) In particular absl::strings_internal missing is giving us missing symbol for absl::lts_20210324::str_format_internal::FormatPack. Is this a bug or a change in the inclusion process coming with 6.0 Thank you Radu ### The information contained in this communication is confidential, may be subject to legal privilege, and is intended only for the individual named. If you are not the named addressee, please notify the sender immediately and delete this email from your system. The views expressed in this email are the views of the sender only. Outgoing and incoming electronic communications to this address are electronically archived and subject to review and/or disclosure to someone other than the recipient. ###
Re: [VOTE] Release Apache Arrow 6.0.1 - RC1
+1 Verified C++/Python/Java sources (Ubuntu 16.04 AMD64), wheels, and binaries. -David On Thu, Nov 11, 2021, at 04:00, Yibo Cai wrote: > +1. > > Verified c++ and python source, on ubuntu 20.04, aarch64. > > CC=clang-10 CXX=clang++-10 \ > TEST_SOURCE=1 TEST_DEFAULT=0 TEST_CPP=1 TEST_PYTHON=1 \ > dev/release/verify-release-candidate.sh source 6.0.1 1 > > > On 11/11/21 10:39 AM, Sutou Kouhei wrote: > > Hi, > > > > I would like to propose the following release candidate (RC1) of Apache > > Arrow version 6.0.1. This is a release consisting of 29 > > resolved JIRA issues[1]. > > > > This release candidate is based on commit: > > 347a88ff9d20e2a4061eec0b455b8ea1aa8335dc [2] > > > > The source release rc1 is hosted at [3]. > > The binary artifacts are hosted at [4][5][6][7][8][9][10][11]. > > The changelog is located at [12]. > > > > Please download, verify checksums and signatures, run the unit tests, > > and vote on the release. See [13] for how to validate a release candidate. > > > > See also verification results by GitHub Actions: > > > >https://github.com/apache/arrow/pull/11671 > > > > There are some known failures: > > > >* verify-rc-source-integration-linux-amd64 > >* verify-rc-source-python-macos-arm64 > >* verify-rc-wheels-macos-11-amd64 > >* verify-rc-wheels-macos-11-arm64 > > > > They except verify-rc-source-integration-linux-amd64 are > > also failed with 6.0.0 RC3: > > > >https://github.com/apache/arrow/pull/11511 > > > > Here is the verify-rc-source-integration-linux-amd64 log: > > > > > > https://github.com/ursacomputing/crossbow/runs/4172486523?check_suite_focus=true > > > > I'm not sure whether this is a blocker or not. > > > > Note that the verification passed on my local machine. > > > > > > The vote will be open for at least 72 hours. > > > > [ ] +1 Release this as Apache Arrow 6.0.1 > > [ ] +0 > > [ ] -1 Do not release this as Apache Arrow 6.0.1 because... > > > > [1]: > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%206.0.1 > > [2]: > > https://github.com/apache/arrow/tree/347a88ff9d20e2a4061eec0b455b8ea1aa8335dc > > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-6.0.1-rc1 > > [4]: https://apache.jfrog.io/artifactory/arrow/almalinux-rc/ > > [5]: https://apache.jfrog.io/artifactory/arrow/amazon-linux-rc/ > > [6]: https://apache.jfrog.io/artifactory/arrow/centos-rc/ > > [7]: https://apache.jfrog.io/artifactory/arrow/debian-rc/ > > [8]: https://apache.jfrog.io/artifactory/arrow/java-rc/6.0.1-rc1 > > [9]: https://apache.jfrog.io/artifactory/arrow/nuget-rc/6.0.1-rc1 > > [10]: https://apache.jfrog.io/artifactory/arrow/python-rc/6.0.1-rc1 > > [11]: https://apache.jfrog.io/artifactory/arrow/ubuntu-rc/ > > [12]: > > https://github.com/apache/arrow/blob/347a88ff9d20e2a4061eec0b455b8ea1aa8335dc/CHANGELOG.md > > [13]: > > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates > > >
Re: [DISCUSS][Rust] Biweekly sync call for arrow/datafusion again?
Due to lack of agenda items [1] this week , I do not plan on holding the call [1] https://docs.google.com/document/d/1atCVnoff5SR4eM4Lwf2M1BBJTY6g3_HUNR6qswYJW_U/edit# On Wed, Oct 27, 2021 at 1:57 PM Benson Muite wrote: > Cannot host at 4:00 UTC on 28 October, but can host at 4:00 UTC on 11 > November. > > Benson > > On 10/27/21 1:02 PM, Andrew Lamb wrote: > > We have some proposed agenda items[1] for the Rust sync[1] this week so I > > will plan to see anyone who is interested tomorrow. > > > > Andrew > > > > [1] > > > https://docs.google.com/document/d/1atCVnoff5SR4eM4Lwf2M1BBJTY6g3_HUNR6qswYJW_U/edit# > > [2] > > > https://arrow.apache.org/datafusion/community/communication.html#sync-up-zoom-calls > > >
Re: [VOTE] Release Apache Arrow 6.0.1 - RC1
+1. Verified c++ and python source, on ubuntu 20.04, aarch64. CC=clang-10 CXX=clang++-10 \ TEST_SOURCE=1 TEST_DEFAULT=0 TEST_CPP=1 TEST_PYTHON=1 \ dev/release/verify-release-candidate.sh source 6.0.1 1 On 11/11/21 10:39 AM, Sutou Kouhei wrote: Hi, I would like to propose the following release candidate (RC1) of Apache Arrow version 6.0.1. This is a release consisting of 29 resolved JIRA issues[1]. This release candidate is based on commit: 347a88ff9d20e2a4061eec0b455b8ea1aa8335dc [2] The source release rc1 is hosted at [3]. The binary artifacts are hosted at [4][5][6][7][8][9][10][11]. The changelog is located at [12]. Please download, verify checksums and signatures, run the unit tests, and vote on the release. See [13] for how to validate a release candidate. See also verification results by GitHub Actions: https://github.com/apache/arrow/pull/11671 There are some known failures: * verify-rc-source-integration-linux-amd64 * verify-rc-source-python-macos-arm64 * verify-rc-wheels-macos-11-amd64 * verify-rc-wheels-macos-11-arm64 They except verify-rc-source-integration-linux-amd64 are also failed with 6.0.0 RC3: https://github.com/apache/arrow/pull/11511 Here is the verify-rc-source-integration-linux-amd64 log: https://github.com/ursacomputing/crossbow/runs/4172486523?check_suite_focus=true I'm not sure whether this is a blocker or not. Note that the verification passed on my local machine. The vote will be open for at least 72 hours. [ ] +1 Release this as Apache Arrow 6.0.1 [ ] +0 [ ] -1 Do not release this as Apache Arrow 6.0.1 because... [1]: https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%206.0.1 [2]: https://github.com/apache/arrow/tree/347a88ff9d20e2a4061eec0b455b8ea1aa8335dc [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-6.0.1-rc1 [4]: https://apache.jfrog.io/artifactory/arrow/almalinux-rc/ [5]: https://apache.jfrog.io/artifactory/arrow/amazon-linux-rc/ [6]: https://apache.jfrog.io/artifactory/arrow/centos-rc/ [7]: https://apache.jfrog.io/artifactory/arrow/debian-rc/ [8]: https://apache.jfrog.io/artifactory/arrow/java-rc/6.0.1-rc1 [9]: https://apache.jfrog.io/artifactory/arrow/nuget-rc/6.0.1-rc1 [10]: https://apache.jfrog.io/artifactory/arrow/python-rc/6.0.1-rc1 [11]: https://apache.jfrog.io/artifactory/arrow/ubuntu-rc/ [12]: https://github.com/apache/arrow/blob/347a88ff9d20e2a4061eec0b455b8ea1aa8335dc/CHANGELOG.md [13]: https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
