[jira] [Commented] (ARROW-4930) [Python] Remove LIBDIR assumptions in Python build
[
https://issues.apache.org/jira/browse/ARROW-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938066#comment-16938066
]
Sutou Kouhei commented on ARROW-4930:
-
{{CMAKE_INSTALL_LIBDIR}} works on Fedora, CentOS and so on but may not work on
Debian, Ubuntu and so on. (This is depends on {{CMAKE_INSTALL_PREFIX}}.)
Using {{PATH_SUFFIXES}} option of {{find_library}} with our
{{LIB_PATH_SUFFIXES}} is better.
https://cmake.org/cmake/help/latest/command/find_library.html
We already do this in {{FindArrow.cmake}} but don't do this in
{{FindParquet.cmake}} yet.
{{FindArrow.cmake}} uses wrong {{ARROW_SEARCH_LIB_PATH}}:
{noformat}
diff --git a/cpp/cmake_modules/FindArrow.cmake
b/cpp/cmake_modules/FindArrow.cmake
index b160506c4..58cf438e3 100644
--- a/cpp/cmake_modules/FindArrow.cmake
+++ b/cpp/cmake_modules/FindArrow.cmake
@@ -52,7 +52,7 @@ if("$ENV{ARROW_HOME}" STREQUAL "")
else()
set(ARROW_HOME "$ENV{ARROW_HOME}")
set(ARROW_SEARCH_HEADER_PATHS ${ARROW_HOME}/include)
- set(ARROW_SEARCH_LIB_PATH ${ARROW_HOME}/lib)
+ set(ARROW_SEARCH_LIB_PATH ${ARROW_HOME})
find_path(ARROW_INCLUDE_DIR arrow/array.h
PATHS ${ARROW_SEARCH_HEADER_PATHS}
{noformat}
But we need to fix more code in {{FindArrow.cmake}}.
Anyway, could you create a pull request to discuss right fix with code?
Or should I take over this?
> [Python] Remove LIBDIR assumptions in Python build
> --
>
> Key: ARROW-4930
> URL: https://issues.apache.org/jira/browse/ARROW-4930
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
>Affects Versions: 0.12.1
>Reporter: Suvayu Ali
>Priority: Minor
> Labels: setup.py
> Fix For: 2.0.0
>
> Attachments: FindArrow.cmake.patch, FindParquet.cmake.patch
>
>
> This is in reference to (4) in
> [this|http://mail-archives.apache.org/mod_mbox/arrow-dev/201903.mbox/%3C0AF328A1-ED2A-457F-B72D-3B49C8614850%40xhochy.com%3E]
> mailing list discussion.
> Certain sections of setup.py assume a specific location of the C++ libraries.
> Removing this hard assumption will simplify PyArrow builds significantly. As
> far as I could tell these assumptions are made in the
> {{build_ext._run_cmake()}} method (wherever bundling of C++ libraries are
> handled).
> # The first occurrence is before invoking cmake (see line 237).
> # The second occurrence is when the C++ libraries are moved from their build
> directory to the Python tree (see line 347). The actual implementation is in
> the function {{_move_shared_libs_unix(..)}} (see line 468).
> Hope this helps.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (ARROW-6639) [Packaging][RPM] Add support for CentOS 7 on aarch64
[ https://issues.apache.org/jira/browse/ARROW-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6639. - Fix Version/s: 0.15.0 Resolution: Fixed Issue resolved by pull request 5448 [https://github.com/apache/arrow/pull/5448] > [Packaging][RPM] Add support for CentOS 7 on aarch64 > > > Key: ARROW-6639 > URL: https://issues.apache.org/jira/browse/ARROW-6639 > Project: Apache Arrow > Issue Type: Bug > Components: Packaging >Reporter: Kentaro Hayashi >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 2h > Remaining Estimate: 0h > > apt:build rake task supports architecture to run [1], but it is not true > for yum task. > [1] > [https://github.com/apache/arrow/blob/master/dev/tasks/linux-packages/package-task.rb#L276] > It is useful yum task also supports architecture (ex. i386) too. (even though > CentOS 6 i386 EOL reaches 2020/11) > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-6653) [Developer] Add support for auto JIRA link on pull request
[ https://issues.apache.org/jira/browse/ARROW-6653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935163#comment-16935163 ] Sutou Kouhei commented on ARROW-6653: - It doesn't work with GITHUB_TOKEN in GitHub Actions: https://github.com/apache/arrow/pull/5463 > [Developer] Add support for auto JIRA link on pull request > -- > > Key: ARROW-6653 > URL: https://issues.apache.org/jira/browse/ARROW-6653 > Project: Apache Arrow > Issue Type: Improvement > Components: Developer Tools >Reporter: Kenta Murata >Priority: Major > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > https://lists.apache.org/thread.html/7bb9e646832390d207393f064d7934e54c6cb010e30ea9f39f3ed1ce@%3Cdev.arrow.apache.org%3E > I frequently do the following little bit bothersome steps for opening > JIRA tickets when I watch a GitHub pull-request: > 1. Select the "ARROW-" text in the title and copy it > 2. Open JIRA if I haven't open it > 3. Select a ticket to open it > 4. Alter the URL by pasting text that copied at the step-1 > 5. Hit the enter key > I think it is better if these steps become easier. > We already have a mechanism to inject a GitHub pull-request URL into > the corresponding JIRA ticket. How about making the similar mechanism > for the reverse link? I guess it is possible to automate making a > comment of JIRA ticket URL to the pull-request when the "ARROW-" > text is injected in the title field by using GitHub Actions. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ARROW-6653) [Developer] Add support for auto JIRA link on pull request
[ https://issues.apache.org/jira/browse/ARROW-6653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-6653: Reporter: Kenta Murata (was: Sutou Kouhei) > [Developer] Add support for auto JIRA link on pull request > -- > > Key: ARROW-6653 > URL: https://issues.apache.org/jira/browse/ARROW-6653 > Project: Apache Arrow > Issue Type: Improvement > Components: Developer Tools >Reporter: Kenta Murata >Priority: Major > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > https://lists.apache.org/thread.html/7bb9e646832390d207393f064d7934e54c6cb010e30ea9f39f3ed1ce@%3Cdev.arrow.apache.org%3E > I frequently do the following little bit bothersome steps for opening > JIRA tickets when I watch a GitHub pull-request: > 1. Select the "ARROW-" text in the title and copy it > 2. Open JIRA if I haven't open it > 3. Select a ticket to open it > 4. Alter the URL by pasting text that copied at the step-1 > 5. Hit the enter key > I think it is better if these steps become easier. > We already have a mechanism to inject a GitHub pull-request URL into > the corresponding JIRA ticket. How about making the similar mechanism > for the reverse link? I guess it is possible to automate making a > comment of JIRA ticket URL to the pull-request when the "ARROW-" > text is injected in the title field by using GitHub Actions. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ARROW-6653) [Developer] Add support for auto JIRA link on pull request
[ https://issues.apache.org/jira/browse/ARROW-6653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-6653: Description: https://lists.apache.org/thread.html/7bb9e646832390d207393f064d7934e54c6cb010e30ea9f39f3ed1ce@%3Cdev.arrow.apache.org%3E I frequently do the following little bit bothersome steps for opening JIRA tickets when I watch a GitHub pull-request: 1. Select the "ARROW-" text in the title and copy it 2. Open JIRA if I haven't open it 3. Select a ticket to open it 4. Alter the URL by pasting text that copied at the step-1 5. Hit the enter key I think it is better if these steps become easier. We already have a mechanism to inject a GitHub pull-request URL into the corresponding JIRA ticket. How about making the similar mechanism for the reverse link? I guess it is possible to automate making a comment of JIRA ticket URL to the pull-request when the "ARROW-" text is injected in the title field by using GitHub Actions. > [Developer] Add support for auto JIRA link on pull request > -- > > Key: ARROW-6653 > URL: https://issues.apache.org/jira/browse/ARROW-6653 > Project: Apache Arrow > Issue Type: Improvement > Components: Developer Tools >Reporter: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > https://lists.apache.org/thread.html/7bb9e646832390d207393f064d7934e54c6cb010e30ea9f39f3ed1ce@%3Cdev.arrow.apache.org%3E > I frequently do the following little bit bothersome steps for opening > JIRA tickets when I watch a GitHub pull-request: > 1. Select the "ARROW-" text in the title and copy it > 2. Open JIRA if I haven't open it > 3. Select a ticket to open it > 4. Alter the URL by pasting text that copied at the step-1 > 5. Hit the enter key > I think it is better if these steps become easier. > We already have a mechanism to inject a GitHub pull-request URL into > the corresponding JIRA ticket. How about making the similar mechanism > for the reverse link? I guess it is possible to automate making a > comment of JIRA ticket URL to the pull-request when the "ARROW-" > text is injected in the title field by using GitHub Actions. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (ARROW-6653) [Developer] Add support for auto JIRA link on pull request
[ https://issues.apache.org/jira/browse/ARROW-6653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei reassigned ARROW-6653: --- Assignee: (was: Sutou Kouhei) > [Developer] Add support for auto JIRA link on pull request > -- > > Key: ARROW-6653 > URL: https://issues.apache.org/jira/browse/ARROW-6653 > Project: Apache Arrow > Issue Type: Improvement > Components: Developer Tools >Reporter: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-6653) [Developer] Add support for auto JIRA link on pull request
Sutou Kouhei created ARROW-6653: --- Summary: [Developer] Add support for auto JIRA link on pull request Key: ARROW-6653 URL: https://issues.apache.org/jira/browse/ARROW-6653 Project: Apache Arrow Issue Type: Improvement Components: Developer Tools Reporter: Sutou Kouhei Assignee: Sutou Kouhei -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-5575) [C++] arrowConfig.cmake includes uninstalled targets
[
https://issues.apache.org/jira/browse/ARROW-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934873#comment-16934873
]
Sutou Kouhei commented on ARROW-5575:
-
Ah, we need to split target files.
> [C++] arrowConfig.cmake includes uninstalled targets
>
>
> Key: ARROW-5575
> URL: https://issues.apache.org/jira/browse/ARROW-5575
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.13.0, 0.14.0, 0.14.1
>Reporter: Matthijs Brobbel
>Assignee: Sutou Kouhei
>Priority: Minor
> Fix For: 1.0.0
>
>
> I'm building a CMake project against arrow and I'm using:
> {code:java}
> find_package(arrow 0.13 CONFIG REQUIRED)
> {code}
> to get the arrow_shared target in scope. This works for me on macOS. I
> installed apache-arrow with:
> {code:java}
> brew install apache-arrow{code}
> However, when I attempt to build the project in a ubuntu xenial container, I
> get the following CMake error:
> {code:java}
> CMake Error at /usr/lib/x86_64-linux-gnu/cmake/arrow/arrowTargets.cmake:151
> (message):
> The imported target "arrow_cuda_shared" references the file
> "/usr/lib/x86_64-linux-gnu/libarrow_cuda.so.13.0.0"
> but this file does not exist. Possible reasons include:
> * The file was deleted, renamed, or moved to another location.
> * An install or uninstall procedure did not complete successfully.
> * The installation package was faulty and contained
> "/usr/lib/x86_64-linux-gnu/cmake/arrow/arrowTargets.cmake"
> but not all the files it references.
> Call Stack (most recent call first):
> /usr/lib/x86_64-linux-gnu/cmake/arrow/arrowConfig.cmake:61 (include)
> CMakeLists.txt:15 (find_package)
> {code}
> I installed arrow with:
> {code:java}
> curl -sSL "https://dist.apache.org/repos/dist/dev/arrow/KEYS; | apt-key add -
> echo "deb [arch=amd64] https://dl.bintray.com/apache/arrow/ubuntu/ xenial
> main" | tee -a /etc/apt/sources.list
> apt-get update
> apt-get install -y libarrow-dev=0.13.0-1
> {code}
> I can also install libarrow-cuda-dev, but I don't want to because I don't
> need it.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (ARROW-5575) [C++] arrowConfig.cmake includes uninstalled targets
[
https://issues.apache.org/jira/browse/ARROW-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei reassigned ARROW-5575:
---
Assignee: Sutou Kouhei
> [C++] arrowConfig.cmake includes uninstalled targets
>
>
> Key: ARROW-5575
> URL: https://issues.apache.org/jira/browse/ARROW-5575
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.13.0, 0.14.0, 0.14.1
>Reporter: Matthijs Brobbel
>Assignee: Sutou Kouhei
>Priority: Minor
> Fix For: 1.0.0
>
>
> I'm building a CMake project against arrow and I'm using:
> {code:java}
> find_package(arrow 0.13 CONFIG REQUIRED)
> {code}
> to get the arrow_shared target in scope. This works for me on macOS. I
> installed apache-arrow with:
> {code:java}
> brew install apache-arrow{code}
> However, when I attempt to build the project in a ubuntu xenial container, I
> get the following CMake error:
> {code:java}
> CMake Error at /usr/lib/x86_64-linux-gnu/cmake/arrow/arrowTargets.cmake:151
> (message):
> The imported target "arrow_cuda_shared" references the file
> "/usr/lib/x86_64-linux-gnu/libarrow_cuda.so.13.0.0"
> but this file does not exist. Possible reasons include:
> * The file was deleted, renamed, or moved to another location.
> * An install or uninstall procedure did not complete successfully.
> * The installation package was faulty and contained
> "/usr/lib/x86_64-linux-gnu/cmake/arrow/arrowTargets.cmake"
> but not all the files it references.
> Call Stack (most recent call first):
> /usr/lib/x86_64-linux-gnu/cmake/arrow/arrowConfig.cmake:61 (include)
> CMakeLists.txt:15 (find_package)
> {code}
> I installed arrow with:
> {code:java}
> curl -sSL "https://dist.apache.org/repos/dist/dev/arrow/KEYS; | apt-key add -
> echo "deb [arch=amd64] https://dl.bintray.com/apache/arrow/ubuntu/ xenial
> main" | tee -a /etc/apt/sources.list
> apt-get update
> apt-get install -y libarrow-dev=0.13.0-1
> {code}
> I can also install libarrow-cuda-dev, but I don't want to because I don't
> need it.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (ARROW-4649) [C++/CI/R] Add (nightly) job that builds `brew install apache-arrow --HEAD`
[
https://issues.apache.org/jira/browse/ARROW-4649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei resolved ARROW-4649.
-
Fix Version/s: (was: 1.0.0)
0.15.0
Resolution: Fixed
Issue resolved by pull request 5360
[https://github.com/apache/arrow/pull/5360]
> [C++/CI/R] Add (nightly) job that builds `brew install apache-arrow --HEAD`
> ---
>
> Key: ARROW-4649
> URL: https://issues.apache.org/jira/browse/ARROW-4649
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, Continuous Integration
>Reporter: Uwe L. Korn
>Assignee: Neal Richardson
>Priority: Major
> Labels: nightly, pull-request-available, travis-ci
> Fix For: 0.15.0
>
> Time Spent: 11h 40m
> Remaining Estimate: 0h
>
> Now that we have an Arrow homebrew formula again and we may want to have it
> as a simple setup for R Arrow users, we should add a nightly crossbow task
> that checks whether this still builds fine.
> To implement this, one should write a new travis.yml like
> [https://github.com/apache/arrow/blob/master/dev/tasks/python-wheels/travis.osx.yml]
> that calls {{brew install apache-arrow --HEAD}}. This task should then be
> added to https://github.com/apache/arrow/blob/master/dev/tasks/tests.yml so
> that it is executed as part of the nightly chain.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-6647) [C++] Can't build with g++ 4.8.5 on CentOS 7 by member initializer for shared_ptr
Sutou Kouhei created ARROW-6647:
---
Summary: [C++] Can't build with g++ 4.8.5 on CentOS 7 by member
initializer for shared_ptr
Key: ARROW-6647
URL: https://issues.apache.org/jira/browse/ARROW-6647
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Sutou Kouhei
Assignee: Sutou Kouhei
{noformat}
% g++ --version
g++ (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39)
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
{noformat}
Error message:
{noformat}
/root/rpmbuild/BUILD/apache-arrow-0.15.0/cpp/src/arrow/python/python_to_arrow.cc:
In instantiation of 'arrow::Status arrow::py::GetConverterFlat(const
std::shared_ptr&, bool,
std::unique_ptr*) [with arrow::py::NullCoding
null_coding = (arrow::py::NullCoding)1]':
/root/rpmbuild/BUILD/apache-arrow-0.15.0/cpp/src/arrow/python/python_to_arrow.cc:1001:5:
required from here
/root/rpmbuild/BUILD/apache-arrow-0.15.0/cpp/src/arrow/python/python_to_arrow.cc:864:7:
error: conversion from 'std::nullptr_t' to non-scalar type
'std::shared_ptr' requested
class DecimalConverter
^
/root/rpmbuild/BUILD/apache-arrow-0.15.0/cpp/src/arrow/python/python_to_arrow.cc:894:10:
note: synthesized method
'arrow::py::DecimalConverter<(arrow::py::NullCoding)1>::DecimalConverter()'
first required here
*out = std::unique_ptr(new TYPE_CLASS); \
^
/root/rpmbuild/BUILD/apache-arrow-0.15.0/cpp/src/arrow/python/python_to_arrow.cc:915:5:
note: in expansion of macro 'SIMPLE_CONVERTER_CASE'
SIMPLE_CONVERTER_CASE(DECIMAL, DecimalConverter);
^
/root/rpmbuild/BUILD/apache-arrow-0.15.0/cpp/src/arrow/python/python_to_arrow.cc:
In instantiation of 'arrow::Status arrow::py::GetConverterFlat(const
std::shared_ptr&, bool,
std::unique_ptr*) [with arrow::py::NullCoding
null_coding = (arrow::py::NullCoding)0]':
/root/rpmbuild/BUILD/apache-arrow-0.15.0/cpp/src/arrow/python/python_to_arrow.cc:1004:5:
required from here
/root/rpmbuild/BUILD/apache-arrow-0.15.0/cpp/src/arrow/python/python_to_arrow.cc:864:7:
error: conversion from 'std::nullptr_t' to non-scalar type
'std::shared_ptr' requested
class DecimalConverter
^
/root/rpmbuild/BUILD/apache-arrow-0.15.0/cpp/src/arrow/python/python_to_arrow.cc:894:10:
note: synthesized method
'arrow::py::DecimalConverter<(arrow::py::NullCoding)0>::DecimalConverter()'
first required here
*out = std::unique_ptr(new TYPE_CLASS); \
^
/root/rpmbuild/BUILD/apache-arrow-0.15.0/cpp/src/arrow/python/python_to_arrow.cc:915:5:
note: in expansion of macro 'SIMPLE_CONVERTER_CASE'
SIMPLE_CONVERTER_CASE(DECIMAL, DecimalConverter);
^
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-6639) [Packaging][RPM] Add support for CentOS 7 on aarch64
[ https://issues.apache.org/jira/browse/ARROW-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934142#comment-16934142 ] Sutou Kouhei commented on ARROW-6639: - We don't build i386 packages. But adding support for aarch64. So it's acceptable to do this to add support for aarch64. > [Packaging][RPM] Add support for CentOS 7 on aarch64 > > > Key: ARROW-6639 > URL: https://issues.apache.org/jira/browse/ARROW-6639 > Project: Apache Arrow > Issue Type: Bug > Components: Packaging >Reporter: Kentaro Hayashi >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > apt:build rake task supports architecture to run [1], but it is not true > for yum task. > [1] > [https://github.com/apache/arrow/blob/master/dev/tasks/linux-packages/package-task.rb#L276] > It is useful yum task also supports architecture (ex. i386) too. (even though > CentOS 6 i386 EOL reaches 2020/11) > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ARROW-6639) [Packaging][RPM] Add support for CentOS 7 on aarch64
[ https://issues.apache.org/jira/browse/ARROW-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-6639: Summary: [Packaging][RPM] Add support for CentOS 7 on aarch64 (was: [Packaging] Improve i386 support with Yum task) > [Packaging][RPM] Add support for CentOS 7 on aarch64 > > > Key: ARROW-6639 > URL: https://issues.apache.org/jira/browse/ARROW-6639 > Project: Apache Arrow > Issue Type: Bug > Components: Packaging >Reporter: Kentaro Hayashi >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > apt:build rake task supports architecture to run [1], but it is not true > for yum task. > [1] > [https://github.com/apache/arrow/blob/master/dev/tasks/linux-packages/package-task.rb#L276] > It is useful yum task also supports architecture (ex. i386) too. (even though > CentOS 6 i386 EOL reaches 2020/11) > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (ARROW-6639) [Packaging] Improve i386 support with Yum task
[ https://issues.apache.org/jira/browse/ARROW-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei reassigned ARROW-6639: --- Assignee: Sutou Kouhei > [Packaging] Improve i386 support with Yum task > -- > > Key: ARROW-6639 > URL: https://issues.apache.org/jira/browse/ARROW-6639 > Project: Apache Arrow > Issue Type: Bug > Components: Packaging >Reporter: Kentaro Hayashi >Assignee: Sutou Kouhei >Priority: Major > > apt:build rake task supports architecture to run [1], but it is not true > for yum task. > [1] > [https://github.com/apache/arrow/blob/master/dev/tasks/linux-packages/package-task.rb#L276] > It is useful yum task also supports architecture (ex. i386) too. (even though > CentOS 6 i386 EOL reaches 2020/11) > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-6617) [Crossbow] Unify the version numbers generated by crossbow and rake
[
https://issues.apache.org/jira/browse/ARROW-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933763#comment-16933763
]
Sutou Kouhei commented on ARROW-6617:
-
Ah, sorry.
I described wrong version in
https://github.com/apache/arrow/pull/5024#issuecomment-532873336 .
deb uses "0.15.0~dev20190918" because "0.15.0~..." is smaller than "0.15.0" in
deb version: http://man7.org/linux/man-pages/man5/deb-version.5.html
("0.15.0~dev20190918" has only "upstream-version". There are no "epoch" and
"debian-revision". We always use "1" for "debian-revision".)
If we use smaller version for non production version, people who install non
production version (0.15.0~dev20190918) can upgrade to production version
(0.15.0).
rpm uses "0.15.0-0.dev20190918" for non production. rpm uses "0.15.0-1" for
production". "0.15.0-1" is larger than "0.15.0-0".
"0.15.0-0.dev20190918" has "Version" and "Release". "0.15.0" is "Version".
"0.dev20190918" is "Release". "-" is separator.
See also Fedora's Versioning Guidelines especially "Prelease versions":
https://docs.fedoraproject.org/en-US/packaging-guidelines/Versioning/#_prerelease_versions
> [Crossbow] Unify the version numbers generated by crossbow and rake
> ---
>
> Key: ARROW-6617
> URL: https://issues.apache.org/jira/browse/ARROW-6617
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Packaging
>Reporter: Krisztian Szucs
>Priority: Major
>
> Crossbow's default package version (0.14.0.dev584) and rake apt:build/rake
> yum:build's default package version (0.15.0-dev20190918) are different. We
> need to unify them, and prefer the latter one.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (ARROW-6148) [C++][Packaging] Improve aarch64 support
[ https://issues.apache.org/jira/browse/ARROW-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6148. - Fix Version/s: (was: 2.0.0) 0.15.0 Resolution: Fixed Issue resolved by pull request 5024 [https://github.com/apache/arrow/pull/5024] > [C++][Packaging] Improve aarch64 support > - > > Key: ARROW-6148 > URL: https://issues.apache.org/jira/browse/ARROW-6148 > Project: Apache Arrow > Issue Type: Bug > Components: Packaging >Reporter: Francois Saint-Jacques >Assignee: Marcin Juszkiewicz >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 9h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-6127) [Website] Add favicons and meta tags
[ https://issues.apache.org/jira/browse/ARROW-6127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6127. - Fix Version/s: (was: 1.0.0) 0.15.0 Resolution: Fixed > [Website] Add favicons and meta tags > > > Key: ARROW-6127 > URL: https://issues.apache.org/jira/browse/ARROW-6127 > Project: Apache Arrow > Issue Type: Improvement > Components: Website >Reporter: Neal Richardson >Assignee: Neal Richardson >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 3h 20m > Remaining Estimate: 0h > > Among the things I noticed recently that should be easy to clean up: > * We should supply a favicon > * The is the same for every page and it always says "Apache Arrow > Homepage" > * There are no opengraph or twitter card meta tags, so there's no link > preview > * The version of bootstrap used is not current and has been flagged as a > possible security vulnerability > Much of this could just be fixed by porting to a modern Hugo template, which > I'll explore. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-5673) [Crossbow] Support GitLab runners
[ https://issues.apache.org/jira/browse/ARROW-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932882#comment-16932882 ] Sutou Kouhei commented on ARROW-5673: - GitHub Actions doesn't support self-hosted workers yet. GitLab supports it. If we can use self-hosted workers, we can run tests that require GPU, ARM and so on by CI. > [Crossbow] Support GitLab runners > - > > Key: ARROW-5673 > URL: https://issues.apache.org/jira/browse/ARROW-5673 > Project: Apache Arrow > Issue Type: Improvement > Components: Packaging >Reporter: Krisztian Szucs >Priority: Major > Fix For: 2.0.0 > > > Description is by [~kou]: > I want to use GitLab Runner instead of CircleCI. > Because we can add custom GitLab Runners for us. For example, we can add GPU > enabled GitLab Runner to test CUDA enabled Apache Arrow build. We can also > increase timeout more than 5h for our GitLab Runners. > We can use https://gitlab.com/ to run GitLab Runners: > https://about.gitlab.com/solutions/github/ > This feature isn't included in the Free tier on GitLab.com (it's available > with the Free tier for campaing for now (*1)) but GitLab.com provides Gold > tier features to open source projects (*2). So we can use this feature by > choosing "CI/CD for external repo" in "New project page" > https://gitlab.com/projects/new . > (*1) > So, for the next year we are making the GitLab CI/CD for GitHub feature a > part of our GitLab.com Free tier. > (*2) > As part of our commitment to open source, we offer all public projects > our highest tier features (Gold) for free. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-6588) [C++] Suppress class-memaccess warning with g++ 9.2.1
Sutou Kouhei created ARROW-6588:
---
Summary: [C++] Suppress class-memaccess warning with g++ 9.2.1
Key: ARROW-6588
URL: https://issues.apache.org/jira/browse/ARROW-6588
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Sutou Kouhei
Assignee: Sutou Kouhei
{noformat}
[1/8] Building CXX object
src/parquet/CMakeFiles/parquet_objlib.dir/encoding.cc.o
FAILED: src/parquet/CMakeFiles/parquet_objlib.dir/encoding.cc.o
/usr/bin/c++ -DARROW_EXTRA_ERROR_CONTEXT -DARROW_JEMALLOC
-DARROW_JEMALLOC_INCLUDE_DIR="" -DARROW_USE_GLOG -DARROW_USE_SIMD
-DARROW_WITH_ZSTD -DHAVE_INTTYPES_H -DHAVE_NETDB_H -DHAVE_NETINET_IN_H
-DPARQUET_EXPORTING -Isrc -I../src -isystem jemalloc_ep-prefix/src -isystem
flatbuffers_ep-prefix/src/flatbuffers_ep-install/include -isystem
../thirdparty/cares_ep-install/include -isystem ../thirdparty/hadoop/include
-isystem orc_ep-install/include -Wno-noexcept-type -fdiagnostics-color=always
-ggdb -O0 -Wall -Wno-conversion -Wno-sign-conversion -Wno-unused-variable
-Werror -msse4.2 -g -fPIC -std=gnu++11 -MD -MT
src/parquet/CMakeFiles/parquet_objlib.dir/encoding.cc.o -MF
src/parquet/CMakeFiles/parquet_objlib.dir/encoding.cc.o.d -o
src/parquet/CMakeFiles/parquet_objlib.dir/encoding.cc.o -c
../src/parquet/encoding.cc
In file included from ../src/parquet/encoding.cc:33:
../src/arrow/util/rle_encoding.h: In instantiation of 'int
arrow::util::RleDecoder::GetBatchWithDictSpaced(const T*, T*, int, int, const
uint8_t*, int64_t) [with T = parquet::FixedLenByteArray; uint8_t = unsigned
char; int64_t = long int]':
../src/parquet/encoding.cc:1079:20: required from 'int
parquet::DictDecoderImpl::DecodeSpaced(parquet::DictDecoderImpl::T*,
int, int, const uint8_t*, int64_t) [with Type =
parquet::PhysicalType;
parquet::DictDecoderImpl::T = parquet::FixedLenByteArray; uint8_t =
unsigned char; int64_t = long int]'
../src/parquet/encoding.cc:1076:7: required from here
../src/arrow/util/rle_encoding.h:440:9: error: 'void* memset(void*, int,
size_t)' clearing an object of non-trivial type 'struct
parquet::FixedLenByteArray'; use assignment or value-initialization instead
[-Werror=class-memaccess]
440 | memset(, 0, sizeof(T));
| ~~^
In file included from ../src/parquet/encoding.h:27,
from ../src/parquet/encoding.cc:18:
../src/parquet/types.h:515:8: note: 'struct parquet::FixedLenByteArray'
declared here
515 | struct FixedLenByteArray {
|^
In file included from ../src/parquet/encoding.cc:33:
../src/arrow/util/rle_encoding.h: In instantiation of 'int
arrow::util::RleDecoder::GetBatchWithDictSpaced(const T*, T*, int, int, const
uint8_t*, int64_t) [with T = parquet::ByteArray; uint8_t = unsigned char;
int64_t = long int]':
../src/parquet/encoding.cc:1079:20: required from 'int
parquet::DictDecoderImpl::DecodeSpaced(parquet::DictDecoderImpl::T*,
int, int, const uint8_t*, int64_t) [with Type =
parquet::PhysicalType;
parquet::DictDecoderImpl::T = parquet::ByteArray; uint8_t = unsigned
char; int64_t = long int]'
../src/parquet/encoding.cc:1076:7: required from here
../src/arrow/util/rle_encoding.h:440:9: error: 'void* memset(void*, int,
size_t)' clearing an object of non-trivial type 'struct parquet::ByteArray';
use assignment or value-initialization instead [-Werror=class-memaccess]
440 | memset(, 0, sizeof(T));
| ~~^
In file included from ../src/parquet/encoding.h:27,
from ../src/parquet/encoding.cc:18:
../src/parquet/types.h:495:8: note: 'struct parquet::ByteArray' declared here
495 | struct ByteArray {
|^
cc1plus: all warnings being treated as errors
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Closed] (ARROW-6497) [Website] On change to master branch, automatically make PR to asf-site
[ https://issues.apache.org/jira/browse/ARROW-6497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei closed ARROW-6497. --- Fix Version/s: (was: 0.15.0) Resolution: Won't Fix > [Website] On change to master branch, automatically make PR to asf-site > --- > > Key: ARROW-6497 > URL: https://issues.apache.org/jira/browse/ARROW-6497 > Project: Apache Arrow > Issue Type: Improvement > Components: Website >Reporter: Neal Richardson >Assignee: Neal Richardson >Priority: Major > Labels: pull-request-available > Time Spent: 40m > Remaining Estimate: 0h > > I added a build/deploy script to arrow-site that would enable automatically > publishing to asf-site when there is a commit to the master branch. However, > ASF won't let us add a deploy key to enable this publishing (INFRA-18924). > I have a workaround that's not automatic but as close as we can get. On > commits to apache/arrow-site's master branch, Travis builds the site and > pushes it to a fork of arrow-site (where there is no restriction on deploy > keys), and then it makes a PR from there back to the asf-site branch of > apache/arrow-site using [hub|https://hub.github.com/hub-pull-request.1.html]. > So it's "semiautomatic": the asf-site PR is made automatically, but a > committer will need to merge it. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6569) [Website] Add support for auto deployment by GitHub Actions
[ https://issues.apache.org/jira/browse/ARROW-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6569. - Fix Version/s: 0.15.0 Resolution: Fixed > [Website] Add support for auto deployment by GitHub Actions > --- > > Key: ARROW-6569 > URL: https://issues.apache.org/jira/browse/ARROW-6569 > Project: Apache Arrow > Issue Type: Improvement > Components: Website >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Reopened] (ARROW-6497) [Website] On change to master branch, automatically make PR to asf-site
[ https://issues.apache.org/jira/browse/ARROW-6497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei reopened ARROW-6497: - Assignee: Neal Richardson (was: Sutou Kouhei) I changed wrong issue. ARROW-6569 should have been changed... > [Website] On change to master branch, automatically make PR to asf-site > --- > > Key: ARROW-6497 > URL: https://issues.apache.org/jira/browse/ARROW-6497 > Project: Apache Arrow > Issue Type: Improvement > Components: Website >Reporter: Neal Richardson >Assignee: Neal Richardson >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 40m > Remaining Estimate: 0h > > I added a build/deploy script to arrow-site that would enable automatically > publishing to asf-site when there is a commit to the master branch. However, > ASF won't let us add a deploy key to enable this publishing (INFRA-18924). > I have a workaround that's not automatic but as close as we can get. On > commits to apache/arrow-site's master branch, Travis builds the site and > pushes it to a fork of arrow-site (where there is no restriction on deploy > keys), and then it makes a PR from there back to the asf-site branch of > apache/arrow-site using [hub|https://hub.github.com/hub-pull-request.1.html]. > So it's "semiautomatic": the asf-site PR is made automatically, but a > committer will need to merge it. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6497) [Website] On change to master branch, automatically make PR to asf-site
[ https://issues.apache.org/jira/browse/ARROW-6497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6497. - Fix Version/s: 0.15.0 Assignee: Sutou Kouhei (was: Neal Richardson) Resolution: Fixed > [Website] On change to master branch, automatically make PR to asf-site > --- > > Key: ARROW-6497 > URL: https://issues.apache.org/jira/browse/ARROW-6497 > Project: Apache Arrow > Issue Type: Improvement > Components: Website >Reporter: Neal Richardson >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 40m > Remaining Estimate: 0h > > I added a build/deploy script to arrow-site that would enable automatically > publishing to asf-site when there is a commit to the master branch. However, > ASF won't let us add a deploy key to enable this publishing (INFRA-18924). > I have a workaround that's not automatic but as close as we can get. On > commits to apache/arrow-site's master branch, Travis builds the site and > pushes it to a fork of arrow-site (where there is no restriction on deploy > keys), and then it makes a PR from there back to the asf-site branch of > apache/arrow-site using [hub|https://hub.github.com/hub-pull-request.1.html]. > So it's "semiautomatic": the asf-site PR is made automatically, but a > committer will need to merge it. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (ARROW-6569) [Website] Add support for auto deployment by GitHub Actions
Sutou Kouhei created ARROW-6569: --- Summary: [Website] Add support for auto deployment by GitHub Actions Key: ARROW-6569 URL: https://issues.apache.org/jira/browse/ARROW-6569 Project: Apache Arrow Issue Type: Improvement Components: Website Reporter: Sutou Kouhei Assignee: Sutou Kouhei -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (ARROW-6404) [C++] CMake build of arrow libraries fails on Windows
[
https://issues.apache.org/jira/browse/ARROW-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930126#comment-16930126
]
Sutou Kouhei commented on ARROW-6404:
-
We need work to add support for multi configuration builds. It means that we
can build by both {{cmake --build --config Debug}} and {{cmake --build --config
Release}} with one {{cmake}} configuration for Visual Studio.
But this is not high priority feature. So this is not required for 0.15.0.
> [C++] CMake build of arrow libraries fails on Windows
> -
>
> Key: ARROW-6404
> URL: https://issues.apache.org/jira/browse/ARROW-6404
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Reporter: ARF
>Assignee: Sutou Kouhei
>Priority: Major
> Labels: build, pull-request-available
> Fix For: 1.0.0
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> I am trying to build the python pyarrow extension on Windows 10 using Visual
> Studio 2015 Build Tools and the current stable CMake.
> Following [the
> instructions|https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst]
> to the letter, CMake fails with the error:
> {{??CMake Error at cmake_modules/SetupCxxFlags.cmake:42 (string):??}}
> {{?? string no output variable specified??}}
> {{??Call Stack (most recent call first):??}}
> {{?? CMakeLists.txt:357 (include)??}}
>
> Complete output:
> {{(pyarrow-dev) Z:\devel\arrow\cpp\build>cmake -G "Visual Studio 14 2015
> Win64" ^}}
> {{More? -DCMAKE_INSTALL_PREFIX=%ARROW_HOME% ^}}
> {{More? -DARROW_CXXFLAGS="/WX /MP" ^}}
> {{More? -DARROW_GANDIVA=on ^}}
> {{More? -DARROW_PARQUET=on ^}}
> {{More? -DARROW_PYTHON=on ..}}
> {{-- Building using CMake version: 3.15.2}}
> {{CMake Error at CMakeLists.txt:30 (string):}}
> {{ string no output variable specified}}
> {{-- Selecting Windows SDK version to target Windows 10.0.17763.}}
> {{-- The C compiler identification is MSVC 19.0.24210.0}}
> {{-- The CXX compiler identification is MSVC 19.0.24210.0}}
> {{-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe -- works}}
> {{-- Detecting C compiler ABI info}}
> {{-- Detecting C compiler ABI info - done}}
> {{-- Detecting C compile features}}
> {{-- Detecting C compile features - done}}
> {{-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe -- works}}
> {{-- Detecting CXX compiler ABI info}}
> {{-- Detecting CXX compiler ABI info - done}}
> {{-- Detecting CXX compile features}}
> {{-- Detecting CXX compile features - done}}
> {{-- Arrow version: 0.15.0 (full: '0.15.0-SNAPSHOT')}}
> {{-- Arrow SO version: 15 (full: 15.0.0)}}
> {{-- Found PkgConfig:
> Z:/Systemdateien/Miniconda3/envs/pyarrow-dev/Library/bin/pkg-config.exe
> (found version "0.29.2")}}
> {{-- clang-tidy not found}}
> {{-- clang-format not found}}
> {{-- infer not found}}
> {{-- Found PythonInterp:
> Z:/Systemdateien/Miniconda3/envs/pyarrow-dev/python.exe (found version
> "3.7.3")}}
> {{-- Found cpplint executable at Z:/devel/arrow/cpp/build-support/cpplint.py}}
> {{-- Compiler command: C:/Program Files (x86)/Microsoft Visual Studio
> 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Compiler version:}}
> {{-- Compiler id: MSVC}}
> {{Selected compiler msvc}}
> {{-- Performing Test CXX_SUPPORTS_SSE4_2}}
> {{-- Performing Test CXX_SUPPORTS_SSE4_2 - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ALTIVEC}}
> {{-- Performing Test CXX_SUPPORTS_ALTIVEC - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ARMCRC}}
> {{-- Performing Test CXX_SUPPORTS_ARMCRC - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO}}
> {{-- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO - Failed}}
> {{CMake Error at cmake_modules/SetupCxxFlags.cmake:42 (string):}}
> {{ string no output variable specified}}
> {{Call Stack (most recent call first):}}
> {{ CMakeLists.txt:357 (include)}}
> {{-- Arrow build warning level: CHECKIN}}
> {{Configured for build (set with cmake
> -DCMAKE_BUILD_TYPE=\{release,debug,...})}}
> {{CMake Error at cmake_modules/SetupCxxFlags.cmake:438 (message):}}
> {{ Unknown build type:}}
> {{Call Stack (most recent call first):}}
> {{ CMakeLists.txt:357 (include)}}
> {{-- Configuring incomplete, errors occurred!}}
> {{See also "Z:/devel/arrow/cpp/build/CMakeFiles/CMakeOutput.log".}}
> {{See also "Z:/devel/arrow/cpp/build/CMakeFiles/CMakeError.log".}}
> {{(pyarrow-dev) Z:\devel\arrow\cpp\build>}}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Created] (ARROW-6562) [GLib] Fix wrong sliced data of GArrowBuffer
Sutou Kouhei created ARROW-6562: --- Summary: [GLib] Fix wrong sliced data of GArrowBuffer Key: ARROW-6562 URL: https://issues.apache.org/jira/browse/ARROW-6562 Project: Apache Arrow Issue Type: Bug Reporter: Sutou Kouhei Assignee: Sutou Kouhei -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Assigned] (ARROW-6009) [Release][JS] Ignore NPM errors in the javascript release script
[
https://issues.apache.org/jira/browse/ARROW-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei reassigned ARROW-6009:
---
Assignee: Paul Taylor
> [Release][JS] Ignore NPM errors in the javascript release script
>
>
> Key: ARROW-6009
> URL: https://issues.apache.org/jira/browse/ARROW-6009
> Project: Apache Arrow
> Issue Type: Task
>Reporter: Krisztian Szucs
>Assignee: Paul Taylor
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Use {npx lerna exec --no-bail -- npm publish} in the npm-release.sh script.
> cc [~paultaylor]
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Created] (ARROW-6546) [C++] Add missing FlatBuffers source dependency
Sutou Kouhei created ARROW-6546: --- Summary: [C++] Add missing FlatBuffers source dependency Key: ARROW-6546 URL: https://issues.apache.org/jira/browse/ARROW-6546 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Sutou Kouhei Assignee: Sutou Kouhei -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6502) [GLib][CI] MinGW failure in CI
[ https://issues.apache.org/jira/browse/ARROW-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6502. - Resolution: Fixed Issue resolved by pull request 5338 [https://github.com/apache/arrow/pull/5338] > [GLib][CI] MinGW failure in CI > -- > > Key: ARROW-6502 > URL: https://issues.apache.org/jira/browse/ARROW-6502 > Project: Apache Arrow > Issue Type: Bug > Components: GLib >Reporter: Wes McKinney >Assignee: Sutou Kouhei >Priority: Blocker > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > > This failure seems to have crept in to master > https://ci.appveyor.com/project/wesm/arrow/build/job/ocfkn9m0a3ux1ur5#L2288 -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Assigned] (ARROW-1324) [C++] Support ARROW_BOOST_VENDORED on Windows / MSVC
[ https://issues.apache.org/jira/browse/ARROW-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei reassigned ARROW-1324: --- Assignee: Sutou Kouhei > [C++] Support ARROW_BOOST_VENDORED on Windows / MSVC > > > Key: ARROW-1324 > URL: https://issues.apache.org/jira/browse/ARROW-1324 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Wes McKinney >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available, windows > Time Spent: 1h 40m > Remaining Estimate: 0h > > Follow up to ARROW-1303 -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Closed] (ARROW-6499) [C++] Add support for bundled Boost with MSVC
[ https://issues.apache.org/jira/browse/ARROW-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei closed ARROW-6499. --- Resolution: Duplicate > [C++] Add support for bundled Boost with MSVC > - > > Key: ARROW-6499 > URL: https://issues.apache.org/jira/browse/ARROW-6499 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (ARROW-6502) [GLib][CI] MinGW failure in CI
[ https://issues.apache.org/jira/browse/ARROW-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926247#comment-16926247 ] Sutou Kouhei commented on ARROW-6502: - Oh, it may be related to gobject-introspection gem 3.3.8 I released today. > [GLib][CI] MinGW failure in CI > -- > > Key: ARROW-6502 > URL: https://issues.apache.org/jira/browse/ARROW-6502 > Project: Apache Arrow > Issue Type: Bug > Components: GLib >Reporter: Wes McKinney >Assignee: Sutou Kouhei >Priority: Blocker > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 10m > Remaining Estimate: 0h > > This failure seems to have crept in to master > https://ci.appveyor.com/project/wesm/arrow/build/job/ocfkn9m0a3ux1ur5#L2288 -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Assigned] (ARROW-6502) [GLib][CI] MinGW failure in CI
[ https://issues.apache.org/jira/browse/ARROW-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei reassigned ARROW-6502: --- Assignee: Sutou Kouhei > [GLib][CI] MinGW failure in CI > -- > > Key: ARROW-6502 > URL: https://issues.apache.org/jira/browse/ARROW-6502 > Project: Apache Arrow > Issue Type: Bug > Components: GLib >Reporter: Wes McKinney >Assignee: Sutou Kouhei >Priority: Blocker > Fix For: 0.15.0 > > > This failure seems to have crept in to master > https://ci.appveyor.com/project/wesm/arrow/build/job/ocfkn9m0a3ux1ur5#L2288 -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (ARROW-6499) [C++] Add support for bundled Boost with MSVC
Sutou Kouhei created ARROW-6499: --- Summary: [C++] Add support for bundled Boost with MSVC Key: ARROW-6499 URL: https://issues.apache.org/jira/browse/ARROW-6499 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Sutou Kouhei Assignee: Sutou Kouhei -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6489) [Developer][Documentation] Fix merge script and readme
[ https://issues.apache.org/jira/browse/ARROW-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6489. - Fix Version/s: 0.15.0 Resolution: Fixed Issue resolved by pull request 5325 [https://github.com/apache/arrow/pull/5325] > [Developer][Documentation] Fix merge script and readme > -- > > Key: ARROW-6489 > URL: https://issues.apache.org/jira/browse/ARROW-6489 > Project: Apache Arrow > Issue Type: Improvement > Components: Developer Tools, Documentation >Reporter: Kenta Murata >Assignee: Kenta Murata >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 20m > Remaining Estimate: 0h > > The following things should be fixed. > - merge_arrow_pr.py shouldn't be affected by git's merge.ff value. > - README should describe the information of APACHE_JIRA_USERNAME and > APACHE_JIRA_PASSWORD > - README should describe the users needs to install requests and jira > libraries before running merge_arrow_pr.py -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (ARROW-6489) [Developer][Documentation] Fix merge script and readme
[ https://issues.apache.org/jira/browse/ARROW-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-6489: Summary: [Developer][Documentation] Fix merge script and readme (was: [Developer][Documentation]Fix merge script and readme) > [Developer][Documentation] Fix merge script and readme > -- > > Key: ARROW-6489 > URL: https://issues.apache.org/jira/browse/ARROW-6489 > Project: Apache Arrow > Issue Type: Improvement > Components: Developer Tools, Documentation >Reporter: Kenta Murata >Assignee: Kenta Murata >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > The following things should be fixed. > - merge_arrow_pr.py shouldn't be affected by git's merge.ff value. > - README should describe the information of APACHE_JIRA_USERNAME and > APACHE_JIRA_PASSWORD > - README should describe the users needs to install requests and jira > libraries before running merge_arrow_pr.py -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (ARROW-6441) [CI][Crossbow] Nightly Centos 6 job fails
[ https://issues.apache.org/jira/browse/ARROW-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923749#comment-16923749 ] Sutou Kouhei commented on ARROW-6441: - Yes. I created ARROW-6462. Sorry for not creating a reference to the issue. > [CI][Crossbow] Nightly Centos 6 job fails > - > > Key: ARROW-6441 > URL: https://issues.apache.org/jira/browse/ARROW-6441 > Project: Apache Arrow > Issue Type: Bug > Components: Continuous Integration, Packaging >Reporter: Neal Richardson >Assignee: Sutou Kouhei >Priority: Blocker > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 1h > Remaining Estimate: 0h > > https://travis-ci.org/ursa-labs/crossbow/builds/580192251 > Log seems to implicate doubleconversion, which is why I didn't bundle this > with the rest in ARROW-6440. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6440) [CI][Crossbow] Nightly ubuntu, debian, and centos package builds fail
[
https://issues.apache.org/jira/browse/ARROW-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei resolved ARROW-6440.
-
Resolution: Fixed
Issue resolved by pull request 5284
[https://github.com/apache/arrow/pull/5284]
> [CI][Crossbow] Nightly ubuntu, debian, and centos package builds fail
> -
>
> Key: ARROW-6440
> URL: https://issues.apache.org/jira/browse/ARROW-6440
> Project: Apache Arrow
> Issue Type: Bug
> Components: Continuous Integration, Packaging
>Reporter: Neal Richardson
>Assignee: Sutou Kouhei
>Priority: Blocker
> Labels: pull-request-available
> Fix For: 0.15.0
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> See
> * https://travis-ci.org/ursa-labs/crossbow/builds/580192012
> * https://travis-ci.org/ursa-labs/crossbow/builds/580192084
> * https://travis-ci.org/ursa-labs/crossbow/builds/580192418
> * https://travis-ci.org/ursa-labs/crossbow/builds/580192214
> * https://travis-ci.org/ursa-labs/crossbow/builds/580192247
> * https://travis-ci.org/ursa-labs/crossbow/builds/580192313
> * https://travis-ci.org/ursa-labs/crossbow/builds/580192133
> The failures look like:
> {code}
>dh_install
> dh_install: Cannot find (any matches for) "usr/bin/plasma_store_server"
> (tried in ., debian/tmp)
> dh_install: plasma-store-server missing files: usr/bin/plasma_store_server
> dh_install: missing files, aborting
> make: *** [debian/rules:14: binary] Error 25
> dpkg-buildpackage: error: fakeroot debian/rules binary subprocess returned
> exit status 2
> debuild: fatal error at line 1152:
> dpkg-buildpackage -rfakeroot -us -uc -ui failed
> Failed debuild -us -uc
> rake aborted!
> {code}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Created] (ARROW-6462) [C++] Can't build with bundled double-conversion on CentOS 6 x86_64
Sutou Kouhei created ARROW-6462:
---
Summary: [C++] Can't build with bundled double-conversion on
CentOS 6 x86_64
Key: ARROW-6462
URL: https://issues.apache.org/jira/browse/ARROW-6462
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Sutou Kouhei
Assignee: Sutou Kouhei
https://travis-ci.org/ursa-labs/crossbow/builds/581001313#L8163
{noformat}
-- Installing:
/root/rpmbuild/BUILD/apache-arrow-0.14.0.dev451/cpp/build/double-conversion_ep/src/double-conversion_ep/lib64/libdouble-conversion.a
...
make[2]: *** No rule to make target
'double-conversion_ep/src/double-conversion_ep/lib/libdouble-conversion.a',
needed by 'release/libarrow.so.15.0.0'. Stop.
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Resolved] (ARROW-6441) [CI][Crossbow] Nightly Centos 6 job fails
[ https://issues.apache.org/jira/browse/ARROW-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6441. - Resolution: Fixed Issue resolved by pull request 5285 [https://github.com/apache/arrow/pull/5285] > [CI][Crossbow] Nightly Centos 6 job fails > - > > Key: ARROW-6441 > URL: https://issues.apache.org/jira/browse/ARROW-6441 > Project: Apache Arrow > Issue Type: Bug > Components: Continuous Integration, Packaging >Reporter: Neal Richardson >Assignee: Sutou Kouhei >Priority: Blocker > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 1h > Remaining Estimate: 0h > > https://travis-ci.org/ursa-labs/crossbow/builds/580192251 > Log seems to implicate doubleconversion, which is why I didn't bundle this > with the rest in ARROW-6440. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6358) [C++] FileSystem::DeleteDir should make it optional to delete the directory itself
[ https://issues.apache.org/jira/browse/ARROW-6358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6358. - Fix Version/s: 0.15.0 Resolution: Fixed Issue resolved by pull request 5264 [https://github.com/apache/arrow/pull/5264] > [C++] FileSystem::DeleteDir should make it optional to delete the directory > itself > -- > > Key: ARROW-6358 > URL: https://issues.apache.org/jira/browse/ARROW-6358 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Affects Versions: 0.14.1 >Reporter: Antoine Pitrou >Assignee: Antoine Pitrou >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 1h 10m > Remaining Estimate: 0h > > In some situations, it can be desirable to delete the entirety of a > directory's contents, but not the directory itself (e.g. when it's a S3 > bucket). Perhaps we should add an option for that. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6415) [R] Remove usage of R CMD config CXXCPP
[ https://issues.apache.org/jira/browse/ARROW-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6415. - Resolution: Fixed Issue resolved by pull request 5266 [https://github.com/apache/arrow/pull/5266] > [R] Remove usage of R CMD config CXXCPP > --- > > Key: ARROW-6415 > URL: https://issues.apache.org/jira/browse/ARROW-6415 > Project: Apache Arrow > Issue Type: Improvement > Components: R >Reporter: Neal Richardson >Assignee: Neal Richardson >Priority: Blocker > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > > From email from BDR at CRAN: > "R CMD config CXXCPP has been deprecated: it is not used by R itself and > there are several things wrong with the standard autoconf detection code: > - If CXXCPP is set by the user, it is not tested. It could be empty, > which AFAICS none of you allow for. > - The code looks at $CXX -E and /lib/cpp in turn, and tests a system C > header without consulting CPPFLAGS. /lib/cpp is unlikely to find C++ > headers, and we have seen instances where without CPPFLAGS it did not > find C headers. > - It is the setting for the default C++ compiler, in R-devel C++11 but > not specified in earlier R (even 3.6.x could be C++98). > It would be better to use $(CXX) -E (or $(CXX11) etc) or test for yourself. > Please change at the next package update." -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6423) [Python] pyarrow.CompressedOutputStream() never completes with compression='snappy'
[
https://issues.apache.org/jira/browse/ARROW-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei resolved ARROW-6423.
-
Fix Version/s: 0.15.0
Resolution: Fixed
Issue resolved by pull request 5260
[https://github.com/apache/arrow/pull/5260]
> [Python] pyarrow.CompressedOutputStream() never completes with
> compression='snappy'
> ---
>
> Key: ARROW-6423
> URL: https://issues.apache.org/jira/browse/ARROW-6423
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.14.1
>Reporter: Arik Funke
>Assignee: Antoine Pitrou
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.15.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> On python, the execution of {{CompressedOutputSteam(stream,
> compression='snappy')}} never completes.
>
> {color:#00}raw {color}{color:#00}={color}{color:#00}
> pa.BufferOutputStream(){color}
> {color:#00}compressed {color}{color:#00}={color}{color:#00}
> pa.CompressedOutputStream(raw,
> {color}{color:#a31515}'snappy'{color}{color:#00}){color}
> Note: With 'gzip' this works fine.
>
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Updated] (ARROW-6423) [Python] pyarrow.CompressedOutputStream() never completes with compression='snappy'
[
https://issues.apache.org/jira/browse/ARROW-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei updated ARROW-6423:
Component/s: C++
> [Python] pyarrow.CompressedOutputStream() never completes with
> compression='snappy'
> ---
>
> Key: ARROW-6423
> URL: https://issues.apache.org/jira/browse/ARROW-6423
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.14.1
>Reporter: Arik Funke
>Assignee: Antoine Pitrou
>Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> On python, the execution of {{CompressedOutputSteam(stream,
> compression='snappy')}} never completes.
>
> {color:#00}raw {color}{color:#00}={color}{color:#00}
> pa.BufferOutputStream(){color}
> {color:#00}compressed {color}{color:#00}={color}{color:#00}
> pa.CompressedOutputStream(raw,
> {color}{color:#a31515}'snappy'{color}{color:#00}){color}
> Note: With 'gzip' this works fine.
>
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Commented] (ARROW-6404) [C++] CMake build of arrow libraries fails on Windows
[
https://issues.apache.org/jira/browse/ARROW-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921047#comment-16921047
]
Sutou Kouhei commented on ARROW-6404:
-
[~ARF1] Thanks for the information.
It seems that we need to update many points in {{python.rst}} than I imagined.
Could you work on the {{python.rst}} update task as a separated issue? It seems
that I'm not a suitable person to work on this because I'm not a Windows user.
I just use Windows to test Apache Arrow only when it's avoidable.
> [C++] CMake build of arrow libraries fails on Windows
> -
>
> Key: ARROW-6404
> URL: https://issues.apache.org/jira/browse/ARROW-6404
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Reporter: Arik Funke
>Assignee: Sutou Kouhei
>Priority: Major
> Labels: build, pull-request-available
> Fix For: 0.15.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> I am trying to build the python pyarrow extension on Windows 10 using Visual
> Studio 2015 Build Tools and the current stable CMake.
> Following [the
> instructions|https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst]
> to the letter, CMake fails with the error:
> {{??CMake Error at cmake_modules/SetupCxxFlags.cmake:42 (string):??}}
> {{?? string no output variable specified??}}
> {{??Call Stack (most recent call first):??}}
> {{?? CMakeLists.txt:357 (include)??}}
>
> Complete output:
> {{(pyarrow-dev) Z:\devel\arrow\cpp\build>cmake -G "Visual Studio 14 2015
> Win64" ^}}
> {{More? -DCMAKE_INSTALL_PREFIX=%ARROW_HOME% ^}}
> {{More? -DARROW_CXXFLAGS="/WX /MP" ^}}
> {{More? -DARROW_GANDIVA=on ^}}
> {{More? -DARROW_PARQUET=on ^}}
> {{More? -DARROW_PYTHON=on ..}}
> {{-- Building using CMake version: 3.15.2}}
> {{CMake Error at CMakeLists.txt:30 (string):}}
> {{ string no output variable specified}}
> {{-- Selecting Windows SDK version to target Windows 10.0.17763.}}
> {{-- The C compiler identification is MSVC 19.0.24210.0}}
> {{-- The CXX compiler identification is MSVC 19.0.24210.0}}
> {{-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe -- works}}
> {{-- Detecting C compiler ABI info}}
> {{-- Detecting C compiler ABI info - done}}
> {{-- Detecting C compile features}}
> {{-- Detecting C compile features - done}}
> {{-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe -- works}}
> {{-- Detecting CXX compiler ABI info}}
> {{-- Detecting CXX compiler ABI info - done}}
> {{-- Detecting CXX compile features}}
> {{-- Detecting CXX compile features - done}}
> {{-- Arrow version: 0.15.0 (full: '0.15.0-SNAPSHOT')}}
> {{-- Arrow SO version: 15 (full: 15.0.0)}}
> {{-- Found PkgConfig:
> Z:/Systemdateien/Miniconda3/envs/pyarrow-dev/Library/bin/pkg-config.exe
> (found version "0.29.2")}}
> {{-- clang-tidy not found}}
> {{-- clang-format not found}}
> {{-- infer not found}}
> {{-- Found PythonInterp:
> Z:/Systemdateien/Miniconda3/envs/pyarrow-dev/python.exe (found version
> "3.7.3")}}
> {{-- Found cpplint executable at Z:/devel/arrow/cpp/build-support/cpplint.py}}
> {{-- Compiler command: C:/Program Files (x86)/Microsoft Visual Studio
> 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Compiler version:}}
> {{-- Compiler id: MSVC}}
> {{Selected compiler msvc}}
> {{-- Performing Test CXX_SUPPORTS_SSE4_2}}
> {{-- Performing Test CXX_SUPPORTS_SSE4_2 - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ALTIVEC}}
> {{-- Performing Test CXX_SUPPORTS_ALTIVEC - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ARMCRC}}
> {{-- Performing Test CXX_SUPPORTS_ARMCRC - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO}}
> {{-- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO - Failed}}
> {{CMake Error at cmake_modules/SetupCxxFlags.cmake:42 (string):}}
> {{ string no output variable specified}}
> {{Call Stack (most recent call first):}}
> {{ CMakeLists.txt:357 (include)}}
> {{-- Arrow build warning level: CHECKIN}}
> {{Configured for build (set with cmake
> -DCMAKE_BUILD_TYPE=\{release,debug,...})}}
> {{CMake Error at cmake_modules/SetupCxxFlags.cmake:438 (message):}}
> {{ Unknown build type:}}
> {{Call Stack (most recent call first):}}
> {{ CMakeLists.txt:357 (include)}}
> {{-- Configuring incomplete, errors occurred!}}
> {{See also "Z:/devel/arrow/cpp/build/CMakeFiles/CMakeOutput.log".}}
> {{See also "Z:/devel/arrow/cpp/build/CMakeFiles/CMakeError.log".}}
> {{(pyarrow-dev) Z:\devel\arrow\cpp\build>}}
--
This message was sent by Atlassian Jira
[jira] [Commented] (ARROW-6404) [C++] CMake build of arrow libraries fails on Windows
[
https://issues.apache.org/jira/browse/ARROW-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920536#comment-16920536
]
Sutou Kouhei commented on ARROW-6404:
-
[~ARF1] Thanks for trying this patch. But we realize that we need to use
another approach to fix this. So I'll ask you trying new patch again.
> [C++] CMake build of arrow libraries fails on Windows
> -
>
> Key: ARROW-6404
> URL: https://issues.apache.org/jira/browse/ARROW-6404
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Reporter: Arik Funke
>Assignee: Sutou Kouhei
>Priority: Major
> Labels: build, pull-request-available
> Fix For: 0.15.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> I am trying to build the python pyarrow extension on Windows 10 using Visual
> Studio 2015 Build Tools and the current stable CMake.
> Following [the
> instructions|https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst]
> to the letter, CMake fails with the error:
> {{??CMake Error at cmake_modules/SetupCxxFlags.cmake:42 (string):??}}
> {{?? string no output variable specified??}}
> {{??Call Stack (most recent call first):??}}
> {{?? CMakeLists.txt:357 (include)??}}
>
> Complete output:
> {{(pyarrow-dev) Z:\devel\arrow\cpp\build>cmake -G "Visual Studio 14 2015
> Win64" ^}}
> {{More? -DCMAKE_INSTALL_PREFIX=%ARROW_HOME% ^}}
> {{More? -DARROW_CXXFLAGS="/WX /MP" ^}}
> {{More? -DARROW_GANDIVA=on ^}}
> {{More? -DARROW_PARQUET=on ^}}
> {{More? -DARROW_PYTHON=on ..}}
> {{-- Building using CMake version: 3.15.2}}
> {{CMake Error at CMakeLists.txt:30 (string):}}
> {{ string no output variable specified}}
> {{-- Selecting Windows SDK version to target Windows 10.0.17763.}}
> {{-- The C compiler identification is MSVC 19.0.24210.0}}
> {{-- The CXX compiler identification is MSVC 19.0.24210.0}}
> {{-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe -- works}}
> {{-- Detecting C compiler ABI info}}
> {{-- Detecting C compiler ABI info - done}}
> {{-- Detecting C compile features}}
> {{-- Detecting C compile features - done}}
> {{-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe -- works}}
> {{-- Detecting CXX compiler ABI info}}
> {{-- Detecting CXX compiler ABI info - done}}
> {{-- Detecting CXX compile features}}
> {{-- Detecting CXX compile features - done}}
> {{-- Arrow version: 0.15.0 (full: '0.15.0-SNAPSHOT')}}
> {{-- Arrow SO version: 15 (full: 15.0.0)}}
> {{-- Found PkgConfig:
> Z:/Systemdateien/Miniconda3/envs/pyarrow-dev/Library/bin/pkg-config.exe
> (found version "0.29.2")}}
> {{-- clang-tidy not found}}
> {{-- clang-format not found}}
> {{-- infer not found}}
> {{-- Found PythonInterp:
> Z:/Systemdateien/Miniconda3/envs/pyarrow-dev/python.exe (found version
> "3.7.3")}}
> {{-- Found cpplint executable at Z:/devel/arrow/cpp/build-support/cpplint.py}}
> {{-- Compiler command: C:/Program Files (x86)/Microsoft Visual Studio
> 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Compiler version:}}
> {{-- Compiler id: MSVC}}
> {{Selected compiler msvc}}
> {{-- Performing Test CXX_SUPPORTS_SSE4_2}}
> {{-- Performing Test CXX_SUPPORTS_SSE4_2 - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ALTIVEC}}
> {{-- Performing Test CXX_SUPPORTS_ALTIVEC - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ARMCRC}}
> {{-- Performing Test CXX_SUPPORTS_ARMCRC - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO}}
> {{-- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO - Failed}}
> {{CMake Error at cmake_modules/SetupCxxFlags.cmake:42 (string):}}
> {{ string no output variable specified}}
> {{Call Stack (most recent call first):}}
> {{ CMakeLists.txt:357 (include)}}
> {{-- Arrow build warning level: CHECKIN}}
> {{Configured for build (set with cmake
> -DCMAKE_BUILD_TYPE=\{release,debug,...})}}
> {{CMake Error at cmake_modules/SetupCxxFlags.cmake:438 (message):}}
> {{ Unknown build type:}}
> {{Call Stack (most recent call first):}}
> {{ CMakeLists.txt:357 (include)}}
> {{-- Configuring incomplete, errors occurred!}}
> {{See also "Z:/devel/arrow/cpp/build/CMakeFiles/CMakeOutput.log".}}
> {{See also "Z:/devel/arrow/cpp/build/CMakeFiles/CMakeError.log".}}
> {{(pyarrow-dev) Z:\devel\arrow\cpp\build>}}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Commented] (ARROW-6404) [C++] CMake build of arrow libraries fails on Windows
[
https://issues.apache.org/jira/browse/ARROW-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920537#comment-16920537
]
Sutou Kouhei commented on ARROW-6404:
-
[~wesmckinn] OK. I'll update {{python.rst}} too.
> [C++] CMake build of arrow libraries fails on Windows
> -
>
> Key: ARROW-6404
> URL: https://issues.apache.org/jira/browse/ARROW-6404
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Reporter: Arik Funke
>Assignee: Sutou Kouhei
>Priority: Major
> Labels: build, pull-request-available
> Fix For: 0.15.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> I am trying to build the python pyarrow extension on Windows 10 using Visual
> Studio 2015 Build Tools and the current stable CMake.
> Following [the
> instructions|https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst]
> to the letter, CMake fails with the error:
> {{??CMake Error at cmake_modules/SetupCxxFlags.cmake:42 (string):??}}
> {{?? string no output variable specified??}}
> {{??Call Stack (most recent call first):??}}
> {{?? CMakeLists.txt:357 (include)??}}
>
> Complete output:
> {{(pyarrow-dev) Z:\devel\arrow\cpp\build>cmake -G "Visual Studio 14 2015
> Win64" ^}}
> {{More? -DCMAKE_INSTALL_PREFIX=%ARROW_HOME% ^}}
> {{More? -DARROW_CXXFLAGS="/WX /MP" ^}}
> {{More? -DARROW_GANDIVA=on ^}}
> {{More? -DARROW_PARQUET=on ^}}
> {{More? -DARROW_PYTHON=on ..}}
> {{-- Building using CMake version: 3.15.2}}
> {{CMake Error at CMakeLists.txt:30 (string):}}
> {{ string no output variable specified}}
> {{-- Selecting Windows SDK version to target Windows 10.0.17763.}}
> {{-- The C compiler identification is MSVC 19.0.24210.0}}
> {{-- The CXX compiler identification is MSVC 19.0.24210.0}}
> {{-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe -- works}}
> {{-- Detecting C compiler ABI info}}
> {{-- Detecting C compiler ABI info - done}}
> {{-- Detecting C compile features}}
> {{-- Detecting C compile features - done}}
> {{-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe -- works}}
> {{-- Detecting CXX compiler ABI info}}
> {{-- Detecting CXX compiler ABI info - done}}
> {{-- Detecting CXX compile features}}
> {{-- Detecting CXX compile features - done}}
> {{-- Arrow version: 0.15.0 (full: '0.15.0-SNAPSHOT')}}
> {{-- Arrow SO version: 15 (full: 15.0.0)}}
> {{-- Found PkgConfig:
> Z:/Systemdateien/Miniconda3/envs/pyarrow-dev/Library/bin/pkg-config.exe
> (found version "0.29.2")}}
> {{-- clang-tidy not found}}
> {{-- clang-format not found}}
> {{-- infer not found}}
> {{-- Found PythonInterp:
> Z:/Systemdateien/Miniconda3/envs/pyarrow-dev/python.exe (found version
> "3.7.3")}}
> {{-- Found cpplint executable at Z:/devel/arrow/cpp/build-support/cpplint.py}}
> {{-- Compiler command: C:/Program Files (x86)/Microsoft Visual Studio
> 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Compiler version:}}
> {{-- Compiler id: MSVC}}
> {{Selected compiler msvc}}
> {{-- Performing Test CXX_SUPPORTS_SSE4_2}}
> {{-- Performing Test CXX_SUPPORTS_SSE4_2 - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ALTIVEC}}
> {{-- Performing Test CXX_SUPPORTS_ALTIVEC - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ARMCRC}}
> {{-- Performing Test CXX_SUPPORTS_ARMCRC - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO}}
> {{-- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO - Failed}}
> {{CMake Error at cmake_modules/SetupCxxFlags.cmake:42 (string):}}
> {{ string no output variable specified}}
> {{Call Stack (most recent call first):}}
> {{ CMakeLists.txt:357 (include)}}
> {{-- Arrow build warning level: CHECKIN}}
> {{Configured for build (set with cmake
> -DCMAKE_BUILD_TYPE=\{release,debug,...})}}
> {{CMake Error at cmake_modules/SetupCxxFlags.cmake:438 (message):}}
> {{ Unknown build type:}}
> {{Call Stack (most recent call first):}}
> {{ CMakeLists.txt:357 (include)}}
> {{-- Configuring incomplete, errors occurred!}}
> {{See also "Z:/devel/arrow/cpp/build/CMakeFiles/CMakeOutput.log".}}
> {{See also "Z:/devel/arrow/cpp/build/CMakeFiles/CMakeError.log".}}
> {{(pyarrow-dev) Z:\devel\arrow\cpp\build>}}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Resolved] (ARROW-6406) [C++] jemalloc_ep fails for offline build
[
https://issues.apache.org/jira/browse/ARROW-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei resolved ARROW-6406.
-
Fix Version/s: 0.15.0
Resolution: Fixed
Issue resolved by pull request 5246
[https://github.com/apache/arrow/pull/5246]
> [C++] jemalloc_ep fails for offline build
> -
>
> Key: ARROW-6406
> URL: https://issues.apache.org/jira/browse/ARROW-6406
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Reporter: Wes McKinney
>Assignee: Wes McKinney
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.15.0
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Seems we have some slippage between the dependency download script and
> ThirdpartyToolchain.cmake
> {code}
> -- Build files have been written to: /home/wesm/code/arrow/cpp/build
> [2/8] Performing download step (verify and extract) for 'jemalloc_ep'
> -- jemalloc_ep download command succeeded. See also
> /home/wesm/code/arrow/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-download-*.log
> [5/8] Performing configure step for 'jemalloc_ep'
> FAILED: jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure
> cd /home/wesm/code/arrow/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep &&
> /home/wesm/cpp-toolchain/bin/cmake -P
> /home/wesm/code/arrow/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure-DEBUG.cmake
> && /home/wesm/cpp-toolchain/bin/cmake -E touch
> /home/wesm/code/arrow/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure
> CMake Error at
> /home/wesm/code/arrow/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure-DEBUG.cmake:49
> (message):
> Command failed: No such file or directory
>'./configure' 'AR=/usr/bin/ar' 'CC=/usr/bin/clang-7'
> '--prefix=/home/wesm/code/arrow/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep/dist/'
> '--with-jemalloc-prefix=je_arrow_'
> '--with-private-namespace=je_arrow_private_' '--without-export'
> '--disable-cxx' '--disable-libdl' '--disable-initial-exec-tls'
> See also
>
> /home/wesm/code/arrow/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure-*.log
> ninja: build stopped: subcommand failed.
> {code}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Resolved] (ARROW-6347) [GLib] Add garrow_array_diff_unified()
[ https://issues.apache.org/jira/browse/ARROW-6347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6347. - Fix Version/s: 0.15.0 Resolution: Fixed Issue resolved by pull request 5197 [https://github.com/apache/arrow/pull/5197] > [GLib] Add garrow_array_diff_unified() > -- > > Key: ARROW-6347 > URL: https://issues.apache.org/jira/browse/ARROW-6347 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 3h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (ARROW-6347) [GLib] Add garrow_array_diff_unified()
[ https://issues.apache.org/jira/browse/ARROW-6347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-6347: Summary: [GLib] Add garrow_array_diff_unified() (was: [GLib] Add garrow_array_diff()) > [GLib] Add garrow_array_diff_unified() > -- > > Key: ARROW-6347 > URL: https://issues.apache.org/jira/browse/ARROW-6347 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Time Spent: 2h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (ARROW-6404) [C++] CMake build of arrow libraries fails on Windows
[
https://issues.apache.org/jira/browse/ARROW-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920219#comment-16920219
]
Sutou Kouhei commented on ARROW-6404:
-
[~ARF1] Could you try https://github.com/apache/arrow/pull/5247 ?
> [C++] CMake build of arrow libraries fails on Windows
> -
>
> Key: ARROW-6404
> URL: https://issues.apache.org/jira/browse/ARROW-6404
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Reporter: Arik Funke
>Assignee: Sutou Kouhei
>Priority: Major
> Labels: build, pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I am trying to build the python pyarrow extension on Windows 10 using Visual
> Studio 2015 Build Tools and the current stable CMake.
> Following [the
> instructions|https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst]
> to the letter, CMake fails with the error:
> {{??CMake Error at cmake_modules/SetupCxxFlags.cmake:42 (string):??}}
> {{?? string no output variable specified??}}
> {{??Call Stack (most recent call first):??}}
> {{?? CMakeLists.txt:357 (include)??}}
>
> Complete output:
> {{(pyarrow-dev) Z:\devel\arrow\cpp\build>cmake -G "Visual Studio 14 2015
> Win64" ^}}
> {{More? -DCMAKE_INSTALL_PREFIX=%ARROW_HOME% ^}}
> {{More? -DARROW_CXXFLAGS="/WX /MP" ^}}
> {{More? -DARROW_GANDIVA=on ^}}
> {{More? -DARROW_PARQUET=on ^}}
> {{More? -DARROW_PYTHON=on ..}}
> {{-- Building using CMake version: 3.15.2}}
> {{CMake Error at CMakeLists.txt:30 (string):}}
> {{ string no output variable specified}}
> {{-- Selecting Windows SDK version to target Windows 10.0.17763.}}
> {{-- The C compiler identification is MSVC 19.0.24210.0}}
> {{-- The CXX compiler identification is MSVC 19.0.24210.0}}
> {{-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe -- works}}
> {{-- Detecting C compiler ABI info}}
> {{-- Detecting C compiler ABI info - done}}
> {{-- Detecting C compile features}}
> {{-- Detecting C compile features - done}}
> {{-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe -- works}}
> {{-- Detecting CXX compiler ABI info}}
> {{-- Detecting CXX compiler ABI info - done}}
> {{-- Detecting CXX compile features}}
> {{-- Detecting CXX compile features - done}}
> {{-- Arrow version: 0.15.0 (full: '0.15.0-SNAPSHOT')}}
> {{-- Arrow SO version: 15 (full: 15.0.0)}}
> {{-- Found PkgConfig:
> Z:/Systemdateien/Miniconda3/envs/pyarrow-dev/Library/bin/pkg-config.exe
> (found version "0.29.2")}}
> {{-- clang-tidy not found}}
> {{-- clang-format not found}}
> {{-- infer not found}}
> {{-- Found PythonInterp:
> Z:/Systemdateien/Miniconda3/envs/pyarrow-dev/python.exe (found version
> "3.7.3")}}
> {{-- Found cpplint executable at Z:/devel/arrow/cpp/build-support/cpplint.py}}
> {{-- Compiler command: C:/Program Files (x86)/Microsoft Visual Studio
> 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Compiler version:}}
> {{-- Compiler id: MSVC}}
> {{Selected compiler msvc}}
> {{-- Performing Test CXX_SUPPORTS_SSE4_2}}
> {{-- Performing Test CXX_SUPPORTS_SSE4_2 - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ALTIVEC}}
> {{-- Performing Test CXX_SUPPORTS_ALTIVEC - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ARMCRC}}
> {{-- Performing Test CXX_SUPPORTS_ARMCRC - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO}}
> {{-- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO - Failed}}
> {{CMake Error at cmake_modules/SetupCxxFlags.cmake:42 (string):}}
> {{ string no output variable specified}}
> {{Call Stack (most recent call first):}}
> {{ CMakeLists.txt:357 (include)}}
> {{-- Arrow build warning level: CHECKIN}}
> {{Configured for build (set with cmake
> -DCMAKE_BUILD_TYPE=\{release,debug,...})}}
> {{CMake Error at cmake_modules/SetupCxxFlags.cmake:438 (message):}}
> {{ Unknown build type:}}
> {{Call Stack (most recent call first):}}
> {{ CMakeLists.txt:357 (include)}}
> {{-- Configuring incomplete, errors occurred!}}
> {{See also "Z:/devel/arrow/cpp/build/CMakeFiles/CMakeOutput.log".}}
> {{See also "Z:/devel/arrow/cpp/build/CMakeFiles/CMakeError.log".}}
> {{(pyarrow-dev) Z:\devel\arrow\cpp\build>}}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Assigned] (ARROW-6404) [C++] CMake build of arrow libraries fails on Windows
[
https://issues.apache.org/jira/browse/ARROW-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei reassigned ARROW-6404:
---
Assignee: Sutou Kouhei
> [C++] CMake build of arrow libraries fails on Windows
> -
>
> Key: ARROW-6404
> URL: https://issues.apache.org/jira/browse/ARROW-6404
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Reporter: Arik Funke
>Assignee: Sutou Kouhei
>Priority: Major
> Labels: build, pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I am trying to build the python pyarrow extension on Windows 10 using Visual
> Studio 2015 Build Tools and the current stable CMake.
> Following [the
> instructions|https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst]
> to the letter, CMake fails with the error:
> {{??CMake Error at cmake_modules/SetupCxxFlags.cmake:42 (string):??}}
> {{?? string no output variable specified??}}
> {{??Call Stack (most recent call first):??}}
> {{?? CMakeLists.txt:357 (include)??}}
>
> Complete output:
> {{(pyarrow-dev) Z:\devel\arrow\cpp\build>cmake -G "Visual Studio 14 2015
> Win64" ^}}
> {{More? -DCMAKE_INSTALL_PREFIX=%ARROW_HOME% ^}}
> {{More? -DARROW_CXXFLAGS="/WX /MP" ^}}
> {{More? -DARROW_GANDIVA=on ^}}
> {{More? -DARROW_PARQUET=on ^}}
> {{More? -DARROW_PYTHON=on ..}}
> {{-- Building using CMake version: 3.15.2}}
> {{CMake Error at CMakeLists.txt:30 (string):}}
> {{ string no output variable specified}}
> {{-- Selecting Windows SDK version to target Windows 10.0.17763.}}
> {{-- The C compiler identification is MSVC 19.0.24210.0}}
> {{-- The CXX compiler identification is MSVC 19.0.24210.0}}
> {{-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe -- works}}
> {{-- Detecting C compiler ABI info}}
> {{-- Detecting C compiler ABI info - done}}
> {{-- Detecting C compile features}}
> {{-- Detecting C compile features - done}}
> {{-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual
> Studio 14.0/VC/bin/x86_amd64/cl.exe -- works}}
> {{-- Detecting CXX compiler ABI info}}
> {{-- Detecting CXX compiler ABI info - done}}
> {{-- Detecting CXX compile features}}
> {{-- Detecting CXX compile features - done}}
> {{-- Arrow version: 0.15.0 (full: '0.15.0-SNAPSHOT')}}
> {{-- Arrow SO version: 15 (full: 15.0.0)}}
> {{-- Found PkgConfig:
> Z:/Systemdateien/Miniconda3/envs/pyarrow-dev/Library/bin/pkg-config.exe
> (found version "0.29.2")}}
> {{-- clang-tidy not found}}
> {{-- clang-format not found}}
> {{-- infer not found}}
> {{-- Found PythonInterp:
> Z:/Systemdateien/Miniconda3/envs/pyarrow-dev/python.exe (found version
> "3.7.3")}}
> {{-- Found cpplint executable at Z:/devel/arrow/cpp/build-support/cpplint.py}}
> {{-- Compiler command: C:/Program Files (x86)/Microsoft Visual Studio
> 14.0/VC/bin/x86_amd64/cl.exe}}
> {{-- Compiler version:}}
> {{-- Compiler id: MSVC}}
> {{Selected compiler msvc}}
> {{-- Performing Test CXX_SUPPORTS_SSE4_2}}
> {{-- Performing Test CXX_SUPPORTS_SSE4_2 - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ALTIVEC}}
> {{-- Performing Test CXX_SUPPORTS_ALTIVEC - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ARMCRC}}
> {{-- Performing Test CXX_SUPPORTS_ARMCRC - Failed}}
> {{-- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO}}
> {{-- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO - Failed}}
> {{CMake Error at cmake_modules/SetupCxxFlags.cmake:42 (string):}}
> {{ string no output variable specified}}
> {{Call Stack (most recent call first):}}
> {{ CMakeLists.txt:357 (include)}}
> {{-- Arrow build warning level: CHECKIN}}
> {{Configured for build (set with cmake
> -DCMAKE_BUILD_TYPE=\{release,debug,...})}}
> {{CMake Error at cmake_modules/SetupCxxFlags.cmake:438 (message):}}
> {{ Unknown build type:}}
> {{Call Stack (most recent call first):}}
> {{ CMakeLists.txt:357 (include)}}
> {{-- Configuring incomplete, errors occurred!}}
> {{See also "Z:/devel/arrow/cpp/build/CMakeFiles/CMakeOutput.log".}}
> {{See also "Z:/devel/arrow/cpp/build/CMakeFiles/CMakeError.log".}}
> {{(pyarrow-dev) Z:\devel\arrow\cpp\build>}}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Resolved] (ARROW-5300) [C++] 0.13 FAILED to build with option -DARROW_NO_DEFAULT_MEMORY_POOL
[
https://issues.apache.org/jira/browse/ARROW-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei resolved ARROW-5300.
-
Resolution: Fixed
Issue resolved by pull request 5240
[https://github.com/apache/arrow/pull/5240]
> [C++] 0.13 FAILED to build with option -DARROW_NO_DEFAULT_MEMORY_POOL
> -
>
> Key: ARROW-5300
> URL: https://issues.apache.org/jira/browse/ARROW-5300
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.13.0
>Reporter: Weihua Jiang
>Assignee: Francois Saint-Jacques
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.15.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I tried to upgrade Apache Arrow to 0.13. But, when building Apache Arrow 0.13
> with option {{-DARROW_NO_DEFAULT_MEMORY_POOL}}, I got a lot of failures.
> It seems 0.13 assuming default memory pool always available.
>
> My cmake command is:
> |{{make .. -DCMAKE_BUILD_TYPE=Release -DARROW_BUILD_TESTS=off
> -DARROW_USE_GLOG=off -DARROW_WITH_LZ4=off -DARROW_WITH_ZSTD=off
> -DARROW_WITH_SNAPPY=off -DARROW_WITH_BROTLI=off -DARROW_WITH_ZLIB=off
> -DARROW_JEMALLOC=off -DARROW_CXXFLAGS=-DARROW_NO_DEFAULT_MEMORY_POOL}}|
> I tried to fix the compilation by adding some missing constructors. However,
> it seems this issue is bigger than I expected. It seems all the builders and
> appenders have this issue as many classes even don't have a memory pool
> associated.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Resolved] (ARROW-6402) [C++] Suppress sign-compare warning with g++ 9.2.1
[
https://issues.apache.org/jira/browse/ARROW-6402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei resolved ARROW-6402.
-
Fix Version/s: 0.15.0
Resolution: Fixed
Issue resolved by pull request 5244
[https://github.com/apache/arrow/pull/5244]
> [C++] Suppress sign-compare warning with g++ 9.2.1
> --
>
> Key: ARROW-6402
> URL: https://issues.apache.org/jira/browse/ARROW-6402
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
>Reporter: Sutou Kouhei
>Assignee: Sutou Kouhei
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.15.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> {noformat}
> ../src/arrow/array/builder_union.cc: In constructor
> 'arrow::BasicUnionBuilder::BasicUnionBuilder(arrow::MemoryPool*,
> arrow::UnionMode::type, const
> std::vector >&, const
> std::shared_ptr&)':
> ../src/arrow/util/logging.h:86:55: error: comparison of integer
> expressions of different signedness:
> 'std::vector >::size_type' {aka 'long
> unsigned int'} and 'signed char' [-Werror=sign-compare]
>86 | #define ARROW_CHECK_LT(val1, val2) ARROW_CHECK((val1) < (val2))
> |~~~^~~~
> ../src/arrow/util/macros.h:43:52: note: in definition of macro
> 'ARROW_PREDICT_TRUE'
>43 | #define ARROW_PREDICT_TRUE(x) (__builtin_expect(!!(x), 1))
> |^
> ../src/arrow/util/logging.h:86:36: note: in expansion of macro
> 'ARROW_CHECK'
>86 | #define ARROW_CHECK_LT(val1, val2) ARROW_CHECK((val1) < (val2))
> |^~~
> ../src/arrow/util/logging.h:135:19: note: in expansion of macro
> 'ARROW_CHECK_LT'
> 135 | #define DCHECK_LT ARROW_CHECK_LT
> | ^~
> ../src/arrow/array/builder_union.cc:79:3: note: in expansion of macro
> 'DCHECK_LT'
>79 | DCHECK_LT(type_id_to_children_.size(),
> std::numeric_limits::max());
> | ^
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Resolved] (ARROW-6397) [C++][CI] Fix S3 minio failure
[ https://issues.apache.org/jira/browse/ARROW-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6397. - Fix Version/s: 0.15.0 Resolution: Fixed Issue resolved by pull request 5238 [https://github.com/apache/arrow/pull/5238] > [C++][CI] Fix S3 minio failure > -- > > Key: ARROW-6397 > URL: https://issues.apache.org/jira/browse/ARROW-6397 > Project: Apache Arrow > Issue Type: New Feature > Components: C++, Continuous Integration >Reporter: Francois Saint-Jacques >Assignee: Francois Saint-Jacques >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > > See > [https://ci.appveyor.com/project/ApacheSoftwareFoundation/arrow/builds/27065941/job/gwjmr2hudm7693ef] -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (ARROW-6402) [C++] Suppress sign-compare warning with g++ 9.2.1
Sutou Kouhei created ARROW-6402:
---
Summary: [C++] Suppress sign-compare warning with g++ 9.2.1
Key: ARROW-6402
URL: https://issues.apache.org/jira/browse/ARROW-6402
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Sutou Kouhei
Assignee: Sutou Kouhei
{noformat}
../src/arrow/array/builder_union.cc: In constructor
'arrow::BasicUnionBuilder::BasicUnionBuilder(arrow::MemoryPool*,
arrow::UnionMode::type, const std::vector
>&, const std::shared_ptr&)':
../src/arrow/util/logging.h:86:55: error: comparison of integer expressions
of different signedness: 'std::vector
>::size_type' {aka 'long unsigned int'} and 'signed char' [-Werror=sign-compare]
86 | #define ARROW_CHECK_LT(val1, val2) ARROW_CHECK((val1) < (val2))
|~~~^~~~
../src/arrow/util/macros.h:43:52: note: in definition of macro
'ARROW_PREDICT_TRUE'
43 | #define ARROW_PREDICT_TRUE(x) (__builtin_expect(!!(x), 1))
|^
../src/arrow/util/logging.h:86:36: note: in expansion of macro 'ARROW_CHECK'
86 | #define ARROW_CHECK_LT(val1, val2) ARROW_CHECK((val1) < (val2))
|^~~
../src/arrow/util/logging.h:135:19: note: in expansion of macro
'ARROW_CHECK_LT'
135 | #define DCHECK_LT ARROW_CHECK_LT
| ^~
../src/arrow/array/builder_union.cc:79:3: note: in expansion of macro
'DCHECK_LT'
79 | DCHECK_LT(type_id_to_children_.size(),
std::numeric_limits::max());
| ^
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Resolved] (ARROW-2769) [C++][Python] Deprecate and rename add_metadata methods
[ https://issues.apache.org/jira/browse/ARROW-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-2769. - Resolution: Fixed Issue resolved by pull request 5232 [https://github.com/apache/arrow/pull/5232] > [C++][Python] Deprecate and rename add_metadata methods > --- > > Key: ARROW-2769 > URL: https://issues.apache.org/jira/browse/ARROW-2769 > Project: Apache Arrow > Issue Type: Improvement > Components: C++, Python >Reporter: Krisztian Szucs >Assignee: Krisztian Szucs >Priority: Minor > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 3h 40m > Remaining Estimate: 0h > > Deprecate and replace `pyarrow.Field.add_metadata` (and other likely named > methods) with replace_metadata, set_metadata or with_metadata. Knowing > Spark's immutable API, I would have chosen with_metadata but I guess this is > probably not what the average Python user would expect as naming. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (ARROW-2769) [C++][Python] Deprecate and rename add_metadata methods
[ https://issues.apache.org/jira/browse/ARROW-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-2769: Component/s: C++ > [C++][Python] Deprecate and rename add_metadata methods > --- > > Key: ARROW-2769 > URL: https://issues.apache.org/jira/browse/ARROW-2769 > Project: Apache Arrow > Issue Type: Improvement > Components: C++, Python >Reporter: Krisztian Szucs >Assignee: Krisztian Szucs >Priority: Minor > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 3.5h > Remaining Estimate: 0h > > Deprecate and replace `pyarrow.Field.add_metadata` (and other likely named > methods) with replace_metadata, set_metadata or with_metadata. Knowing > Spark's immutable API, I would have chosen with_metadata but I guess this is > probably not what the average Python user would expect as naming. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (ARROW-2769) [C++][Python] Deprecate and rename add_metadata methods
[ https://issues.apache.org/jira/browse/ARROW-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-2769: Summary: [C++][Python] Deprecate and rename add_metadata methods (was: [Python] Deprecate and rename add_metadata methods) > [C++][Python] Deprecate and rename add_metadata methods > --- > > Key: ARROW-2769 > URL: https://issues.apache.org/jira/browse/ARROW-2769 > Project: Apache Arrow > Issue Type: Improvement > Components: Python >Reporter: Krisztian Szucs >Assignee: Krisztian Szucs >Priority: Minor > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 3.5h > Remaining Estimate: 0h > > Deprecate and replace `pyarrow.Field.add_metadata` (and other likely named > methods) with replace_metadata, set_metadata or with_metadata. Knowing > Spark's immutable API, I would have chosen with_metadata but I guess this is > probably not what the average Python user would expect as naming. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Comment Edited] (ARROW-6322) [C#] Implement a plasma client
[
https://issues.apache.org/jira/browse/ARROW-6322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918968#comment-16918968
]
Sutou Kouhei edited comment on ARROW-6322 at 8/29/19 9:27 PM:
--
I'm not a expert of Plasma but I think that the followings are remained
problems:
* Using {{mmap}} directly
* Using UNIX domain socket
Using {{mmap}} may be resolved by using {{arrow/io/mman.h}}.
UNIX domain socket is used to send a file descriptor. I think that we can't do
it on Windows.
Anyway, how about starting discussion on the dev@ mailing list?
was (Author: kou):
I'm not a expert of Plasma but I think that the followings are remained
problems:
* Using {mmap} directly
* Using UNIX domain socket
Using {mmap} maybe resolved by using {arrow/io/mman.h}.
UNIX domain socket is used to send a file descriptor. I think that we can't do
it on Windows.
Anyway, how about starting discussion on the dev@ mailing list?
> [C#] Implement a plasma client
> --
>
> Key: ARROW-6322
> URL: https://issues.apache.org/jira/browse/ARROW-6322
> Project: Apache Arrow
> Issue Type: New Feature
> Components: C#
>Reporter: Eric Erhardt
>Assignee: Eric Erhardt
>Priority: Major
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> We should create a C# plasma client, so .NET code can get and put objects
> into the plasma store.
> An easy-ish way of implementing this would be to build on the c_glib C APIs
> already exposed for the plasma client. Unfortunately, I haven't found a
> decent C# GObject generator, so I think the C bindings will need to be
> written by hand, but there isn't too many of them.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Commented] (ARROW-6322) [C#] Implement a plasma client
[
https://issues.apache.org/jira/browse/ARROW-6322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918968#comment-16918968
]
Sutou Kouhei commented on ARROW-6322:
-
I'm not a expert of Plasma but I think that the followings are remained
problems:
* Using {mmap} directly
* Using UNIX domain socket
Using {mmap} maybe resolved by using {arrow/io/mman.h}.
UNIX domain socket is used to send a file descriptor. I think that we can't do
it on Windows.
Anyway, how about starting discussion on the dev@ mailing list?
> [C#] Implement a plasma client
> --
>
> Key: ARROW-6322
> URL: https://issues.apache.org/jira/browse/ARROW-6322
> Project: Apache Arrow
> Issue Type: New Feature
> Components: C#
>Reporter: Eric Erhardt
>Assignee: Eric Erhardt
>Priority: Major
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> We should create a C# plasma client, so .NET code can get and put objects
> into the plasma store.
> An easy-ish way of implementing this would be to build on the c_glib C APIs
> already exposed for the plasma client. Unfortunately, I haven't found a
> decent C# GObject generator, so I think the C bindings will need to be
> written by hand, but there isn't too many of them.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Created] (ARROW-6351) [Ruby] Improve Arrow#values performance
Sutou Kouhei created ARROW-6351: --- Summary: [Ruby] Improve Arrow#values performance Key: ARROW-6351 URL: https://issues.apache.org/jira/browse/ARROW-6351 Project: Apache Arrow Issue Type: Improvement Components: Ruby Reporter: Sutou Kouhei Assignee: Sutou Kouhei -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (ARROW-6322) [C#] Implement a plasma client
[ https://issues.apache.org/jira/browse/ARROW-6322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915386#comment-16915386 ] Sutou Kouhei commented on ARROW-6322: - FYI: Plasma doesn't support Windows yet. > [C#] Implement a plasma client > -- > > Key: ARROW-6322 > URL: https://issues.apache.org/jira/browse/ARROW-6322 > Project: Apache Arrow > Issue Type: New Feature > Components: C# >Reporter: Eric Erhardt >Assignee: Eric Erhardt >Priority: Major > Original Estimate: 96h > Remaining Estimate: 96h > > We should create a C# plasma client, so .NET code can get and put objects > into the plasma store. > An easy-ish way of implementing this would be to build on the c_glib C APIs > already exposed for the plasma client. Unfortunately, I haven't found a > decent C# GObject generator, so I think the C bindings will need to be > written by hand, but there isn't too many of them. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (ARROW-6350) [Ruby] Remove Arrow::Struct and use Hash instead
Sutou Kouhei created ARROW-6350: --- Summary: [Ruby] Remove Arrow::Struct and use Hash instead Key: ARROW-6350 URL: https://issues.apache.org/jira/browse/ARROW-6350 Project: Apache Arrow Issue Type: Improvement Components: Ruby Reporter: Sutou Kouhei Assignee: Sutou Kouhei -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6346) [GLib] Add garrow_array_view()
[ https://issues.apache.org/jira/browse/ARROW-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6346. - Fix Version/s: 0.15.0 Resolution: Fixed Issue resolved by pull request 5187 [https://github.com/apache/arrow/pull/5187] > [GLib] Add garrow_array_view() > -- > > Key: ARROW-6346 > URL: https://issues.apache.org/jira/browse/ARROW-6346 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Attachments: ARROW-6346.doc > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6203) [GLib] Add garrow_array_sort_to_indices()
[ https://issues.apache.org/jira/browse/ARROW-6203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6203. - Resolution: Fixed Issue resolved by pull request 5061 [https://github.com/apache/arrow/pull/5061] > [GLib] Add garrow_array_sort_to_indices() > - > > Key: ARROW-6203 > URL: https://issues.apache.org/jira/browse/ARROW-6203 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 2h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-5906) [CI] Set -DARROW_VERBOSE_THIRDPARTY_BUILD=OFF in builds running in Travis CI, maybe all docker-compose builds by default
[ https://issues.apache.org/jira/browse/ARROW-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-5906. - Resolution: Fixed Issue resolved by pull request 5183 [https://github.com/apache/arrow/pull/5183] > [CI] Set -DARROW_VERBOSE_THIRDPARTY_BUILD=OFF in builds running in Travis CI, > maybe all docker-compose builds by default > > > Key: ARROW-5906 > URL: https://issues.apache.org/jira/browse/ARROW-5906 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Wes McKinney >Assignee: Wes McKinney >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 1h > Remaining Estimate: 0h > > This setting should be disabled in general unless we are trying to debug > something. It makes logs much more verbose -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6232) [C++] Rename Argsort kernel to SortToIndices
[ https://issues.apache.org/jira/browse/ARROW-6232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6232. - Fix Version/s: 0.15.0 Resolution: Fixed Issue resolved by pull request 5080 [https://github.com/apache/arrow/pull/5080] > [C++] Rename Argsort kernel to SortToIndices > > > Key: ARROW-6232 > URL: https://issues.apache.org/jira/browse/ARROW-6232 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 3h 40m > Remaining Estimate: 0h > > "Argsort" is NumPy specific name. Other languages/libraries use > different name: > * R: order > * > https://cran.r-project.org/doc/manuals/r-release/fullrefman.pdf#Rfn.order > * MATLAB: sort > * https://mathworks.com/help/matlab/ref/sort.html > * "sort" returns sorted array and indices to sort array > * Julia: sortperm > * > https://pkg.julialang.org/docs/julia/THl1k/1.1.1/base/sort.html#Base.sortperm > It's better that we use general name because Arrow C++ isn't a NumPy > compatible library. > "SortToIndices" means "sort that returns indices array". -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Assigned] (ARROW-6328) Click.option-s should have help text
[ https://issues.apache.org/jira/browse/ARROW-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei reassigned ARROW-6328: --- Assignee: Ulzii O > Click.option-s should have help text > > > Key: ARROW-6328 > URL: https://issues.apache.org/jira/browse/ARROW-6328 > Project: Apache Arrow > Issue Type: Improvement > Components: Python >Reporter: Ulzii O >Assignee: Ulzii O >Priority: Trivial > > Click.option-s should have `help` text > ## What? > Add `help` text to click.option > ## Why? > Click.option should ideally have a `help` text defined to be useful. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-4848) [C++] Static libparquet not compiled with -DARROW_STATIC on Windows
[ https://issues.apache.org/jira/browse/ARROW-4848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-4848. - Resolution: Fixed Issue resolved by pull request 5168 [https://github.com/apache/arrow/pull/5168] > [C++] Static libparquet not compiled with -DARROW_STATIC on Windows > --- > > Key: ARROW-4848 > URL: https://issues.apache.org/jira/browse/ARROW-4848 > Project: Apache Arrow > Issue Type: Bug > Components: C++ >Affects Versions: 0.12.1 >Reporter: Jeroen >Assignee: Neal Richardson >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 40m > Remaining Estimate: 0h > > When trying to link the R bindings against static libparquet.a + libarrow.a > we get a lot of missing arrow symbol warnings from libparquet.a. I think the > problem is that libparquet.a was not compiled -DARROW_STATIC, and therefore > cannot be linked against libarrow.a. > When arrow cmake is configured with -DARROW_BUILD_SHARED=OFF I think it > should automatically use -DARROW_STATIC when compiling libparquet on Windows? -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6260) [Website] Use deploy key on Travis to build and push to asf-site
[ https://issues.apache.org/jira/browse/ARROW-6260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6260. - Resolution: Fixed > [Website] Use deploy key on Travis to build and push to asf-site > > > Key: ARROW-6260 > URL: https://issues.apache.org/jira/browse/ARROW-6260 > Project: Apache Arrow > Issue Type: Improvement > Components: Website >Reporter: Neal Richardson >Assignee: Neal Richardson >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 1h 40m > Remaining Estimate: 0h > > ARROW-4473 added CI/CD for the website, but there was some discomfort about > having a committer provide a GitHub personal access token to do the pushing > of the built site to the asf-site branch. Investigate using GitHub Deploy > Keys instead, which are scoped to a single repository, not all public > repositories that a user has access to. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (ARROW-6260) [Website] Use deploy key on Travis to build and push to asf-site
[ https://issues.apache.org/jira/browse/ARROW-6260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-6260: Fix Version/s: 0.15.0 > [Website] Use deploy key on Travis to build and push to asf-site > > > Key: ARROW-6260 > URL: https://issues.apache.org/jira/browse/ARROW-6260 > Project: Apache Arrow > Issue Type: Improvement > Components: Website >Reporter: Neal Richardson >Assignee: Neal Richardson >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 1h 40m > Remaining Estimate: 0h > > ARROW-4473 added CI/CD for the website, but there was some discomfort about > having a committer provide a GitHub personal access token to do the pushing > of the built site to the asf-site branch. Investigate using GitHub Deploy > Keys instead, which are scoped to a single repository, not all public > repositories that a user has access to. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (ARROW-3203) [C++] Build error on Debian Buster
[
https://issues.apache.org/jira/browse/ARROW-3203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912822#comment-16912822
]
Sutou Kouhei commented on ARROW-3203:
-
Yes. This is outdated.
> [C++] Build error on Debian Buster
> --
>
> Key: ARROW-3203
> URL: https://issues.apache.org/jira/browse/ARROW-3203
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.10.0
>Reporter: albertoramon
>Priority: Major
> Attachments: DockerfileRV, flatbuffers_ep-build-err.log
>
>
> There is a error with Debian Buster (In Debian Stretch works fine)
> You can test it easily change the first line from dockerfile (attached)
>
> *To reproduce it:*
> {code:java}
> docker build -f DockerfileRV -t arrow_rw .
> docker run -it arrow_rw bash
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Commented] (ARROW-6309) [C++] Parquet tests and executables are linked statically
[
https://issues.apache.org/jira/browse/ARROW-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912724#comment-16912724
]
Sutou Kouhei commented on ARROW-6309:
-
We need to use static linking only on Windows, right?
I've created a pull request for the change:
https://github.com/apache/arrow/pull/5158
> [C++] Parquet tests and executables are linked statically
> -
>
> Key: ARROW-6309
> URL: https://issues.apache.org/jira/browse/ARROW-6309
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Reporter: Antoine Pitrou
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.15.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> For some reason, on Linux Parquet tests are now statically linked with
> {{libparquet}} and {{libarrow}} by default, even though other tests (Arrow,
> Plasma...) are dynamically-linked.
> For example:
> {code}
> $ ldd build-test/debug/parquet-schema-test
> linux-vdso.so.1 (0x7ffd376ad000)
> libgtest_main.so =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libgtest_main.so
> (0x7f3affeaf000)
> libgtest.so => /home/antoine/miniconda3/envs/pyarrow/lib/libgtest.so
> (0x7f3affde5000)
> libbz2.so.1.0 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libbz2.so.1.0 (0x7f3affdd1000)
> liblz4.so.1 => /home/antoine/miniconda3/envs/pyarrow/lib/liblz4.so.1
> (0x7f3aff58d000)
> libsnappy.so.1 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libsnappy.so.1 (0x7f3aff384000)
> libz.so.1 => /home/antoine/miniconda3/envs/pyarrow/lib/libz.so.1
> (0x7f3affdb1000)
> libzstd.so.1.3.7 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libzstd.so.1.3.7
> (0x7f3affd0a000)
> libboost_filesystem.so.1.67.0 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libboost_filesystem.so.1.67.0
> (0x7f3aff168000)
> libstdc++.so.6 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libstdc++.so.6 (0x7f3afeff4000)
> libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x7f3afec56000)
> libgcc_s.so.1 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libgcc_s.so.1 (0x7f3affcbb000)
> libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x7f3afe865000)
> libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0
> (0x7f3afe646000)
> libboost_system.so.1.67.0 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/./libboost_system.so.1.67.0
> (0x7f3afe441000)
> librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x7f3afe239000)
> /lib64/ld-linux-x86-64.so.2 (0x7f3affc8f000)
> {code}
> Contrast with e.g.:
> {code}
> $ ldd build-test/debug/arrow-uri-test
> linux-vdso.so.1 (0x7ffe07fb6000)
> libarrow.so.15 =>
> /home/antoine/arrow/dev/cpp/build-test/debug/libarrow.so.15
> (0x7f774f34)
> libboost_system.so.1.67.0 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libboost_system.so.1.67.0
> (0x7f774f13b000)
> libgtest_main.so =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libgtest_main.so
> (0x7f7751723000)
> libgtest.so => /home/antoine/miniconda3/envs/pyarrow/lib/libgtest.so
> (0x7f7751659000)
> libstdc++.so.6 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libstdc++.so.6 (0x7f774efc7000)
> libgcc_s.so.1 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libgcc_s.so.1 (0x7f7751645000)
> libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x7f774ebd6000)
> libaws-cpp-sdk-s3.so =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libaws-cpp-sdk-s3.so
> (0x7f774e99)
> libaws-cpp-sdk-core.so =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libaws-cpp-sdk-core.so
> (0x7f774e893000)
> libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x7f774e68f000)
> liburiparser.so.1 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/liburiparser.so.1
> (0x7f77515f2000)
> libbz2.so.1.0 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libbz2.so.1.0 (0x7f77515de000)
> liblz4.so.1 => /home/antoine/miniconda3/envs/pyarrow/lib/liblz4.so.1
> (0x7f774e46b000)
> libsnappy.so.1 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libsnappy.so.1 (0x7f774e262000)
> libz.so.1 => /home/antoine/miniconda3/envs/pyarrow/lib/libz.so.1
> (0x7f77515bc000)
> libzstd.so.1.3.7 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libzstd.so.1.3.7
> (0x7f774e1bd000)
> libboost_filesystem.so.1.67.0 =>
> /home/antoine/miniconda3/envs/pyarrow/lib/libboost_filesystem.so.1.67.0
> (0x7f774dfa1000)
> libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0
> (0x7f774dd82000)
> libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x7f774d9e4000)
> /lib64/ld-linux-x86-64.so.2 (0x7f7751503000)
>
[jira] [Assigned] (ARROW-6312) Declare required Libs.private in arrow.pc package config
[
https://issues.apache.org/jira/browse/ARROW-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei reassigned ARROW-6312:
---
Assignee: Michael Maguire
> Declare required Libs.private in arrow.pc package config
>
>
> Key: ARROW-6312
> URL: https://issues.apache.org/jira/browse/ARROW-6312
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.14.1
>Reporter: Michael Maguire
>Assignee: Michael Maguire
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.15.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> The current arrow.pc package config file produced is deficient and doesn't
> properly declare static libraries pre-requisities that must be linked in in
> order to *statically* link in libarrow.a
> Currently it just has:
> ```
> Libs: -L${libdir} -larrow
> ```
> But in cases, e.g. where you enabled snappy, brotli or zlib support in arrow,
> our toolchains need to see an arrow.pc file something more like:
> ```
> Libs: -L${libdir} -larrow
> Libs.private: -lsnappy -lboost_system -lz -llz4 -lbrotlidec -lbrotlienc
> -lbrotlicommon -lzstd
> ```
> If not, we get linkage errors. I'm told the convention is that if the .a has
> an UNDEF, the Requires.private plus the Libs.private should resolve all the
> undefs. See the Libs.private info in [https://linux.die.net/man/1/pkg-config]
>
> Note, however, as Sutou Kouhei pointed out in
> [https://github.com/apache/arrow/pull/5123#issuecomment-522771452,] the
> additional Libs.private need to be dynamically generated based on whether
> functionality like snappy, brotli or zlib is enabled..
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Resolved] (ARROW-6291) [C++] CMake ignores ARROW_PARQUET
[
https://issues.apache.org/jira/browse/ARROW-6291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei resolved ARROW-6291.
-
Fix Version/s: 0.15.0
Resolution: Fixed
Issue resolved by pull request 5154
[https://github.com/apache/arrow/pull/5154]
> [C++] CMake ignores ARROW_PARQUET
> -
>
> Key: ARROW-6291
> URL: https://issues.apache.org/jira/browse/ARROW-6291
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Developer Tools
>Reporter: Antoine Pitrou
>Assignee: Wes McKinney
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.15.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Passing {{-DARROW_PARQUET=off}} is ignored and Parquet is always built. It
> shouldn't.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Assigned] (ARROW-6291) [C++] CMake ignores ARROW_PARQUET
[
https://issues.apache.org/jira/browse/ARROW-6291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei reassigned ARROW-6291:
---
Assignee: Wes McKinney
> [C++] CMake ignores ARROW_PARQUET
> -
>
> Key: ARROW-6291
> URL: https://issues.apache.org/jira/browse/ARROW-6291
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Developer Tools
>Reporter: Antoine Pitrou
>Assignee: Wes McKinney
>Priority: Major
>
> Passing {{-DARROW_PARQUET=off}} is ignored and Parquet is always built. It
> shouldn't.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Commented] (ARROW-6225) [Website] Update arrow-site/README and any other places to point website contributors in right direction
[ https://issues.apache.org/jira/browse/ARROW-6225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912130#comment-16912130 ] Sutou Kouhei commented on ARROW-6225: - Could you create an issue to INFRA project to change the default branch? > [Website] Update arrow-site/README and any other places to point website > contributors in right direction > > > Key: ARROW-6225 > URL: https://issues.apache.org/jira/browse/ARROW-6225 > Project: Apache Arrow > Issue Type: Improvement > Components: Website >Reporter: Wes McKinney >Assignee: Neal Richardson >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 20m > Remaining Estimate: 0h > > I noticed this is out of date > https://github.com/apache/arrow-site/blob/asf-site/README.md > We might want to ask ASF Infra to make the "master" branch the default when > people land at apache/arrow-site on GitHub -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6225) [Website] Update arrow-site/README and any other places to point website contributors in right direction
[ https://issues.apache.org/jira/browse/ARROW-6225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6225. - Resolution: Fixed > [Website] Update arrow-site/README and any other places to point website > contributors in right direction > > > Key: ARROW-6225 > URL: https://issues.apache.org/jira/browse/ARROW-6225 > Project: Apache Arrow > Issue Type: Improvement > Components: Website >Reporter: Wes McKinney >Assignee: Neal Richardson >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 20m > Remaining Estimate: 0h > > I noticed this is out of date > https://github.com/apache/arrow-site/blob/asf-site/README.md > We might want to ask ASF Infra to make the "master" branch the default when > people land at apache/arrow-site on GitHub -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (ARROW-6294) [C++] Use hyphen for plasma-store-server executable
Sutou Kouhei created ARROW-6294: --- Summary: [C++] Use hyphen for plasma-store-server executable Key: ARROW-6294 URL: https://issues.apache.org/jira/browse/ARROW-6294 Project: Apache Arrow Issue Type: Improvement Components: C++ - Plasma Reporter: Sutou Kouhei Assignee: Sutou Kouhei -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (ARROW-6232) [C++] Rename Argsort kernel to SortToIndices
[ https://issues.apache.org/jira/browse/ARROW-6232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-6232: Description: "Argsort" is NumPy specific name. Other languages/libraries use different name: * R: order * https://cran.r-project.org/doc/manuals/r-release/fullrefman.pdf#Rfn.order * MATLAB: sort * https://mathworks.com/help/matlab/ref/sort.html * "sort" returns sorted array and indices to sort array * Julia: sortperm * https://pkg.julialang.org/docs/julia/THl1k/1.1.1/base/sort.html#Base.sortperm It's better that we use general name because Arrow C++ isn't a NumPy compatible library. "SortToIndices" means "sort that returns indices array". was: "Argsort" is NumPy specific name. Other languages/libraries use different name: * R: order * https://cran.r-project.org/doc/manuals/r-release/fullrefman.pdf#Rfn.order * MATLAB: sort * https://mathworks.com/help/matlab/ref/sort.html * "sort" returns sorted array and indices to sort array * Julia: sortperm * https://pkg.julialang.org/docs/julia/THl1k/1.1.1/base/sort.html#Base.sortperm It's better that we use general name because Arrow C++ isn't a NumPy compatible library. "SortIndices" means "sort that returns indices array". We can add "SortValues" or something for sort kernel that returns values array. "SortIndices" may be easily mistaken for "sort by indices". > [C++] Rename Argsort kernel to SortToIndices > > > Key: ARROW-6232 > URL: https://issues.apache.org/jira/browse/ARROW-6232 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Time Spent: 3h > Remaining Estimate: 0h > > "Argsort" is NumPy specific name. Other languages/libraries use > different name: > * R: order > * > https://cran.r-project.org/doc/manuals/r-release/fullrefman.pdf#Rfn.order > * MATLAB: sort > * https://mathworks.com/help/matlab/ref/sort.html > * "sort" returns sorted array and indices to sort array > * Julia: sortperm > * > https://pkg.julialang.org/docs/julia/THl1k/1.1.1/base/sort.html#Base.sortperm > It's better that we use general name because Arrow C++ isn't a NumPy > compatible library. > "SortToIndices" means "sort that returns indices array". -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (ARROW-6232) [C++] Rename Argsort kernel to SortToIndices
[ https://issues.apache.org/jira/browse/ARROW-6232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-6232: Summary: [C++] Rename Argsort kernel to SortToIndices (was: [C++] Rename Argsort kernel to SortIndices) > [C++] Rename Argsort kernel to SortToIndices > > > Key: ARROW-6232 > URL: https://issues.apache.org/jira/browse/ARROW-6232 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Time Spent: 3h > Remaining Estimate: 0h > > "Argsort" is NumPy specific name. Other languages/libraries use > different name: > * R: order > * > https://cran.r-project.org/doc/manuals/r-release/fullrefman.pdf#Rfn.order > * MATLAB: sort > * https://mathworks.com/help/matlab/ref/sort.html > * "sort" returns sorted array and indices to sort array > * Julia: sortperm > * > https://pkg.julialang.org/docs/julia/THl1k/1.1.1/base/sort.html#Base.sortperm > It's better that we use general name because Arrow C++ isn't a NumPy > compatible library. > "SortIndices" means "sort that returns indices array". We can add > "SortValues" or something for sort kernel that returns values array. > "SortIndices" may be easily mistaken for "sort by indices". -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-5638) [C++] cmake fails to generate Xcode project when Gandiva JNI bindings are enabled
[ https://issues.apache.org/jira/browse/ARROW-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-5638. - Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request 5046 [https://github.com/apache/arrow/pull/5046] > [C++] cmake fails to generate Xcode project when Gandiva JNI bindings are > enabled > - > > Key: ARROW-5638 > URL: https://issues.apache.org/jira/browse/ARROW-5638 > Project: Apache Arrow > Issue Type: Bug > Components: C++ >Reporter: Hatem Helal >Assignee: Hatem Helal >Priority: Minor > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 3h 40m > Remaining Estimate: 0h > > See comment with error here: > https://github.com/apache/arrow/pull/4596#issuecomment-502954709 -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (ARROW-5638) [C++] cmake fails to generate Xcode project when Gandiva JNI bindings are enabled
[ https://issues.apache.org/jira/browse/ARROW-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-5638: Component/s: C++ > [C++] cmake fails to generate Xcode project when Gandiva JNI bindings are > enabled > - > > Key: ARROW-5638 > URL: https://issues.apache.org/jira/browse/ARROW-5638 > Project: Apache Arrow > Issue Type: Bug > Components: C++ >Reporter: Hatem Helal >Assignee: Hatem Helal >Priority: Minor > Labels: pull-request-available > Time Spent: 3h 40m > Remaining Estimate: 0h > > See comment with error here: > https://github.com/apache/arrow/pull/4596#issuecomment-502954709 -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (ARROW-6267) [Ruby] Add Arrow::Time for Arrow::Time{32,64}DataType value
Sutou Kouhei created ARROW-6267:
---
Summary: [Ruby] Add Arrow::Time for Arrow::Time{32,64}DataType
value
Key: ARROW-6267
URL: https://issues.apache.org/jira/browse/ARROW-6267
Project: Apache Arrow
Issue Type: Improvement
Components: Ruby
Reporter: Sutou Kouhei
Assignee: Sutou Kouhei
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Created] (ARROW-6262) [Developer] Show JIRA issue before merging
Sutou Kouhei created ARROW-6262: --- Summary: [Developer] Show JIRA issue before merging Key: ARROW-6262 URL: https://issues.apache.org/jira/browse/ARROW-6262 Project: Apache Arrow Issue Type: Improvement Components: Developer Tools Reporter: Sutou Kouhei Assignee: Sutou Kouhei It's useful to confirm whehter the associated JIRA issue is right or not. We couldn't find wrong associated JIRA issue after we merge the pull request https://github.com/apache/arrow/pull/5050 . -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-6170) [R] "docker-compose build r" is slow
[ https://issues.apache.org/jira/browse/ARROW-6170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6170. - Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request 5039 [https://github.com/apache/arrow/pull/5039] > [R] "docker-compose build r" is slow > > > Key: ARROW-6170 > URL: https://issues.apache.org/jira/browse/ARROW-6170 > Project: Apache Arrow > Issue Type: Bug > Components: Developer Tools, R >Reporter: Antoine Pitrou >Assignee: Antoine Pitrou >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 2h 20m > Remaining Estimate: 0h > > Apparently it installs and compiles all packages in single-thread mode. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-6204) [GLib] Add garrow_array_is_in_chunked_array()
[ https://issues.apache.org/jira/browse/ARROW-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6204. - Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request 5086 [https://github.com/apache/arrow/pull/5086] > [GLib] Add garrow_array_is_in_chunked_array() > - > > Key: ARROW-6204 > URL: https://issues.apache.org/jira/browse/ARROW-6204 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 1h 40m > Remaining Estimate: 0h > > This is follow-up of > [https://github.com/apache/arrow/pull/5047#issuecomment-520103706]. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-6186) [Packaging][C++] Plasma headers not included for ubuntu-xenial libplasma-dev debian package
[ https://issues.apache.org/jira/browse/ARROW-6186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6186. - Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request 5050 [https://github.com/apache/arrow/pull/5050] > [Packaging][C++] Plasma headers not included for ubuntu-xenial libplasma-dev > debian package > --- > > Key: ARROW-6186 > URL: https://issues.apache.org/jira/browse/ARROW-6186 > Project: Apache Arrow > Issue Type: Bug > Components: C++ - Plasma, Packaging >Affects Versions: 0.14.1 >Reporter: Wannes G >Assignee: Sutou Kouhei >Priority: Major > Labels: debian, packaging, pull-request-available > Fix For: 0.15.0 > > Time Spent: 10m > Remaining Estimate: 0h > > See > [https://github.com/kou/arrow/blob/master/dev/tasks/linux-packages/debian.ubuntu-xenial/libplasma-dev.install] > Issue is still present on latest master branch, the debian install script is > correct: > [https://github.com/kou/arrow/blob/master/dev/tasks/linux-packages/debian/libplasma-dev.install] > The first line is missing from the ubuntu install script causing no headers > to be installed when apt-get is used to install libplasma-dev. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (ARROW-4473) [Website] Add instructions to do a test-deploy of Arrow website and fix bugs
[ https://issues.apache.org/jira/browse/ARROW-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-4473: Fix Version/s: (was: 1.0.0) 0.15.0 > [Website] Add instructions to do a test-deploy of Arrow website and fix bugs > > > Key: ARROW-4473 > URL: https://issues.apache.org/jira/browse/ARROW-4473 > Project: Apache Arrow > Issue Type: Improvement > Components: Website >Reporter: Wes McKinney >Assignee: Neal Richardson >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 5h 40m > Remaining Estimate: 0h > > This will help with testing and proofing the website. > I have noticed that there are bugs in the website when the baseurl is not a > foo.bar.baz, e.g. if you deploy at root foo.bar.baz/test-site many images and > links are broken -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-4473) [Website] Add instructions to do a test-deploy of Arrow website and fix bugs
[ https://issues.apache.org/jira/browse/ARROW-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-4473. - Resolution: Fixed > [Website] Add instructions to do a test-deploy of Arrow website and fix bugs > > > Key: ARROW-4473 > URL: https://issues.apache.org/jira/browse/ARROW-4473 > Project: Apache Arrow > Issue Type: Improvement > Components: Website >Reporter: Wes McKinney >Assignee: Neal Richardson >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 5h 40m > Remaining Estimate: 0h > > This will help with testing and proofing the website. > I have noticed that there are bugs in the website when the baseurl is not a > foo.bar.baz, e.g. if you deploy at root foo.bar.baz/test-site many images and > links are broken -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-5307) [CI][GLib] Enable GTK-Doc
[ https://issues.apache.org/jira/browse/ARROW-5307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-5307. - Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request 5087 [https://github.com/apache/arrow/pull/5087] > [CI][GLib] Enable GTK-Doc > - > > Key: ARROW-5307 > URL: https://issues.apache.org/jira/browse/ARROW-5307 > Project: Apache Arrow > Issue Type: Improvement > Components: Continuous Integration, GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 20m > Remaining Estimate: 0h > > Enable GTK-Doc when 1.31 is released. > See https://issues.apache.org/jira/browse/ARROW-5306. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (ARROW-6240) [Ruby] Arrow::Decimal128Array returns BigDecimal
Sutou Kouhei created ARROW-6240: --- Summary: [Ruby] Arrow::Decimal128Array returns BigDecimal Key: ARROW-6240 URL: https://issues.apache.org/jira/browse/ARROW-6240 Project: Apache Arrow Issue Type: Improvement Components: Ruby Reporter: Sutou Kouhei Assignee: Sutou Kouhei -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-6237) [R] Add option to set CXXFLAGS when compiling R package with $ARROW_R_CXXFLAGS
[
https://issues.apache.org/jira/browse/ARROW-6237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei resolved ARROW-6237.
-
Resolution: Fixed
Issue resolved by pull request 5088
[https://github.com/apache/arrow/pull/5088]
> [R] Add option to set CXXFLAGS when compiling R package with $ARROW_R_CXXFLAGS
> --
>
> Key: ARROW-6237
> URL: https://issues.apache.org/jira/browse/ARROW-6237
> Project: Apache Arrow
> Issue Type: Improvement
> Components: R
>Reporter: Wes McKinney
>Assignee: Wes McKinney
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.15.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> I want to be able to pass {{-fno-omit-frame-pointer}} with an environment
> variable
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Created] (ARROW-6232) [C++] Rename Argsort kernel to SortIndices
Sutou Kouhei created ARROW-6232: --- Summary: [C++] Rename Argsort kernel to SortIndices Key: ARROW-6232 URL: https://issues.apache.org/jira/browse/ARROW-6232 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Sutou Kouhei Assignee: Sutou Kouhei "Argsort" is NumPy specific name. Other languages/libraries use different name: * R: order * https://cran.r-project.org/doc/manuals/r-release/fullrefman.pdf#Rfn.order * MATLAB: sort * https://mathworks.com/help/matlab/ref/sort.html * "sort" returns sorted array and indices to sort array * Julia: sortperm * https://pkg.julialang.org/docs/julia/THl1k/1.1.1/base/sort.html#Base.sortperm It's better that we use general name because Arrow C++ isn't a NumPy compatible library. "SortIndices" means "sort that returns indices array". We can add "SortValues" or something for sort kernel that returns values array. "SortIndices" may be easily mistaken for "sort by indices". -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-6177) [C++] Add Array::Validate()
[
https://issues.apache.org/jira/browse/ARROW-6177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei resolved ARROW-6177.
-
Resolution: Fixed
Fix Version/s: 0.15.0
Issue resolved by pull request 5067
[https://github.com/apache/arrow/pull/5067]
> [C++] Add Array::Validate()
> ---
>
> Key: ARROW-6177
> URL: https://issues.apache.org/jira/browse/ARROW-6177
> Project: Apache Arrow
> Issue Type: Task
> Components: C++
>Affects Versions: 0.14.1
>Reporter: Antoine Pitrou
>Assignee: Antoine Pitrou
>Priority: Trivial
> Labels: easy, pull-request-available
> Fix For: 0.15.0
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> It's a bit weird to have {{ChunkedArray::Validate()}} and
> {{Table::Validate()}} methods but only a standalone {{ValidateArray}}
> function for arrays.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Assigned] (ARROW-6205) ARROW_DEPRECATED warning when including io/interfaces.h from CUDA (.cu) source
[
https://issues.apache.org/jira/browse/ARROW-6205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sutou Kouhei reassigned ARROW-6205:
---
Assignee: Mark Harris
> ARROW_DEPRECATED warning when including io/interfaces.h from CUDA (.cu) source
> --
>
> Key: ARROW-6205
> URL: https://issues.apache.org/jira/browse/ARROW-6205
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.14.1
>Reporter: Mark Harris
>Assignee: Mark Harris
>Priority: Minor
> Labels: easyfix, pull-request-available
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> When including arrow/io/interfaces.h from a .cu source file (compiled with
> nvcc, the CUDA compiler), we get warnings like the following:
> {{[6/58] Building CUDA obje.../csv/csv_reader_impl.cu.}}
> {{arrow/install/include/arrow/io/interfaces.h(195): warning: attribute does
> not apply to any entity}}
> This example is from compiling [libcudf|[https://github.com/rapidsai/cudf].]
> libcudf installs these headers and includes them. This is a problem for
> libraries like libcudf which treat warnings as errors.
> There is a simple fix (I will submit a PR): change this code in interfaces.h:
> {{// TODO(kszucs): remove this after 0.13}}
> {{#ifndef _MSC_VER}}
> {{using WriteableFile ARROW_DEPRECATED("Use WritableFile") = WritableFile;}}
> {{using ReadableFileInterface ARROW_DEPRECATED("Use RandomAccessFile") =
> RandomAccessFile;}}
> {{#else}}{{// MSVC does not like using ARROW_DEPRECATED with using
> declarations}}{{using WriteableFile = WritableFile;}}
> {{using ReadableFileInterface = RandomAccessFile;}}
> {{#endif}}
>
> Just change the ifndef to:
> {{#if not defined(_MSC_VER) && not defined(__CUDACC__)}}
> This fix should have no impact on other compilers.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Commented] (ARROW-6204) [GLib] Add garrow_array_is_in_chunked_array()
[
https://issues.apache.org/jira/browse/ARROW-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905745#comment-16905745
]
Sutou Kouhei commented on ARROW-6204:
-
Really?
Could you create a pull request for {{GArrowArray *left}} and
{{GArrowChunkedArray *right}}? Then I'll test it too.
> [GLib] Add garrow_array_is_in_chunked_array()
> -
>
> Key: ARROW-6204
> URL: https://issues.apache.org/jira/browse/ARROW-6204
> Project: Apache Arrow
> Issue Type: New Feature
> Components: GLib
>Reporter: Yosuke Shiro
>Assignee: Yosuke Shiro
>Priority: Major
>
> This is follow-up of
> [https://github.com/apache/arrow/pull/5047#issuecomment-520103706].
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Updated] (ARROW-6217) [Website] Remove needless _site/ directory
[ https://issues.apache.org/jira/browse/ARROW-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-6217: Fix Version/s: 0.15.0 > [Website] Remove needless _site/ directory > -- > > Key: ARROW-6217 > URL: https://issues.apache.org/jira/browse/ARROW-6217 > Project: Apache Arrow > Issue Type: Task > Components: Website >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Minor > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-6217) [Website] Remove needless _site/ directory
[ https://issues.apache.org/jira/browse/ARROW-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei resolved ARROW-6217. - Resolution: Fixed > [Website] Remove needless _site/ directory > -- > > Key: ARROW-6217 > URL: https://issues.apache.org/jira/browse/ARROW-6217 > Project: Apache Arrow > Issue Type: Task > Components: Website >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Minor > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
