[jira] [Resolved] (ARROW-8912) [Ruby] Keep reference of Arrow::Buffer's data for GC
[ https://issues.apache.org/jira/browse/ARROW-8912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-8912. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7254 [https://github.com/apache/arrow/pull/7254] > [Ruby] Keep reference of Arrow::Buffer's data for GC > > > Key: ARROW-8912 > URL: https://issues.apache.org/jira/browse/ARROW-8912 > Project: Apache Arrow > Issue Type: Improvement > Components: Ruby >Reporter: Kouhei Sutou >Assignee: Kouhei Sutou >Priority: Major > Labels: pull-request-available > Fix For: 1.0.0 > > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-8830) [GLib] Add support for Tell againt not seekable GIO output stream
[ https://issues.apache.org/jira/browse/ARROW-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-8830. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7207 [https://github.com/apache/arrow/pull/7207] > [GLib] Add support for Tell againt not seekable GIO output stream > - > > Key: ARROW-8830 > URL: https://issues.apache.org/jira/browse/ARROW-8830 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Kouhei Sutou >Assignee: Kouhei Sutou >Priority: Major > Labels: pull-request-available > Fix For: 1.0.0 > > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-8682) [Ruby][Parquet] Add support for column level compression
[ https://issues.apache.org/jira/browse/ARROW-8682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-8682. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7092 [https://github.com/apache/arrow/pull/7092] > [Ruby][Parquet] Add support for column level compression > > > Key: ARROW-8682 > URL: https://issues.apache.org/jira/browse/ARROW-8682 > Project: Apache Arrow > Issue Type: Improvement > Components: Ruby >Reporter: Kouhei Sutou >Assignee: Kouhei Sutou >Priority: Major > Labels: pull-request-available > Fix For: 1.0.0 > > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-8509) [GLib] Add low level record batch read/write functions
[ https://issues.apache.org/jira/browse/ARROW-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-8509. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7086 [https://github.com/apache/arrow/pull/7086] > [GLib] Add low level record batch read/write functions > -- > > Key: ARROW-8509 > URL: https://issues.apache.org/jira/browse/ARROW-8509 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Tanveer >Assignee: Kouhei Sutou >Priority: Major > Labels: pull-request-available > Fix For: 1.0.0 > > Time Spent: 50m > Remaining Estimate: 0h > > Hi All, > I am working on integrating two programs, both of which are using Plasma API. > For this purpose, I need to convert RecordBatches to Buffer to transfer to > Plasma. > I have created GArrowRecordBatch <-> GArrowBuffer conversion functions which > are working for me locally, but I am not sure if I have adopted the correct > way, I want it to be integrated into c_glib. Can you people please check > these functions and update/accept the pull request? > > https://github.com/apache/arrow/pull/6963 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-8539) [CI] "AMD64 MacOS 10.15 GLib & Ruby" fails
[ https://issues.apache.org/jira/browse/ARROW-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088674#comment-17088674 ] Yosuke Shiro commented on ARROW-8539: - [https://github.com/Homebrew/homebrew-core/pull/53445.] has been merged. CI is green. [https://github.com/apache/arrow/pull/6991/checks?check_run_id=605238698] > [CI] "AMD64 MacOS 10.15 GLib & Ruby" fails > -- > > Key: ARROW-8539 > URL: https://issues.apache.org/jira/browse/ARROW-8539 > Project: Apache Arrow > Issue Type: Bug > Components: C, Continuous Integration, GLib >Reporter: Antoine Pitrou >Assignee: Yosuke Shiro >Priority: Critical > > See e.g. > https://github.com/apache/arrow/pull/6991/checks?check_run_id=604703868 > {code} > [192/256] Generating arithmetic_ops.bc > FAILED: src/gandiva/precompiled/arithmetic_ops.bc > cd > /Users/runner/runners/2.169.0/work/arrow/arrow/build/cpp/src/gandiva/precompiled > && /usr/local/Cellar/cmake/3.17.1/bin/cmake -E env > SDKROOT=/Applications/Xcode_11.3.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk > /usr/local/opt/llvm@8/bin/clang-8 -std=c++11 -DGANDIVA_IR -DNDEBUG > -DARROW_STATIC -DGANDIVA_STATIC -fno-use-cxa-atexit -emit-llvm -O3 -c > /Users/runner/runners/2.169.0/work/arrow/arrow/cpp/src/gandiva/precompiled/arithmetic_ops.cc > -o > /Users/runner/runners/2.169.0/work/arrow/arrow/build/cpp/src/gandiva/precompiled/arithmetic_ops.bc > -isysroot > /Applications/Xcode_11.3.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk > -I/Users/runner/runners/2.169.0/work/arrow/arrow/cpp/src > dyld: Library not loaded: /usr/local/opt/z3/lib/libz3.dylib > Referenced from: /usr/local/opt/llvm@8/bin/clang-8 > Reason: image not found > Child aborted > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-8539) [CI] "AMD64 MacOS 10.15 GLib & Ruby" fails
[ https://issues.apache.org/jira/browse/ARROW-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-8539. - Resolution: Resolved > [CI] "AMD64 MacOS 10.15 GLib & Ruby" fails > -- > > Key: ARROW-8539 > URL: https://issues.apache.org/jira/browse/ARROW-8539 > Project: Apache Arrow > Issue Type: Bug > Components: C, Continuous Integration, GLib >Reporter: Antoine Pitrou >Assignee: Yosuke Shiro >Priority: Critical > > See e.g. > https://github.com/apache/arrow/pull/6991/checks?check_run_id=604703868 > {code} > [192/256] Generating arithmetic_ops.bc > FAILED: src/gandiva/precompiled/arithmetic_ops.bc > cd > /Users/runner/runners/2.169.0/work/arrow/arrow/build/cpp/src/gandiva/precompiled > && /usr/local/Cellar/cmake/3.17.1/bin/cmake -E env > SDKROOT=/Applications/Xcode_11.3.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk > /usr/local/opt/llvm@8/bin/clang-8 -std=c++11 -DGANDIVA_IR -DNDEBUG > -DARROW_STATIC -DGANDIVA_STATIC -fno-use-cxa-atexit -emit-llvm -O3 -c > /Users/runner/runners/2.169.0/work/arrow/arrow/cpp/src/gandiva/precompiled/arithmetic_ops.cc > -o > /Users/runner/runners/2.169.0/work/arrow/arrow/build/cpp/src/gandiva/precompiled/arithmetic_ops.bc > -isysroot > /Applications/Xcode_11.3.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk > -I/Users/runner/runners/2.169.0/work/arrow/arrow/cpp/src > dyld: Library not loaded: /usr/local/opt/z3/lib/libz3.dylib > Referenced from: /usr/local/opt/llvm@8/bin/clang-8 > Reason: image not found > Child aborted > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-8539) [CI] "AMD64 MacOS 10.15 GLib & Ruby" fails
[ https://issues.apache.org/jira/browse/ARROW-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088530#comment-17088530 ] Yosuke Shiro commented on ARROW-8539: - This caused by llvm@8(Homebrew). I sent https://github.com/Homebrew/homebrew-core/pull/53445. If this PR has been merged, I'll check if CI passes. > [CI] "AMD64 MacOS 10.15 GLib & Ruby" fails > -- > > Key: ARROW-8539 > URL: https://issues.apache.org/jira/browse/ARROW-8539 > Project: Apache Arrow > Issue Type: Bug > Components: C, Continuous Integration, GLib >Reporter: Antoine Pitrou >Priority: Critical > > See e.g. > https://github.com/apache/arrow/pull/6991/checks?check_run_id=604703868 > {code} > [192/256] Generating arithmetic_ops.bc > FAILED: src/gandiva/precompiled/arithmetic_ops.bc > cd > /Users/runner/runners/2.169.0/work/arrow/arrow/build/cpp/src/gandiva/precompiled > && /usr/local/Cellar/cmake/3.17.1/bin/cmake -E env > SDKROOT=/Applications/Xcode_11.3.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk > /usr/local/opt/llvm@8/bin/clang-8 -std=c++11 -DGANDIVA_IR -DNDEBUG > -DARROW_STATIC -DGANDIVA_STATIC -fno-use-cxa-atexit -emit-llvm -O3 -c > /Users/runner/runners/2.169.0/work/arrow/arrow/cpp/src/gandiva/precompiled/arithmetic_ops.cc > -o > /Users/runner/runners/2.169.0/work/arrow/arrow/build/cpp/src/gandiva/precompiled/arithmetic_ops.bc > -isysroot > /Applications/Xcode_11.3.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk > -I/Users/runner/runners/2.169.0/work/arrow/arrow/cpp/src > dyld: Library not loaded: /usr/local/opt/z3/lib/libz3.dylib > Referenced from: /usr/local/opt/llvm@8/bin/clang-8 > Reason: image not found > Child aborted > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (ARROW-8539) [CI] "AMD64 MacOS 10.15 GLib & Ruby" fails
[ https://issues.apache.org/jira/browse/ARROW-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro reassigned ARROW-8539: --- Assignee: Yosuke Shiro > [CI] "AMD64 MacOS 10.15 GLib & Ruby" fails > -- > > Key: ARROW-8539 > URL: https://issues.apache.org/jira/browse/ARROW-8539 > Project: Apache Arrow > Issue Type: Bug > Components: C, Continuous Integration, GLib >Reporter: Antoine Pitrou >Assignee: Yosuke Shiro >Priority: Critical > > See e.g. > https://github.com/apache/arrow/pull/6991/checks?check_run_id=604703868 > {code} > [192/256] Generating arithmetic_ops.bc > FAILED: src/gandiva/precompiled/arithmetic_ops.bc > cd > /Users/runner/runners/2.169.0/work/arrow/arrow/build/cpp/src/gandiva/precompiled > && /usr/local/Cellar/cmake/3.17.1/bin/cmake -E env > SDKROOT=/Applications/Xcode_11.3.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk > /usr/local/opt/llvm@8/bin/clang-8 -std=c++11 -DGANDIVA_IR -DNDEBUG > -DARROW_STATIC -DGANDIVA_STATIC -fno-use-cxa-atexit -emit-llvm -O3 -c > /Users/runner/runners/2.169.0/work/arrow/arrow/cpp/src/gandiva/precompiled/arithmetic_ops.cc > -o > /Users/runner/runners/2.169.0/work/arrow/arrow/build/cpp/src/gandiva/precompiled/arithmetic_ops.bc > -isysroot > /Applications/Xcode_11.3.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk > -I/Users/runner/runners/2.169.0/work/arrow/arrow/cpp/src > dyld: Library not loaded: /usr/local/opt/z3/lib/libz3.dylib > Referenced from: /usr/local/opt/llvm@8/bin/clang-8 > Reason: image not found > Child aborted > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-8530) [Ruby] Return dictionary value by DictionaryArray#[]
Yosuke Shiro created ARROW-8530: --- Summary: [Ruby] Return dictionary value by DictionaryArray#[] Key: ARROW-8530 URL: https://issues.apache.org/jira/browse/ARROW-8530 Project: Apache Arrow Issue Type: New Feature Components: Ruby Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Issue Comment Deleted] (ARROW-7637) [GLib] Check components installed when building
[ https://issues.apache.org/jira/browse/ARROW-7637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-7637: Comment: was deleted (was: I close this due to duplicate by https://github.com/apache/arrow/pull/6105/commits/110ffd9ed71f38087fafdea79e1911dd4c747e08.) > [GLib] Check components installed when building > --- > > Key: ARROW-7637 > URL: https://issues.apache.org/jira/browse/ARROW-7637 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (ARROW-7637) [GLib] Check components installed when building
[ https://issues.apache.org/jira/browse/ARROW-7637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro closed ARROW-7637. --- Resolution: Duplicate I close this due to duplicate by https://github.com/apache/arrow/pull/6105/commits/110ffd9ed71f38087fafdea79e1911dd4c747e08. > [GLib] Check components installed when building > --- > > Key: ARROW-7637 > URL: https://issues.apache.org/jira/browse/ARROW-7637 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-7637) [GLib] Check components installed when building
[ https://issues.apache.org/jira/browse/ARROW-7637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087669#comment-17087669 ] Yosuke Shiro commented on ARROW-7637: - I close this due to duplicate by https://github.com/apache/arrow/pull/6105/commits/110ffd9ed71f38087fafdea79e1911dd4c747e08. > [GLib] Check components installed when building > --- > > Key: ARROW-7637 > URL: https://issues.apache.org/jira/browse/ARROW-7637 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-8083) [GLib] Add support for Peek() to GIOInputStream
[ https://issues.apache.org/jira/browse/ARROW-8083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-8083. - Fix Version/s: 0.17.0 Resolution: Fixed Issue resolved by pull request 6589 [https://github.com/apache/arrow/pull/6589] > [GLib] Add support for Peek() to GIOInputStream > --- > > Key: ARROW-8083 > URL: https://issues.apache.org/jira/browse/ARROW-8083 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Kouhei Sutou >Assignee: Kouhei Sutou >Priority: Major > Labels: pull-request-available > Fix For: 0.17.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-7959) [Ruby] Add support for Ruby 2.3 again
[ https://issues.apache.org/jira/browse/ARROW-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-7959. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 6501 [https://github.com/apache/arrow/pull/6501] > [Ruby] Add support for Ruby 2.3 again > - > > Key: ARROW-7959 > URL: https://issues.apache.org/jira/browse/ARROW-7959 > Project: Apache Arrow > Issue Type: Improvement > Components: Ruby >Reporter: Kouhei Sutou >Assignee: Kouhei Sutou >Priority: Major > Labels: pull-request-available > Fix For: 1.0.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > > Ruby 2.3 reached EOL but Ubuntu 16.04 LTS ships Ruby 2.3. So supporting Ruby > 2.3 again is valuable. > Note that Red Arrow 0.15.1 works with Ruby 2.3. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-7625) [GLib] Parquet GLib and Red Parquet (Ruby) do not allow specifying compression type
[ https://issues.apache.org/jira/browse/ARROW-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-7625. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 6336 [https://github.com/apache/arrow/pull/6336] > [GLib] Parquet GLib and Red Parquet (Ruby) do not allow specifying > compression type > --- > > Key: ARROW-7625 > URL: https://issues.apache.org/jira/browse/ARROW-7625 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib > Environment: red-arrow 0.15.1 > red-parquet 0.15.1 > libarrow 0.15.1 > libparquet 0.15.1 >Reporter: Keith Gable >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Fix For: 1.0.0 > > Time Spent: 4h 20m > Remaining Estimate: 0h > > It seems that the ArrowFileWriter being used by parquet-glib just uses the > default writer properties > ([https://github.com/apache/arrow/blob/master/c_glib/parquet-glib/arrow-file-writer.cpp#L184),] > and does not offer the user the ability to override this. As a consumer of > the GLib API in Ruby (red-parquet), I therefore have no way of compressing > Parquet columns. Of course, I can compress the entire file by doing something > like {{t.save('...', format: 'parquet', compression: 'GZIP')}}, but this is > not compatible with most tools and isn't the correct way of compressing a > Parquet file. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-7742) [GLib] Add support for MapArray
Yosuke Shiro created ARROW-7742: --- Summary: [GLib] Add support for MapArray Key: ARROW-7742 URL: https://issues.apache.org/jira/browse/ARROW-7742 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (ARROW-7625) [GLib] Parquet GLib and Red Parquet (Ruby) do not allow specifying compression type
[ https://issues.apache.org/jira/browse/ARROW-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro reassigned ARROW-7625: --- Assignee: Yosuke Shiro (was: Kouhei Sutou) > [GLib] Parquet GLib and Red Parquet (Ruby) do not allow specifying > compression type > --- > > Key: ARROW-7625 > URL: https://issues.apache.org/jira/browse/ARROW-7625 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib > Environment: red-arrow 0.15.1 > red-parquet 0.15.1 > libarrow 0.15.1 > libparquet 0.15.1 >Reporter: Keith Gable >Assignee: Yosuke Shiro >Priority: Major > > It seems that the ArrowFileWriter being used by parquet-glib just uses the > default writer properties > ([https://github.com/apache/arrow/blob/master/c_glib/parquet-glib/arrow-file-writer.cpp#L184),] > and does not offer the user the ability to override this. As a consumer of > the GLib API in Ruby (red-parquet), I therefore have no way of compressing > Parquet columns. Of course, I can compress the entire file by doing something > like {{t.save('...', format: 'parquet', compression: 'GZIP')}}, but this is > not compatible with most tools and isn't the correct way of compressing a > Parquet file. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-7609) [C++] Build error by passing -DARROW_HIVESERVER2=ON
[ https://issues.apache.org/jira/browse/ARROW-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020315#comment-17020315 ] Yosuke Shiro commented on ARROW-7609: - I see. Thank you for confirming this issue. > [C++] Build error by passing -DARROW_HIVESERVER2=ON > --- > > Key: ARROW-7609 > URL: https://issues.apache.org/jira/browse/ARROW-7609 > Project: Apache Arrow > Issue Type: Bug > Components: C++ >Reporter: Yosuke Shiro >Priority: Major > > Currently using Apple Clang 11.0.0 and Thrift 0.13.0 on macOS Mojave 10.14.4. > I got the following errors by passing -DARROW_HIVESERVER2=ON. > {code:java} > In file included from > /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.cpp:7: > /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:29:17: > error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] >* @param query > ~~~^ > /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:36:17: > error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] >* @param query > ~~~^ > /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:37:21: > error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] >* @param clientCtx > ~~~^ > /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:44:17: > error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] >* @param query > ~~~^ > /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:53:20: > error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] >* @param query_id > ~~^ > /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:54:22: > error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] >* @param start_over > ^ > /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:55:22: > error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] >* @param fetch_size > ^ > /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:62:18: > error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] >* @param handle > ^ > /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:69:18: > error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] >* @param handle > ^ > /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:76:13: > error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] >* @param s > ~~~^ > /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:89:19: > error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] >* @param context > ~^ > 11 errors generated. > {code} > CMake command: > {code:java} > cmake -DCMAKE_BUILD_TYPE=debug -DARROW_GANDIVA=ON -DARROW_PARQUET=ON > -DARROW_PLASMA=ON -DARROW_FLIGHT=ON -DARROW_WITH_ZLIB=ON -DARROW_JSON=ON > -DARROW_CSV=ON -DARROW_ORC=ON -DARROW_TENSORFLOW=ON -DARROW_HIVESERVER2=ON > ..{code} > Output of CMake: > {code:java} > -- Building using CMake version: 3.15.4 > -- The C compiler identification is AppleClang 11.0.0.1133 > -- The CXX compiler identification is AppleClang 11.0.0.1133 > -- Check for working C compiler: > /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc > -- Check for working C compiler: > /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc > -- works > -- Detecting C compiler ABI info > -- Detecting C compiler ABI info - done > -- Detecting C compile features > -- Detecting C compile features - done > -- Check for working CXX compiler: > /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++ > -- Check for working CXX compiler: > /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++ > -- works > -- Detecting CXX compiler ABI info > -- Detecting CXX compiler ABI info - done > -- Detecting CXX compile features > -- Detecting CXX compile features - done > -- Arrow version: 1.0.0 (full: '1.0.0-SNAPSHOT') > -- Arrow SO version: 100 (full: 100.0.0) > -- Found PkgConfig: /usr/local/bin/pkg-config (found version "0.29.2") > -- clang-tidy not found > -- clang-format not found > -- infer not found > -- Found PythonInterp: /Users/shiro/.pyenv/shims/python (found version > "3.6.1") > -- Using ccache: /usr/local/bin/ccache > -- Found cpplint executable at >
[jira] [Created] (ARROW-7637) [GLib] Check components installed when building
Yosuke Shiro created ARROW-7637: --- Summary: [GLib] Check components installed when building Key: ARROW-7637 URL: https://issues.apache.org/jira/browse/ARROW-7637 Project: Apache Arrow Issue Type: Improvement Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-7635) [C++] Add pkg-config support for each components
Yosuke Shiro created ARROW-7635: --- Summary: [C++] Add pkg-config support for each components Key: ARROW-7635 URL: https://issues.apache.org/jira/browse/ARROW-7635 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-7626) [Parquet][GLib] Add support for version macros
[ https://issues.apache.org/jira/browse/ARROW-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-7626. - Fix Version/s: 0.16.0 Resolution: Fixed Issue resolved by pull request 6236 [https://github.com/apache/arrow/pull/6236] > [Parquet][GLib] Add support for version macros > -- > > Key: ARROW-7626 > URL: https://issues.apache.org/jira/browse/ARROW-7626 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Kouhei Sutou >Assignee: Kouhei Sutou >Priority: Major > Labels: pull-request-available > Fix For: 0.16.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-7609) [C++] Build error by passing -DARROW_HIVESERVER2=ON
Yosuke Shiro created ARROW-7609: --- Summary: [C++] Build error by passing -DARROW_HIVESERVER2=ON Key: ARROW-7609 URL: https://issues.apache.org/jira/browse/ARROW-7609 Project: Apache Arrow Issue Type: Bug Components: C++ Reporter: Yosuke Shiro Currently using Apple Clang 11.0.0 and Thrift 0.13.0 on macOS Mojave 10.14.4. I got the following errors by passing -DARROW_HIVESERVER2=ON. {code:java} In file included from /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.cpp:7: /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:29:17: error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] * @param query ~~~^ /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:36:17: error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] * @param query ~~~^ /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:37:21: error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] * @param clientCtx ~~~^ /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:44:17: error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] * @param query ~~~^ /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:53:20: error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] * @param query_id ~~^ /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:54:22: error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] * @param start_over ^ /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:55:22: error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] * @param fetch_size ^ /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:62:18: error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] * @param handle ^ /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:69:18: error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] * @param handle ^ /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:76:13: error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] * @param s ~~~^ /Users/shiro/dev/arrow/cpp/build/src/arrow/dbi/hiveserver2/BeeswaxService.h:89:19: error: empty paragraph passed to '@param' command [-Werror,-Wdocumentation] * @param context ~^ 11 errors generated. {code} CMake command: {code:java} cmake -DCMAKE_BUILD_TYPE=debug -DARROW_GANDIVA=ON -DARROW_PARQUET=ON -DARROW_PLASMA=ON -DARROW_FLIGHT=ON -DARROW_WITH_ZLIB=ON -DARROW_JSON=ON -DARROW_CSV=ON -DARROW_ORC=ON -DARROW_TENSORFLOW=ON -DARROW_HIVESERVER2=ON ..{code} Output of CMake: {code:java} -- Building using CMake version: 3.15.4 -- The C compiler identification is AppleClang 11.0.0.1133 -- The CXX compiler identification is AppleClang 11.0.0.1133 -- Check for working C compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc -- Check for working C compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc -- works -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Detecting C compile features -- Detecting C compile features - done -- Check for working CXX compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++ -- Check for working CXX compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++ -- works -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Detecting CXX compile features -- Detecting CXX compile features - done -- Arrow version: 1.0.0 (full: '1.0.0-SNAPSHOT') -- Arrow SO version: 100 (full: 100.0.0) -- Found PkgConfig: /usr/local/bin/pkg-config (found version "0.29.2") -- clang-tidy not found -- clang-format not found -- infer not found -- Found PythonInterp: /Users/shiro/.pyenv/shims/python (found version "3.6.1") -- Using ccache: /usr/local/bin/ccache -- Found cpplint executable at /Users/shiro/dev/arrow/cpp/build-support/cpplint.py -- Performing Test CXX_SUPPORTS_SSE4_2 -- Performing Test CXX_SUPPORTS_SSE4_2 - Success -- Performing Test CXX_SUPPORTS_ALTIVEC -- Performing Test CXX_SUPPORTS_ALTIVEC - Success -- Performing Test CXX_SUPPORTS_ARMCRC -- Performing Test CXX_SUPPORTS_ARMCRC - Failed -- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO -- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO - Failed -- Arrow build warning level: CHECKIN Configured for DEBUG build (set with
[jira] [Resolved] (ARROW-7474) [Ruby] Save CSV files faster
[ https://issues.apache.org/jira/browse/ARROW-7474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-7474. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 6106 [https://github.com/apache/arrow/pull/6106] > [Ruby] Save CSV files faster > > > Key: ARROW-7474 > URL: https://issues.apache.org/jira/browse/ARROW-7474 > Project: Apache Arrow > Issue Type: Improvement > Components: Ruby >Reporter: kojix2 >Assignee: Kouhei Sutou >Priority: Minor > Labels: pull-request-available > Fix For: 1.0.0 > > Attachments: arrow.png > > Time Spent: 0.5h > Remaining Estimate: 0h > > Hi developers > Saving Arrow::Table in CSV format may be slow. > Ad hoc benchmarks... > > {code:ruby} > > require 'arrow' > require 'csv' > require 'gr/plot' > t = Arrow::Table.load('some_nice.tsv', format: :csv, delimiter: "\t".ord) > n = 1.step(1000, 100).to_a > arrow_save_times = [] > csv_save_times = [] > n.each do |i| > t2 = t.slice(0, i) > start = Time.now > t2.save('test.csv') > arrow_save_times << p(Time.now - start) > t2 = t.raw_records > start = Time.now > CSV.open('test2.csv', 'w') do |csv| > t2.each do |r| > csv << r > end > end > csv_save_times << p(Time.now - start) > end > GR.stem([n, arrow_save_times], [n, csv_save_times], > labels: ["arrow", "CSV"], xlabel: "lines", ylabel: "time", location: 2) > GR.savefig("arrow.png") > gets > {code} > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-7276) [Ruby] Add support for building Arrow::ListArray from [[...]]
[ https://issues.apache.org/jira/browse/ARROW-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-7276. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 5925 [https://github.com/apache/arrow/pull/5925] > [Ruby] Add support for building Arrow::ListArray from [[...]] > - > > Key: ARROW-7276 > URL: https://issues.apache.org/jira/browse/ARROW-7276 > Project: Apache Arrow > Issue Type: Improvement > Components: Ruby >Reporter: Kouhei Sutou >Assignee: Kouhei Sutou >Priority: Major > Labels: pull-request-available > Fix For: 1.0.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-7275) [Ruby] Add support for Arrow::ListDataType.new(data_type)
[ https://issues.apache.org/jira/browse/ARROW-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-7275. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 5924 [https://github.com/apache/arrow/pull/5924] > [Ruby] Add support for Arrow::ListDataType.new(data_type) > - > > Key: ARROW-7275 > URL: https://issues.apache.org/jira/browse/ARROW-7275 > Project: Apache Arrow > Issue Type: Improvement > Components: Ruby >Reporter: Kouhei Sutou >Assignee: Kouhei Sutou >Priority: Major > Labels: pull-request-available > Fix For: 1.0.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-7201) [GLib][Gandiva] Add support for BooleanNode
Yosuke Shiro created ARROW-7201: --- Summary: [GLib][Gandiva] Add support for BooleanNode Key: ARROW-7201 URL: https://issues.apache.org/jira/browse/ARROW-7201 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-7195) [Ruby] Improve #filter, #take, and #is_in
[ https://issues.apache.org/jira/browse/ARROW-7195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-7195. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 5851 [https://github.com/apache/arrow/pull/5851] > [Ruby] Improve #filter, #take, and #is_in > - > > Key: ARROW-7195 > URL: https://issues.apache.org/jira/browse/ARROW-7195 > Project: Apache Arrow > Issue Type: Improvement > Components: Ruby >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Fix For: 1.0.0 > > Time Spent: 40m > Remaining Estimate: 0h > > This is follow-up of > https://github.com/apache/arrow/pull/5837#pullrequestreview-317438583. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-7195) [Ruby] Improve #filter, #take, and #is_in
Yosuke Shiro created ARROW-7195: --- Summary: [Ruby] Improve #filter, #take, and #is_in Key: ARROW-7195 URL: https://issues.apache.org/jira/browse/ARROW-7195 Project: Apache Arrow Issue Type: Improvement Components: Ruby Reporter: Yosuke Shiro Assignee: Yosuke Shiro This is follow-up of https://github.com/apache/arrow/pull/5837#pullrequestreview-317438583. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-7171) [Ruby] Pass Array for Arrow::Table#filter
Yosuke Shiro created ARROW-7171: --- Summary: [Ruby] Pass Array for Arrow::Table#filter Key: ARROW-7171 URL: https://issues.apache.org/jira/browse/ARROW-7171 Project: Apache Arrow Issue Type: New Feature Components: Ruby Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-7111) [GLib] Add take support for GArrowTable, GArrowChunkedArray, and GArrowRecordBatch
Yosuke Shiro created ARROW-7111: --- Summary: [GLib] Add take support for GArrowTable, GArrowChunkedArray, and GArrowRecordBatch Key: ARROW-7111 URL: https://issues.apache.org/jira/browse/ARROW-7111 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-7110) [GLib] Add filter support for GArrowTable, GArrowChunkedArray, and GArrowRecordBatch
Yosuke Shiro created ARROW-7110: --- Summary: [GLib] Add filter support for GArrowTable, GArrowChunkedArray, and GArrowRecordBatch Key: ARROW-7110 URL: https://issues.apache.org/jira/browse/ARROW-7110 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-6285) [GLib] Add support for LargeBinary and LargeString types
[ https://issues.apache.org/jira/browse/ARROW-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-6285. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 5113 [https://github.com/apache/arrow/pull/5113] > [GLib] Add support for LargeBinary and LargeString types > > > Key: ARROW-6285 > URL: https://issues.apache.org/jira/browse/ARROW-6285 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Fix For: 1.0.0 > > Time Spent: 4h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (ARROW-5808) [GLib][Ruby] Dockerize (add to docker-compose) current GLib + Ruby Travis CI entry
[ https://issues.apache.org/jira/browse/ARROW-5808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro reassigned ARROW-5808: --- Assignee: Yosuke Shiro > [GLib][Ruby] Dockerize (add to docker-compose) current GLib + Ruby Travis CI > entry > -- > > Key: ARROW-5808 > URL: https://issues.apache.org/jira/browse/ARROW-5808 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib, Ruby >Reporter: Wes McKinney >Assignee: Yosuke Shiro >Priority: Major > Fix For: 1.0.0 > > > Add to docker-compose and use in Travis CI > https://github.com/apache/arrow/blob/master/.travis.yml#L265 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-6619) [Ruby] Add support for building Gandiva::Expression by Arrow::Schema#build_expression
Yosuke Shiro created ARROW-6619: --- Summary: [Ruby] Add support for building Gandiva::Expression by Arrow::Schema#build_expression Key: ARROW-6619 URL: https://issues.apache.org/jira/browse/ARROW-6619 Project: Apache Arrow Issue Type: New Feature Components: Ruby Reporter: Yosuke Shiro Assignee: Yosuke Shiro This is the first attempt to make Red Gandiva API better. This adds Arrow::Schema#build_expression, which aims to build Gandiva::Expression with FunctionNode or IfNode easily. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (ARROW-6562) [GLib] Fix wrong sliced data of GArrowBuffer
[ https://issues.apache.org/jira/browse/ARROW-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-6562. - Fix Version/s: 0.15.0 Resolution: Fixed Issue resolved by pull request 5382 [https://github.com/apache/arrow/pull/5382] > [GLib] Fix wrong sliced data of GArrowBuffer > > > Key: ARROW-6562 > URL: https://issues.apache.org/jira/browse/ARROW-6562 > Project: Apache Arrow > Issue Type: Bug >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (ARROW-6427) [GLib] Add support for column names autogeneration CSV read option
Yosuke Shiro created ARROW-6427: --- Summary: [GLib] Add support for column names autogeneration CSV read option Key: ARROW-6427 URL: https://issues.apache.org/jira/browse/ARROW-6427 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6351) [Ruby] Improve Arrow#values performance
[ https://issues.apache.org/jira/browse/ARROW-6351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-6351. - Fix Version/s: 0.15.0 Resolution: Fixed Issue resolved by pull request 5194 [https://github.com/apache/arrow/pull/5194] > [Ruby] Improve Arrow#values performance > --- > > Key: ARROW-6351 > URL: https://issues.apache.org/jira/browse/ARROW-6351 > Project: Apache Arrow > Issue Type: Improvement > Components: Ruby >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 1h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6350) [Ruby] Remove Arrow::Struct and use Hash instead
[ https://issues.apache.org/jira/browse/ARROW-6350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-6350. - Fix Version/s: 0.15.0 Resolution: Fixed Issue resolved by pull request 5190 [https://github.com/apache/arrow/pull/5190] > [Ruby] Remove Arrow::Struct and use Hash instead > > > Key: ARROW-6350 > URL: https://issues.apache.org/jira/browse/ARROW-6350 > Project: Apache Arrow > Issue Type: Improvement > Components: Ruby >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (ARROW-6347) [GLib] Add garrow_array_diff()
Yosuke Shiro created ARROW-6347: --- Summary: [GLib] Add garrow_array_diff() Key: ARROW-6347 URL: https://issues.apache.org/jira/browse/ARROW-6347 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (ARROW-6346) [GLib] Add garrow_array_view()
Yosuke Shiro created ARROW-6346: --- Summary: [GLib] Add garrow_array_view() Key: ARROW-6346 URL: https://issues.apache.org/jira/browse/ARROW-6346 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (ARROW-6203) [GLib] Add garrow_array_sort_to_indices()
[ https://issues.apache.org/jira/browse/ARROW-6203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-6203: Summary: [GLib] Add garrow_array_sort_to_indices() (was: [GLib] Add garrow_array_argsort()) > [GLib] Add garrow_array_sort_to_indices() > - > > Key: ARROW-6203 > URL: https://issues.apache.org/jira/browse/ARROW-6203 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 2h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (ARROW-6267) [Ruby] Add Arrow::Time for Arrow::Time{32,64}DataType value
[ https://issues.apache.org/jira/browse/ARROW-6267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-6267. - Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request 5102 [https://github.com/apache/arrow/pull/5102] > [Ruby] Add Arrow::Time for Arrow::Time{32,64}DataType value > --- > > Key: ARROW-6267 > URL: https://issues.apache.org/jira/browse/ARROW-6267 > Project: Apache Arrow > Issue Type: Improvement > Components: Ruby >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (ARROW-6286) [GLib] Add support for LargeList type
Yosuke Shiro created ARROW-6286: --- Summary: [GLib] Add support for LargeList type Key: ARROW-6286 URL: https://issues.apache.org/jira/browse/ARROW-6286 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (ARROW-6285) [GLib] Add support for LargeBinary and LargeString types
Yosuke Shiro created ARROW-6285: --- Summary: [GLib] Add support for LargeBinary and LargeString types Key: ARROW-6285 URL: https://issues.apache.org/jira/browse/ARROW-6285 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-6240) [Ruby] Arrow::Decimal128Array returns BigDecimal
[ https://issues.apache.org/jira/browse/ARROW-6240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-6240. - Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request 5089 [https://github.com/apache/arrow/pull/5089] > [Ruby] Arrow::Decimal128Array returns BigDecimal > > > Key: ARROW-6240 > URL: https://issues.apache.org/jira/browse/ARROW-6240 > Project: Apache Arrow > Issue Type: Improvement > Components: Ruby >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (ARROW-5307) [CI][GLib] Enable GTK-Doc
[ https://issues.apache.org/jira/browse/ARROW-5307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5307: Summary: [CI][GLib] Enable GTK-Doc (was: [CI] [GLib] Enable GTK-Doc) > [CI][GLib] Enable GTK-Doc > - > > Key: ARROW-5307 > URL: https://issues.apache.org/jira/browse/ARROW-5307 > Project: Apache Arrow > Issue Type: Improvement > Components: Continuous Integration, GLib >Reporter: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > Enable GTK-Doc when 1.31 is released. > See https://issues.apache.org/jira/browse/ARROW-5306. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Assigned] (ARROW-5307) [CI][GLib] Enable GTK-Doc
[ https://issues.apache.org/jira/browse/ARROW-5307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro reassigned ARROW-5307: --- Assignee: Yosuke Shiro > [CI][GLib] Enable GTK-Doc > - > > Key: ARROW-5307 > URL: https://issues.apache.org/jira/browse/ARROW-5307 > Project: Apache Arrow > Issue Type: Improvement > Components: Continuous Integration, GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > Enable GTK-Doc when 1.31 is released. > See https://issues.apache.org/jira/browse/ARROW-5306. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (ARROW-5306) [CI] [GLib] Disable GTK-Doc
[ https://issues.apache.org/jira/browse/ARROW-5306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5306: Description: Travis fails to process documents by GTK-Doc. [https://travis-ci.org/apache/arrow/jobs/531197944#L4170] This caused by the recent GTK-Doc upgrade to 1.30. So disable GTK-Doc until 1.31 is released. was: Travis fails to process documents by GTK-Doc. [https://travis-ci.org/apache/arrow/jobs/531197944#L4170] This caused by the recent GTK-Doc upgrade to 0.13.0. So disable GTK-Doc until 0.13.1 is released. > [CI] [GLib] Disable GTK-Doc > --- > > Key: ARROW-5306 > URL: https://issues.apache.org/jira/browse/ARROW-5306 > Project: Apache Arrow > Issue Type: Bug > Components: Continuous Integration, GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Fix For: 0.14.0 > > Time Spent: 20m > Remaining Estimate: 0h > > Travis fails to process documents by GTK-Doc. > [https://travis-ci.org/apache/arrow/jobs/531197944#L4170] > This caused by the recent GTK-Doc upgrade to 1.30. So disable GTK-Doc until > 1.31 is released. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (ARROW-5307) [CI] [GLib] Enable GTK-Doc
[ https://issues.apache.org/jira/browse/ARROW-5307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5307: Description: Enable GTK-Doc when 1.31 is released. See https://issues.apache.org/jira/browse/ARROW-5306. was: Enable GTK-Doc when 0.13.1 is released. See https://issues.apache.org/jira/browse/ARROW-5306. > [CI] [GLib] Enable GTK-Doc > -- > > Key: ARROW-5307 > URL: https://issues.apache.org/jira/browse/ARROW-5307 > Project: Apache Arrow > Issue Type: Improvement > Components: Continuous Integration, GLib >Reporter: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > Enable GTK-Doc when 1.31 is released. > See https://issues.apache.org/jira/browse/ARROW-5306. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (ARROW-6204) [GLib] Add garrow_array_is_in_chunked_array()
[ https://issues.apache.org/jira/browse/ARROW-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907419#comment-16907419 ] Yosuke Shiro commented on ARROW-6204: - I've created a pull request. https://github.com/apache/arrow/pull/5086 And sorry. I forgot to leave the following error message in the previous comment. {code:java} E == 57: ] 58: right_chunked_array = Arrow::ChunkedArray.new(chunks) 59: assert_equal(build_boolean_array([true, true, true, false]), => 60: left_array.is_in(right_chunked_array)) 61: end 62: end 63: end /Users/shiro/dev/arrow/c_glib/test/test-is-in.rb:60:in `test_no_null' /Users/shiro/.rbenv/versions/2.6.0/lib/ruby/site_ruby/2.6.0/gobject-introspection/loader.rb:533:in `block in define_method' /Users/shiro/.rbenv/versions/2.6.0/lib/ruby/site_ruby/2.6.0/gobject-introspection/loader.rb:616:in `invoke' /Users/shiro/.rbenv/versions/2.6.0/lib/ruby/site_ruby/2.6.0/gobject-introspection/loader.rb:616:in `invoke' Error: test_no_null(TestIsIn::ChunkedArray): ArgumentError: must be object: <[ [ 1, 0 ], [ 1, 0, 3 ] ]> == .. .. .. ...WARNING: Logging before InitGoogleLogging() is written to STDERR {code} We may need to change Ruby/GObjectIntrospection. > [GLib] Add garrow_array_is_in_chunked_array() > - > > Key: ARROW-6204 > URL: https://issues.apache.org/jira/browse/ARROW-6204 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > This is follow-up of > [https://github.com/apache/arrow/pull/5047#issuecomment-520103706]. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (ARROW-6204) [GLib] Add garrow_array_is_in_chunked_array()
[ https://issues.apache.org/jira/browse/ARROW-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906774#comment-16906774 ] Yosuke Shiro commented on ARROW-6204: - Yes. I'll create a pull request. Thanks! > [GLib] Add garrow_array_is_in_chunked_array() > - > > Key: ARROW-6204 > URL: https://issues.apache.org/jira/browse/ARROW-6204 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > > This is follow-up of > [https://github.com/apache/arrow/pull/5047#issuecomment-520103706]. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (ARROW-6204) [GLib] Add garrow_array_is_in_chunked_array()
[ https://issues.apache.org/jira/browse/ARROW-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905702#comment-16905702 ] Yosuke Shiro commented on ARROW-6204: - Perhaps, should we add "garrow_chunked_array_is_in" rather than "garrow_array_is_in_chunked_array"? It seems that both a left hand side array and a right hand side array need to be "ChunkedArray". So, I think it is good to add the following function in compute.cpp. {code:java} GArrowChunkedArray * garrow_chunked_array_is_in(GArrowChunkedArray *left, GArrowChunkedArray *right, GError **error){code} [~kou] What do you think about this? > [GLib] Add garrow_array_is_in_chunked_array() > - > > Key: ARROW-6204 > URL: https://issues.apache.org/jira/browse/ARROW-6204 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > > This is follow-up of > [https://github.com/apache/arrow/pull/5047#issuecomment-520103706]. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (ARROW-6204) [GLib] Add garrow_array_is_in_chunked_array()
Yosuke Shiro created ARROW-6204: --- Summary: [GLib] Add garrow_array_is_in_chunked_array() Key: ARROW-6204 URL: https://issues.apache.org/jira/browse/ARROW-6204 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro This is follow-up of [https://github.com/apache/arrow/pull/5047#issuecomment-520103706]. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (ARROW-6203) [GLib] Add garrow_array_argsort()
Yosuke Shiro created ARROW-6203: --- Summary: [GLib] Add garrow_array_argsort() Key: ARROW-6203 URL: https://issues.apache.org/jira/browse/ARROW-6203 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro Fix For: 0.15.0 -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-6197) [GLib] Add garrow_decimal128_rescale()
[ https://issues.apache.org/jira/browse/ARROW-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-6197. - Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request 5057 [https://github.com/apache/arrow/pull/5057] > [GLib] Add garrow_decimal128_rescale() > -- > > Key: ARROW-6197 > URL: https://issues.apache.org/jira/browse/ARROW-6197 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-6196) [Ruby] Add support for building Arrow::TimeNNArray by .new
[ https://issues.apache.org/jira/browse/ARROW-6196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-6196. - Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request 5056 [https://github.com/apache/arrow/pull/5056] > [Ruby] Add support for building Arrow::TimeNNArray by .new > -- > > Key: ARROW-6196 > URL: https://issues.apache.org/jira/browse/ARROW-6196 > Project: Apache Arrow > Issue Type: New Feature > Components: Ruby >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Fix For: 0.15.0 > > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-6193) [GLib] Add missing require in test
[ https://issues.apache.org/jira/browse/ARROW-6193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-6193. - Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request 5052 [https://github.com/apache/arrow/pull/5052] > [GLib] Add missing require in test > -- > > Key: ARROW-6193 > URL: https://issues.apache.org/jira/browse/ARROW-6193 > Project: Apache Arrow > Issue Type: Test > Components: GLib >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-6192) [GLib] Use the same SO version as C++
[ https://issues.apache.org/jira/browse/ARROW-6192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-6192. - Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request 5051 [https://github.com/apache/arrow/pull/5051] > [GLib] Use the same SO version as C++ > - > > Key: ARROW-6192 > URL: https://issues.apache.org/jira/browse/ARROW-6192 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (ARROW-6188) [GLib] Add garrow_array_isin()
Yosuke Shiro created ARROW-6188: --- Summary: [GLib] Add garrow_array_isin() Key: ARROW-6188 URL: https://issues.apache.org/jira/browse/ARROW-6188 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro Fix For: 0.15.0 -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-5772) [GLib][Plasma][CUDA] Plasma::Client#refer_object test is failed
[ https://issues.apache.org/jira/browse/ARROW-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-5772. - Resolution: Fixed Fix Version/s: (was: 1.0.0) 0.15.0 Issue resolved by pull request 5004 [https://github.com/apache/arrow/pull/5004] > [GLib][Plasma][CUDA] Plasma::Client#refer_object test is failed > --- > > Key: ARROW-5772 > URL: https://issues.apache.org/jira/browse/ARROW-5772 > Project: Apache Arrow > Issue Type: Bug > Components: GLib >Affects Versions: 0.14.0 >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.15.0 > > Time Spent: 1h > Remaining Estimate: 0h > > {noformat} > /home/kou/work/cpp/arrow.kou/c_glib/test/plasma/test-plasma-client.rb:75:in > `block (2 levels) in ' > /tmp/local/lib/ruby/gems/2.7.0/gems/gobject-introspection-3.3.6/lib/gobject-introspection/loader.rb:533:in > `block in define_method' > /tmp/local/lib/ruby/gems/2.7.0/gems/gobject-introspection-3.3.6/lib/gobject-introspection/loader.rb:616:in > `invoke' > /tmp/local/lib/ruby/gems/2.7.0/gems/gobject-introspection-3.3.6/lib/gobject-introspection/loader.rb:616:in > `invoke' > Error: test: options: GPU device(TestPlasmaClient::#create): > Arrow::Error::Io: [plasma][client][refer-object]: IOError: Cuda Driver API > call in ../src/arrow/gpu/cuda_context.cc at line 156 failed with code 208: > cuIpcOpenMemHandle(, *handle, CU_IPC_MEM_LAZY_ENABLE_PEER_ACCESS) > In ../src/arrow/gpu/cuda_context.cc, line 341, code: > impl_->OpenIpcBuffer(ipc_handle, ) > In ../src/plasma/client.cc, line 586, code: > context->OpenIpcBuffer(*object->ipc_handle, _handle->ptr) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (ARROW-6039) [GLib] Add garrow_array_filter()
[ https://issues.apache.org/jira/browse/ARROW-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-6039: Fix Version/s: (was: 1.0.0) 0.15.0 > [GLib] Add garrow_array_filter() > > > Key: ARROW-6039 > URL: https://issues.apache.org/jira/browse/ARROW-6039 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Fix For: 0.15.0 > > > Add bindings of a boolean selection filter. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (ARROW-6039) [GLib] Add garrow_array_filter()
Yosuke Shiro created ARROW-6039: --- Summary: [GLib] Add garrow_array_filter() Key: ARROW-6039 URL: https://issues.apache.org/jira/browse/ARROW-6039 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro Fix For: 1.0.0 Add bindings of a boolean selection filter. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (ARROW-6036) [GLib] Add support for skip rows and column_names CSV read option
[ https://issues.apache.org/jira/browse/ARROW-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-6036: Issue Type: Improvement (was: New Feature) > [GLib] Add support for skip rows and column_names CSV read option > - > > Key: ARROW-6036 > URL: https://issues.apache.org/jira/browse/ARROW-6036 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Fix For: 1.0.0 > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (ARROW-6037) [GLib] Add a missing version macro
Yosuke Shiro created ARROW-6037: --- Summary: [GLib] Add a missing version macro Key: ARROW-6037 URL: https://issues.apache.org/jira/browse/ARROW-6037 Project: Apache Arrow Issue Type: Improvement Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro Fix For: 1.0.0 -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (ARROW-6036) [GLib] Add support for skip rows and column_names CSV read option
[ https://issues.apache.org/jira/browse/ARROW-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-6036: Issue Type: New Feature (was: Improvement) > [GLib] Add support for skip rows and column_names CSV read option > - > > Key: ARROW-6036 > URL: https://issues.apache.org/jira/browse/ARROW-6036 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Fix For: 1.0.0 > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (ARROW-6036) [GLib] Add support for skip rows and column_names CSV read option
Yosuke Shiro created ARROW-6036: --- Summary: [GLib] Add support for skip rows and column_names CSV read option Key: ARROW-6036 URL: https://issues.apache.org/jira/browse/ARROW-6036 Project: Apache Arrow Issue Type: Improvement Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro Fix For: 1.0.0 -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-5943) [GLib][Gandiva] Add support for function aliases
[ https://issues.apache.org/jira/browse/ARROW-5943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-5943. - Resolution: Fixed Issue resolved by pull request 4874 [https://github.com/apache/arrow/pull/4874] > [GLib][Gandiva] Add support for function aliases > > > Key: ARROW-5943 > URL: https://issues.apache.org/jira/browse/ARROW-5943 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 1.0.0 > > Time Spent: 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ARROW-5939) [Release] Add support for generating vote email template separately
[ https://issues.apache.org/jira/browse/ARROW-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-5939. - Resolution: Fixed Fix Version/s: (was: 1.0.0) Issue resolved by pull request 4870 [https://github.com/apache/arrow/pull/4870] > [Release] Add support for generating vote email template separately > --- > > Key: ARROW-5939 > URL: https://issues.apache.org/jira/browse/ARROW-5939 > Project: Apache Arrow > Issue Type: Improvement > Components: Packaging >Reporter: Sutou Kouhei >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.14.1 > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (ARROW-5866) [C++] Remove duplicate library in cpp/Brewfile
[ https://issues.apache.org/jira/browse/ARROW-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5866: Priority: Minor (was: Major) > [C++] Remove duplicate library in cpp/Brewfile > -- > > Key: ARROW-5866 > URL: https://issues.apache.org/jira/browse/ARROW-5866 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Minor > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ARROW-5866) [C++] Remove duplicate library in cpp/Brewfile
Yosuke Shiro created ARROW-5866: --- Summary: [C++] Remove duplicate library in cpp/Brewfile Key: ARROW-5866 URL: https://issues.apache.org/jira/browse/ARROW-5866 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Yosuke Shiro Assignee: Yosuke Shiro -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5784) [Release][GLib] Replace c_glib/ after running c_glib/autogen.sh in dev/release/02-source.sh
[ https://issues.apache.org/jira/browse/ARROW-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5784: Description: c_glib/ source archive is generated by `make dist` because includes configure script. The current `dev/release/02-source.sh` build Arrow C++ and Arrow GLib to include the artifacts of GTK-Doc and then run `make dist`. But it is slow. So run only `c_glib/autogen.sh` and then replace c_glib/. was: c_glib/ source archive is generated by `make dist` because includes configure script. The current `dev/release/02-source.sh` build Arrow C++ and Arrow GLib to include the artifacts of GTK-Doc and run `make dist` but it is slow. So this PR run only c_glib/autogen.sh and replace c_glib/. > [Release][GLib] Replace c_glib/ after running c_glib/autogen.sh in > dev/release/02-source.sh > --- > > Key: ARROW-5784 > URL: https://issues.apache.org/jira/browse/ARROW-5784 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > > c_glib/ source archive is generated by `make dist` because includes configure > script. > The current `dev/release/02-source.sh` build Arrow C++ and Arrow GLib to > include the artifacts of GTK-Doc and then run `make dist`. But it is slow. > So run only `c_glib/autogen.sh` and then replace c_glib/. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5784) [Release][GLib] Replace c_glib/ after running c_glib/autogen.sh in dev/release/02-source.sh
[ https://issues.apache.org/jira/browse/ARROW-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5784: Summary: [Release][GLib] Replace c_glib/ after running c_glib/autogen.sh in dev/release/02-source.sh (was: [Release][GLib] Replace c_glib/ by c_glib/ after running autogen.sh in dev/release/02-source.sh) > [Release][GLib] Replace c_glib/ after running c_glib/autogen.sh in > dev/release/02-source.sh > --- > > Key: ARROW-5784 > URL: https://issues.apache.org/jira/browse/ARROW-5784 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > > c_glib/ source archive is generated by `make dist` because includes configure > script. > The current `dev/release/02-source.sh` build Arrow C++ and Arrow GLib to > include the artifacts of GTK-Doc and run `make dist` but it is slow. > So this PR run only c_glib/autogen.sh and replace c_glib/. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5784) [Release][GLib] Replace c_glib/ by c_glib/ after running autogen.sh in dev/release/02-source.sh
[ https://issues.apache.org/jira/browse/ARROW-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5784: Description: c_glib/ source archive is generated by `make dist` because includes configure script. The current `dev/release/02-source.sh` build Arrow C++ and Arrow GLib to include the artifacts of GTK-Doc and run `make dist` but it is slow. So this PR run only c_glib/autogen.sh and replace c_glib/. was: c_glib is generated the archive by `make dist` to use `configure` in dev/release/02-source.sh. The current dev/release/02-source.sh build C++ and GLib to include the artifacts of GTK-Doc and run `make dist` but it is slow. So just run ./autogen.sh and replace c_glib/. > [Release][GLib] Replace c_glib/ by c_glib/ after running autogen.sh in > dev/release/02-source.sh > --- > > Key: ARROW-5784 > URL: https://issues.apache.org/jira/browse/ARROW-5784 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > > c_glib/ source archive is generated by `make dist` because includes configure > script. > The current `dev/release/02-source.sh` build Arrow C++ and Arrow GLib to > include the artifacts of GTK-Doc and run `make dist` but it is slow. > So this PR run only c_glib/autogen.sh and replace c_glib/. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5784) [Release][GLib] Replace c_glib/ by c_glib/ after running autogen.sh in dev/release/02-source.sh
[ https://issues.apache.org/jira/browse/ARROW-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5784: Description: c_glib is generated the archive by `make dist` to use `configure` in dev/release/02-source.sh. The current dev/release/02-source.sh build C++ and GLib to include the artifacts of GTK-Doc and run `make dist` but it is slow. So just run ./autogen.sh and replace c_glib/. was: c_glib is generated the archive by `make dist` to use `configure`. Currently we build C++ and GLib to include the artifacts of GTK-Doc and run `make dist` but it is slow. So run only ./autogen.sh and replace c_glib/. > [Release][GLib] Replace c_glib/ by c_glib/ after running autogen.sh in > dev/release/02-source.sh > --- > > Key: ARROW-5784 > URL: https://issues.apache.org/jira/browse/ARROW-5784 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > > c_glib is generated the archive by `make dist` to use `configure` in > dev/release/02-source.sh. > The current dev/release/02-source.sh build C++ and GLib to include the > artifacts of GTK-Doc and run `make dist` but it is slow. So just run > ./autogen.sh and replace c_glib/. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5784) [Release][GLib] Replace c_glib/ by c_glib/ after running autogen.sh in dev/release/02-source.sh
[ https://issues.apache.org/jira/browse/ARROW-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5784: Summary: [Release][GLib] Replace c_glib/ by c_glib/ after running autogen.sh in dev/release/02-source.sh (was: [Release][GLib] Run only c_glib/autogen.sh and replace c_glib/ in dev/release/02-source.sh) > [Release][GLib] Replace c_glib/ by c_glib/ after running autogen.sh in > dev/release/02-source.sh > --- > > Key: ARROW-5784 > URL: https://issues.apache.org/jira/browse/ARROW-5784 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > > c_glib is generated the archive by `make dist` to use `configure`. > Currently we build C++ and GLib to include the artifacts of GTK-Doc and run > `make dist` but it is slow. So run only ./autogen.sh and replace c_glib/. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ARROW-5784) [Release][GLib] Run only c_glib/autogen.sh and replace c_glib/ in dev/release/02-source.sh
Yosuke Shiro created ARROW-5784: --- Summary: [Release][GLib] Run only c_glib/autogen.sh and replace c_glib/ in dev/release/02-source.sh Key: ARROW-5784 URL: https://issues.apache.org/jira/browse/ARROW-5784 Project: Apache Arrow Issue Type: Improvement Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro c_glib is generated the archive by `make dist` to use `configure`. Currently we build C++ and GLib to include the artifacts of GTK-Doc and run `make dist` but it is slow. So run only ./autogen.sh and replace c_glib/. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (ARROW-5695) [C#][Release] Run sourcelink test in verify-release-candidate.sh
[ https://issues.apache.org/jira/browse/ARROW-5695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873631#comment-16873631 ] Yosuke Shiro commented on ARROW-5695: - Thank you so much for your lucid instructions. I’ll work on it. > [C#][Release] Run sourcelink test in verify-release-candidate.sh > > > Key: ARROW-5695 > URL: https://issues.apache.org/jira/browse/ARROW-5695 > Project: Apache Arrow > Issue Type: Improvement > Components: C# >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Blocker > Fix For: 0.14.0 > > > Follow up of > https://github.com/apache/arrow/pull/4488#pullrequestreview-253110667. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (ARROW-5695) [C#][Release] Run sourcelink test in verify-release-candidate.sh
[ https://issues.apache.org/jira/browse/ARROW-5695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872593#comment-16872593 ] Yosuke Shiro commented on ARROW-5695: - [~kou] I'll add `test_package_csharp()` in verify-release-candidate.sh. Is my understanding correct? {code:java} test_package_csharp() { pushd csharp dotnet test mv dummy.git ../.git dotnet pack -c Release mv ../.git dummy.git ~/.dotnet/tools/sourcelink test artifacts/Apache.Arrow/Release/netstandard1.3/Apache.Arrow.pdb ~/.dotnet/tools/sourcelink test artifacts/Apache.Arrow/Release/netcoreapp2.1/Apache.Arrow.pdb popd } {code} > [C#][Release] Run sourcelink test in verify-release-candidate.sh > > > Key: ARROW-5695 > URL: https://issues.apache.org/jira/browse/ARROW-5695 > Project: Apache Arrow > Issue Type: Improvement > Components: C# >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Blocker > Fix For: 0.14.0 > > > Follow up of > https://github.com/apache/arrow/pull/4488#pullrequestreview-253110667. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (ARROW-5092) [C#] Source Link doesn't work with the C# release script
[ https://issues.apache.org/jira/browse/ARROW-5092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-5092. - Resolution: Fixed Fix Version/s: 0.14.0 Issue resolved by pull request 4488 [https://github.com/apache/arrow/pull/4488] > [C#] Source Link doesn't work with the C# release script > > > Key: ARROW-5092 > URL: https://issues.apache.org/jira/browse/ARROW-5092 > Project: Apache Arrow > Issue Type: Bug > Components: C# >Affects Versions: 0.13.0 >Reporter: Eric Erhardt >Assignee: Yosuke Shiro >Priority: Major > Labels: pull-request-available > Fix For: 0.14.0 > > Time Spent: 7h > Remaining Estimate: 0h > > With the 0.13.0 C# NuGet package, [Source > Link|https://docs.microsoft.com/en-us/dotnet/standard/library-guidance/sourcelink] > doesn't work. The symbols can be downloaded from nuget.org correctly, but > when Visual Studio tries to download the code, it cannot find the correct > files. > The following is why it doesn't work: > The .NET tooling expects the build of an official release to happen in the > context of a {{git}} repository. This does 2 things to the produced assets: > # In the {{.nupkg}} file that is generated, the .NET tooling will encode the > current git commit's SHA hash into both the {{Apache.Arrow.nuspec}} file, and > into the compiled {{Apache.Arrow.dll}} assembly. Looking at the released > version that was published over the weekend: > [https://www.nuget.org/packages/Apache.Arrow/0.13.0], this information made > it into the {{.nuspec}} and the {{.dll}}: > {code} > [assembly: > AssemblyInformationalVersion("0.13.0+57de5c3adffe526f37366bb15c3ff0d4a2e84655")] > https://github.com/apache/arrow; > commit="57de5c3adffe526f37366bb15c3ff0d4a2e84655" /> > {code} > However, I don't see how the [C# release > script|https://github.com/apache/arrow/blob/master/dev/release/post-06-csharp.sh] > could have done that. > # Also, .NET has a feature called "Source Link", which allows for the source > code to be automatically downloaded from GitHub when debugging into this > library. The way the tooling works today, it requires that the git > repository's {{origin}} remote is set to > [https://github.com/apache/arrow.git]. The tooling reads uses the `origin` > git remote to encode the GitHub URL into the symbols file in the {{.snupkg}} > file. > This, however, doesn't work with the 0.13.0 release that occurred over the > weekend. I tried using the Source Link feature, and it didn't automatically > download the source files from GitHub. > Looking into the symbols file, I see the Source Link information that was > embedded: > {code} > 1: > '/home/kou/work/cpp/arrow.kou/apache-arrow-0.13.0/csharp/src/Apache.Arrow/Flatbuf/FlatBuffers/ByteBuffer.cs' > (#19c)C# (#3) SHA-1 (#2) > 04-64-A0-48-82-EA-F5-B5-50-EC-CA-9F-85-75-E2-95-A4-EC-AB-B3 (#1b7) > 2: > '/home/kou/work/cpp/arrow.kou/apache-arrow-0.13.0/csharp/src/Apache.Arrow/Flatbuf/FlatBuffers/ByteBufferUtil.cs' > (#68f)C# (#3) SHA-1 (#2) > F0-4F-28-53-88-A4-E0-6E-F1-1F-17-F6-CD-FE-0E-64-AB-0B-C2-95 (#6aa) > {code} > {code:json} > { > "documents": { > "/home/kou/work/cpp/arrow.kou/*": > "https://raw.githubusercontent.com/kou/arrow/57de5c3adffe526f37366bb15c3ff0d4a2e84655/*;, > "/home/kou/work/cpp/arrow.kou/cpp/submodules/parquet-testing/*": > "https://raw.githubusercontent.com/apache/parquet-testing/bb7b6abbb3fbeff845646364a4286142127be04c/*; > } > } > {code} > Here it appears the {{origin}} remote was set to {{kou/arrow}}, and not > {{apache/arrow}}. Also, it appears the {{apache-arrow-0.13.0}} folder was > under a git repository, and so the sources aren't matched up with the git > repository. (Basically that folder shouldn't have appeared in the Documents > list that has the {{.cs}} file path.) I think this explains how (1) above > happened - the build was under a git repository - but this script downloaded > an extra copy of the sources into that git repository. > I'm wondering how we can fix either this script, or the .NET Tooling, or > both, to make this experience better for the next release. I think we need to > ensure two things: > # The git commit information is set correctly in the {{.nuspec}} and the > {{.dll}} when the release build is run. I think it just happened by pure luck > this time. It just so happened that the script was executed in an already > established repo, and it just so happened to be on the right commit (or maybe > it wasn't the right commit?). > # The source link information is set correctly in the symbols file. > [~wesmckinn] [~kou] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5695) [C#][Release] Run sourcelink test in verify-release-candidate.sh
[ https://issues.apache.org/jira/browse/ARROW-5695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5695: Summary: [C#][Release] Run sourcelink test in verify-release-candidate.sh (was: [Release] Run sourcelink test in verify-release-candidate.sh) > [C#][Release] Run sourcelink test in verify-release-candidate.sh > > > Key: ARROW-5695 > URL: https://issues.apache.org/jira/browse/ARROW-5695 > Project: Apache Arrow > Issue Type: Improvement > Components: C# >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Fix For: 0.14.0 > > > Follow up of > https://github.com/apache/arrow/pull/4488#pullrequestreview-253110667. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ARROW-5695) [Release] Run sourcelink test in verify-release-candidate.sh
Yosuke Shiro created ARROW-5695: --- Summary: [Release] Run sourcelink test in verify-release-candidate.sh Key: ARROW-5695 URL: https://issues.apache.org/jira/browse/ARROW-5695 Project: Apache Arrow Issue Type: Improvement Components: C# Reporter: Yosuke Shiro Assignee: Yosuke Shiro Fix For: 0.14.0 Follow up of https://github.com/apache/arrow/pull/4488#pullrequestreview-253110667. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (ARROW-5622) [C++][Dataset] arrow-dataset.pc isn't provided
[ https://issues.apache.org/jira/browse/ARROW-5622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro reassigned ARROW-5622: --- Assignee: Yosuke Shiro > [C++][Dataset] arrow-dataset.pc isn't provided > -- > > Key: ARROW-5622 > URL: https://issues.apache.org/jira/browse/ARROW-5622 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Sutou Kouhei >Assignee: Yosuke Shiro >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ARROW-5641) [GLib] Remove enums files generated by GNU Autotools from Git targets
Yosuke Shiro created ARROW-5641: --- Summary: [GLib] Remove enums files generated by GNU Autotools from Git targets Key: ARROW-5641 URL: https://issues.apache.org/jira/browse/ARROW-5641 Project: Apache Arrow Issue Type: Improvement Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro Fix For: 0.14.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (ARROW-5447) [CI] [Ruby] CI is failed on AppVeyor
[ https://issues.apache.org/jira/browse/ARROW-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-5447. - Resolution: Fixed Fix Version/s: 0.14.0 Issue resolved by pull request 4584 [https://github.com/apache/arrow/pull/4584] > [CI] [Ruby] CI is failed on AppVeyor > > > Key: ARROW-5447 > URL: https://issues.apache.org/jira/browse/ARROW-5447 > Project: Apache Arrow > Issue Type: Improvement > Components: Continuous Integration, Ruby >Reporter: Yosuke Shiro >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.14.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > > This happens sometimes. > {code:java} > Error: test: csv.gz(TableTest::#save and .load::path:::format::load: auto > detect): Arrow::Error::Io: [csv-reader][read]: IOError: zlib inflate failed: > invalid distance too far back > c:/Ruby26-x64/lib/ruby/gems/2.6.0/gems/gobject-introspection-3.3.6/lib/gobject-introspection/loader.rb:616:in > `invoke' > c:/Ruby26-x64/lib/ruby/gems/2.6.0/gems/gobject-introspection-3.3.6/lib/gobject-introspection/loader.rb:616:in > `invoke' > c:/Ruby26-x64/lib/ruby/gems/2.6.0/gems/gobject-introspection-3.3.6/lib/gobject-introspection/loader.rb:533:in > `block in define_method' > C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:158:in `block (2 > levels) in load_from_path' > C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:147:in `block (2 > levels) in wrap_input' > C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:140:in > `open_encoding_convert_stream' > C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:146:in `block in > wrap_input' > C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:125:in `block in > open_decompress_input' > C:/projects/arrow/ruby/red-arrow/lib/arrow/block-closable.rb:25:in `open' > C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:124:in > `open_decompress_input' > C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:145:in `wrap_input' > C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:157:in `block in > load_from_path' > C:/projects/arrow/ruby/red-arrow/lib/arrow/block-closable.rb:25:in `open' > C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:156:in > `load_from_path' > C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:39:in `load' > C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:26:in `load' > C:/projects/arrow/ruby/red-arrow/lib/arrow/table-loader.rb:158:in > `load_as_csv' > C:/projects/arrow/ruby/red-arrow/lib/arrow/table-loader.rb:50:in `load' > C:/projects/arrow/ruby/red-arrow/lib/arrow/table-loader.rb:22:in `load' > C:/projects/arrow/ruby/red-arrow/lib/arrow/table.rb:27:in `load' > C:/projects/arrow/ruby/red-arrow/test/test-table.rb:503:in `block (5 levels) > in ' > === > {code} > > https://ci.appveyor.com/project/ApacheSoftwareFoundation/arrow/builds/24813909/job/kkc98r3e4ltxeor3#L2328 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (ARROW-5553) [Ruby] red-arrow gem does not compile on ruby:2.5 docker image
[ https://issues.apache.org/jira/browse/ARROW-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-5553. - Resolution: Fixed Fix Version/s: 0.14.0 Issue resolved by pull request 4526 [https://github.com/apache/arrow/pull/4526] > [Ruby] red-arrow gem does not compile on ruby:2.5 docker image > -- > > Key: ARROW-5553 > URL: https://issues.apache.org/jira/browse/ARROW-5553 > Project: Apache Arrow > Issue Type: Bug > Components: Ruby >Affects Versions: 0.13.0 >Reporter: Sean Dilda >Assignee: Sutou Kouhei >Priority: Major > Labels: pull-request-available > Fix For: 0.14.0 > > Time Spent: 10m > Remaining Estimate: 0h > > I'm attempting to install the red-arrow gem in a docker container based on > the ruby:2.5 image on docker hub. I followed the debian instructions on > [https://github.com/red-data-tools/packages.red-data-tools.org] to install > libarrow-dev. > > I then ran 'gem install red-arrow' > The output is as follows: > Building native extensions. This could take a while... > ERROR: Error installing red-arrow: > ERROR: Failed to build gem native extension. > current directory: /usr/local/bundle/gems/red-arrow-0.13.0/ext/arrow > /usr/local/bin/ruby -I /usr/local/lib/ruby/site_ruby/2.5.0 -r > ./siteconf20190611-1782-1gg8bpn.rb extconf.rb > checking --enable-debug-build option... no > checking C++ compiler... g++ > checking g++ version... 6.3 (gnu++14) > checking for --enable-debug-build option... no > checking for -Wall option to compiler... yes > checking for -Waggregate-return option to compiler... yes > checking for -Wcast-align option to compiler... yes > checking for -Wextra option to compiler... yes > checking for -Wformat=2 option to compiler... yes > checking for -Winit-self option to compiler... yes > checking for -Wlarger-than-65500 option to compiler... yes > checking for -Wmissing-declarations option to compiler... yes > checking for -Wmissing-format-attribute option to compiler... yes > checking for -Wmissing-include-dirs option to compiler... yes > checking for -Wmissing-noreturn option to compiler... yes > checking for -Wmissing-prototypes option to compiler... yes > checking for -Wnested-externs option to compiler... yes > checking for -Wold-style-definition option to compiler... yes > checking for -Wpacked option to compiler... yes > checking for -Wp,-D_FORTIFY_SOURCE=2 option to compiler... yes > checking for -Wpointer-arith option to compiler... yes > checking for -Wswitch-default option to compiler... yes > checking for -Wswitch-enum option to compiler... yes > checking for -Wundef option to compiler... yes > checking for -Wout-of-line-declaration option to compiler... no > checking for -Wunsafe-loop-optimizations option to compiler... yes > checking for -Wwrite-strings option to compiler... yes > checking for Homebrew... no > checking for arrow... yes > checking for arrow-glib... yes > creating Makefile > current directory: /usr/local/bundle/gems/red-arrow-0.13.0/ext/arrow > make "DESTDIR=" clean > current directory: /usr/local/bundle/gems/red-arrow-0.13.0/ext/arrow > make "DESTDIR=" > compiling arrow.cpp > compiling record-batch.cpp > record-batch.cpp: In member function 'VALUE > red_arrow::{anonymous}::StructArrayValueConverter::convert(const > arrow::StructArray&, int64_t)': > record-batch.cpp:344:40: error: 'const class arrow::StructArray' has no > member named 'struct_type' > const auto struct_type = array.struct_type(); > ^~~ > In file included from /usr/local/include/ruby-2.5.0/ruby/ruby.h:29:0, > from /usr/local/include/ruby-2.5.0/ruby.h:33, > from > /usr/local/bundle/gems/glib2-3.3.6/ext/glib2/rbgobject.h:26, > from red-arrow.hpp:33, > from record-batch.cpp:20: > /usr/local/include/ruby-2.5.0/ruby/defines.h:105:57: error: void value not > ignored as it ought to be > #define RB_GNUC_EXTENSION_BLOCK(x) __extension__ ({ x; }) > ^ > /usr/local/include/ruby-2.5.0/ruby/intern.h:788:35: note: in expansion of > macro 'RB_GNUC_EXTENSION_BLOCK' > #define rb_utf8_str_new(str, len) RB_GNUC_EXTENSION_BLOCK( \ >^~~ > record-batch.cpp:350:18: note: in expansion of macro 'rb_utf8_str_new' >key_ = rb_utf8_str_new(field_name.data(), field_name.length()); > ^~~ > record-batch.cpp: In member function 'uint8_t > red_arrow::{anonymous}::UnionArrayValueConverter::compute_child_index(const > arrow::UnionArray&, arrow::UnionType*, const char*)': > record-batch.cpp:516:66: error: no matching function for
[jira] [Assigned] (ARROW-5547) [C++][FlightRPC] arrow-flight.pc isn't provided
[ https://issues.apache.org/jira/browse/ARROW-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro reassigned ARROW-5547: --- Assignee: Yosuke Shiro > [C++][FlightRPC] arrow-flight.pc isn't provided > --- > > Key: ARROW-5547 > URL: https://issues.apache.org/jira/browse/ARROW-5547 > Project: Apache Arrow > Issue Type: Improvement > Components: C++, FlightRPC >Reporter: Sutou Kouhei >Assignee: Yosuke Shiro >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ARROW-5535) [GLib] Add garrow_table_slice()
Yosuke Shiro created ARROW-5535: --- Summary: [GLib] Add garrow_table_slice() Key: ARROW-5535 URL: https://issues.apache.org/jira/browse/ARROW-5535 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro Fix For: 0.14.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5534) [GLib] Add garrow_table_concatenate()
[ https://issues.apache.org/jira/browse/ARROW-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5534: Issue Type: New Feature (was: Improvement) > [GLib] Add garrow_table_concatenate() > - > > Key: ARROW-5534 > URL: https://issues.apache.org/jira/browse/ARROW-5534 > Project: Apache Arrow > Issue Type: New Feature > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Fix For: 0.14.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ARROW-5534) [GLib] Add garrow_table_concatenate()
Yosuke Shiro created ARROW-5534: --- Summary: [GLib] Add garrow_table_concatenate() Key: ARROW-5534 URL: https://issues.apache.org/jira/browse/ARROW-5534 Project: Apache Arrow Issue Type: Improvement Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro Fix For: 0.14.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (ARROW-5092) [C#] Source Link doesn't work with the C# release script
[ https://issues.apache.org/jira/browse/ARROW-5092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro reassigned ARROW-5092: --- Assignee: Yosuke Shiro > [C#] Source Link doesn't work with the C# release script > > > Key: ARROW-5092 > URL: https://issues.apache.org/jira/browse/ARROW-5092 > Project: Apache Arrow > Issue Type: Bug > Components: C# >Affects Versions: 0.13.0 >Reporter: Eric Erhardt >Assignee: Yosuke Shiro >Priority: Major > > With the 0.13.0 C# NuGet package, [Source > Link|https://docs.microsoft.com/en-us/dotnet/standard/library-guidance/sourcelink] > doesn't work. The symbols can be downloaded from nuget.org correctly, but > when Visual Studio tries to download the code, it cannot find the correct > files. > The following is why it doesn't work: > The .NET tooling expects the build of an official release to happen in the > context of a {{git}} repository. This does 2 things to the produced assets: > # In the {{.nupkg}} file that is generated, the .NET tooling will encode the > current git commit's SHA hash into both the {{Apache.Arrow.nuspec}} file, and > into the compiled {{Apache.Arrow.dll}} assembly. Looking at the released > version that was published over the weekend: > [https://www.nuget.org/packages/Apache.Arrow/0.13.0], this information made > it into the {{.nuspec}} and the {{.dll}}: > {code} > [assembly: > AssemblyInformationalVersion("0.13.0+57de5c3adffe526f37366bb15c3ff0d4a2e84655")] > https://github.com/apache/arrow; > commit="57de5c3adffe526f37366bb15c3ff0d4a2e84655" /> > {code} > However, I don't see how the [C# release > script|https://github.com/apache/arrow/blob/master/dev/release/post-06-csharp.sh] > could have done that. > # Also, .NET has a feature called "Source Link", which allows for the source > code to be automatically downloaded from GitHub when debugging into this > library. The way the tooling works today, it requires that the git > repository's {{origin}} remote is set to > [https://github.com/apache/arrow.git]. The tooling reads uses the `origin` > git remote to encode the GitHub URL into the symbols file in the {{.snupkg}} > file. > This, however, doesn't work with the 0.13.0 release that occurred over the > weekend. I tried using the Source Link feature, and it didn't automatically > download the source files from GitHub. > Looking into the symbols file, I see the Source Link information that was > embedded: > {code} > 1: > '/home/kou/work/cpp/arrow.kou/apache-arrow-0.13.0/csharp/src/Apache.Arrow/Flatbuf/FlatBuffers/ByteBuffer.cs' > (#19c)C# (#3) SHA-1 (#2) > 04-64-A0-48-82-EA-F5-B5-50-EC-CA-9F-85-75-E2-95-A4-EC-AB-B3 (#1b7) > 2: > '/home/kou/work/cpp/arrow.kou/apache-arrow-0.13.0/csharp/src/Apache.Arrow/Flatbuf/FlatBuffers/ByteBufferUtil.cs' > (#68f)C# (#3) SHA-1 (#2) > F0-4F-28-53-88-A4-E0-6E-F1-1F-17-F6-CD-FE-0E-64-AB-0B-C2-95 (#6aa) > {code} > {code:json} > { > "documents": { > "/home/kou/work/cpp/arrow.kou/*": > "https://raw.githubusercontent.com/kou/arrow/57de5c3adffe526f37366bb15c3ff0d4a2e84655/*;, > "/home/kou/work/cpp/arrow.kou/cpp/submodules/parquet-testing/*": > "https://raw.githubusercontent.com/apache/parquet-testing/bb7b6abbb3fbeff845646364a4286142127be04c/*; > } > } > {code} > Here it appears the {{origin}} remote was set to {{kou/arrow}}, and not > {{apache/arrow}}. Also, it appears the {{apache-arrow-0.13.0}} folder was > under a git repository, and so the sources aren't matched up with the git > repository. (Basically that folder shouldn't have appeared in the Documents > list that has the {{.cs}} file path.) I think this explains how (1) above > happened - the build was under a git repository - but this script downloaded > an extra copy of the sources into that git repository. > I'm wondering how we can fix either this script, or the .NET Tooling, or > both, to make this experience better for the next release. I think we need to > ensure two things: > # The git commit information is set correctly in the {{.nuspec}} and the > {{.dll}} when the release build is run. I think it just happened by pure luck > this time. It just so happened that the script was executed in an already > established repo, and it just so happened to be on the right commit (or maybe > it wasn't the right commit?). > # The source link information is set correctly in the symbols file. > [~wesmckinn] [~kou] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (ARROW-5481) [GLib] garrow_seekable_input_stream_peek() misses "error" parameter document
[ https://issues.apache.org/jira/browse/ARROW-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854818#comment-16854818 ] Yosuke Shiro commented on ARROW-5481: - Yes. > [GLib] garrow_seekable_input_stream_peek() misses "error" parameter document > > > Key: ARROW-5481 > URL: https://issues.apache.org/jira/browse/ARROW-5481 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Sutou Kouhei >Assignee: Yosuke Shiro >Priority: Minor > > https://github.com/apache/arrow/blob/master/c_glib/arrow-glib/input-stream.cpp#L402 > This is follow-up work of > https://github.com/apache/arrow/commit/ff2ee42092c09d13e38205fedd3acbdf375199f0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (ARROW-5456) [GLib][Plasma] Installed plasma-glib may be used on building document
[ https://issues.apache.org/jira/browse/ARROW-5456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro resolved ARROW-5456. - Resolution: Fixed Fix Version/s: 0.14.0 Issue resolved by pull request 4425 [https://github.com/apache/arrow/pull/4425] > [GLib][Plasma] Installed plasma-glib may be used on building document > - > > Key: ARROW-5456 > URL: https://issues.apache.org/jira/browse/ARROW-5456 > Project: Apache Arrow > Issue Type: Bug > Components: GLib >Affects Versions: 0.13.0 >Reporter: Kouhei Sutou >Assignee: Kouhei Sutou >Priority: Minor > Labels: pull-request-available > Fix For: 0.14.0 > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ARROW-5447) [CI] [Ruby] CI is failued on AppVeyor
Yosuke Shiro created ARROW-5447: --- Summary: [CI] [Ruby] CI is failued on AppVeyor Key: ARROW-5447 URL: https://issues.apache.org/jira/browse/ARROW-5447 Project: Apache Arrow Issue Type: Improvement Components: Continuous Integration, Ruby Reporter: Yosuke Shiro This happens sometimes. {code:java} Error: test: csv.gz(TableTest::#save and .load::path:::format::load: auto detect): Arrow::Error::Io: [csv-reader][read]: IOError: zlib inflate failed: invalid distance too far back c:/Ruby26-x64/lib/ruby/gems/2.6.0/gems/gobject-introspection-3.3.6/lib/gobject-introspection/loader.rb:616:in `invoke' c:/Ruby26-x64/lib/ruby/gems/2.6.0/gems/gobject-introspection-3.3.6/lib/gobject-introspection/loader.rb:616:in `invoke' c:/Ruby26-x64/lib/ruby/gems/2.6.0/gems/gobject-introspection-3.3.6/lib/gobject-introspection/loader.rb:533:in `block in define_method' C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:158:in `block (2 levels) in load_from_path' C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:147:in `block (2 levels) in wrap_input' C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:140:in `open_encoding_convert_stream' C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:146:in `block in wrap_input' C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:125:in `block in open_decompress_input' C:/projects/arrow/ruby/red-arrow/lib/arrow/block-closable.rb:25:in `open' C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:124:in `open_decompress_input' C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:145:in `wrap_input' C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:157:in `block in load_from_path' C:/projects/arrow/ruby/red-arrow/lib/arrow/block-closable.rb:25:in `open' C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:156:in `load_from_path' C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:39:in `load' C:/projects/arrow/ruby/red-arrow/lib/arrow/csv-loader.rb:26:in `load' C:/projects/arrow/ruby/red-arrow/lib/arrow/table-loader.rb:158:in `load_as_csv' C:/projects/arrow/ruby/red-arrow/lib/arrow/table-loader.rb:50:in `load' C:/projects/arrow/ruby/red-arrow/lib/arrow/table-loader.rb:22:in `load' C:/projects/arrow/ruby/red-arrow/lib/arrow/table.rb:27:in `load' C:/projects/arrow/ruby/red-arrow/test/test-table.rb:503:in `block (5 levels) in ' === {code} https://ci.appveyor.com/project/ApacheSoftwareFoundation/arrow/builds/24813909/job/kkc98r3e4ltxeor3#L2328 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (ARROW-5077) [Rust] Release process should change Cargo.toml to use release versions
[ https://issues.apache.org/jira/browse/ARROW-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro reassigned ARROW-5077: --- Assignee: Yosuke Shiro > [Rust] Release process should change Cargo.toml to use release versions > --- > > Key: ARROW-5077 > URL: https://issues.apache.org/jira/browse/ARROW-5077 > Project: Apache Arrow > Issue Type: Improvement > Components: Rust >Affects Versions: 0.13.0 >Reporter: Andy Grove >Assignee: Yosuke Shiro >Priority: Major > Fix For: 0.14.0 > > > In the dev tree we use relative path dependencies between arrow, parquet, and > datafusion, which means we can't just run cargo publish for each crate from > the release source tarball. > It would be good to have the relaese packaging change the Cargo.toml for > parquet and datafusion to have dependencies on a versioned release instead of > a relative path to remove this manual step when publishing. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ARROW-5372) [GLib] Add support for null/boolean values CSV read option
Yosuke Shiro created ARROW-5372: --- Summary: [GLib] Add support for null/boolean values CSV read option Key: ARROW-5372 URL: https://issues.apache.org/jira/browse/ARROW-5372 Project: Apache Arrow Issue Type: New Feature Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro Fix For: 0.14.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ARROW-5364) [C++] Fix UTF-8 comments to ASCII in BuildUtils.cmake
Yosuke Shiro created ARROW-5364: --- Summary: [C++] Fix UTF-8 comments to ASCII in BuildUtils.cmake Key: ARROW-5364 URL: https://issues.apache.org/jira/browse/ARROW-5364 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Yosuke Shiro Assignee: Yosuke Shiro Fix For: 0.14.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5363) [GLib] Fix coding styles
[ https://issues.apache.org/jira/browse/ARROW-5363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5363: Description: See [https://github.com/apache/arrow/pull/4317/files#r284887186]. > [GLib] Fix coding styles > > > Key: ARROW-5363 > URL: https://issues.apache.org/jira/browse/ARROW-5363 > Project: Apache Arrow > Issue Type: Improvement > Components: GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > Fix For: 0.14.0 > > > See [https://github.com/apache/arrow/pull/4317/files#r284887186]. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ARROW-5363) [GLib] Fix coding styles
Yosuke Shiro created ARROW-5363: --- Summary: [GLib] Fix coding styles Key: ARROW-5363 URL: https://issues.apache.org/jira/browse/ARROW-5363 Project: Apache Arrow Issue Type: Improvement Components: GLib Reporter: Yosuke Shiro Assignee: Yosuke Shiro Fix For: 0.14.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5306) [CI] [GLib] Disable GTK-Doc
[ https://issues.apache.org/jira/browse/ARROW-5306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5306: Issue Type: Bug (was: New Feature) > [CI] [GLib] Disable GTK-Doc > --- > > Key: ARROW-5306 > URL: https://issues.apache.org/jira/browse/ARROW-5306 > Project: Apache Arrow > Issue Type: Bug > Components: Continuous Integration, GLib >Reporter: Yosuke Shiro >Assignee: Yosuke Shiro >Priority: Major > > Travis fails to process documents by GTK-Doc. > [https://travis-ci.org/apache/arrow/jobs/531197944#L4170] > This caused by the recent GTK-Doc upgrade to 0.13.0. So disable GTK-Doc until > 0.13.1 is released. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5307) [CI] [GLib] Enable GTK-Doc
[ https://issues.apache.org/jira/browse/ARROW-5307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yosuke Shiro updated ARROW-5307: Issue Type: Improvement (was: New Feature) > [CI] [GLib] Enable GTK-Doc > -- > > Key: ARROW-5307 > URL: https://issues.apache.org/jira/browse/ARROW-5307 > Project: Apache Arrow > Issue Type: Improvement > Components: Continuous Integration, GLib >Reporter: Yosuke Shiro >Priority: Major > > Enable GTK-Doc when 0.13.1 is released. > See https://issues.apache.org/jira/browse/ARROW-5306. -- This message was sent by Atlassian JIRA (v7.6.3#76005)