[GitHub] [arrow] emkornfield commented on pull request #8130: Parquet file writer snapshot API and proper ColumnChunk.file_path utilization

2020-09-09 Thread GitBox
emkornfield commented on pull request #8130: URL: https://github.com/apache/arrow/pull/8130#issuecomment-69459 I don't think we should support this unless we can get consensus on dev@parquet mailing list that we want to support this across java and C++ (if java already supports it a po

[GitHub] [arrow] emkornfield commented on pull request #8052: ARROW-9761: [C/C++] Add experimental C stream inferface

2020-09-09 Thread GitBox
emkornfield commented on pull request #8052: URL: https://github.com/apache/arrow/pull/8052#issuecomment-689996230 > Rebased. Does someone want to review the doc at https://pitrou.net/arrowdevdoc/format/CStreamInterface.html ? I took a quick look and seemed reasonable (nothing jumped

[GitHub] [arrow] github-actions[bot] commented on pull request #8156: ARROW-9810: [C++] Generalized nested reconstruction helpers

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8156: URL: https://github.com/apache/arrow/pull/8156#issuecomment-689994855 https://issues.apache.org/jira/browse/ARROW-9810 This is an automated message from the Apache Git Serv

[GitHub] [arrow] emkornfield opened a new pull request #8156: ARROW-9810: [C++] Generalized nested reconstruction helpers

2020-09-09 Thread GitBox
emkornfield opened a new pull request #8156: URL: https://github.com/apache/arrow/pull/8156 This adds helper methods for reconstructing all necessary metadata for arrow types. For now this doesn't handle null_slot_usage (i.e. children of FixedSizeList), it throws exceptions when nulls

[GitHub] [arrow] emkornfield commented on a change in pull request #7887: ARROW-9304: [C++] Add "AppendEmpty" builder APIs for use inside StructBuilder::AppendNull

2020-09-09 Thread GitBox
emkornfield commented on a change in pull request #7887: URL: https://github.com/apache/arrow/pull/7887#discussion_r486028649 ## File path: cpp/src/arrow/array/builder_base.h ## @@ -98,6 +98,9 @@ class ARROW_EXPORT ArrayBuilder { virtual Status AppendNull() = 0; virtual S

[GitHub] [arrow] tianchen92 commented on pull request #7887: ARROW-9304: [C++] Add "AppendEmpty" builder APIs for use inside StructBuilder::AppendNull

2020-09-09 Thread GitBox
tianchen92 commented on pull request #7887: URL: https://github.com/apache/arrow/pull/7887#issuecomment-689938956 @pitrou Thanks for your patch and careful review, I updated PR according to the comments above. @emkornfield doesn't matter :), pitrou helped disabled the failed test and no

[GitHub] [arrow] emkornfield commented on pull request #7887: ARROW-9304: [C++] Add "AppendEmpty" builder APIs for use inside StructBuilder::AppendNull

2020-09-09 Thread GitBox
emkornfield commented on pull request #7887: URL: https://github.com/apache/arrow/pull/7887#issuecomment-689935755 @tianchen92 sorry I missed the tag. Is it possible the failure could be related to https://issues.apache.org/jira/browse/ARROW-9603?filter=-2 ---

[GitHub] [arrow] andygrove closed pull request #8135: ARROW-9837: [Rust][DataFusion] Added provider for variable

2020-09-09 Thread GitBox
andygrove closed pull request #8135: URL: https://github.com/apache/arrow/pull/8135 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] andygrove closed pull request #8142: ARROW-9944: [Rust][DataFusion] Implement to_timestamp function

2020-09-09 Thread GitBox
andygrove closed pull request #8142: URL: https://github.com/apache/arrow/pull/8142 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] alamb commented on pull request #8142: ARROW-9944: [Rust][DataFusion] Implement to_timestamp function

2020-09-09 Thread GitBox
alamb commented on pull request #8142: URL: https://github.com/apache/arrow/pull/8142#issuecomment-689861246 @andygrove -- I have rebased this PR and I believe I have implemented all suggestions. There is one more lingering thing regarding parsing local timestamps that I want to check out

[GitHub] [arrow] nealrichardson closed pull request #8154: ARROW-9890: [R] Add zstandard compression codec in macOS build

2020-09-09 Thread GitBox
nealrichardson closed pull request #8154: URL: https://github.com/apache/arrow/pull/8154 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [arrow] nealrichardson closed pull request #8012: ARROW-9806: [R] More compute kernel bindings

2020-09-09 Thread GitBox
nealrichardson closed pull request #8012: URL: https://github.com/apache/arrow/pull/8012 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [arrow] alamb commented on a change in pull request #8142: ARROW-9944: [Rust][DataFusion] Implement to_timestamp function

2020-09-09 Thread GitBox
alamb commented on a change in pull request #8142: URL: https://github.com/apache/arrow/pull/8142#discussion_r485950446 ## File path: rust/datafusion/src/physical_plan/datetime_expressions.rs ## @@ -0,0 +1,225 @@ +// Licensed to the Apache Software Foundation (ASF) under one +/

[GitHub] [arrow] alamb commented on a change in pull request #8142: ARROW-9944: [Rust][DataFusion] Implement to_timestamp function

2020-09-09 Thread GitBox
alamb commented on a change in pull request #8142: URL: https://github.com/apache/arrow/pull/8142#discussion_r485935565 ## File path: rust/datafusion/src/physical_plan/datetime_expressions.rs ## @@ -0,0 +1,225 @@ +// Licensed to the Apache Software Foundation (ASF) under one +/

[GitHub] [arrow] github-actions[bot] commented on pull request #8155: ARROW-9954: [Rust] [DataFusion] Made aggregates support the same signatures as functions.

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8155: URL: https://github.com/apache/arrow/pull/8155#issuecomment-689833250 https://issues.apache.org/jira/browse/ARROW-9954 This is an automated message from the Apache Git Serv

[GitHub] [arrow] jorgecarleitao opened a new pull request #8155: ARROW-9954: [Rust] [DataFusion] Made aggregates support the same signatures as functions.

2020-09-09 Thread GitBox
jorgecarleitao opened a new pull request #8155: URL: https://github.com/apache/arrow/pull/8155 This commit makes the creation of aggregate expressions similar to the creation of built-in expressions. This allows to share coercion rules and signatures between scalar and aggregate fun

[GitHub] [arrow] nealrichardson commented on a change in pull request #8150: ARROW-9271: [R] Preserve data frame metadata in round trip

2020-09-09 Thread GitBox
nealrichardson commented on a change in pull request #8150: URL: https://github.com/apache/arrow/pull/8150#discussion_r485914346 ## File path: r/R/table.R ## @@ -185,6 +185,36 @@ Table <- R6Class("Table", inherit = ArrowObject, ) ) +bad_attributes <- function(x) { + UseM

[GitHub] [arrow] eerhardt commented on a change in pull request #8146: ARROW-5034: [C#] ArrowStreamWriter implement sync WriteRecordBatch

2020-09-09 Thread GitBox
eerhardt commented on a change in pull request #8146: URL: https://github.com/apache/arrow/pull/8146#discussion_r485898496 ## File path: csharp/src/Apache.Arrow/Ipc/ArrowStreamWriter.cs ## @@ -212,6 +212,96 @@ private void CountSelfAndChildrenNodes(IArrowType type, ref int cou

[GitHub] [arrow] MingyuZhong commented on a change in pull request #8143: ARROW-9949: [C++] Improve performance of Decimal128::FromString by 46%, and make the implementation reusable for Decimal256.

2020-09-09 Thread GitBox
MingyuZhong commented on a change in pull request #8143: URL: https://github.com/apache/arrow/pull/8143#discussion_r485907213 ## File path: cpp/src/arrow/util/decimal.cc ## @@ -42,34 +45,40 @@ namespace arrow { using internal::SafeLeftShift; using internal::SafeSignedAdd; +

[GitHub] [arrow] github-actions[bot] commented on pull request #8154: ARROW-9890: [R] Add zstandard compression codec in macOS build

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8154: URL: https://github.com/apache/arrow/pull/8154#issuecomment-689801423 This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [arrow] nealrichardson commented on pull request #8154: ARROW-9890: [R] Add zstandard compression codec in macOS build

2020-09-09 Thread GitBox
nealrichardson commented on pull request #8154: URL: https://github.com/apache/arrow/pull/8154#issuecomment-689800447 @github-actions crossbow submit homebrew-r-autobrew This is an automated message from the Apache Git Servic

[GitHub] [arrow] nealrichardson opened a new pull request #8154: ARROW-9890: [R] Add zstandard compression codec in macOS build

2020-09-09 Thread GitBox
nealrichardson opened a new pull request #8154: URL: https://github.com/apache/arrow/pull/8154 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [arrow] nealrichardson closed pull request #8152: ARROW-9953: [R] Declare minimum version for bit64

2020-09-09 Thread GitBox
nealrichardson closed pull request #8152: URL: https://github.com/apache/arrow/pull/8152 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [arrow] pitrou commented on a change in pull request #8143: ARROW-9949: [C++] Improve performance of Decimal128::FromString by 46%, and make the implementation reusable for Decimal256.

2020-09-09 Thread GitBox
pitrou commented on a change in pull request #8143: URL: https://github.com/apache/arrow/pull/8143#discussion_r485888089 ## File path: cpp/src/arrow/util/decimal.cc ## @@ -42,34 +45,40 @@ namespace arrow { using internal::SafeLeftShift; using internal::SafeSignedAdd; +#ifde

[GitHub] [arrow] MingyuZhong commented on a change in pull request #8143: ARROW-9949: [C++] Improve performance of Decimal128::FromString by 46%, and make the implementation reusable for Decimal256.

2020-09-09 Thread GitBox
MingyuZhong commented on a change in pull request #8143: URL: https://github.com/apache/arrow/pull/8143#discussion_r485885307 ## File path: cpp/src/arrow/util/decimal.cc ## @@ -42,34 +45,40 @@ namespace arrow { using internal::SafeLeftShift; using internal::SafeSignedAdd; +

[GitHub] [arrow] github-actions[bot] commented on pull request #8153: ARROW-9616: [C++] Support LTO for R

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8153: URL: https://github.com/apache/arrow/pull/8153#issuecomment-689747629 https://issues.apache.org/jira/browse/ARROW-9616 This is an automated message from the Apache Git Serv

[GitHub] [arrow] nealrichardson opened a new pull request #8153: ARROW-9616: [C++] Support LTO for R

2020-09-09 Thread GitBox
nealrichardson opened a new pull request #8153: URL: https://github.com/apache/arrow/pull/8153 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [arrow] kiszk commented on a change in pull request #8147: ARROW-9680: [Java] Support non-nullable vectors

2020-09-09 Thread GitBox
kiszk commented on a change in pull request #8147: URL: https://github.com/apache/arrow/pull/8147#discussion_r485785372 ## File path: java/vector/src/main/java/org/apache/arrow/vector/IntVector.java ## @@ -164,7 +165,9 @@ private void setValue(int index, int value) { * @par

[GitHub] [arrow] kiszk commented on a change in pull request #8147: ARROW-9680: [Java] Support non-nullable vectors

2020-09-09 Thread GitBox
kiszk commented on a change in pull request #8147: URL: https://github.com/apache/arrow/pull/8147#discussion_r485785372 ## File path: java/vector/src/main/java/org/apache/arrow/vector/IntVector.java ## @@ -164,7 +165,9 @@ private void setValue(int index, int value) { * @par

[GitHub] [arrow] github-actions[bot] commented on pull request #8152: Explicitly list minimal version for the bit64 package dependency

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8152: URL: https://github.com/apache/arrow/pull/8152#issuecomment-689697572 Thanks for opening a pull request! Could you open an issue for this pull request on JIRA? https://issues.apache.org/jira/browse/ARROW Then could

[GitHub] [arrow] OfekShilon opened a new pull request #8152: Explicitly list minimal version for the bit64 package dependency

2020-09-09 Thread GitBox
OfekShilon opened a new pull request #8152: URL: https://github.com/apache/arrow/pull/8152 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [arrow] elferherrera commented on pull request #8129: ARROW-9934 [Rust] Shape and stride check in tensor

2020-09-09 Thread GitBox
elferherrera commented on pull request #8129: URL: https://github.com/apache/arrow/pull/8129#issuecomment-689647404 I wasn't aware of tch-rs. I will have a look at it and how it creates the torch tensors. Thanks for the info. Regarding the features, I was planning to implement the fm

[GitHub] [arrow] github-actions[bot] commented on pull request #8146: ARROW-5034: [C#] ArrowStreamWriter implement sync WriteRecordBatch

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8146: URL: https://github.com/apache/arrow/pull/8146#issuecomment-689623840 https://issues.apache.org/jira/browse/ARROW-5034 This is an automated message from the Apache Git Serv

[GitHub] [arrow] github-actions[bot] commented on pull request #8148: ARROW-9104: [C++] Parquet encryption tests should write files to a temporary directory instead of the testing submodule's director

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8148: URL: https://github.com/apache/arrow/pull/8148#issuecomment-689586337 https://issues.apache.org/jira/browse/ARROW-9104 This is an automated message from the Apache Git Serv

[GitHub] [arrow] github-actions[bot] commented on pull request #8127: WIP: ARROW-8359: [C++/Python] Enable linux-aarch64 builds

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8127: URL: https://github.com/apache/arrow/pull/8127#issuecomment-689579549 Revision: 8c58d24820a44204095711f42748f304b7de65ad Submitted crossbow builds: [ursa-labs/crossbow @ actions-522](https://github.com/ursa-labs/crossbow/branches/a

[GitHub] [arrow] xhochy commented on pull request #8127: WIP: ARROW-8359: [C++/Python] Enable linux-aarch64 builds

2020-09-09 Thread GitBox
xhochy commented on pull request #8127: URL: https://github.com/apache/arrow/pull/8127#issuecomment-689578161 @github-actions crossbow submit conda-linux-gcc-py36-aarch64 This is an automated message from the Apache G

[GitHub] [arrow] pitrou commented on pull request #8052: ARROW-9761: [C/C++] Add experimental C stream inferface

2020-09-09 Thread GitBox
pitrou commented on pull request #8052: URL: https://github.com/apache/arrow/pull/8052#issuecomment-689575836 Rebased. Does someone want to review the doc at https://pitrou.net/arrowdevdoc/format/CStreamInterface.html ? This

[GitHub] [arrow] pitrou commented on pull request #7887: ARROW-9304: [C++] Add "AppendEmpty" builder APIs for use inside StructBuilder::AppendNull

2020-09-09 Thread GitBox
pitrou commented on pull request #7887: URL: https://github.com/apache/arrow/pull/7887#issuecomment-689569522 @tianchen92 The Parquet failure is probably a bug in the nested Parquet reader. I've pushed changes to your branch, be careful to pick them up. ---

[GitHub] [arrow] pitrou commented on a change in pull request #7887: ARROW-9304: [C++] Add "AppendEmpty" builder APIs for use inside StructBuilder::AppendNull

2020-09-09 Thread GitBox
pitrou commented on a change in pull request #7887: URL: https://github.com/apache/arrow/pull/7887#discussion_r485588382 ## File path: cpp/src/arrow/array/builder_dict.h ## @@ -233,6 +233,20 @@ class DictionaryBuilderBase : public ArrayBuilder { return indices_builder_.App

[GitHub] [arrow] github-actions[bot] commented on pull request #8127: WIP: ARROW-8359: [C++/Python] Enable linux-aarch64 builds

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8127: URL: https://github.com/apache/arrow/pull/8127#issuecomment-689559291 Revision: 9b3e31bda2608d364ad1dde2bcf4ab12dfe23885 Submitted crossbow builds: [ursa-labs/crossbow @ actions-521](https://github.com/ursa-labs/crossbow/branches/a

[GitHub] [arrow] xhochy commented on pull request #8127: WIP: ARROW-8359: [C++/Python] Enable linux-aarch64 builds

2020-09-09 Thread GitBox
xhochy commented on pull request #8127: URL: https://github.com/apache/arrow/pull/8127#issuecomment-689557890 @github-actions crossbow submit conda-linux-gcc-py36-aarch64 This is an automated message from the Apache G

[GitHub] [arrow] github-actions[bot] commented on pull request #8151: ARROW-9279: [C++] Implement PrettyPrint for Scalars

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8151: URL: https://github.com/apache/arrow/pull/8151#issuecomment-689540884 https://issues.apache.org/jira/browse/ARROW-9279 This is an automated message from the Apache Git Serv

[GitHub] [arrow] pitrou closed pull request #8131: ARROW-9936: [Python] Fix / test relative file paths in pyarrow.parquet

2020-09-09 Thread GitBox
pitrou closed pull request #8131: URL: https://github.com/apache/arrow/pull/8131 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] tianchen92 opened a new pull request #8151: ARROW-9279: [C++] Implement PrettyPrint for Scalars

2020-09-09 Thread GitBox
tianchen92 opened a new pull request #8151: URL: https://github.com/apache/arrow/pull/8151 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [arrow] pitrou commented on a change in pull request #8023: ARROW-9318: [C++] Parquet encryption key management

2020-09-09 Thread GitBox
pitrou commented on a change in pull request #8023: URL: https://github.com/apache/arrow/pull/8023#discussion_r485575668 ## File path: cpp/src/parquet/kms_client_factory.h ## @@ -0,0 +1,42 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor

[GitHub] [arrow] github-actions[bot] commented on pull request #8150: ARROW-9271: [R] Preserve data frame metadata in round trip

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8150: URL: https://github.com/apache/arrow/pull/8150#issuecomment-689530988 https://issues.apache.org/jira/browse/ARROW-9271 This is an automated message from the Apache Git Serv

[GitHub] [arrow] romainfrancois opened a new pull request #8150: ARROW-9271: [R] Preserve data frame metadata in round trip

2020-09-09 Thread GitBox
romainfrancois opened a new pull request #8150: URL: https://github.com/apache/arrow/pull/8150 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [arrow] pitrou commented on a change in pull request #8023: ARROW-9318: [C++] Parquet encryption key management

2020-09-09 Thread GitBox
pitrou commented on a change in pull request #8023: URL: https://github.com/apache/arrow/pull/8023#discussion_r485569777 ## File path: cpp/src/parquet/key_toolkit.h ## @@ -0,0 +1,123 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor licen

[GitHub] [arrow] ggershinsky commented on a change in pull request #8023: ARROW-9318: [C++] Parquet encryption key management

2020-09-09 Thread GitBox
ggershinsky commented on a change in pull request #8023: URL: https://github.com/apache/arrow/pull/8023#discussion_r485567679 ## File path: cpp/src/parquet/properties_driven_crypto_factory.cc ## @@ -0,0 +1,278 @@ +// Licensed to the Apache Software Foundation (ASF) under one +/

[GitHub] [arrow] pitrou commented on a change in pull request #8023: ARROW-9318: [C++] Parquet encryption key management

2020-09-09 Thread GitBox
pitrou commented on a change in pull request #8023: URL: https://github.com/apache/arrow/pull/8023#discussion_r485558482 ## File path: cpp/src/parquet/key_toolkit.h ## @@ -0,0 +1,123 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor licen

[GitHub] [arrow] pitrou commented on a change in pull request #8023: ARROW-9318: [C++] Parquet encryption key management

2020-09-09 Thread GitBox
pitrou commented on a change in pull request #8023: URL: https://github.com/apache/arrow/pull/8023#discussion_r485557938 ## File path: cpp/src/parquet/key_toolkit.h ## @@ -0,0 +1,123 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor licen

[GitHub] [arrow] pitrou commented on a change in pull request #8023: ARROW-9318: [C++] Parquet encryption key management

2020-09-09 Thread GitBox
pitrou commented on a change in pull request #8023: URL: https://github.com/apache/arrow/pull/8023#discussion_r485557493 ## File path: cpp/src/parquet/key_toolkit.h ## @@ -0,0 +1,123 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor licen

[GitHub] [arrow] pitrou commented on a change in pull request #8023: ARROW-9318: [C++] Parquet encryption key management

2020-09-09 Thread GitBox
pitrou commented on a change in pull request #8023: URL: https://github.com/apache/arrow/pull/8023#discussion_r485556981 ## File path: cpp/src/parquet/key_toolkit.h ## @@ -0,0 +1,123 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor licen

[GitHub] [arrow] ggershinsky commented on a change in pull request #8023: ARROW-9318: [C++] Parquet encryption key management

2020-09-09 Thread GitBox
ggershinsky commented on a change in pull request #8023: URL: https://github.com/apache/arrow/pull/8023#discussion_r485535843 ## File path: cpp/src/parquet/key_toolkit.h ## @@ -0,0 +1,123 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor

[GitHub] [arrow] pereverges closed issue #8140: Can you respond at my last issue

2020-09-09 Thread GitBox
pereverges closed issue #8140: URL: https://github.com/apache/arrow/issues/8140 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] ggershinsky commented on a change in pull request #8023: ARROW-9318: [C++] Parquet encryption key management

2020-09-09 Thread GitBox
ggershinsky commented on a change in pull request #8023: URL: https://github.com/apache/arrow/pull/8023#discussion_r485510128 ## File path: cpp/src/parquet/properties_driven_crypto_factory.h ## @@ -0,0 +1,207 @@ +// Licensed to the Apache Software Foundation (ASF) under one +//

[GitHub] [arrow] xhochy commented on pull request #8127: WIP: ARROW-8359: [C++/Python] Enable linux-aarch64 builds

2020-09-09 Thread GitBox
xhochy commented on pull request #8127: URL: https://github.com/apache/arrow/pull/8127#issuecomment-689468483 Needs `pygit2` on `aarch64` for the package upload, requested here: https://github.com/conda-forge/conda-forge-pinning-feedstock/pull/761 -

[GitHub] [arrow] pitrou closed pull request #8141: ARROW-9906: [C++] Keep S3 filesystem alive through open file objects

2020-09-09 Thread GitBox
pitrou closed pull request #8141: URL: https://github.com/apache/arrow/pull/8141 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] github-actions[bot] commented on pull request #8127: WIP: ARROW-8359: [C++/Python] Enable linux-aarch64 builds

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8127: URL: https://github.com/apache/arrow/pull/8127#issuecomment-689455537 Revision: 9b3e31bda2608d364ad1dde2bcf4ab12dfe23885 Submitted crossbow builds: [ursa-labs/crossbow @ actions-520](https://github.com/ursa-labs/crossbow/branches/a

[GitHub] [arrow] alamb commented on pull request #7967: ARROW-9751: [Rust] [DataFusion] Allow UDFs to accept multiple data types per argument

2020-09-09 Thread GitBox
alamb commented on pull request #7967: URL: https://github.com/apache/arrow/pull/7967#issuecomment-689455228 🎉 Hooray! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [arrow] xhochy commented on pull request #8127: WIP: ARROW-8359: [C++/Python] Enable linux-aarch64 builds

2020-09-09 Thread GitBox
xhochy commented on pull request #8127: URL: https://github.com/apache/arrow/pull/8127#issuecomment-689454442 @github-actions crossbow submit conda-linux-gcc-py36-aarch64 This is an automated message from the Apache G

[GitHub] [arrow] github-actions[bot] commented on pull request #8149: ARROW-9645: [Python] Deprecate pyarrow.filesystem in favor of pyarrow.fs

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8149: URL: https://github.com/apache/arrow/pull/8149#issuecomment-689442469 https://issues.apache.org/jira/browse/ARROW-9645 This is an automated message from the Apache Git Serv

[GitHub] [arrow] jhorstmann commented on a change in pull request #8142: ARROW-9944: [Rust][DataFusion] Implement to_timestamp function

2020-09-09 Thread GitBox
jhorstmann commented on a change in pull request #8142: URL: https://github.com/apache/arrow/pull/8142#discussion_r485468664 ## File path: rust/datafusion/src/physical_plan/datetime_expressions.rs ## @@ -0,0 +1,225 @@ +// Licensed to the Apache Software Foundation (ASF) under o

[GitHub] [arrow] jorisvandenbossche opened a new pull request #8149: ARROW-9645: [Python] Deprecate pyarrow.filesystem in favor of pyarrow.fs

2020-09-09 Thread GitBox
jorisvandenbossche opened a new pull request #8149: URL: https://github.com/apache/arrow/pull/8149 WIP, still need to deprecate hdfs as well This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [arrow] pitrou commented on a change in pull request #8143: ARROW-9949: [C++] Improve performance of Decimal128::FromString by 46%, and make the implementation reusable for Decimal256.

2020-09-09 Thread GitBox
pitrou commented on a change in pull request #8143: URL: https://github.com/apache/arrow/pull/8143#discussion_r485460964 ## File path: cpp/src/arrow/util/decimal.cc ## @@ -42,34 +45,40 @@ namespace arrow { using internal::SafeLeftShift; using internal::SafeSignedAdd; +#ifde

[GitHub] [arrow] pitrou commented on a change in pull request #8143: ARROW-9949: [C++] Improve performance of Decimal128::FromString by 46%, and make the implementation reusable for Decimal256.

2020-09-09 Thread GitBox
pitrou commented on a change in pull request #8143: URL: https://github.com/apache/arrow/pull/8143#discussion_r485460551 ## File path: cpp/src/arrow/util/decimal.cc ## @@ -42,34 +45,40 @@ namespace arrow { using internal::SafeLeftShift; using internal::SafeSignedAdd; +#ifde

[GitHub] [arrow] pitrou commented on pull request #8143: ARROW-9949: [C++] Improve performance of Decimal128::FromString by 46%, and make the implementation reusable for Decimal256.

2020-09-09 Thread GitBox
pitrou commented on pull request #8143: URL: https://github.com/apache/arrow/pull/8143#issuecomment-689434791 Be careful: it seems you updated the `testing` submodule. This is an automated message from the Apache Git Service.

[GitHub] [arrow] pitrou commented on a change in pull request #8148: "ARROW-9104: [C++] Parquet encryption tests should write files to a temporary directory instead of the testing submodule's director

2020-09-09 Thread GitBox
pitrou commented on a change in pull request #8148: URL: https://github.com/apache/arrow/pull/8148#discussion_r485435374 ## File path: cpp/src/parquet/test_encryption_util.h ## @@ -57,6 +57,7 @@ const char kFooterEncryptionKey[] = "0123456789012345"; // 128bit/16 const char

[GitHub] [arrow] pitrou commented on pull request #8139: ARROW-9814: [Python] Fix crash in test_parquet::test_read_partitioned_directory_s3fs

2020-09-09 Thread GitBox
pitrou commented on pull request #8139: URL: https://github.com/apache/arrow/pull/8139#issuecomment-689413221 > you should either pass a URI ("s3://...) and no filesystem, or either a filesystem object with a "normal" path (without scheme prefix), but never the combo of filesystem object à

[GitHub] [arrow] github-actions[bot] commented on pull request #8148: "ARROW-9104: [C++] Parquet encryption tests should write files to a temporary directory instead of the testing submodule's directo

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8148: URL: https://github.com/apache/arrow/pull/8148#issuecomment-689410400 Thanks for opening a pull request! Could you open an issue for this pull request on JIRA? https://issues.apache.org/jira/browse/ARROW Then could

[GitHub] [arrow] revit13 opened a new pull request #8148: "ARROW-9104: [C++] Parquet encryption tests should write files to a temporary directory instead of the testing submodule's directory"

2020-09-09 Thread GitBox
revit13 opened a new pull request #8148: URL: https://github.com/apache/arrow/pull/8148 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [arrow] jorisvandenbossche closed pull request #8139: ARROW-9814: [Python] Fix crash in test_parquet::test_read_partitioned_directory_s3fs

2020-09-09 Thread GitBox
jorisvandenbossche closed pull request #8139: URL: https://github.com/apache/arrow/pull/8139 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [arrow] jorisvandenbossche commented on pull request #8139: ARROW-9814: [Python] Fix crash in test_parquet::test_read_partitioned_directory_s3fs

2020-09-09 Thread GitBox
jorisvandenbossche commented on pull request #8139: URL: https://github.com/apache/arrow/pull/8139#issuecomment-689380287 Failures are brew installation failures, so ignoring those This is an automated message from the Apache

[GitHub] [arrow] github-actions[bot] commented on pull request #8147: ARROW-9680: [Java] Support non-nullable vectors

2020-09-09 Thread GitBox
github-actions[bot] commented on pull request #8147: URL: https://github.com/apache/arrow/pull/8147#issuecomment-689362095 https://issues.apache.org/jira/browse/ARROW-9680 This is an automated message from the Apache Git Serv

[GitHub] [arrow] liyafan82 commented on pull request #8147: ARROW-9680: [Java] Support non-nullable vectors

2020-09-09 Thread GitBox
liyafan82 commented on pull request #8147: URL: https://github.com/apache/arrow/pull/8147#issuecomment-689356664 In the first commit of this PR, we only support IntVector. This is an automated message from the Apache Git Serv

[GitHub] [arrow] liyafan82 opened a new pull request #8147: ARROW-9680: [Java] Support non-nullable vectors

2020-09-09 Thread GitBox
liyafan82 opened a new pull request #8147: URL: https://github.com/apache/arrow/pull/8147 This issue was first discussed in the ML (https://lists.apache.org/thread.html/r480387ec9ec822f3ed30e9131109e43874a1c4d18af74ede1a7e41c5%40%3Cdev.arrow.apache.org%3E), from which we have received some