[GitHub] [arrow] jorgecarleitao opened a new pull request #7879: ARROW-9618: [Rust] [DataFusion] Simplified code around optimizers.

2020-08-02 Thread GitBox
jorgecarleitao opened a new pull request #7879: URL: https://github.com/apache/arrow/pull/7879 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [arrow] github-actions[bot] commented on pull request #7879: ARROW-9618: [Rust] [DataFusion] Simplified code around optimizers.

2020-08-02 Thread GitBox
github-actions[bot] commented on pull request #7879: URL: https://github.com/apache/arrow/pull/7879#issuecomment-667643163 https://issues.apache.org/jira/browse/ARROW-9618 This is an automated message from the Apache Git Serv

[GitHub] [arrow] nevi-me commented on a change in pull request #7878: ARROW-9617: [Rust] [DataFusion] Add length of string array

2020-08-02 Thread GitBox
nevi-me commented on a change in pull request #7878: URL: https://github.com/apache/arrow/pull/7878#discussion_r464059368 ## File path: rust/arrow/src/compute/kernels/length.rs ## @@ -0,0 +1,197 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contr

[GitHub] [arrow] jorgecarleitao opened a new pull request #7880: ARROW-9619: [Rust] [DataFusion] Add predicate push-down

2020-08-02 Thread GitBox
jorgecarleitao opened a new pull request #7880: URL: https://github.com/apache/arrow/pull/7880 This PR adds a new optimizer to push filters down. For example, a plan of the form ``` Selection: #SUM(c) Gt Int64(10)\ Selection: #b Gt Int64(10)\ Aggregate: groupBy=[[#b]]

[GitHub] [arrow] github-actions[bot] commented on pull request #7880: ARROW-9619: [Rust] [DataFusion] Add predicate push-down

2020-08-02 Thread GitBox
github-actions[bot] commented on pull request #7880: URL: https://github.com/apache/arrow/pull/7880#issuecomment-667668376 https://issues.apache.org/jira/browse/ARROW-9619 This is an automated message from the Apache Git Serv

[GitHub] [arrow] jorgecarleitao commented on a change in pull request #7878: ARROW-9617: [Rust] [DataFusion] Add length of string array

2020-08-02 Thread GitBox
jorgecarleitao commented on a change in pull request #7878: URL: https://github.com/apache/arrow/pull/7878#discussion_r464083171 ## File path: rust/arrow/src/compute/kernels/length.rs ## @@ -0,0 +1,197 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or mor

[GitHub] [arrow] jorgecarleitao opened a new pull request #7881: A trivial change to test CI.

2020-08-02 Thread GitBox
jorgecarleitao opened a new pull request #7881: URL: https://github.com/apache/arrow/pull/7881 CI for rust is breaking on some of the PRs, I am making a trivial PR to test if we have a broken CI. This is an automated message

[GitHub] [arrow] github-actions[bot] commented on pull request #7881: A trivial change to test CI.

2020-08-02 Thread GitBox
github-actions[bot] commented on pull request #7881: URL: https://github.com/apache/arrow/pull/7881#issuecomment-667708975 Thanks for opening a pull request! Could you open an issue for this pull request on JIRA? https://issues.apache.org/jira/browse/ARROW Then could

[GitHub] [arrow] Harshitg opened a new issue #7882: Performance difference between pc.multiply vs pd.multiply

2020-08-02 Thread GitBox
Harshitg opened a new issue #7882: URL: https://github.com/apache/arrow/issues/7882 Wanted to report the performance difference observed between Pandas and Pyarrow. ``` import numpy as np import pandas as pd import pyarrow as pa import pyarrow.compute as pc df = p

[GitHub] [arrow] kszucs commented on pull request #7816: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-08-02 Thread GitBox
kszucs commented on pull request #7816: URL: https://github.com/apache/arrow/pull/7816#issuecomment-667720694 I mean ignore_tomezone could be a useful conversion option for mixed timezone aware/naive input values (should be rare or rather discouraged though). I agree with the depre

[GitHub] [arrow] 18dcb01 opened a new pull request #7883: ARROW-9620: [C++] Added split function to Gandiva

2020-08-02 Thread GitBox
18dcb01 opened a new pull request #7883: URL: https://github.com/apache/arrow/pull/7883 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [arrow] github-actions[bot] commented on pull request #7883: ARROW-9620: [C++] Added split function to Gandiva

2020-08-02 Thread GitBox
github-actions[bot] commented on pull request #7883: URL: https://github.com/apache/arrow/pull/7883#issuecomment-667722780 https://issues.apache.org/jira/browse/ARROW-9620 This is an automated message from the Apache Git Serv

[GitHub] [arrow] wqc200 opened a new pull request #7884: add a new func for ExecutionContextSchemaProvider

2020-08-02 Thread GitBox
wqc200 opened a new pull request #7884: URL: https://github.com/apache/arrow/pull/7884 I use ExecutionContextSchemaProvider in outside app, so i add keyword "pub" for ExecutionContextSchemaProvider, and add a new func "new" for ExecutionContextSchemaProvider. I add keyword "pub" fo

[GitHub] [arrow] github-actions[bot] commented on pull request #7884: add a new func for ExecutionContextSchemaProvider

2020-08-02 Thread GitBox
github-actions[bot] commented on pull request #7884: URL: https://github.com/apache/arrow/pull/7884#issuecomment-667735983 Thanks for opening a pull request! Could you open an issue for this pull request on JIRA? https://issues.apache.org/jira/browse/ARROW Then could

[GitHub] [arrow] wqc200 closed pull request #7884: add a new func for ExecutionContextSchemaProvider

2020-08-02 Thread GitBox
wqc200 closed pull request #7884: URL: https://github.com/apache/arrow/pull/7884 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] kou commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox
kou commented on pull request #7842: URL: https://github.com/apache/arrow/pull/7842#issuecomment-66693 @github-actions crossbow submit -g nightly This is an automated message from the Apache Git Service. To respond to the

[GitHub] [arrow] github-actions[bot] commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox
github-actions[bot] commented on pull request #7842: URL: https://github.com/apache/arrow/pull/7842#issuecomment-667778103 Revision: 1bc156e6e5a582f15d73a848153a578461c523dd Submitted crossbow builds: [ursa-labs/crossbow @ actions-454](https://github.com/ursa-labs/crossbow/branches/a

[GitHub] [arrow] emkornfield commented on issue #7882: Performance difference between pc.multiply vs pd.multiply

2020-08-02 Thread GitBox
emkornfield commented on issue #7882: URL: https://github.com/apache/arrow/issues/7882#issuecomment-667784048 @zacqed thanks for the report. We use [JIRA](https://issues.apache.org/jira/secure/Dashboard.jspa) could you report this here? Also what version of pyarrow?

[GitHub] [arrow] emkornfield commented on issue #7877: Adding local persistence to examples/flight/server.py

2020-08-02 Thread GitBox
emkornfield commented on issue #7877: URL: https://github.com/apache/arrow/issues/7877#issuecomment-667784599 @lhayhurst glad you solved the issue. these types of discussions are best had on user@ or dev@ arrow mailing lists (we don't use github issues to answer questions/track bugs). If

[GitHub] [arrow] emkornfield closed issue #7877: Adding local persistence to examples/flight/server.py

2020-08-02 Thread GitBox
emkornfield closed issue #7877: URL: https://github.com/apache/arrow/issues/7877 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] emkornfield commented on pull request #7846: ARROW-8445: [Gandiva][UDF][c++] Add a udf for gandiva to extract all named groups.

2020-08-02 Thread GitBox
emkornfield commented on pull request #7846: URL: https://github.com/apache/arrow/pull/7846#issuecomment-667785504 @praveenbingo do you have time to review? This is an automated message from the Apache Git Service. To respond

[GitHub] [arrow] emkornfield commented on pull request #7816: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-08-02 Thread GitBox
emkornfield commented on pull request #7816: URL: https://github.com/apache/arrow/pull/7816#issuecomment-667786442 @github-actions crossbow submit test-conda-python-3.8-spark-master This is an automated message from the Apach

[GitHub] [arrow] kou commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox
kou commented on pull request #7842: URL: https://github.com/apache/arrow/pull/7842#issuecomment-667789090 @tobim Most of changes are done. I'm working on the last check. Could you confirm the current code and the updated PR description? If the last check is done and addressed your feedbac

[GitHub] [arrow] github-actions[bot] commented on pull request #7816: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-08-02 Thread GitBox
github-actions[bot] commented on pull request #7816: URL: https://github.com/apache/arrow/pull/7816#issuecomment-667789181 Revision: e27e86cdc83dede4bb70c49ac5af2fb3a0494c51 Submitted crossbow builds: [ursa-labs/crossbow @ actions-455](https://github.com/ursa-labs/crossbow/branches/a

[GitHub] [arrow] sagnikc-dremio opened a new pull request #7885: Implement round() function

2020-08-02 Thread GitBox
sagnikc-dremio opened a new pull request #7885: URL: https://github.com/apache/arrow/pull/7885 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [arrow] github-actions[bot] commented on pull request #7885: Implement round() function

2020-08-02 Thread GitBox
github-actions[bot] commented on pull request #7885: URL: https://github.com/apache/arrow/pull/7885#issuecomment-667791168 Thanks for opening a pull request! Could you open an issue for this pull request on JIRA? https://issues.apache.org/jira/browse/ARROW Then could

[GitHub] [arrow] kou commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox
kou commented on pull request #7842: URL: https://github.com/apache/arrow/pull/7842#issuecomment-667793688 @github-actions crossbow submit -g example -g linux This is an automated message from the Apache Git Service. To respo

[GitHub] [arrow] github-actions[bot] commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox
github-actions[bot] commented on pull request #7842: URL: https://github.com/apache/arrow/pull/7842#issuecomment-667794158 Revision: d34763c65d5dd69f990f97d0a0a8787f4c8c425b Submitted crossbow builds: [ursa-labs/crossbow @ actions-456](https://github.com/ursa-labs/crossbow/branches/a

[GitHub] [arrow] zacqed commented on issue #7882: Performance difference between pc.multiply vs pd.multiply

2020-08-02 Thread GitBox
zacqed commented on issue #7882: URL: https://github.com/apache/arrow/issues/7882#issuecomment-667800722 Sure, i will open JIRA and confirm. The pyarrow version is 1.0.0 This is an automated message from the Apache Git Servic

[GitHub] [arrow] projjal opened a new pull request #7886: ARROW-9622: [Java] Fixed UnsupportedOperationExceptio in complexcopier with null value in unionvector inside st…

2020-08-02 Thread GitBox
projjal opened a new pull request #7886: URL: https://github.com/apache/arrow/pull/7886 …ructvector This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [arrow] github-actions[bot] commented on pull request #7886: ARROW-9622: [Java] Fixed UnsupportedOperationException in complexcopier with null value in unionvector inside st…

2020-08-02 Thread GitBox
github-actions[bot] commented on pull request #7886: URL: https://github.com/apache/arrow/pull/7886#issuecomment-667804677 https://issues.apache.org/jira/browse/ARROW-9622 This is an automated message from the Apache Git Serv

[GitHub] [arrow] kou commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox
kou commented on pull request #7842: URL: https://github.com/apache/arrow/pull/7842#issuecomment-667805956 @github-actions crossbow submit -g linux wheel-win-* This is an automated message from the Apache Git Service. To resp

[GitHub] [arrow] github-actions[bot] commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox
github-actions[bot] commented on pull request #7842: URL: https://github.com/apache/arrow/pull/7842#issuecomment-667806486 Revision: 0cb21e889c61253ebeafde46de9989c553c62c32 Submitted crossbow builds: [ursa-labs/crossbow @ actions-457](https://github.com/ursa-labs/crossbow/branches/a

[GitHub] [arrow] emkornfield commented on issue #7882: Performance difference between pc.multiply vs pd.multiply

2020-08-02 Thread GitBox
emkornfield commented on issue #7882: URL: https://github.com/apache/arrow/issues/7882#issuecomment-667807803 Thanks, also if you are using prebuilt wheels, I think this could be due to the target compiler settings (I would guess numpy multiply has dynamic dispatch for more recent CPUs whe

[GitHub] [arrow] emkornfield commented on pull request #7816: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-08-02 Thread GitBox
emkornfield commented on pull request #7816: URL: https://github.com/apache/arrow/pull/7816#issuecomment-667815553 @github-actions crossbow submit test-conda-python-3.8-spark-master This is an automated message from the Apach

[GitHub] [arrow] github-actions[bot] commented on pull request #7816: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-08-02 Thread GitBox
github-actions[bot] commented on pull request #7816: URL: https://github.com/apache/arrow/pull/7816#issuecomment-667816017 Revision: b4e3b9d4dcf3da6c7fa3e652d5b77fc4e7abad13 Submitted crossbow builds: [ursa-labs/crossbow @ actions-458](https://github.com/ursa-labs/crossbow/branches/a

[GitHub] [arrow] kou commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox
kou commented on pull request #7842: URL: https://github.com/apache/arrow/pull/7842#issuecomment-667836959 @github-actions crossbow submit centos-* wheel-win-* This is an automated message from the Apache Git Service. To

[GitHub] [arrow] github-actions[bot] commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox
github-actions[bot] commented on pull request #7842: URL: https://github.com/apache/arrow/pull/7842#issuecomment-667837678 Revision: 5617d5b27041a8c4beba8cd4e29d0f0c5929c17d Submitted crossbow builds: [ursa-labs/crossbow @ actions-459](https://github.com/ursa-labs/crossbow/branches/a