[GitHub] [arrow] emkornfield opened a new pull request #7805: Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
emkornfield opened a new pull request #7805: URL: https://github.com/apache/arrow/pull/7805 Draft PR to enable round trip to TZ info to hopefully solve spark issues. This is an automated message from the Apache Git Service. T

[GitHub] [arrow] emkornfield commented on pull request #7805: Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
emkornfield commented on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-660844779 @github-actions crossbow submit test-conda-python-3.7-spark-master This is an automated message from the Apach

[GitHub] [arrow] jorgecarleitao opened a new pull request #7806: ARROW-9527: [Rust] Removed un-used dev dependencies.

2020-07-20 Thread GitBox
jorgecarleitao opened a new pull request #7806: URL: https://github.com/apache/arrow/pull/7806 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [arrow] emkornfield commented on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
emkornfield commented on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-660848232 @github-actions crossbow submit test-conda-python-3.7-spark-master This is an automated message from the Apach

[GitHub] [arrow] github-actions[bot] commented on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
github-actions[bot] commented on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-660848831 https://issues.apache.org/jira/browse/ARROW-9528 This is an automated message from the Apache Git Serv

[GitHub] [arrow] github-actions[bot] commented on pull request #7806: ARROW-9527: [Rust] Removed un-used dev dependencies.

2020-07-20 Thread GitBox
github-actions[bot] commented on pull request #7806: URL: https://github.com/apache/arrow/pull/7806#issuecomment-660848829 https://issues.apache.org/jira/browse/ARROW-9527 This is an automated message from the Apache Git Serv

[GitHub] [arrow] emkornfield commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
emkornfield commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457121068 ## File path: cpp/src/arrow/python/inference.cc ## @@ -332,6 +329,13 @@ class TypeInferrer { ++int_count_; } else if (PyDateTime_Check(obj))

[GitHub] [arrow] emkornfield commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
emkornfield commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457121774 ## File path: python/pyarrow/scalar.pxi ## @@ -331,7 +331,8 @@ cdef class Date64Scalar(Scalar): def as_py(self): """ -Return thi

[GitHub] [arrow] kou commented on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
kou commented on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-660855376 @github-actions crossbow submit test-conda-python-3.8-spark-master This is an automated message from the Apache Git Se

[GitHub] [arrow] github-actions[bot] commented on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
github-actions[bot] commented on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-660856056 Revision: a5b2a51665ab1383fb371ecd76bb3c20c4bf8726 Submitted crossbow builds: [ursa-labs/crossbow @ actions-433](https://github.com/ursa-labs/crossbow/branches/a

[GitHub] [arrow] kou commented on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
kou commented on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-660856402 We can use task listed only in https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml#L1930 for `crossbow submit`. We don't have `...-3.7-...` task. We only have `...-3.8-

[GitHub] [arrow] emkornfield commented on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
emkornfield commented on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-660857649 @kou 3.8 should be fine. Thank you!. I copied the command from the previous PR related to datetimes, I guess CI has changed since then. -

[GitHub] [arrow] jorgecarleitao commented on pull request #7797: ARROW-4189 [Rust] Added coverage report.

2020-07-20 Thread GitBox
jorgecarleitao commented on pull request #7797: URL: https://github.com/apache/arrow/pull/7797#issuecomment-660877250 @sunchao , I moved the coverage to run on the docker image and added reporting to codecov to github's workflow. Since coverage reporting requires a different compilat

[GitHub] [arrow] pitrou commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
pitrou commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457173202 ## File path: cpp/src/arrow/python/inference.cc ## @@ -332,6 +329,13 @@ class TypeInferrer { ++int_count_; } else if (PyDateTime_Check(obj)) {

[GitHub] [arrow] pitrou commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
pitrou commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457176423 ## File path: python/pyarrow/tests/test_pandas.py ## @@ -3325,6 +3325,21 @@ def test_cast_timestamp_unit(): assert result.equals(expected) +def test

[GitHub] [arrow] pitrou commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
pitrou commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457177694 ## File path: cpp/src/arrow/python/inference.cc ## @@ -332,6 +329,13 @@ class TypeInferrer { ++int_count_; } else if (PyDateTime_Check(obj)) {

[GitHub] [arrow] pitrou commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
pitrou commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457178228 ## File path: python/pyarrow/tests/test_pandas.py ## @@ -3325,6 +3325,21 @@ def test_cast_timestamp_unit(): assert result.equals(expected) +def test

[GitHub] [arrow] pitrou commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
pitrou commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457178426 ## File path: python/pyarrow/tests/test_pandas.py ## @@ -3325,6 +3325,21 @@ def test_cast_timestamp_unit(): assert result.equals(expected) +def test

[GitHub] [arrow] zhztheplayer commented on pull request #7030: ARROW-7808: [Java][Dataset] Implement Datasets Java API by JNI to C++

2020-07-20 Thread GitBox
zhztheplayer commented on pull request #7030: URL: https://github.com/apache/arrow/pull/7030#issuecomment-660927861 Sorry I am reconsidering whether to use JVM direct memory as a limit of native buffer allocation. By Oracle's explanation[1] about direct memory, direct memory seems only to

[GitHub] [arrow] zhztheplayer edited a comment on pull request #7030: ARROW-7808: [Java][Dataset] Implement Datasets Java API by JNI to C++

2020-07-20 Thread GitBox
zhztheplayer edited a comment on pull request #7030: URL: https://github.com/apache/arrow/pull/7030#issuecomment-660927861 Sorry I am reconsidering whether to use JVM direct memory as a limit of native buffer allocation. Technically by Oracle's explanation[1] about direct memory, direct me

[GitHub] [arrow] kszucs closed pull request #7801: ARROW-9529: [Dev][Release] Improvements to release verification scripts

2020-07-20 Thread GitBox
kszucs closed pull request #7801: URL: https://github.com/apache/arrow/pull/7801 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] kszucs commented on pull request #7800: ARROW-9524: [CI][Gandiva] Fix c++ unit test failure in Gandiva nightly build

2020-07-20 Thread GitBox
kszucs commented on pull request #7800: URL: https://github.com/apache/arrow/pull/7800#issuecomment-660948169 Thanks @projjal! This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [arrow] kszucs closed pull request #7800: ARROW-9524: [CI][Gandiva] Fix c++ unit test failure in Gandiva nightly build

2020-07-20 Thread GitBox
kszucs closed pull request #7800: URL: https://github.com/apache/arrow/pull/7800 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] kszucs commented on pull request #7799: ARROW-7136: [Rust] Added caching to the docker image

2020-07-20 Thread GitBox
kszucs commented on pull request #7799: URL: https://github.com/apache/arrow/pull/7799#issuecomment-660949359 Thanks @jorgecarleitao, it looks like a nice improvement. Currently I'm working on the next release candidate, but I'll take a look at it afterwards. -

[GitHub] [arrow] kszucs closed pull request #7792: ARROW-9509: [Release] Don't test Gandiva in the windows wheel verification script

2020-07-20 Thread GitBox
kszucs closed pull request #7792: URL: https://github.com/apache/arrow/pull/7792 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] kszucs commented on pull request #7792: ARROW-9509: [Release] Don't test Gandiva in the windows wheel verification script

2020-07-20 Thread GitBox
kszucs commented on pull request #7792: URL: https://github.com/apache/arrow/pull/7792#issuecomment-660949955 Closing in favor of https://github.com/apache/arrow/commit/83679f3b46e2c12e8f506c76323341c1d05b7d01#diff-3ebb5f8536634a43ccb884fcd453b1cdL88 --

[GitHub] [arrow] praveenbingo commented on pull request #7782: ARROW-9501: Add logic in timestampdiff() when end date is last day of…

2020-07-20 Thread GitBox
praveenbingo commented on pull request #7782: URL: https://github.com/apache/arrow/pull/7782#issuecomment-660959362 thanks @sagnikc-dremio This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [arrow] praveenbingo closed pull request #7782: ARROW-9501: Add logic in timestampdiff() when end date is last day of…

2020-07-20 Thread GitBox
praveenbingo closed pull request #7782: URL: https://github.com/apache/arrow/pull/7782 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [arrow] mr-smidge commented on pull request #7654: ARROW-8581: [C#] Accept and return DateTime from DateXXArray

2020-07-20 Thread GitBox
mr-smidge commented on pull request #7654: URL: https://github.com/apache/arrow/pull/7654#issuecomment-660971998 @eerhardt , is there a way to re-trigger build checks? The `C# / AMD64 MacOS 10.15 C# 2.2.103 (pull_request)` check failed with an unhelpful "This check failed" error message -

[GitHub] [arrow] projjal commented on a change in pull request #7641: ARROW-9328: [C++][Gandiva] Add LTRIM, RTRIM, BTRIM functions for string

2020-07-20 Thread GitBox
projjal commented on a change in pull request #7641: URL: https://github.com/apache/arrow/pull/7641#discussion_r45731 ## File path: cpp/src/gandiva/precompiled/string_ops.cc ## @@ -16,6 +16,7 @@ // under the License. // String functions +#include Review comment:

[GitHub] [arrow] projjal commented on a change in pull request #7641: ARROW-9328: [C++][Gandiva] Add LTRIM, RTRIM, BTRIM functions for string

2020-07-20 Thread GitBox
projjal commented on a change in pull request #7641: URL: https://github.com/apache/arrow/pull/7641#discussion_r457316490 ## File path: cpp/src/gandiva/precompiled/string_ops.cc ## @@ -322,6 +387,138 @@ const char* trim_utf8(gdv_int64 context, const char* data, gdv_int32 data_

[GitHub] [arrow] kszucs commented on pull request #7793: ARROW-9107: [C++][Dataset] Support temporal partitioning fields

2020-07-20 Thread GitBox
kszucs commented on pull request #7793: URL: https://github.com/apache/arrow/pull/7793#issuecomment-661050757 @ursabot benchmark --suite-filter=value-parsing This is an automated message from the Apache Git Service. To respon

[GitHub] [arrow] romainfrancois opened a new pull request #7807: ARROW-6537 [R]: Pass column_types to CSV reader

2020-07-20 Thread GitBox
romainfrancois opened a new pull request #7807: URL: https://github.com/apache/arrow/pull/7807 Either passing down NULL or a Schema. But perhaps a schema is confusing because the only thing that is being controlled by it here is the types, not their order etc .. which I believe fee

[GitHub] [arrow] github-actions[bot] commented on pull request #7807: ARROW-6537 [R]: Pass column_types to CSV reader

2020-07-20 Thread GitBox
github-actions[bot] commented on pull request #7807: URL: https://github.com/apache/arrow/pull/7807#issuecomment-661060579 https://issues.apache.org/jira/browse/ARROW-6537 This is an automated message from the Apache Git Serv

[GitHub] [arrow] emkornfield commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
emkornfield commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457421000 ## File path: cpp/src/arrow/python/inference.cc ## @@ -332,6 +329,13 @@ class TypeInferrer { ++int_count_; } else if (PyDateTime_Check(obj))

[GitHub] [arrow] emkornfield commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
emkornfield commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457422354 ## File path: python/pyarrow/tests/test_pandas.py ## @@ -3325,6 +3325,21 @@ def test_cast_timestamp_unit(): assert result.equals(expected) +def

[GitHub] [arrow] bkietz removed a comment on pull request #7793: ARROW-9107: [C++][Dataset] Support temporal partitioning fields

2020-07-20 Thread GitBox
bkietz removed a comment on pull request #7793: URL: https://github.com/apache/arrow/pull/7793#issuecomment-660406335 @ursabot benchmark diff --suite-filter=value-parsing This is an automated message from the Apache Git Servi

[GitHub] [arrow] ursabot removed a comment on pull request #7793: ARROW-9107: [C++][Dataset] Support temporal partitioning fields

2020-07-20 Thread GitBox
ursabot removed a comment on pull request #7793: URL: https://github.com/apache/arrow/pull/7793#issuecomment-660406370 [AMD64 Ubuntu 18.04 C++ Benchmark (#120194)](https://ci.ursalabs.org/#builders/73/builds/96) builder failed. Revision: 008b24cda168481b01f4caf696403e4d7358f191

[GitHub] [arrow] pitrou commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
pitrou commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457425287 ## File path: python/pyarrow/tests/test_array.py ## @@ -300,6 +301,8 @@ def test_nulls(ty): def test_array_from_scalar(): today = datetime.date.today()

[GitHub] [arrow] pitrou commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
pitrou commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457436813 ## File path: cpp/src/arrow/python/inference.cc ## @@ -332,6 +329,13 @@ class TypeInferrer { ++int_count_; } else if (PyDateTime_Check(obj)) {

[GitHub] [arrow] pitrou commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
pitrou commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457436813 ## File path: cpp/src/arrow/python/inference.cc ## @@ -332,6 +329,13 @@ class TypeInferrer { ++int_count_; } else if (PyDateTime_Check(obj)) {

[GitHub] [arrow] pitrou commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
pitrou commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457445991 ## File path: python/pyarrow/tests/test_pandas.py ## @@ -3325,6 +3325,21 @@ def test_cast_timestamp_unit(): assert result.equals(expected) +def test

[GitHub] [arrow] MosheVai commented on issue #1336: pyarrow parquet and datasets with metadata files

2020-07-20 Thread GitBox
MosheVai commented on issue #1336: URL: https://github.com/apache/arrow/issues/1336#issuecomment-661101732 @wesm I seem to run into the exact same problem is it fixed? This is an automated message from the Apache Git Service.

[GitHub] [arrow] kszucs commented on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
kszucs commented on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-661106422 My main concern with this solution is while it resolves the pandas roundtrip, the intermediate array values are different. People may "rely" on the previous buggy behavior, and I

[GitHub] [arrow] kszucs edited a comment on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
kszucs edited a comment on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-661106422 My main concern with this solution is while it resolves the pandas roundtrip, the intermediate array values are different. People may "rely" on the previous buggy behavior

[GitHub] [arrow] kszucs closed pull request #7790: ARROW-9511: [Packaging][Release] Set conda packages' build number to 0

2020-07-20 Thread GitBox
kszucs closed pull request #7790: URL: https://github.com/apache/arrow/pull/7790 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] kszucs opened a new pull request #7808: [Packaging][Release] Update conda forge dependency pins

2020-07-20 Thread GitBox
kszucs opened a new pull request #7808: URL: https://github.com/apache/arrow/pull/7808 All of the nightly conda package builds are failing with dependency resolution issues: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-20-0-azure-conda Hopefully updating

[GitHub] [arrow] kszucs commented on pull request #7808: [Packaging][Release] Update conda forge dependency pins

2020-07-20 Thread GitBox
kszucs commented on pull request #7808: URL: https://github.com/apache/arrow/pull/7808#issuecomment-661118394 @github-actions crossbow submit -g conda This is an automated message from the Apache Git Service. To respond to th

[GitHub] [arrow] emkornfield commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
emkornfield commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457510267 ## File path: cpp/src/arrow/python/inference.cc ## @@ -332,6 +329,13 @@ class TypeInferrer { ++int_count_; } else if (PyDateTime_Check(obj))

[GitHub] [arrow] emkornfield commented on a change in pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
emkornfield commented on a change in pull request #7805: URL: https://github.com/apache/arrow/pull/7805#discussion_r457510267 ## File path: cpp/src/arrow/python/inference.cc ## @@ -332,6 +329,13 @@ class TypeInferrer { ++int_count_; } else if (PyDateTime_Check(obj))

[GitHub] [arrow] github-actions[bot] commented on pull request #7808: [Packaging][Release] Update conda forge dependency pins

2020-07-20 Thread GitBox
github-actions[bot] commented on pull request #7808: URL: https://github.com/apache/arrow/pull/7808#issuecomment-661126012 Revision: 1ef88e3fc2d69ff1af46e840e0afb8c7d497f929 Submitted crossbow builds: [ursa-labs/crossbow @ actions-434](https://github.com/ursa-labs/crossbow/branches/a

[GitHub] [arrow] emkornfield commented on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
emkornfield commented on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-661127682 @kszucs Breaking users is a concern, I'll add an environment variable for both this change and the previous one that can keep the old buggy behavior. Just to clarify: was act

[GitHub] [arrow] kszucs commented on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
kszucs commented on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-661130910 > @kszucs Breaking users is a concern, I'll add an environment variable for both this change and the previous one that can keep the old buggy behavior. Just to clarify: was actuall

[GitHub] [arrow] kszucs edited a comment on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
kszucs edited a comment on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-661130910 > @kszucs Breaking users is a concern, I'll add an environment variable for both this change and the previous one that can keep the old buggy behavior. Just to clarify: was

[GitHub] [arrow] sunchao commented on pull request #7797: ARROW-4189 [Rust] Added coverage report.

2020-07-20 Thread GitBox
sunchao commented on pull request #7797: URL: https://github.com/apache/arrow/pull/7797#issuecomment-661139731 Thanks @jorgecarleitao ! IMO the compilation time is important so let's see of #7799 goes. I'll take a look later today.

[GitHub] [arrow] eerhardt commented on pull request #7654: ARROW-8581: [C#] Accept and return DateTime from DateXXArray

2020-07-20 Thread GitBox
eerhardt commented on pull request #7654: URL: https://github.com/apache/arrow/pull/7654#issuecomment-661158367 > is there a way to re-trigger build checks? In other repos I've used the "Ru-run jobs" button on the "Checks" tab: ![image](https://user-images.githubusercontent.co

[GitHub] [arrow] emkornfield commented on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
emkornfield commented on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-661160765 > It fixes that as well, just doesn't keep the old buggy behavior. I was considering to just apply the spark patch on the current master to keep the old buggy behavior, but th

[GitHub] [arrow] kszucs commented on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
kszucs commented on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-661169560 @emkornfield Thanks for working on this! In the meantime I'm going to apply the reversion patch and cut RC2 since it is going to take at least 6-8 hours to build and three a

[GitHub] [arrow] kszucs merged pull request #7802: Revert "ARROW-9223: [Python] Propagate timezone information in pandas conversion"

2020-07-20 Thread GitBox
kszucs merged pull request #7802: URL: https://github.com/apache/arrow/pull/7802 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] eerhardt commented on a change in pull request #7654: ARROW-8581: [C#] Accept and return DateTime from DateXXArray

2020-07-20 Thread GitBox
eerhardt commented on a change in pull request #7654: URL: https://github.com/apache/arrow/pull/7654#discussion_r457560950 ## File path: csharp/src/Apache.Arrow/Arrays/Date64Array.cs ## @@ -15,56 +15,94 @@ using Apache.Arrow.Types; using System; -using System.Collections.Ge

[GitHub] [arrow] kszucs commented on pull request #7808: ARROW-9531: [Packaging][Release] Update conda forge dependency pins

2020-07-20 Thread GitBox
kszucs commented on pull request #7808: URL: https://github.com/apache/arrow/pull/7808#issuecomment-661204742 @github-actions crossbow submit conda-win-* This is an automated message from the Apache Git Service. To respond to

[GitHub] [arrow] github-actions[bot] commented on pull request #7808: ARROW-9531: [Packaging][Release] Update conda forge dependency pins

2020-07-20 Thread GitBox
github-actions[bot] commented on pull request #7808: URL: https://github.com/apache/arrow/pull/7808#issuecomment-661205371 https://issues.apache.org/jira/browse/ARROW-9531 This is an automated message from the Apache Git Serv

[GitHub] [arrow] BryanCutler closed pull request #7804: [WIP][CI] Add patch for Spark integration to handle pyarrow struct arrays with tz timestamps

2020-07-20 Thread GitBox
BryanCutler closed pull request #7804: URL: https://github.com/apache/arrow/pull/7804 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [arrow] BryanCutler commented on pull request #7804: [WIP][CI] Add patch for Spark integration to handle pyarrow struct arrays with tz timestamps

2020-07-20 Thread GitBox
BryanCutler commented on pull request #7804: URL: https://github.com/apache/arrow/pull/7804#issuecomment-661207808 closing in favor of #7805 This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [arrow] github-actions[bot] commented on pull request #7808: ARROW-9531: [Packaging][Release] Update conda forge dependency pins

2020-07-20 Thread GitBox
github-actions[bot] commented on pull request #7808: URL: https://github.com/apache/arrow/pull/7808#issuecomment-661208158 Revision: b3512b033ac076a53d2bfee62a4f19d2d5394c87 Submitted crossbow builds: [ursa-labs/crossbow @ actions-435](https://github.com/ursa-labs/crossbow/branches/a

[GitHub] [arrow] BryanCutler commented on pull request #7802: Revert "ARROW-9223: [Python] Propagate timezone information in pandas conversion"

2020-07-20 Thread GitBox
BryanCutler commented on pull request #7802: URL: https://github.com/apache/arrow/pull/7802#issuecomment-661208643 Let's just verify the Spark tests pass after the reverting. @ursabot crossbow submit test-conda-python-3.8-spark-master

[GitHub] [arrow] ursabot commented on pull request #7802: Revert "ARROW-9223: [Python] Propagate timezone information in pandas conversion"

2020-07-20 Thread GitBox
ursabot commented on pull request #7802: URL: https://github.com/apache/arrow/pull/7802#issuecomment-661209149 [AMD64 Conda Crossbow Submit (#120385)](https://ci.ursalabs.org/#builders/98/builds/646) builder failed. Revision: 12840af97c9903a36877f7e494ed54fccbde1217 Clone Arro

[GitHub] [arrow] eerhardt commented on a change in pull request #7654: ARROW-8581: [C#] Accept and return DateTime from DateXXArray

2020-07-20 Thread GitBox
eerhardt commented on a change in pull request #7654: URL: https://github.com/apache/arrow/pull/7654#discussion_r457569636 ## File path: csharp/src/Apache.Arrow/Arrays/DelegatingArrayBuilder.cs ## @@ -0,0 +1,96 @@ +//

[GitHub] [arrow] BryanCutler commented on pull request #7802: Revert "ARROW-9223: [Python] Propagate timezone information in pandas conversion"

2020-07-20 Thread GitBox
BryanCutler commented on pull request #7802: URL: https://github.com/apache/arrow/pull/7802#issuecomment-661209001 @ursabot crossbow submit test-conda-python-3.8-spark-master This is an automated message from the Apache Git S

[GitHub] [arrow] BryanCutler commented on pull request #7802: Revert "ARROW-9223: [Python] Propagate timezone information in pandas conversion"

2020-07-20 Thread GitBox
BryanCutler commented on pull request #7802: URL: https://github.com/apache/arrow/pull/7802#issuecomment-661210665 @kszucs is there a way to kick off Spark integration tests right now on master? This is an automated message

[GitHub] [arrow] sbinet commented on pull request #7752: ARROW-9462:[Go] The Indentation after the first Record in arrjson writer is incorrect

2020-07-20 Thread GitBox
sbinet commented on pull request #7752: URL: https://github.com/apache/arrow/pull/7752#issuecomment-661234225 (apologies: I don't get notifications when a commit is force-pushed, and also I am on holidays with spotty internet access) I'd say just create a minimal dataset to go through th

[GitHub] [arrow] BryanCutler commented on pull request #7805: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-07-20 Thread GitBox
BryanCutler commented on pull request #7805: URL: https://github.com/apache/arrow/pull/7805#issuecomment-661238238 Just to clarify things, is the main concern with this patch over keeping the previous buggy behavior? Besides that are these changes producing correct results and passing roun

[GitHub] [arrow] andygrove opened a new pull request #7809: ARROW-9534: [Rust] [DataFusion] Add functions to create literal expressions

2020-07-20 Thread GitBox
andygrove opened a new pull request #7809: URL: https://github.com/apache/arrow/pull/7809 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [arrow] kszucs commented on pull request #7808: ARROW-9531: [Packaging][Release] Update conda forge dependency pins

2020-07-20 Thread GitBox
kszucs commented on pull request #7808: URL: https://github.com/apache/arrow/pull/7808#issuecomment-661255732 The windows failures must be caused by the recent CF dependency updates (at least setuptools has a different build hash). They are not mandatory for the release, so +1. --

[GitHub] [arrow] andygrove commented on pull request #7798: ARROW-9523 [Rust] Improve filter kernel performance

2020-07-20 Thread GitBox
andygrove commented on pull request #7798: URL: https://github.com/apache/arrow/pull/7798#issuecomment-661255507 @yordan-pavlov This is exciting! I will start reviewing this later today. This is an automated message from the

[GitHub] [arrow] kszucs edited a comment on pull request #7808: ARROW-9531: [Packaging][Release] Update conda forge dependency pins

2020-07-20 Thread GitBox
kszucs edited a comment on pull request #7808: URL: https://github.com/apache/arrow/pull/7808#issuecomment-661255732 The windows failures must be caused by the recent CF dependency updates (at least setuptools has a different build hash). cc @xhochy They are not mandatory for the r

[GitHub] [arrow] kszucs closed pull request #7808: ARROW-9531: [Packaging][Release] Update conda forge dependency pins

2020-07-20 Thread GitBox
kszucs closed pull request #7808: URL: https://github.com/apache/arrow/pull/7808 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] andygrove closed pull request #7795: ARROW-9519 [Rust] Improved error message when getting a field by name.

2020-07-20 Thread GitBox
andygrove closed pull request #7795: URL: https://github.com/apache/arrow/pull/7795 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] andygrove closed pull request #7806: ARROW-9527: [Rust] Removed un-used dev dependencies.

2020-07-20 Thread GitBox
andygrove closed pull request #7806: URL: https://github.com/apache/arrow/pull/7806 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] kszucs commented on pull request #7802: Revert "ARROW-9223: [Python] Propagate timezone information in pandas conversion"

2020-07-20 Thread GitBox
kszucs commented on pull request #7802: URL: https://github.com/apache/arrow/pull/7802#issuecomment-661257796 @BryanCutler I already submitted them, the spark tests are still running https://github.com/ursa-labs/crossbow/branches/all?query=build-871 ---

[GitHub] [arrow] github-actions[bot] commented on pull request #7809: ARROW-9534: [Rust] [DataFusion] Add functions to create literal expressions

2020-07-20 Thread GitBox
github-actions[bot] commented on pull request #7809: URL: https://github.com/apache/arrow/pull/7809#issuecomment-661260249 https://issues.apache.org/jira/browse/ARROW-9534 This is an automated message from the Apache Git Serv

[GitHub] [arrow] xhochy commented on a change in pull request #7808: ARROW-9531: [Packaging][Release] Update conda forge dependency pins

2020-07-20 Thread GitBox
xhochy commented on a change in pull request #7808: URL: https://github.com/apache/arrow/pull/7808#discussion_r457615350 ## File path: dev/tasks/conda-recipes/azure.win.yml ## @@ -34,11 +34,10 @@ jobs: - task: CondaEnvironment@1 inputs: -packageSpecs: 'pyt

[GitHub] [arrow] andygrove commented on pull request #7809: ARROW-9534: [Rust] [DataFusion] Add functions to create literal expressions

2020-07-20 Thread GitBox
andygrove commented on pull request #7809: URL: https://github.com/apache/arrow/pull/7809#issuecomment-661264618 @jorgecarleitao fyi This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [arrow] xhochy opened a new pull request #7810: WIP: Verbose Windows build

2020-07-20 Thread GitBox
xhochy opened a new pull request #7810: URL: https://github.com/apache/arrow/pull/7810 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [arrow] kszucs commented on pull request #7802: Revert "ARROW-9223: [Python] Propagate timezone information in pandas conversion"

2020-07-20 Thread GitBox
kszucs commented on pull request #7802: URL: https://github.com/apache/arrow/pull/7802#issuecomment-661269532 @BryanCutler seems like the spark tests are passing with the current master. This is an automated message from the

[GitHub] [arrow] xhochy commented on pull request #7810: WIP: Verbose Windows build

2020-07-20 Thread GitBox
xhochy commented on pull request #7810: URL: https://github.com/apache/arrow/pull/7810#issuecomment-661270079 @github-actions crossbow submit conda-win-vs2017-py36 This is an automated message from the Apache Git Service. To

[GitHub] [arrow] github-actions[bot] commented on pull request #7810: WIP: Verbose Windows build

2020-07-20 Thread GitBox
github-actions[bot] commented on pull request #7810: URL: https://github.com/apache/arrow/pull/7810#issuecomment-661271016 Revision: 621022a99122277494b14693dd085b61ee02d1cb Submitted crossbow builds: [ursa-labs/crossbow @ actions-436](https://github.com/ursa-labs/crossbow/branches/a

[GitHub] [arrow] jorgecarleitao commented on pull request #7809: ARROW-9534: [Rust] [DataFusion] Add functions to create literal expressions

2020-07-20 Thread GitBox
jorgecarleitao commented on pull request #7809: URL: https://github.com/apache/arrow/pull/7809#issuecomment-661276604 Nice! I just needed this in my ballista's PR! following [this SO answer](https://stackoverflow.com/a/40776087/931303), what do you think of ``` trait Litera

[GitHub] [arrow] andygrove commented on pull request #7809: ARROW-9534: [Rust] [DataFusion] Add functions to create literal expressions

2020-07-20 Thread GitBox
andygrove commented on pull request #7809: URL: https://github.com/apache/arrow/pull/7809#issuecomment-661283955 @jorgecarleitao Oh, that is much nicer. Do you want to PR that and I'll close this one? This is an automated me

[GitHub] [arrow] jorgecarleitao commented on pull request #7809: ARROW-9534: [Rust] [DataFusion] Add functions to create literal expressions

2020-07-20 Thread GitBox
jorgecarleitao commented on pull request #7809: URL: https://github.com/apache/arrow/pull/7809#issuecomment-661286169 I can take it. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [arrow] patrickpai commented on pull request #7789: PARQUET-1878: [C++] lz4 codec is not compatible with Hadoop Lz4Codec

2020-07-20 Thread GitBox
patrickpai commented on pull request #7789: URL: https://github.com/apache/arrow/pull/7789#issuecomment-661292801 Does anyone know if I'm supposed to be able to see logs for failing checks? When I view the details for a failing check, I can't see any error messages to help figure out what

[GitHub] [arrow] kszucs commented on a change in pull request #7808: ARROW-9531: [Packaging][Release] Update conda forge dependency pins

2020-07-20 Thread GitBox
kszucs commented on a change in pull request #7808: URL: https://github.com/apache/arrow/pull/7808#discussion_r457650256 ## File path: dev/tasks/conda-recipes/azure.win.yml ## @@ -34,11 +34,10 @@ jobs: - task: CondaEnvironment@1 inputs: -packageSpecs: 'pyt

[GitHub] [arrow] andygrove closed pull request #7809: ARROW-9534: [Rust] [DataFusion] Add functions to create literal expressions

2020-07-20 Thread GitBox
andygrove closed pull request #7809: URL: https://github.com/apache/arrow/pull/7809 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] BryanCutler commented on pull request #7802: Revert "ARROW-9223: [Python] Propagate timezone information in pandas conversion"

2020-07-20 Thread GitBox
BryanCutler commented on pull request #7802: URL: https://github.com/apache/arrow/pull/7802#issuecomment-661296416 great, thanks @kszucs ! This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [arrow] kszucs commented on pull request #7782: ARROW-9501: Add logic in timestampdiff() when end date is last day of…

2020-07-20 Thread GitBox
kszucs commented on pull request #7782: URL: https://github.com/apache/arrow/pull/7782#issuecomment-661305131 @praveenbingo please don't forget to add the relevant components `[C++][Gandiva]` to the pull request's title. Thi

[GitHub] [arrow] jorgecarleitao opened a new pull request #7811: ARROW-9534: [Rust] [DataFusion] Added support for lit to all supported rust types.

2020-07-20 Thread GitBox
jorgecarleitao opened a new pull request #7811: URL: https://github.com/apache/arrow/pull/7811 @andygrove fyi This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [arrow] jorgecarleitao commented on a change in pull request #7811: ARROW-9534: [Rust] [DataFusion] Added support for lit to all supported rust types.

2020-07-20 Thread GitBox
jorgecarleitao commented on a change in pull request #7811: URL: https://github.com/apache/arrow/pull/7811#discussion_r457663076 ## File path: rust/datafusion/src/logicalplan.rs ## @@ -378,9 +378,44 @@ pub fn col(name: &str) -> Expr { Expr::UnresolvedColumn(name.to_owned()

[GitHub] [arrow] andygrove commented on pull request #7812: ARROW-9507: [Rust] [DataFusion] Implement Display for PhysicalExpr

2020-07-20 Thread GitBox
andygrove commented on pull request #7812: URL: https://github.com/apache/arrow/pull/7812#issuecomment-661308588 fyi @jorgecarleitao This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [arrow] andygrove opened a new pull request #7812: ARROW-9507: [Rust] [DataFusion] Implement Display for PhysicalExpr

2020-07-20 Thread GitBox
andygrove opened a new pull request #7812: URL: https://github.com/apache/arrow/pull/7812 This allows physical expressions to be printed in a human-readable form and is a step towards a printable physical plan. This is an au

[GitHub] [arrow] github-actions[bot] commented on pull request #7812: ARROW-9507: [Rust] [DataFusion] Implement Display for PhysicalExpr

2020-07-20 Thread GitBox
github-actions[bot] commented on pull request #7812: URL: https://github.com/apache/arrow/pull/7812#issuecomment-661311089 https://issues.apache.org/jira/browse/ARROW-9507 This is an automated message from the Apache Git Serv

  1   2   >