[GitHub] [arrow] martin-liu commented on pull request #13402: MINOR: [Python] Fix pandas conversion failure when using non-str index name

2022-06-22 Thread GitBox
martin-liu commented on PR #13402: URL: https://github.com/apache/arrow/pull/13402#issuecomment-1164017683 @lidavidm Got it, using warning makes sense to me, I added warning for non-str index name following the mixed type warning pattern, do you think that's good enough? -- This is an

[GitHub] [arrow-rs] viirya commented on a diff in pull request #1914: Add Decimal256 API

2022-06-22 Thread GitBox
viirya commented on code in PR #1914: URL: https://github.com/apache/arrow-rs/pull/1914#discussion_r904613522 ## arrow/src/util/decimal.rs: ## @@ -17,124 +17,279 @@ //! Decimal related utils -use std::cmp::Ordering; +use crate::error::{ArrowError, Result}; +use num::bigint:

[GitHub] [arrow-rs] HaoYang670 commented on a diff in pull request #1914: Add Decimal256 API

2022-06-22 Thread GitBox
HaoYang670 commented on code in PR #1914: URL: https://github.com/apache/arrow-rs/pull/1914#discussion_r904601961 ## arrow/src/util/decimal.rs: ## @@ -17,124 +17,279 @@ //! Decimal related utils -use std::cmp::Ordering; +use crate::error::{ArrowError, Result}; +use num::big

[GitHub] [arrow] kou commented on pull request #13150: ARROW-16549: [C++] Simplify AggregateNodeOptions aggregates/targets

2022-06-22 Thread GitBox
kou commented on PR #13150: URL: https://github.com/apache/arrow/pull/13150#issuecomment-1163971988 Done. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

[GitHub] [arrow-datafusion] codecov-commenter commented on pull request #2775: Support multiple paths for ListingTableScanNode

2022-06-22 Thread GitBox
codecov-commenter commented on PR #2775: URL: https://github.com/apache/arrow-datafusion/pull/2775#issuecomment-1163930449 # [Codecov](https://codecov.io/gh/apache/arrow-datafusion/pull/2775?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_

[GitHub] [arrow-datafusion] Ted-Jiang opened a new pull request, #2775: Support multiple paths for ListingTableScanNode

2022-06-22 Thread GitBox
Ted-Jiang opened a new pull request, #2775: URL: https://github.com/apache/arrow-datafusion/pull/2775 # Which issue does this PR close? Closes #2768. # Rationale for this change Sometimes like in ballista we need pass multi-path in `ListingTableScanNode `, like in spark

[GitHub] [arrow-datafusion] liukun4515 commented on a diff in pull request #2764: support decimal for inlist expr

2022-06-22 Thread GitBox
liukun4515 commented on code in PR #2764: URL: https://github.com/apache/arrow-datafusion/pull/2764#discussion_r904499674 ## datafusion/physical-expr/src/planner.rs: ## @@ -310,6 +313,8 @@ pub fn create_physical_expr( &list_expr_data_type,

[GitHub] [arrow-datafusion] liukun4515 closed issue #2774: InList: Can't cast the list expr data type to value expr data type directly

2022-06-22 Thread GitBox
liukun4515 closed issue #2774: InList: Can't cast the list expr data type to value expr data type directly URL: https://github.com/apache/arrow-datafusion/issues/2774 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [arrow-datafusion] liukun4515 commented on issue #2774: InList: Can't cast the list expr data type to value expr data type directly

2022-06-22 Thread GitBox
liukun4515 commented on issue #2774: URL: https://github.com/apache/arrow-datafusion/issues/2774#issuecomment-1163905413 duplicated issue about https://github.com/apache/arrow-datafusion/issues/2759 -- This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [arrow-datafusion] liukun4515 opened a new issue, #2774: InList: Can't cast the list expr data type to value expr data type directly

2022-06-22 Thread GitBox
liukun4515 opened a new issue, #2774: URL: https://github.com/apache/arrow-datafusion/issues/2774 **Describe the bug** In this pr and comment, we find a bug about data type coercion for the Inlist expr https://github.com/apache/arrow-datafusion/pull/2764/files#r904495595 **To Re

[GitHub] [arrow-datafusion] liukun4515 commented on a diff in pull request #2764: support decimal for inlist expr

2022-06-22 Thread GitBox
liukun4515 commented on code in PR #2764: URL: https://github.com/apache/arrow-datafusion/pull/2764#discussion_r904495595 ## datafusion/physical-expr/src/planner.rs: ## @@ -310,6 +313,8 @@ pub fn create_physical_expr( &list_expr_data_type,

[GitHub] [arrow-rs] codecov-commenter commented on pull request #1924: MINOR: Replace `checked_add/sub().unwrap()` with `+/-`

2022-06-22 Thread GitBox
codecov-commenter commented on PR #1924: URL: https://github.com/apache/arrow-rs/pull/1924#issuecomment-1163886204 # [Codecov](https://codecov.io/gh/apache/arrow-rs/pull/1924?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+S

[GitHub] [arrow-rs] HaoYang670 commented on a diff in pull request #1914: Add Decimal256 API

2022-06-22 Thread GitBox
HaoYang670 commented on code in PR #1914: URL: https://github.com/apache/arrow-rs/pull/1914#discussion_r904483995 ## arrow/src/util/decimal.rs: ## @@ -17,124 +17,280 @@ //! Decimal related utils -use std::cmp::Ordering; +use crate::error::{ArrowError, Result}; +use num::big

[GitHub] [arrow-datafusion] liukun4515 commented on pull request #2764: support decimal for inlist expr

2022-06-22 Thread GitBox
liukun4515 commented on PR #2764: URL: https://github.com/apache/arrow-datafusion/pull/2764#issuecomment-1163879871 @alamb @andygrove @viirya PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [arrow-rs] HaoYang670 opened a new pull request, #1924: MINOR: Replace `checked_add(sub).unwrap()` with `+(-)`

2022-06-22 Thread GitBox
HaoYang670 opened a new pull request, #1924: URL: https://github.com/apache/arrow-rs/pull/1924 Signed-off-by: remzi <1371656737...@gmail.com> # Which issue does this PR close? None. Related to #1918. # Are there any user-facing changes? No. -- This is an automat

[GitHub] [arrow-rs] liyongjing commented on issue #1915: incompatible arrow schema, expected struct got List

2022-06-22 Thread GitBox
liyongjing commented on issue #1915: URL: https://github.com/apache/arrow-rs/issues/1915#issuecomment-1163873174 It looks incompatible that read/write category and filter message type using arrow high-level api -- This is an automated message from the Apache Git Service. To respond to th

[GitHub] [arrow] vibhatha commented on pull request #13150: ARROW-16549: [C++] Simplify AggregateNodeOptions aggregates/targets

2022-06-22 Thread GitBox
vibhatha commented on PR #13150: URL: https://github.com/apache/arrow/pull/13150#issuecomment-1163869893 @kou need some help with the C-Glib, when I rebased I tried to fix it, but didn't succeed. Appreciate your help. -- This is an automated message from the Apache Git Service. To respon

[GitHub] [arrow-rs] liukun4515 commented on a diff in pull request #1922: Support casting `NULL` to/from `Decimal`

2022-06-22 Thread GitBox
liukun4515 commented on code in PR #1922: URL: https://github.com/apache/arrow-rs/pull/1922#discussion_r904473324 ## arrow/src/compute/kernels/cast.rs: ## @@ -72,9 +72,9 @@ pub fn can_cast_types(from_type: &DataType, to_type: &DataType) -> bool { // cast one decimal ty

[GitHub] [arrow-rs] liukun4515 commented on a diff in pull request #1922: Support casting `NULL` to/from `Decimal`

2022-06-22 Thread GitBox
liukun4515 commented on code in PR #1922: URL: https://github.com/apache/arrow-rs/pull/1922#discussion_r904472049 ## arrow/src/compute/kernels/cast.rs: ## @@ -72,9 +72,9 @@ pub fn can_cast_types(from_type: &DataType, to_type: &DataType) -> bool { // cast one decimal ty

[GitHub] [arrow-datafusion] liukun4515 commented on issue #2759: InList Expr: expr and list values must can be converted to a same data type

2022-06-22 Thread GitBox
liukun4515 commented on issue #2759: URL: https://github.com/apache/arrow-datafusion/issues/2759#issuecomment-1163865423 In the spark, we can't compare decimal with boolean, but can compare decimal with Null. ``` spark-sql> DESC T1; c1 decimal(10,3) spar

[GitHub] [arrow-datafusion] liukun4515 opened a new issue, #2773: InList: don't need to treat Null as UTF8 data type

2022-06-22 Thread GitBox
liukun4515 opened a new issue, #2773: URL: https://github.com/apache/arrow-datafusion/issues/2773 From this test case, we can know that we should not treat Null as UTF8 data type _Originally posted by @liukun4515 in https://github.com/apache/arrow-datafusion/pull/2764#discussion_r904

[GitHub] [arrow-rs] viirya commented on a diff in pull request #1922: Support casting `NULL` to/from `Decimal`

2022-06-22 Thread GitBox
viirya commented on code in PR #1922: URL: https://github.com/apache/arrow-rs/pull/1922#discussion_r904468878 ## arrow/src/compute/kernels/cast.rs: ## @@ -72,9 +72,9 @@ pub fn can_cast_types(from_type: &DataType, to_type: &DataType) -> bool { // cast one decimal type t

[GitHub] [arrow-datafusion] liukun4515 commented on a diff in pull request #2764: support decimal for inlist expr

2022-06-22 Thread GitBox
liukun4515 commented on code in PR #2764: URL: https://github.com/apache/arrow-datafusion/pull/2764#discussion_r904468132 ## datafusion/physical-expr/src/expressions/in_list.rs: ## @@ -765,35 +909,38 @@ mod tests { list, &true, vec![Some(fa

[GitHub] [arrow-datafusion] liukun4515 commented on a diff in pull request #2764: support decimal for inlist expr

2022-06-22 Thread GitBox
liukun4515 commented on code in PR #2764: URL: https://github.com/apache/arrow-datafusion/pull/2764#discussion_r904467559 ## datafusion/physical-expr/src/expressions/in_list.rs: ## @@ -765,35 +909,38 @@ mod tests { list, &true, vec![Some(fa

[GitHub] [arrow-rs] liukun4515 commented on pull request #1922: Support casting `NULL` to/from `Decimal`

2022-06-22 Thread GitBox
liukun4515 commented on PR #1922: URL: https://github.com/apache/arrow-rs/pull/1922#issuecomment-1163857942 Please hold this pr can don't merge it. I think we need to discuss some rules about casting. @alamb @viirya -- This is an automated message from the Apache Git Service. To res

[GitHub] [arrow-rs] liukun4515 commented on a diff in pull request #1922: Support casting `NULL` to/from `Decimal`

2022-06-22 Thread GitBox
liukun4515 commented on code in PR #1922: URL: https://github.com/apache/arrow-rs/pull/1922#discussion_r904460828 ## arrow/src/compute/kernels/cast.rs: ## @@ -72,9 +72,9 @@ pub fn can_cast_types(from_type: &DataType, to_type: &DataType) -> bool { // cast one decimal ty

[GitHub] [arrow-rs] liukun4515 commented on a diff in pull request #1922: Support casting `NULL` to/from `Decimal`

2022-06-22 Thread GitBox
liukun4515 commented on code in PR #1922: URL: https://github.com/apache/arrow-rs/pull/1922#discussion_r904459539 ## arrow/src/compute/kernels/cast.rs: ## @@ -72,9 +72,9 @@ pub fn can_cast_types(from_type: &DataType, to_type: &DataType) -> bool { // cast one decimal ty

[GitHub] [arrow] wjones127 commented on a diff in pull request #13404: ARROW-16510: [R] Add bindings for GCS filesystem

2022-06-22 Thread GitBox
wjones127 commented on code in PR #13404: URL: https://github.com/apache/arrow/pull/13404#discussion_r904458342 ## r/configure.win: ## @@ -104,6 +105,10 @@ function configure_dev() { PKG_CFLAGS="$PKG_CFLAGS -DARROW_R_WITH_S3" fi + if [ $(cmake_option ARROW_GCS) -eq 1

[GitHub] [arrow-rs] liukun4515 commented on a diff in pull request #1922: Support casting `NULL` to/from `Decimal`

2022-06-22 Thread GitBox
liukun4515 commented on code in PR #1922: URL: https://github.com/apache/arrow-rs/pull/1922#discussion_r904455248 ## arrow/src/compute/kernels/cast.rs: ## @@ -72,9 +72,9 @@ pub fn can_cast_types(from_type: &DataType, to_type: &DataType) -> bool { // cast one decimal ty

[GitHub] [arrow-rs] liukun4515 commented on a diff in pull request #1922: Support casting `NULL` to/from `Decimal`

2022-06-22 Thread GitBox
liukun4515 commented on code in PR #1922: URL: https://github.com/apache/arrow-rs/pull/1922#discussion_r904454454 ## arrow/src/compute/kernels/cast.rs: ## @@ -72,9 +72,9 @@ pub fn can_cast_types(from_type: &DataType, to_type: &DataType) -> bool { // cast one decimal ty

[GitHub] [arrow-rs] liukun4515 commented on a diff in pull request #1922: Support casting `NULL` to/from `Decimal`

2022-06-22 Thread GitBox
liukun4515 commented on code in PR #1922: URL: https://github.com/apache/arrow-rs/pull/1922#discussion_r904454454 ## arrow/src/compute/kernels/cast.rs: ## @@ -72,9 +72,9 @@ pub fn can_cast_types(from_type: &DataType, to_type: &DataType) -> bool { // cast one decimal ty

[GitHub] [arrow-datafusion] AssHero commented on a diff in pull request #2721: Add additional data types are supported in hash join

2022-06-22 Thread GitBox
AssHero commented on code in PR #2721: URL: https://github.com/apache/arrow-datafusion/pull/2721#discussion_r90409 ## datafusion/core/src/physical_plan/hash_join.rs: ## @@ -947,6 +951,58 @@ macro_rules! equal_rows_elem { }}; } +macro_rules! equal_rows_elem_with_strin

[GitHub] [arrow] kou commented on pull request #13404: ARROW-16510: [R] Add bindings for GCS filesystem

2022-06-22 Thread GitBox
kou commented on PR #13404: URL: https://github.com/apache/arrow/pull/13404#issuecomment-1163815653 We need to define `CURL_STATICLIB` on building google-cloud-cpp not Apache Arrow C++. But CMake's bundled `FindCURL.cmake` doesn't support `CURL_STATICLIB`: https://gitlab.kitware.com/cmake/c

[GitHub] [arrow] wjones127 commented on pull request #12775: ARROW-16006: [C++] Row conversion helpers and example

2022-06-22 Thread GitBox
wjones127 commented on PR #12775: URL: https://github.com/apache/arrow/pull/12775#issuecomment-1163809159 > Do we also want to put the example in the Cookbook somehow? I feel like it's a bit too long/involved to go there directly, but maybe we can cross-reference it. Yeah, I can crea

[GitHub] [arrow] alexdesiqueira commented on pull request #13144: ARROW-16356: [Python] Expose RandomAccessFile::GetStream

2022-06-22 Thread GitBox
alexdesiqueira commented on PR #13144: URL: https://github.com/apache/arrow/pull/13144#issuecomment-1163802255 I'm back @pitrou :slightly_smiling_face: For these tests, I'm trying to emulate [cpp/src/arrow/io/memory_test.cc:320](https://github.com/apache/arrow/blob/8daa7a4ed5629c0020dadf

[GitHub] [arrow] kou commented on issue #13422: Building C++ for M1 Macs

2022-06-22 Thread GitBox
kou commented on issue #13422: URL: https://github.com/apache/arrow/issues/13422#issuecomment-1163794297 It seems that we can build binaries for M1 Mac by specifying `-target arm64-apple-macos11` to `clang++`: https://developer.apple.com/documentation/apple-silicon/building-a-universal-maco

[GitHub] [arrow] djnavarro commented on pull request #12154: ARROW-14821: [R] Implement bindings for lubridate's floor_date, ceiling_date, and round_date

2022-06-22 Thread GitBox
djnavarro commented on PR #12154: URL: https://github.com/apache/arrow/pull/12154#issuecomment-1163791002 @rok - not at all. please do! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [arrow] kou commented on a diff in pull request #13386: ARROW-13388 [C++][Parquet] Enable DELTA_LENGTH_BYTE_ARRAY decoder

2022-06-22 Thread GitBox
kou commented on code in PR #13386: URL: https://github.com/apache/arrow/pull/13386#discussion_r904239076 ## cpp/src/parquet/reader_test.cc: ## @@ -127,6 +130,85 @@ void CheckRowGroupMetadata(const RowGroupMetaData* rg_metadata, } } +class TestTextDeltaLengthByteArray : p

[GitHub] [arrow] kou merged pull request #13377: ARROW-14518: [Ruby] Add support for Arrow::Array.new([BigDecimal])

2022-06-22 Thread GitBox
kou merged PR #13377: URL: https://github.com/apache/arrow/pull/13377 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.or

[GitHub] [arrow-datafusion] andygrove commented on a diff in pull request #2772: Remove expr_sub_expressions and rewrite_expression functions

2022-06-22 Thread GitBox
andygrove commented on code in PR #2772: URL: https://github.com/apache/arrow-datafusion/pull/2772#discussion_r904404984 ## datafusion/core/src/physical_optimizer/pruning.rs: ## @@ -553,22 +553,33 @@ fn is_compare_op(op: Operator) -> bool { /// replaces a column with an old n

[GitHub] [arrow] kou commented on pull request #13377: ARROW-14518: [Ruby] Add support for Arrow::Array.new([BigDecimal])

2022-06-22 Thread GitBox
kou commented on PR #13377: URL: https://github.com/apache/arrow/pull/13377#issuecomment-1163778275 +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

[GitHub] [arrow] lidavidm commented on pull request #12775: ARROW-16006: [C++] Row conversion helpers and example

2022-06-22 Thread GitBox
lidavidm commented on PR #12775: URL: https://github.com/apache/arrow/pull/12775#issuecomment-1163777325 Do we also want to put the example in the Cookbook somehow? I feel like it's a bit too long/involved to go there directly, but maybe we can cross-reference it. -- This is an automated

[GitHub] [arrow] lidavidm commented on a diff in pull request #12775: ARROW-16006: [C++] Row conversion helpers and example

2022-06-22 Thread GitBox
lidavidm commented on code in PR #12775: URL: https://github.com/apache/arrow/pull/12775#discussion_r904402488 ## cpp/examples/arrow/rapidjson_row_converter.cc: ## @@ -0,0 +1,618 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license ag

[GitHub] [arrow] wjones127 commented on a diff in pull request #13404: ARROW-16510: [R] Add bindings for GCS filesystem

2022-06-22 Thread GitBox
wjones127 commented on code in PR #13404: URL: https://github.com/apache/arrow/pull/13404#discussion_r904397786 ## r/configure.win: ## @@ -104,6 +105,10 @@ function configure_dev() { PKG_CFLAGS="$PKG_CFLAGS -DARROW_R_WITH_S3" fi + if [ $(cmake_option ARROW_GCS) -eq 1

[GitHub] [arrow] lidavidm commented on a diff in pull request #13109: ARROW-15365: [Python] Expose full cast options in the pyarrow.compute.cast function

2022-06-22 Thread GitBox
lidavidm commented on code in PR #13109: URL: https://github.com/apache/arrow/pull/13109#discussion_r904379120 ## python/pyarrow/_compute.pyx: ## @@ -2198,7 +2198,14 @@ cdef class Expression(_Weakrefable): --- cast : Expression """ -options

[GitHub] [arrow] lidavidm commented on pull request #13402: MINOR: [Python] Fix pandas conversion failure when using non-str index name

2022-06-22 Thread GitBox
lidavidm commented on PR #13402: URL: https://github.com/apache/arrow/pull/13402#issuecomment-1163754740 I think it doesn't work for mixed type, you should probably see a warning? Regardless that was my original point - if it doesn't fully round-trip it's not _necessarily_ a problem I

[GitHub] [arrow-datafusion] comphead commented on issue #2450: Preserve Element Name in ScalarValue::List

2022-06-22 Thread GitBox
comphead commented on issue #2450: URL: https://github.com/apache/arrow-datafusion/issues/2450#issuecomment-1163751034 @tustvold for the test, which was before. This represents roundtrip for the list ``` ScalarValue::List( Some(vec![

[GitHub] [arrow] martin-liu commented on pull request #13402: MINOR: [Python] Fix pandas conversion failure when using non-str index name

2022-06-22 Thread GitBox
martin-liu commented on PR #13402: URL: https://github.com/apache/arrow/pull/13402#issuecomment-1163722508 @lidavidm After some debug, it seems like existing code has bug regarding column names, see below example: ```python >>> import pandas as pd >>> import pyarrow as pa

[GitHub] [arrow] martin-liu commented on a diff in pull request #13402: MINOR: [Python] Fix pandas conversion failure when using non-str index name

2022-06-22 Thread GitBox
martin-liu commented on code in PR #13402: URL: https://github.com/apache/arrow/pull/13402#discussion_r904343035 ## python/pyarrow/tests/test_pandas.py: ## @@ -149,6 +149,12 @@ def test_non_string_columns(self): table = pa.Table.from_pandas(df) assert table.fie

[GitHub] [arrow-rs] viirya commented on pull request #1914: Add Decimal256 API

2022-06-22 Thread GitBox
viirya commented on PR #1914: URL: https://github.com/apache/arrow-rs/pull/1914#issuecomment-1163659143 Seems some unrelated errors in interop test between Go and C#: ``` # FAILURES # FAILED TEST: datetime Go producing, C# consuming 1 failures

[GitHub] [arrow] wjones127 commented on pull request #13404: ARROW-16510: [R] Add bindings for GCS filesystem

2022-06-22 Thread GitBox
wjones127 commented on PR #13404: URL: https://github.com/apache/arrow/pull/13404#issuecomment-1163658023 (I created docs follow up: https://issues.apache.org/jira/browse/ARROW-16887) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [arrow] jeroen commented on pull request #13404: ARROW-16510: [R] Add bindings for GCS filesystem

2022-06-22 Thread GitBox
jeroen commented on PR #13404: URL: https://github.com/apache/arrow/pull/13404#issuecomment-1163655426 I think `find_package()` is supposed to shell out to `pkg-config --cflags libcurl` and `pkg-config --libs libcurl` which should automatically include the macro and static libraries when ne

[GitHub] [arrow] nealrichardson commented on pull request #13404: ARROW-16510: [R] Add bindings for GCS filesystem

2022-06-22 Thread GitBox
nealrichardson commented on PR #13404: URL: https://github.com/apache/arrow/pull/13404#issuecomment-1163637187 For the R Windows packages, I need to use a static libcurl, and stack overflow tells me that I need to define `CURL_STATICLIB` for the google-cloud-cpp build. (The thing I just pus

[GitHub] [arrow] Yuhta commented on issue #13367: How to build without PIC

2022-06-22 Thread GitBox
Yuhta commented on issue #13367: URL: https://github.com/apache/arrow/issues/13367#issuecomment-1163616382 https://issues.apache.org/jira/browse/ARROW-16886 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [arrow] Johnnathanalmeida commented on pull request #13421: ARROW-16881: [Gandiva][C++] Fix castINTERVALYEAR implementation

2022-06-22 Thread GitBox
Johnnathanalmeida commented on PR #13421: URL: https://github.com/apache/arrow/pull/13421#issuecomment-1163616250 @github-actions crossbow submit java-jars -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [arrow] arjunsr1 commented on issue #13396: Is the Arrow::Table.merge function in a working state?

2022-06-22 Thread GitBox
arjunsr1 commented on issue #13396: URL: https://github.com/apache/arrow/issues/13396#issuecomment-1163632271 This works- thanks! I'll close the issue then -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [arrow] github-actions[bot] commented on pull request #13421: ARROW-16881: [Gandiva][C++] Fix castINTERVALYEAR implementation

2022-06-22 Thread GitBox
github-actions[bot] commented on PR #13421: URL: https://github.com/apache/arrow/pull/13421#issuecomment-1163621089 Revision: 8438196a8b0f812e04acb496b7b7f81e9581aa07 Submitted crossbow builds: [ursacomputing/crossbow @ actions-a4b2411d59](https://github.com/ursacomputing/crossbow/bra

[GitHub] [arrow] arjunsr1 closed issue #13396: Is the Arrow::Table.merge function in a working state?

2022-06-22 Thread GitBox
arjunsr1 closed issue #13396: Is the Arrow::Table.merge function in a working state? URL: https://github.com/apache/arrow/issues/13396 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [arrow] kou commented on issue #13396: Is the Arrow::Table.merge function in a working state?

2022-06-22 Thread GitBox
kou commented on issue #13396: URL: https://github.com/apache/arrow/issues/13396#issuecomment-1163596808 Could you use the former code in https://github.com/apache/arrow/issues/13396#issuecomment-1162676527 for now? We'll release a new version in 2022-07 or 2022-08. See also: Preparing

[GitHub] [arrow] kou merged pull request #13418: ARROW-16875: [Ruby] Add Column#cast and ChunkedArray#cast

2022-06-22 Thread GitBox
kou merged PR #13418: URL: https://github.com/apache/arrow/pull/13418 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.or

[GitHub] [arrow] kou commented on pull request #13418: ARROW-16875: [Ruby] Add Column#cast and ChunkedArray#cast

2022-06-22 Thread GitBox
kou commented on PR #13418: URL: https://github.com/apache/arrow/pull/13418#issuecomment-1163593949 +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

[GitHub] [arrow] kou merged pull request #13417: ARROW-16874: [Ruby] Use more .try_convert for auto data type conversion

2022-06-22 Thread GitBox
kou merged PR #13417: URL: https://github.com/apache/arrow/pull/13417 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.or

[GitHub] [arrow] kou commented on pull request #13417: ARROW-16874: [Ruby] Use more .try_convert for auto data type conversion

2022-06-22 Thread GitBox
kou commented on PR #13417: URL: https://github.com/apache/arrow/pull/13417#issuecomment-1163593473 +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

[GitHub] [arrow] kou merged pull request #13308: ARROW-16666: [Docs][Release] Update release guide to specify new workflow and feature freeze

2022-06-22 Thread GitBox
kou merged PR #13308: URL: https://github.com/apache/arrow/pull/13308 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.or

[GitHub] [arrow] kou commented on a diff in pull request #13308: ARROW-16666: [Docs][Release] Update release guide to specify new workflow and feature freeze

2022-06-22 Thread GitBox
kou commented on code in PR #13308: URL: https://github.com/apache/arrow/pull/13308#discussion_r904216776 ## docs/source/developers/release.rst: ## @@ -130,23 +181,28 @@ These are the different steps that are required to create a release candidate. # after you complete the

[GitHub] [arrow-rs] viirya commented on a diff in pull request #1914: Add Decimal256 API

2022-06-22 Thread GitBox
viirya commented on code in PR #1914: URL: https://github.com/apache/arrow-rs/pull/1914#discussion_r904210422 ## arrow/src/util/decimal.rs: ## @@ -17,109 +17,201 @@ //! Decimal related utils -use std::cmp::Ordering; +use crate::error::{ArrowError, Result}; +use num::bigint:

[GitHub] [arrow-rs] viirya commented on a diff in pull request #1914: Add Decimal256 API

2022-06-22 Thread GitBox
viirya commented on code in PR #1914: URL: https://github.com/apache/arrow-rs/pull/1914#discussion_r904204855 ## arrow/src/util/decimal.rs: ## @@ -17,109 +17,201 @@ //! Decimal related utils -use std::cmp::Ordering; +use crate::error::{ArrowError, Result}; +use num::bigint:

[GitHub] [arrow-rs] viirya commented on a diff in pull request #1914: Add Decimal256 API

2022-06-22 Thread GitBox
viirya commented on code in PR #1914: URL: https://github.com/apache/arrow-rs/pull/1914#discussion_r901987661 ## arrow/src/util/decimal.rs: ## @@ -17,109 +17,201 @@ //! Decimal related utils -use std::cmp::Ordering; +use crate::error::{ArrowError, Result}; +use num::bigint:

[GitHub] [arrow-datafusion] codecov-commenter commented on pull request #2772: Remove expr_sub_expressions and rewrite_expression functions

2022-06-22 Thread GitBox
codecov-commenter commented on PR #2772: URL: https://github.com/apache/arrow-datafusion/pull/2772#issuecomment-1163564865 # [Codecov](https://codecov.io/gh/apache/arrow-datafusion/pull/2772?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_

[GitHub] [arrow] nealrichardson commented on a diff in pull request #13404: ARROW-16510: [R] Add bindings for GCS filesystem

2022-06-22 Thread GitBox
nealrichardson commented on code in PR #13404: URL: https://github.com/apache/arrow/pull/13404#discussion_r904189404 ## r/src/filesystem.cpp: ## @@ -331,3 +337,77 @@ std::string fs___S3FileSystem__region(const std::shared_ptr& f } #endif + +#if defined(ARROW_R_WITH_GCS) + +

[GitHub] [arrow] iChauster commented on pull request #13366: ARROW-16809: [C++] Add Benchmarks for FilterNode

2022-06-22 Thread GitBox
iChauster commented on PR #13366: URL: https://github.com/apache/arrow/pull/13366#issuecomment-1163546329 @westonpace , I think this is ready for another round of review. I've packaged some of the helpful benchmarking code into `benchmark_util.h`, and have expanded our filter benchmarks. Gi

[GitHub] [arrow-rs] viirya commented on a diff in pull request #1922: Support casting `NULL` to/from `Decimal`

2022-06-22 Thread GitBox
viirya commented on code in PR #1922: URL: https://github.com/apache/arrow-rs/pull/1922#discussion_r904175802 ## arrow/src/compute/kernels/cast.rs: ## @@ -72,9 +72,9 @@ pub fn can_cast_types(from_type: &DataType, to_type: &DataType) -> bool { // cast one decimal type t

[GitHub] [arrow-rs] viirya opened a new issue, #1923: Disallow cast from other datatypes to NullType

2022-06-22 Thread GitBox
viirya opened a new issue, #1923: URL: https://github.com/apache/arrow-rs/issues/1923 **Describe the bug** We allow casting from other datatypes to NullType (see `can_cast_types`). I suspect that this is a mistake. For example, Spark doesn't allow casting from any datatypes to

[GitHub] [arrow] iChauster commented on a diff in pull request #13366: ARROW-16809: [C++] Add Benchmarks for FilterNode

2022-06-22 Thread GitBox
iChauster commented on code in PR #13366: URL: https://github.com/apache/arrow/pull/13366#discussion_r904166211 ## cpp/src/arrow/compute/exec/filter_benchmark.cc: ## @@ -0,0 +1,168 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license

[GitHub] [arrow-rs] viirya commented on a diff in pull request #1922: Support casting `NULL` to/from `Decimal`

2022-06-22 Thread GitBox
viirya commented on code in PR #1922: URL: https://github.com/apache/arrow-rs/pull/1922#discussion_r904163992 ## arrow/src/compute/kernels/cast.rs: ## @@ -72,9 +72,9 @@ pub fn can_cast_types(from_type: &DataType, to_type: &DataType) -> bool { // cast one decimal type t

[GitHub] [arrow-datafusion] mrob95 opened a new pull request, #2772: Remove expr_sub_expressions and rewrite_expression functions

2022-06-22 Thread GitBox
mrob95 opened a new pull request, #2772: URL: https://github.com/apache/arrow-datafusion/pull/2772 # Which issue does this PR close? Follows from #2736 and #2765 # Rationale for this change These functions were redundant with `ExprVisitor` and `ExprRewriter`

[GitHub] [arrow] markweissman commented on issue #13408: Pyarrow join handles nulls differently than pandas merge.

2022-06-22 Thread GitBox
markweissman commented on issue #13408: URL: https://github.com/apache/arrow/issues/13408#issuecomment-1163529320 @amol- Thanks much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [arrow] amol- commented on issue #13408: Pyarrow join handles nulls differently than pandas merge.

2022-06-22 Thread GitBox
amol- commented on issue #13408: URL: https://github.com/apache/arrow/issues/13408#issuecomment-1163515796 Well, usually `NULL` values represent missing / unknown values thus there is no way to match them against anything else. So it's usually the common behaviour to exclude Null keys.

[GitHub] [arrow] amol- closed issue #13408: Pyarrow join handles nulls differently than pandas merge.

2022-06-22 Thread GitBox
amol- closed issue #13408: Pyarrow join handles nulls differently than pandas merge. URL: https://github.com/apache/arrow/issues/13408 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [arrow] github-actions[bot] commented on pull request #13404: ARROW-16510: [R] Add bindings for GCS filesystem

2022-06-22 Thread GitBox
github-actions[bot] commented on PR #13404: URL: https://github.com/apache/arrow/pull/13404#issuecomment-1163508561 Revision: 4d789f06e0a4eb6621f42bb85784c12b41a8375d Submitted crossbow builds: [ursacomputing/crossbow @ actions-f35855420a](https://github.com/ursacomputing/crossbow/bra

[GitHub] [arrow] nealrichardson commented on pull request #13404: ARROW-16510: [R] Add bindings for GCS filesystem

2022-06-22 Thread GitBox
nealrichardson commented on PR #13404: URL: https://github.com/apache/arrow/pull/13404#issuecomment-1163507517 @github-actions crossbow submit homebrew-r-autobrew -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [arrow] iChauster commented on a diff in pull request #13366: ARROW-16809: [C++] Add Benchmarks for FilterNode

2022-06-22 Thread GitBox
iChauster commented on code in PR #13366: URL: https://github.com/apache/arrow/pull/13366#discussion_r904131551 ## cpp/src/arrow/compute/exec/filter_benchmark.cc: ## @@ -0,0 +1,176 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license

[GitHub] [arrow-rs] viirya commented on a diff in pull request #1922: Support casting `NULL` to/from `Decimal`

2022-06-22 Thread GitBox
viirya commented on code in PR #1922: URL: https://github.com/apache/arrow-rs/pull/1922#discussion_r904128739 ## arrow/src/compute/kernels/cast.rs: ## @@ -72,9 +72,9 @@ pub fn can_cast_types(from_type: &DataType, to_type: &DataType) -> bool { // cast one decimal type t

[GitHub] [arrow-rs] viirya commented on a diff in pull request #1922: Support casting `NULL` to/from `Decimal`

2022-06-22 Thread GitBox
viirya commented on code in PR #1922: URL: https://github.com/apache/arrow-rs/pull/1922#discussion_r904128383 ## arrow/src/compute/kernels/cast.rs: ## @@ -72,9 +72,9 @@ pub fn can_cast_types(from_type: &DataType, to_type: &DataType) -> bool { // cast one decimal type t

[GitHub] [arrow] wjones127 commented on pull request #12775: ARROW-16006: [C++] Row conversion helpers and example

2022-06-22 Thread GitBox
wjones127 commented on PR #12775: URL: https://github.com/apache/arrow/pull/12775#issuecomment-1163488614 I have refactored this PR to only create an example, rebased so that the RecordBatchBuilder changes are separated, and rewrote most of the prose in the example. -- This is an automat

[GitHub] [arrow] github-actions[bot] commented on pull request #13411: [WIP][DO NOT MERGE] R Nightly Troubleshooting

2022-06-22 Thread GitBox
github-actions[bot] commented on PR #13411: URL: https://github.com/apache/arrow/pull/13411#issuecomment-1163480151 Revision: b60fab37d4c57febc19b79d16584c2b01d471d6e Submitted crossbow builds: [ursacomputing/crossbow @ actions-6468332506](https://github.com/ursacomputing/crossbow/bra

[GitHub] [arrow] assignUser commented on pull request #13411: [WIP][DO NOT MERGE] R Nightly Troubleshooting

2022-06-22 Thread GitBox
assignUser commented on PR #13411: URL: https://github.com/apache/arrow/pull/13411#issuecomment-1163478660 @github-actions crossbow submit r-nightly-packages -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [arrow] wjones127 commented on issue #13408: Pyarrow join handles nulls differently than pandas merge.

2022-06-22 Thread GitBox
wjones127 commented on issue #13408: URL: https://github.com/apache/arrow/issues/13408#issuecomment-1163470295 cc @amol- -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [arrow] wjones127 commented on issue #13422: Building C++ for M1 Macs

2022-06-22 Thread GitBox
wjones127 commented on issue #13422: URL: https://github.com/apache/arrow/issues/13422#issuecomment-1163469798 I'm not 100% sure about Intel -> M1, but we do use M1 -> Intel in our Python packaging (which builds C++ with vcpkg for dependencies): https://github.com/apache/arrow/blob/master/d

[GitHub] [arrow] github-actions[bot] commented on pull request #13421: ARROW-16881: [Gandiva][C++] Fix castINTERVALYEAR implementation

2022-06-22 Thread GitBox
github-actions[bot] commented on PR #13421: URL: https://github.com/apache/arrow/pull/13421#issuecomment-1163469295 Revision: a86c6bd1559c6509f1dc4e953ac3c0880c2411e1 Submitted crossbow builds: [ursacomputing/crossbow @ actions-40794fe81b](https://github.com/ursacomputing/crossbow/bra

[GitHub] [arrow] Johnnathanalmeida commented on pull request #13421: ARROW-16881: [Gandiva][C++] Fix castINTERVALYEAR implementation

2022-06-22 Thread GitBox
Johnnathanalmeida commented on PR #13421: URL: https://github.com/apache/arrow/pull/13421#issuecomment-1163468036 @github-actions crossbow submit java-jars -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [arrow] jayhomn-bitquill opened a new issue, #13422: Building C++ for M1 Macs

2022-06-22 Thread GitBox
jayhomn-bitquill opened a new issue, #13422: URL: https://github.com/apache/arrow/issues/13422 Does arrow currently support cross building for M1 Macs? (Intel -> M1). For more context, we are currently also using a package manager called vcpkg with the associated arm64-osx triplet -- Th

[GitHub] [arrow] github-actions[bot] commented on pull request #13421: ARROW-16881: [Gandiva][C++] Fix castINTERVALYEAR implementation

2022-06-22 Thread GitBox
github-actions[bot] commented on PR #13421: URL: https://github.com/apache/arrow/pull/13421#issuecomment-1163445256 Revision: a86c6bd1559c6509f1dc4e953ac3c0880c2411e1 Submitted crossbow builds: [ursacomputing/crossbow @ actions-32999fc89f](https://github.com/ursacomputing/crossbow/bra

[GitHub] [arrow] Johnnathanalmeida commented on pull request #13421: ARROW-16881: [Gandiva][C++] Fix castINTERVALYEAR implementation

2022-06-22 Thread GitBox
Johnnathanalmeida commented on PR #13421: URL: https://github.com/apache/arrow/pull/13421#issuecomment-1163442928 @github-actions crossbow submit java-jars -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [arrow] github-actions[bot] commented on pull request #13421: ARROW-16881: [Gandiva][C++] Fix castINTERVALYEAR implementation

2022-06-22 Thread GitBox
github-actions[bot] commented on PR #13421: URL: https://github.com/apache/arrow/pull/13421#issuecomment-1163416954 :warning: Ticket **has not been started in JIRA**, please click 'Start Progress'. -- This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [arrow] github-actions[bot] commented on pull request #13421: ARROW-16881: [Gandiva][C++] Fix castINTERVALYEAR implementation

2022-06-22 Thread GitBox
github-actions[bot] commented on PR #13421: URL: https://github.com/apache/arrow/pull/13421#issuecomment-1163416927 https://issues.apache.org/jira/browse/ARROW-16881 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [arrow] github-actions[bot] commented on pull request #13411: [WIP][DO NOT MERGE] R Nightly Troubleshooting

2022-06-22 Thread GitBox
github-actions[bot] commented on PR #13411: URL: https://github.com/apache/arrow/pull/13411#issuecomment-1163415782 Revision: c3728123cfbcd43c36d1feecb286e3272695aca3 Submitted crossbow builds: [ursacomputing/crossbow @ actions-c2197d2cb0](https://github.com/ursacomputing/crossbow/bra

[GitHub] [arrow] assignUser commented on pull request #13411: [WIP][DO NOT MERGE] R Nightly Troubleshooting

2022-06-22 Thread GitBox
assignUser commented on PR #13411: URL: https://github.com/apache/arrow/pull/13411#issuecomment-1163414204 @github-actions crossbow submit r-nightly-packages -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [arrow] github-actions[bot] commented on pull request #13421: [Gandiva][C++] Fix castINTERVALYEAR implementation

2022-06-22 Thread GitBox
github-actions[bot] commented on PR #13421: URL: https://github.com/apache/arrow/pull/13421#issuecomment-1163412291 Thanks for opening a pull request! If this is not a [minor PR](https://github.com/apache/arrow/blob/master/CONTRIBUTING.md#Minor-Fixes). Could you open an issue

[GitHub] [arrow] Johnnathanalmeida opened a new pull request, #13421: [Gandiva][C++] Fix castINTERVALYEAR implementation

2022-06-22 Thread GitBox
Johnnathanalmeida opened a new pull request, #13421: URL: https://github.com/apache/arrow/pull/13421 Fix error in LLVM where didn't find these two functions. Fix regex to allow negative digits for Interval Year. -- This is an automated message from the Apache Git Service. To respond

  1   2   3   >