[GitHub] [arrow-datafusion] mustafasrepo commented on a diff in pull request #3916: Support for non-u64 types for Window Bound

2022-10-23 Thread GitBox
mustafasrepo commented on code in PR #3916: URL: https://github.com/apache/arrow-datafusion/pull/3916#discussion_r1002931293 ## datafusion/expr/src/window_frame.rs: ## @@ -132,70 +125,72 @@ pub enum WindowFrameBound { /// /// 5. UNBOUNDED FOLLOWING /// The frame b

[GitHub] [arrow-datafusion] mustafasrepo commented on a diff in pull request #3916: Support for non-u64 types for Window Bound

2022-10-23 Thread GitBox
mustafasrepo commented on code in PR #3916: URL: https://github.com/apache/arrow-datafusion/pull/3916#discussion_r1002930609 ## datafusion/common/src/scalar.rs: ## @@ -476,35 +480,144 @@ macro_rules! impl_op { (ScalarValue::Int8(lhs), ScalarValue::Int8(rhs)) => {

[GitHub] [arrow-ballista] Dandandan merged pull request #438: Add Spark benchmarks

2022-10-23 Thread GitBox
Dandandan merged PR #438: URL: https://github.com/apache/arrow-ballista/pull/438 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arro

[GitHub] [arrow] JkSelf commented on a diff in pull request #14151: ARROW-11776: [C++][Java] Support parquet write from ArrowReader to file

2022-10-23 Thread GitBox
JkSelf commented on code in PR #14151: URL: https://github.com/apache/arrow/pull/14151#discussion_r1002895087 ## java/dataset/src/main/java/org/apache/arrow/dataset/scanner/ArrowScannerReader.java: ## @@ -0,0 +1,112 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

[GitHub] [arrow] JkSelf commented on a diff in pull request #14151: ARROW-11776: [C++][Java] Support parquet write from ArrowReader to file

2022-10-23 Thread GitBox
JkSelf commented on code in PR #14151: URL: https://github.com/apache/arrow/pull/14151#discussion_r1002893145 ## java/dataset/src/test/java/org/apache/arrow/dataset/file/TestDatasetFileWriter.java: ## @@ -0,0 +1,140 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

[GitHub] [arrow-ballista] Ted-Jiang commented on issue #412: Create empty shuffle read task

2022-10-23 Thread GitBox
Ted-Jiang commented on issue #412: URL: https://github.com/apache/arrow-ballista/issues/412#issuecomment-1288380377 @Dandandan I think this is not a bug, like the situation if the data is skew, all data write to the shuffle read partiton-1. IMO we still should launch R executors. 😂 -- T

[GitHub] [arrow] kou commented on a diff in pull request #14481: ARROW-18136: [Docs][Release] Update release verification information for CentOS7

2022-10-23 Thread GitBox
kou commented on code in PR #14481: URL: https://github.com/apache/arrow/pull/14481#discussion_r1002862240 ## dev/release/setup-centos7.sh: ## @@ -0,0 +1,90 @@ + +#!/bin/sh +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements.

[GitHub] [arrow] kou commented on a diff in pull request #14481: ARROW-18136: [Docs][Release] Update release verification information for CentOS7

2022-10-23 Thread GitBox
kou commented on code in PR #14481: URL: https://github.com/apache/arrow/pull/14481#discussion_r1002861908 ## dev/release/VERIFY.md: ## @@ -50,15 +50,28 @@ You can install them by the followings on Debian GNU/Linux and Ubuntu: You can install them by the followings on CentOS 7

[GitHub] [arrow] kou commented on a diff in pull request #14351: ARROW-17904: [C++] [WIP] Parquet Implement crc in reading and writing Page for DATA_PAGE (v1)

2022-10-23 Thread GitBox
kou commented on code in PR #14351: URL: https://github.com/apache/arrow/pull/14351#discussion_r1002860262 ## cpp/src/arrow/util/crc32.cc: ## @@ -0,0 +1,961 @@ +// Licensed to the Apache Software Foundation (ASF) under one Review Comment: Could you add the information to the

[GitHub] [arrow] bkmgit commented on a diff in pull request #14481: ARROW-18136: [Docs][Release] Update release verification information for CentOS7

2022-10-23 Thread GitBox
bkmgit commented on code in PR #14481: URL: https://github.com/apache/arrow/pull/14481#discussion_r1002851546 ## dev/release/setup-centos7.sh: ## @@ -0,0 +1,90 @@ + +#!/bin/sh +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements

[GitHub] [arrow] bkmgit commented on a diff in pull request #14481: ARROW-18136: [Docs][Release] Update release verification information for CentOS7

2022-10-23 Thread GitBox
bkmgit commented on code in PR #14481: URL: https://github.com/apache/arrow/pull/14481#discussion_r1002847734 ## dev/release/setup-centos7.sh: ## @@ -0,0 +1,90 @@ + +#!/bin/sh +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements

[GitHub] [arrow] bkmgit commented on a diff in pull request #14481: ARROW-18136: [Docs][Release] Update release verification information for CentOS7

2022-10-23 Thread GitBox
bkmgit commented on code in PR #14481: URL: https://github.com/apache/arrow/pull/14481#discussion_r1002847567 ## dev/release/setup-centos7.sh: ## @@ -0,0 +1,90 @@ + +#!/bin/sh +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements

[GitHub] [arrow] bkmgit commented on a diff in pull request #14481: ARROW-18136: [Docs][Release] Update release verification information for CentOS7

2022-10-23 Thread GitBox
bkmgit commented on code in PR #14481: URL: https://github.com/apache/arrow/pull/14481#discussion_r1002846163 ## dev/release/VERIFY.md: ## @@ -50,15 +50,28 @@ You can install them by the followings on Debian GNU/Linux and Ubuntu: You can install them by the followings on CentO

[GitHub] [arrow-datafusion] tustvold commented on a diff in pull request #3885: Consolidate remaining parquet config options into ConfigOptions

2022-10-23 Thread GitBox
tustvold commented on code in PR #3885: URL: https://github.com/apache/arrow-datafusion/pull/3885#discussion_r1002828791 ## datafusion/core/src/execution/options.rs: ## @@ -168,56 +170,31 @@ pub struct ParquetReadOptions<'a> { pub file_extension: &'a str, /// Partition

[GitHub] [arrow-datafusion] Kikkon commented on pull request #3933: fix: return error for unsupported SQL

2022-10-23 Thread GitBox
Kikkon commented on PR #3933: URL: https://github.com/apache/arrow-datafusion/pull/3933#issuecomment-1288312967 > Is there any chance you can write some tests for this code? Sure, I will add tests later. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [arrow] mapleFU commented on a diff in pull request #14351: ARROW-17904: [C++] [WIP] Parquet Implement crc in reading and writing Page for DATA_PAGE (v1)

2022-10-23 Thread GitBox
mapleFU commented on code in PR #14351: URL: https://github.com/apache/arrow/pull/14351#discussion_r1002825053 ## cpp/src/arrow/util/crc32.cc: ## @@ -0,0 +1,961 @@ +// Licensed to the Apache Software Foundation (ASF) under one Review Comment: > Could you also add the origina

[GitHub] [arrow] mapleFU commented on a diff in pull request #14351: ARROW-17904: [C++] [WIP] Parquet Implement crc in reading and writing Page for DATA_PAGE (v1)

2022-10-23 Thread GitBox
mapleFU commented on code in PR #14351: URL: https://github.com/apache/arrow/pull/14351#discussion_r1002824724 ## cpp/src/arrow/util/crc32.cc: ## @@ -0,0 +1,961 @@ +// Licensed to the Apache Software Foundation (ASF) under one Review Comment: Will do it tonight -- This i

[GitHub] [arrow-datafusion] tustvold commented on a diff in pull request #3885: Consolidate remaining parquet config options into ConfigOptions

2022-10-23 Thread GitBox
tustvold commented on code in PR #3885: URL: https://github.com/apache/arrow-datafusion/pull/3885#discussion_r1002820504 ## datafusion/core/src/config.rs: ## @@ -237,6 +247,29 @@ impl BuiltInConfigs { to reduce the number of rows decoded.", fal

[GitHub] [arrow-datafusion] tustvold commented on a diff in pull request #3612: Simplify serialization by removing redundant `PrimitiveScalarValue`

2022-10-23 Thread GitBox
tustvold commented on code in PR #3612: URL: https://github.com/apache/arrow-datafusion/pull/3612#discussion_r1002816676 ## datafusion/proto/proto/datafusion.proto: ## @@ -762,8 +762,9 @@ message StructValue { message ScalarValue{ oneof value { -// Null value of

[GitHub] [arrow-datafusion] tustvold commented on a diff in pull request #3612: Simplify serialization by removing redundant `PrimitiveScalarValue`

2022-10-23 Thread GitBox
tustvold commented on code in PR #3612: URL: https://github.com/apache/arrow-datafusion/pull/3612#discussion_r1002816676 ## datafusion/proto/proto/datafusion.proto: ## @@ -762,8 +762,9 @@ message StructValue { message ScalarValue{ oneof value { -// Null value of

[GitHub] [arrow-ballista] andygrove merged pull request #433: README updates

2022-10-23 Thread GitBox
andygrove merged PR #433: URL: https://github.com/apache/arrow-ballista/pull/433 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arro

[GitHub] [arrow] kou commented on a diff in pull request #14362: ARROW-17972: [CI] Update CUDA docker jobs

2022-10-23 Thread GitBox
kou commented on code in PR #14362: URL: https://github.com/apache/arrow/pull/14362#discussion_r1002774927 ## docker-compose.yml: ## @@ -488,17 +488,36 @@ services: shm_size: *shm-size ulimits: *ulimits environment: &cuda-environment - <<: *ccache + <<:

[GitHub] [arrow] kou commented on a diff in pull request #14351: ARROW-17904: [C++] [WIP] Parquet Implement crc in reading and writing Page for DATA_PAGE (v1)

2022-10-23 Thread GitBox
kou commented on code in PR #14351: URL: https://github.com/apache/arrow/pull/14351#discussion_r1002776836 ## cpp/src/arrow/util/crc32.cc: ## @@ -0,0 +1,961 @@ +// Licensed to the Apache Software Foundation (ASF) under one Review Comment: Could you also add the original sour

[GitHub] [arrow] kou commented on a diff in pull request #14351: ARROW-17904: [C++] [WIP] Parquet Implement crc in reading and writing Page for DATA_PAGE (v1)

2022-10-23 Thread GitBox
kou commented on code in PR #14351: URL: https://github.com/apache/arrow/pull/14351#discussion_r1002776531 ## cpp/src/arrow/util/crc32.cc: ## @@ -0,0 +1,961 @@ +// Licensed to the Apache Software Foundation (ASF) under one Review Comment: Could you put this to `cpp/src/arrow

[GitHub] [arrow] kou commented on a diff in pull request #14472: ARROW-18042: [Java] Distribute Apple M1 compatible JNI libraries via mavencentral

2022-10-23 Thread GitBox
kou commented on code in PR #14472: URL: https://github.com/apache/arrow/pull/14472#discussion_r1002771022 ## dev/tasks/java-jars/github.yml: ## @@ -48,47 +50,65 @@ jobs: {% endif %} build-cpp-macos: -name: Build C++ libraries macOS -runs-on: macos-latest +

[GitHub] [arrow] kou commented on a diff in pull request #14033: ARROW-15691: [Dev] Update archery to work with either master or main as default branch

2022-10-23 Thread GitBox
kou commented on code in PR #14033: URL: https://github.com/apache/arrow/pull/14033#discussion_r1002770060 ## .github/workflows/integration.yml: ## @@ -85,7 +85,11 @@ jobs: env: ARCHERY_DOCKER_USER: ${{ secrets.DOCKERHUB_USER }} ARCHERY_DOCKER_PASS

[GitHub] [arrow] kou commented on a diff in pull request #14033: ARROW-15691: [Dev] Update archery to work with either master or main as default branch

2022-10-23 Thread GitBox
kou commented on code in PR #14033: URL: https://github.com/apache/arrow/pull/14033#discussion_r1002769208 ## .github/workflows/integration.yml: ## @@ -85,7 +85,11 @@ jobs: env: ARCHERY_DOCKER_USER: ${{ secrets.DOCKERHUB_USER }} ARCHERY_DOCKER_PASS

[GitHub] [arrow] kou commented on a diff in pull request #14481: ARROW-18136: [Docs][Release] Update release verification information for CentOS7

2022-10-23 Thread GitBox
kou commented on code in PR #14481: URL: https://github.com/apache/arrow/pull/14481#discussion_r1002766539 ## dev/release/VERIFY.md: ## @@ -50,15 +50,28 @@ You can install them by the followings on Debian GNU/Linux and Ubuntu: You can install them by the followings on CentOS 7

[GitHub] [arrow] JacekPliszka commented on pull request #14482: ARROW-18137: [Python][Docs] adding info about TableGroupBy.aggregation with empty list

2022-10-23 Thread GitBox
JacekPliszka commented on PR #14482: URL: https://github.com/apache/arrow/pull/14482#issuecomment-1288189273 The title has been changed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [arrow-ballista] andygrove commented on pull request #438: Add Spark benchmarks

2022-10-23 Thread GitBox
andygrove commented on PR #438: URL: https://github.com/apache/arrow-ballista/pull/438#issuecomment-1288185864 @avantgardnerio fyi -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [arrow-ballista] andygrove closed pull request #365: Add release verification guide

2022-10-23 Thread GitBox
andygrove closed pull request #365: Add release verification guide URL: https://github.com/apache/arrow-ballista/pull/365 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [arrow-ballista] andygrove opened a new pull request, #438: Add Spark benchmarks

2022-10-23 Thread GitBox
andygrove opened a new pull request, #438: URL: https://github.com/apache/arrow-ballista/pull/438 # Which issue does this PR close? N/A # Rationale for this change Make all benchmark code public so others can run the same benchmarks and help find issues.

[GitHub] [arrow] bkmgit commented on pull request #14482: ARROW-18137 adding info about TableGroupBy.aggregation with empty list

2022-10-23 Thread GitBox
bkmgit commented on PR #14482: URL: https://github.com/apache/arrow/pull/14482#issuecomment-1288180423 Thanks for your contribution. To make it easier to determine which areas this affects, please change the title to: `ARROW-18137: [C++][Python][Docs] adding info about TableGroupBy.ag

[GitHub] [arrow] bkmgit commented on pull request #14482: ARROW-18137 adding info about TableGroupBy.aggregation with empty list

2022-10-23 Thread GitBox
bkmgit commented on PR #14482: URL: https://github.com/apache/arrow/pull/14482#issuecomment-1288180376 Thanks for your contribution. To make it easier to determine which areas this affects, please change the title to: `ARROW-18137: [C++][Python][Docs] adding info about TableGroupBy.ag

[GitHub] [arrow] github-actions[bot] commented on pull request #14482: ARROW-18137 adding info about TableGroupBy.aggregation with empty list

2022-10-23 Thread GitBox
github-actions[bot] commented on PR #14482: URL: https://github.com/apache/arrow/pull/14482#issuecomment-1288174614 https://issues.apache.org/jira/browse/ARROW-18137 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [arrow] JacekPliszka opened a new pull request, #14482: ARROW-18137 adding info about TableGroupBy.aggregation with empty list

2022-10-23 Thread GitBox
JacekPliszka opened a new pull request, #14482: URL: https://github.com/apache/arrow/pull/14482 I have realized that pandas drop_duplicates functionality can be easily emulated with group_by(...).aggregate([]) and is much faster than to_pandas().drop_duplicates() Please consider this

[GitHub] [arrow-datafusion] Dandandan commented on pull request #3932: doc: fix doc about `CREATE TABLE IF NOT EXISTS`

2022-10-23 Thread GitBox
Dandandan commented on PR #3932: URL: https://github.com/apache/arrow-datafusion/pull/3932#issuecomment-1288174097 Thanks @jackwener -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [arrow-datafusion] Dandandan closed issue #3904: [DOC] - There are unsupported DDL in the official documentation

2022-10-23 Thread GitBox
Dandandan closed issue #3904: [DOC] - There are unsupported DDL in the official documentation URL: https://github.com/apache/arrow-datafusion/issues/3904 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [arrow-datafusion] Dandandan merged pull request #3932: doc: fix doc about `CREATE TABLE IF NOT EXISTS`

2022-10-23 Thread GitBox
Dandandan merged PR #3932: URL: https://github.com/apache/arrow-datafusion/pull/3932 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@

[GitHub] [arrow] github-actions[bot] commented on pull request #14481: ARROW-18136: [Docs][Release] Update release verification information for CentOS7

2022-10-23 Thread GitBox
github-actions[bot] commented on PR #14481: URL: https://github.com/apache/arrow/pull/14481#issuecomment-1288159675 https://issues.apache.org/jira/browse/ARROW-18136 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [arrow-datafusion] alamb commented on issue #3928: Implement serialization for `ScalarValue::FixedSizeBinary`

2022-10-23 Thread GitBox
alamb commented on issue #3928: URL: https://github.com/apache/arrow-datafusion/issues/3928#issuecomment-1288159111 See also- https://github.com/apache/arrow-datafusion/pull/3612 - the serialization code is a bit of a mess now but hopefully we can get it better -- This is an automated me

[GitHub] [arrow-datafusion] alamb commented on pull request #3933: fix: return error for unsupported SQL

2022-10-23 Thread GitBox
alamb commented on PR #3933: URL: https://github.com/apache/arrow-datafusion/pull/3933#issuecomment-1288158919 Looks good @Kikkon -- thank you! Is there any chance you can write some tests for this code? -- This is an automated message from the Apache Git Service. To respond to th

[GitHub] [arrow-ballista] andygrove closed issue #353: Scheduler silently replaces `ParquetExec` with `EmptyExec` if data path is not correctly mounted in container

2022-10-23 Thread GitBox
andygrove closed issue #353: Scheduler silently replaces `ParquetExec` with `EmptyExec` if data path is not correctly mounted in container URL: https://github.com/apache/arrow-ballista/issues/353 -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [arrow-ballista] andygrove merged pull request #414: scheduler now verifies that `file://` ListingTable URLs are accessible

2022-10-23 Thread GitBox
andygrove merged PR #414: URL: https://github.com/apache/arrow-ballista/pull/414 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arro

[GitHub] [arrow-ballista] andygrove commented on pull request #414: scheduler now verifies that `file://` ListingTable URLs are accessible

2022-10-23 Thread GitBox
andygrove commented on PR #414: URL: https://github.com/apache/arrow-ballista/pull/414#issuecomment-1288155698 I am going to go ahead and merge this so that I can cut the RC today. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [arrow-ballista] andygrove commented on pull request #434: Run benchmarks using python library

2022-10-23 Thread GitBox
andygrove commented on PR #434: URL: https://github.com/apache/arrow-ballista/pull/434#issuecomment-1288154509 @rahulpenti I ran this again. There is no `wheels` directory under `python/target`, -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [arrow-datafusion] Kikkon commented on issue #3873: Default physical planner generates empty relation for DROP TABLE, CREATE MEMORY TABLE, etc

2022-10-23 Thread GitBox
Kikkon commented on issue #3873: URL: https://github.com/apache/arrow-datafusion/issues/3873#issuecomment-1288151129 @alamb If I understand correctly, just modify the return result of create_initial_plan, like this #3933. -- This is an automated message from the Apache Git Service. To re

[GitHub] [arrow-datafusion] Kikkon opened a new pull request, #3933: fix: return error for unsupported SQL

2022-10-23 Thread GitBox
Kikkon opened a new pull request, #3933: URL: https://github.com/apache/arrow-datafusion/pull/3933 # Which issue does this PR close? Closes #3873 # Rationale for this change Refer to this issue #3873 # What changes are included in this PR? Make so

[GitHub] [arrow] github-actions[bot] commented on pull request #14481: Arrow 18136: [Docs][Release] Update release verification information for CentOS7

2022-10-23 Thread GitBox
github-actions[bot] commented on PR #14481: URL: https://github.com/apache/arrow/pull/14481#issuecomment-1288121772 Thanks for opening a pull request! If this is not a [minor PR](https://github.com/apache/arrow/blob/master/CONTRIBUTING.md#Minor-Fixes). Could you open an issue

[GitHub] [arrow-rs] timvw commented on pull request #2891: Add experimental AWS_PROFILE support (#2178)

2022-10-23 Thread GitBox
timvw commented on PR #2891: URL: https://github.com/apache/arrow-rs/pull/2891#issuecomment-1288119774 Also verified that when AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY and AWS_PROFILE are set that the first two get preference over AWS_PROFILE (similar to how aws cli behaves).

[GitHub] [arrow-rs] timvw commented on pull request #2891: Add experimental AWS_PROFILE support (#2178)

2022-10-23 Thread GitBox
timvw commented on PR #2891: URL: https://github.com/apache/arrow-rs/pull/2891#issuecomment-1288116861 Works for me (tested on commit (2079a67c5)) cargo test --package object_store --features aws_profile --lib aws::tests::s3_with_sso_profile -- --exact ```rust #[tokio:

[GitHub] [arrow-datafusion] retikulum commented on issue #3928: Implement serialization for `ScalarValue::FixedSizeBinary`

2022-10-23 Thread GitBox
retikulum commented on issue #3928: URL: https://github.com/apache/arrow-datafusion/issues/3928#issuecomment-1288108295 It looks interesting. Can you assign it to me? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[GitHub] [arrow-datafusion] jackwener opened a new pull request, #3932: doc: fix doc about `CREATE TABLE IF NOT EXISTS`

2022-10-23 Thread GitBox
jackwener opened a new pull request, #3932: URL: https://github.com/apache/arrow-datafusion/pull/3932 # Which issue does this PR close? Closes #3904. # Rationale for this change # What changes are included in this PR? fix doc about `CREATE TABLE IF NOT

[GitHub] [arrow-datafusion] jackwener commented on pull request #3931: Refactor Expr::Cast to use a struct.

2022-10-23 Thread GitBox
jackwener commented on PR #3931: URL: https://github.com/apache/arrow-datafusion/pull/3931#issuecomment-1288101874 @ygf11 thanks, have resolved -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [arrow] rtpsw commented on a diff in pull request #14385: ARROW-17980: [C++] As-of-Join Substrait extension

2022-10-23 Thread GitBox
rtpsw commented on code in PR #14385: URL: https://github.com/apache/arrow/pull/14385#discussion_r1002701934 ## cpp/proto/substrait/extension_rels.proto: ## @@ -0,0 +1,36 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements

[GitHub] [arrow-datafusion] jhorstmann commented on issue #1992: The return type of EXTRACT

2022-10-23 Thread GitBox
jhorstmann commented on issue #1992: URL: https://github.com/apache/arrow-datafusion/issues/1992#issuecomment-1288095217 > PG not support negative timestamp This sounded surprising, it seems what is not supported is the input syntax starting with a minus sign. Negative timestamps are

[GitHub] [arrow-datafusion] alamb commented on a diff in pull request #3612: Simplify serialization by removing redundant `PrimitiveScalarValue`

2022-10-23 Thread GitBox
alamb commented on code in PR #3612: URL: https://github.com/apache/arrow-datafusion/pull/3612#discussion_r1002693944 ## datafusion/proto/src/from_proto.rs: ## @@ -1359,184 +1246,6 @@ fn vec_to_array(v: Vec) -> [T; N] { }) } -//Does not typecheck lists -fn typechecked_s

[GitHub] [arrow-datafusion] alamb commented on a diff in pull request #3612: Simplify serialization by removing redundant `PrimitiveScalarValue`

2022-10-23 Thread GitBox
alamb commented on code in PR #3612: URL: https://github.com/apache/arrow-datafusion/pull/3612#discussion_r1002693845 ## datafusion/proto/proto/datafusion.proto: ## @@ -803,48 +804,9 @@ message Decimal128{ int64 s = 3; } -// Contains all valid datafusion scalar type except

[GitHub] [arrow] rtpsw commented on pull request #14385: ARROW-17980: [C++] As-of-Join Substrait extension

2022-10-23 Thread GitBox
rtpsw commented on PR #14385: URL: https://github.com/apache/arrow/pull/14385#issuecomment-1288086193 > @rtpsw Looks pretty good! There seems to be many style changes that seems orthogonal. Are those changes automatically made? Is it easy to separate out the style change from the actual cha

[GitHub] [arrow-datafusion] ygf11 commented on a diff in pull request #3931: Refactor Expr::Cast to use a struct.

2022-10-23 Thread GitBox
ygf11 commented on code in PR #3931: URL: https://github.com/apache/arrow-datafusion/pull/3931#discussion_r1002683658 ## datafusion/expr/src/expr.rs: ## @@ -353,6 +348,22 @@ pub struct GetIndexedField { pub key: ScalarValue, } +/// BETWEEN expression +#[derive(Clone, Par

[GitHub] [arrow-datafusion] ygf11 commented on a diff in pull request #3931: Refactor Expr::Cast to use a struct.

2022-10-23 Thread GitBox
ygf11 commented on code in PR #3931: URL: https://github.com/apache/arrow-datafusion/pull/3931#discussion_r1002683871 ## datafusion/expr/src/expr.rs: ## @@ -353,6 +348,22 @@ pub struct GetIndexedField { pub key: ScalarValue, } +/// BETWEEN expression +#[derive(Clone, Par

[GitHub] [arrow-datafusion] ygf11 commented on a diff in pull request #3931: Refactor Expr::Cast to use a struct.

2022-10-23 Thread GitBox
ygf11 commented on code in PR #3931: URL: https://github.com/apache/arrow-datafusion/pull/3931#discussion_r1002683658 ## datafusion/expr/src/expr.rs: ## @@ -353,6 +348,22 @@ pub struct GetIndexedField { pub key: ScalarValue, } +/// BETWEEN expression +#[derive(Clone, Par

[GitHub] [arrow-datafusion] ygf11 commented on a diff in pull request #3931: Refactor Expr::Cast to use a struct.

2022-10-23 Thread GitBox
ygf11 commented on code in PR #3931: URL: https://github.com/apache/arrow-datafusion/pull/3931#discussion_r1002683636 ## datafusion/expr/src/expr.rs: ## @@ -353,6 +348,22 @@ pub struct GetIndexedField { pub key: ScalarValue, } +/// BETWEEN expression +#[derive(Clone, Par

[GitHub] [arrow-datafusion] alamb commented on issue #3904: [DOC] - There are unsupported DDL in the official documentation

2022-10-23 Thread GitBox
alamb commented on issue #3904: URL: https://github.com/apache/arrow-datafusion/issues/3904#issuecomment-1288076322 I think the problem is with this example from https://arrow.apache.org/datafusion/user-guide/sql/ddl.html > CREATE TABLE valuetable IF NOT EXISTS AS VALUES(1,'HELLO'),

[GitHub] [arrow] rtpsw commented on pull request #14352: ARROW-17642: [C++] Add ordered aggregation

2022-10-23 Thread GitBox
rtpsw commented on PR #14352: URL: https://github.com/apache/arrow/pull/14352#issuecomment-1288067166 > @lidavidm, are you a good person to review this? or can you suggest someone? Also, note this PR includes a new [SWMR gadget](https://github.com/apache/arrow/pull/14352/files#diff-f53040e5

[GitHub] [arrow-datafusion] HaoYang670 commented on issue #3770: Support rewriting subquery expressions in `simplify_expressions`

2022-10-23 Thread GitBox
HaoYang670 commented on issue #3770: URL: https://github.com/apache/arrow-datafusion/issues/3770#issuecomment-1288065309 Do we need to consider the schema infomation of the parent query when optimizing the subquery? -- This is an automated message from the Apache Git Service. To respond

[GitHub] [arrow-ballista] Dandandan merged pull request #436: MINOR: Remove files left over from forking from Arrow

2022-10-23 Thread GitBox
Dandandan merged PR #436: URL: https://github.com/apache/arrow-ballista/pull/436 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arro

[GitHub] [arrow] github-actions[bot] commented on pull request #14480: ARROW-18135: [C++] Avoid warnings that ExecBatch::length may be uninitialized

2022-10-23 Thread GitBox
github-actions[bot] commented on PR #14480: URL: https://github.com/apache/arrow/pull/14480#issuecomment-1288034727 https://issues.apache.org/jira/browse/ARROW-18135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [arrow] rtpsw opened a new pull request, #14480: ARROW-18135: [C++] Avoid warnings that ExecBatch::length may be uninitialized

2022-10-23 Thread GitBox
rtpsw opened a new pull request, #14480: URL: https://github.com/apache/arrow/pull/14480 See https://issues.apache.org/jira/browse/ARROW-18135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow-datafusion] jackwener opened a new pull request, #3931: Refactor Expr::Cast to use a struct.

2022-10-23 Thread GitBox
jackwener opened a new pull request, #3931: URL: https://github.com/apache/arrow-datafusion/pull/3931 # Which issue does this PR close? Part of #2175 and #3807 # Rationale for this change # What changes are included in this PR? Refactor Expr::Cast to u

[GitHub] [arrow-rs] viirya commented on pull request #2912: Support decimal256 array in sort kernels

2022-10-23 Thread GitBox
viirya commented on PR #2912: URL: https://github.com/apache/arrow-rs/pull/2912#issuecomment-1288032679 Thanks @tustvold -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [arrow-rs] viirya closed issue #2911: Support decimal256 array in sort kernels

2022-10-23 Thread GitBox
viirya closed issue #2911: Support decimal256 array in sort kernels URL: https://github.com/apache/arrow-rs/issues/2911 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [arrow-rs] viirya merged pull request #2912: Support decimal256 array in sort kernels

2022-10-23 Thread GitBox
viirya merged PR #2912: URL: https://github.com/apache/arrow-rs/pull/2912 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apach