[GitHub] [spark] gengliangwang commented on a change in pull request #32056: [SPARK-34667][SQL] Support casting of year-month intervals to strings

2021-04-05 Thread GitBox
gengliangwang commented on a change in pull request #32056: URL: https://github.com/apache/spark/pull/32056#discussion_r607574835 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala ## @@ -834,4 +834,21 @@ object IntervalUtils {

[GitHub] [spark] itholic commented on a change in pull request #32053: [SPARK-34493][DOCS] Add "TEXT Files" page for Data Source documents

2021-04-05 Thread GitBox
itholic commented on a change in pull request #32053: URL: https://github.com/apache/spark/pull/32053#discussion_r607573961 ## File path: examples/src/main/java/org/apache/spark/examples/sql/JavaSQLDataSourceExample.java ## @@ -389,6 +392,67 @@ private static void runCsvDatase

[GitHub] [spark] itholic commented on a change in pull request #32053: [SPARK-34493][DOCS] Add "TEXT Files" page for Data Source documents

2021-04-05 Thread GitBox
itholic commented on a change in pull request #32053: URL: https://github.com/apache/spark/pull/32053#discussion_r607573961 ## File path: examples/src/main/java/org/apache/spark/examples/sql/JavaSQLDataSourceExample.java ## @@ -389,6 +392,67 @@ private static void runCsvDatase

[GitHub] [spark] wangyum commented on a change in pull request #31984: [SPARK-34884][SQL] Improve DPP evaluation to make filtering side must can broadcast by size or broadcast by hint

2021-04-05 Thread GitBox
wangyum commented on a change in pull request #31984: URL: https://github.com/apache/spark/pull/31984#discussion_r607572977 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/dynamicpruning/PartitionPruning.scala ## @@ -160,8 +160,7 @@ object PartitionPruning

[GitHub] [spark] wangyum commented on a change in pull request #31984: [SPARK-34884][SQL] Improve DPP evaluation to make filtering side must can broadcast by size or broadcast by hint

2021-04-05 Thread GitBox
wangyum commented on a change in pull request #31984: URL: https://github.com/apache/spark/pull/31984#discussion_r607572977 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/dynamicpruning/PartitionPruning.scala ## @@ -160,8 +160,7 @@ object PartitionPruning

[GitHub] [spark] itholic commented on a change in pull request #32053: [SPARK-34493][DOCS] Add "TEXT Files" page for Data Source documents

2021-04-05 Thread GitBox
itholic commented on a change in pull request #32053: URL: https://github.com/apache/spark/pull/32053#discussion_r607572400 ## File path: examples/src/main/java/org/apache/spark/examples/sql/JavaSQLDataSourceExample.java ## @@ -389,6 +392,67 @@ private static void runCsvDatase

[GitHub] [spark] gengliangwang commented on pull request #32060: [SPARK-34916][SQL] add condition lambda and rule id to the transform family

2021-04-05 Thread GitBox
gengliangwang commented on pull request #32060: URL: https://github.com/apache/spark/pull/32060#issuecomment-813874164 @sigmod thanks for the first contribution! Could you update the PR description? -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] cloud-fan commented on a change in pull request #32058: [SPARK-34962][SQL] Explicit representation of * in UpdateAction and InsertAction in MergeIntoTable

2021-04-05 Thread GitBox
cloud-fan commented on a change in pull request #32058: URL: https://github.com/apache/spark/pull/32058#discussion_r607570776 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala ## @@ -420,13 +420,15 @@ case class DeleteAction

[GitHub] [spark] sigmod opened a new pull request #32060: [SPARK-34916][SQL] add condition lambda and rule id to the transform family

2021-04-05 Thread GitBox
sigmod opened a new pull request #32060: URL: https://github.com/apache/spark/pull/32060 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was

[GitHub] [spark] viirya commented on a change in pull request #31966: [SPARK-34638][SQL] Single field nested column prune on generator output

2021-04-05 Thread GitBox
viirya commented on a change in pull request #31966: URL: https://github.com/apache/spark/pull/31966#discussion_r607565790 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -241,12 +262,69 @@ object GeneratorNest

[GitHub] [spark] viirya opened a new pull request #32059: [SPARK-34963][SQL] Fix nested column pruning for extracting case-insensitive struct field from array of struct

2021-04-05 Thread GitBox
viirya opened a new pull request #32059: URL: https://github.com/apache/spark/pull/32059 ### What changes were proposed in this pull request? This patch proposes a fix of nested column pruning for extracting case-insensitive struct field from array of struct. ### W

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32053: [SPARK-34493][DOCS] Add "TEXT Files" page for Data Source documents

2021-04-05 Thread GitBox
HyukjinKwon commented on a change in pull request #32053: URL: https://github.com/apache/spark/pull/32053#discussion_r607561917 ## File path: examples/src/main/java/org/apache/spark/examples/sql/JavaSQLDataSourceExample.java ## @@ -389,6 +392,67 @@ private static void runCsvDa

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32053: [SPARK-34493][DOCS] Add "TEXT Files" page for Data Source documents

2021-04-05 Thread GitBox
HyukjinKwon commented on a change in pull request #32053: URL: https://github.com/apache/spark/pull/32053#discussion_r607561383 ## File path: docs/sql-data-sources-text.md ## @@ -0,0 +1,40 @@ +--- +layout: global +title: Text Files +displayTitle: Text Files +license: | + Licen

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32053: [SPARK-34493][DOCS] Add "TEXT Files" page for Data Source documents

2021-04-05 Thread GitBox
HyukjinKwon commented on a change in pull request #32053: URL: https://github.com/apache/spark/pull/32053#discussion_r607560028 ## File path: docs/sql-data-sources-text.md ## @@ -0,0 +1,40 @@ +--- +layout: global +title: Text Files +displayTitle: Text Files +license: | + Licen

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30930: [SPARK-33070][SQL] Optimize higher order functions

2021-04-05 Thread GitBox
HyukjinKwon commented on a change in pull request #30930: URL: https://github.com/apache/spark/pull/30930#discussion_r607557743 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/OptimizeHigherOrderFunctions.scala ## @@ -0,0 +1,48 @@ +/* + * Lice

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30930: [SPARK-33070][SQL] Optimize higher order functions

2021-04-05 Thread GitBox
HyukjinKwon commented on a change in pull request #30930: URL: https://github.com/apache/spark/pull/30930#discussion_r607557557 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/OptimizeHigherOrderFunctions.scala ## @@ -0,0 +1,48 @@ +/* + * Lice

[GitHub] [spark] HyukjinKwon commented on pull request #31213: [SPARK-34141][SQL] Remove side effect from ExtractGenerator

2021-04-05 Thread GitBox
HyukjinKwon commented on pull request #31213: URL: https://github.com/apache/spark/pull/31213#issuecomment-813855084 Oh, just saw it. LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [spark] cloud-fan commented on a change in pull request #31984: [SPARK-34884][SQL] Improve DPP evaluation to make filtering side must can broadcast by size or broadcast by hint

2021-04-05 Thread GitBox
cloud-fan commented on a change in pull request #31984: URL: https://github.com/apache/spark/pull/31984#discussion_r607540865 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/dynamicpruning/PartitionPruning.scala ## @@ -160,8 +160,7 @@ object PartitionPruni

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-813848487 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41509/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32017: [SPARK-34923][SQL] Metadata output should be empty for more plans

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #32017: URL: https://github.com/apache/spark/pull/32017#issuecomment-813848481 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31887: [SPARK-34794][SQL] Fix nested transform issue

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #31887: URL: https://github.com/apache/spark/pull/31887#issuecomment-813848484 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136924/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32017: [SPARK-34923][SQL] Metadata output should be empty for more plans

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #32017: URL: https://github.com/apache/spark/pull/32017#issuecomment-813848483 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For q

[GitHub] [spark] AmplabJenkins commented on pull request #31887: [SPARK-34794][SQL] Fix nested transform issue

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #31887: URL: https://github.com/apache/spark/pull/31887#issuecomment-813848484 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136924/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-813848487 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41509/ -- T

[GitHub] [spark] SparkQA commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

2021-04-05 Thread GitBox
SparkQA commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-813846672 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] SparkQA commented on pull request #32017: [SPARK-34923][SQL] Metadata output should be empty for more plans

2021-04-05 Thread GitBox
SparkQA commented on pull request #32017: URL: https://github.com/apache/spark/pull/32017#issuecomment-813843350 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] mridulm edited a comment on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

2021-04-05 Thread GitBox
mridulm edited a comment on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-813838612 Also, +CC @Ngone51, @attilapiros, @otterc -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [spark] mridulm commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

2021-04-05 Thread GitBox
mridulm commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-813838612 Also, +CC @Ngone51 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA removed a comment on pull request #31887: [SPARK-34794][SQL] Fix nested transform issue

2021-04-05 Thread GitBox
SparkQA removed a comment on pull request #31887: URL: https://github.com/apache/spark/pull/31887#issuecomment-813751239 **[Test build #136924 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136924/testReport)** for PR 31887 at commit [`8c2ad61`](https://gi

[GitHub] [spark] mridulm commented on pull request #32007: [SPARK-33350][SHUFFLE] Add support to DiskBlockManager to create merge directory and to get the local shuffle merged data

2021-04-05 Thread GitBox
mridulm commented on pull request #32007: URL: https://github.com/apache/spark/pull/32007#issuecomment-813837901 +CC @tgravescs, @Ngone51, @attilapiros -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA commented on pull request #31887: [SPARK-34794][SQL] Fix nested transform issue

2021-04-05 Thread GitBox
SparkQA commented on pull request #31887: URL: https://github.com/apache/spark/pull/31887#issuecomment-813837892 **[Test build #136924 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136924/testReport)** for PR 31887 at commit [`8c2ad61`](https://github.co

[GitHub] [spark] mridulm commented on a change in pull request #32007: [SPARK-33350][SHUFFLE] Add support to DiskBlockManager to create merge directory and to get the local shuffle merged data

2021-04-05 Thread GitBox
mridulm commented on a change in pull request #32007: URL: https://github.com/apache/spark/pull/32007#discussion_r607501885 ## File path: core/src/main/scala/org/apache/spark/shuffle/IndexShuffleBlockResolver.scala ## @@ -343,6 +359,50 @@ private[spark] class IndexShuffleBlock

[GitHub] [spark] SparkQA removed a comment on pull request #32017: [SPARK-34923][SQL] Metadata output should be empty for more plans

2021-04-05 Thread GitBox
SparkQA removed a comment on pull request #32017: URL: https://github.com/apache/spark/pull/32017#issuecomment-813752863 **[Test build #136925 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136925/testReport)** for PR 32017 at commit [`b1c0183`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32017: [SPARK-34923][SQL] Metadata output should be empty for more plans

2021-04-05 Thread GitBox
SparkQA commented on pull request #32017: URL: https://github.com/apache/spark/pull/32017#issuecomment-813836949 **[Test build #136925 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136925/testReport)** for PR 32017 at commit [`b1c0183`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813825386 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41508/

[GitHub] [spark] AmplabJenkins commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813825386 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41508/ -- T

[GitHub] [spark] SparkQA commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
SparkQA commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813825369 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41508/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31968: [SPARK-34873][SQL] Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #31968: URL: https://github.com/apache/spark/pull/31968#issuecomment-813824902 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41507/

[GitHub] [spark] SparkQA commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

2021-04-05 Thread GitBox
SparkQA commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-813824876 **[Test build #136932 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136932/testReport)** for PR 32031 at commit [`e156dff`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #31968: [SPARK-34873][SQL] Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #31968: URL: https://github.com/apache/spark/pull/31968#issuecomment-813824902 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41507/ -- T

[GitHub] [spark] SparkQA commented on pull request #32017: [SPARK-34923][SQL] Metadata output should be empty for more plans

2021-04-05 Thread GitBox
SparkQA commented on pull request #32017: URL: https://github.com/apache/spark/pull/32017#issuecomment-813824921 **[Test build #136933 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136933/testReport)** for PR 32017 at commit [`e8e6e7d`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31968: [SPARK-34873][SQL] Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-04-05 Thread GitBox
SparkQA commented on pull request #31968: URL: https://github.com/apache/spark/pull/31968#issuecomment-813824863 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31791: [SPARK-34678][SQL] Add table function registry

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #31791: URL: https://github.com/apache/spark/pull/31791#issuecomment-813824532 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41505/

[GitHub] [spark] AmplabJenkins commented on pull request #31791: [SPARK-34678][SQL] Add table function registry

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #31791: URL: https://github.com/apache/spark/pull/31791#issuecomment-813824532 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41505/ -- T

[GitHub] [spark] SparkQA commented on pull request #31791: [SPARK-34678][SQL] Add table function registry

2021-04-05 Thread GitBox
SparkQA commented on pull request #31791: URL: https://github.com/apache/spark/pull/31791#issuecomment-813824508 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41505/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32058: [SPARK-34962][SQL] Explicit representation of * in UpdateAction and InsertAction in MergeIntoTable

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #32058: URL: https://github.com/apache/spark/pull/32058#issuecomment-813824169 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136922/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32037: [SPARK-34944][SQL][TESTS] Employ correct data type for web_returns and store_returns in TPCDS tests

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-813824163 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41503/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813824168 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41504/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31548: [SPARK-34127][SQL] Support table valued command

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #31548: URL: https://github.com/apache/spark/pull/31548#issuecomment-813824165 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41506/

[GitHub] [spark] AmplabJenkins commented on pull request #31548: [SPARK-34127][SQL] Support table valued command

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #31548: URL: https://github.com/apache/spark/pull/31548#issuecomment-813824165 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41506/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813824168 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41504/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #32037: [SPARK-34944][SQL][TESTS] Employ correct data type for web_returns and store_returns in TPCDS tests

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-813824163 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41503/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #32058: [SPARK-34962][SQL] Explicit representation of * in UpdateAction and InsertAction in MergeIntoTable

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #32058: URL: https://github.com/apache/spark/pull/32058#issuecomment-813824169 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136922/ -- This

[GitHub] [spark] SparkQA commented on pull request #31548: [SPARK-34127][SQL] Support table valued command

2021-04-05 Thread GitBox
SparkQA commented on pull request #31548: URL: https://github.com/apache/spark/pull/31548#issuecomment-813822372 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] SparkQA commented on pull request #32037: [SPARK-34944][SQL][TESTS] Employ correct data type for web_returns and store_returns in TPCDS tests

2021-04-05 Thread GitBox
SparkQA commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-813822186 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] SparkQA commented on pull request #31791: [SPARK-34678][SQL] Add table function registry

2021-04-05 Thread GitBox
SparkQA commented on pull request #31791: URL: https://github.com/apache/spark/pull/31791#issuecomment-813822000 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41505/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
SparkQA commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813821665 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] MaxGekk commented on pull request #32056: [SPARK-34667][SQL] Support casting of year-month intervals to strings

2021-04-05 Thread GitBox
MaxGekk commented on pull request #32056: URL: https://github.com/apache/spark/pull/32056#issuecomment-813820798 @gengliangwang @cloud-fan @yaooqinn @AngersZh Could you review this PR, please. -- This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] mridulm commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

2021-04-05 Thread GitBox
mridulm commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-813820509 I am assuming this is going to be built on top of SPARK-25299 ? Given SPARK-25299 is still not in, and has major interfaces still in design ... would be a good idea to converg

[GitHub] [spark] SparkQA removed a comment on pull request #32058: [SPARK-34962][SQL] Explicit representation of * in UpdateAction and InsertAction in MergeIntoTable

2021-04-05 Thread GitBox
SparkQA removed a comment on pull request #32058: URL: https://github.com/apache/spark/pull/32058#issuecomment-813731177 **[Test build #136922 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136922/testReport)** for PR 32058 at commit [`26b5104`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32058: [SPARK-34962][SQL] Explicit representation of * in UpdateAction and InsertAction in MergeIntoTable

2021-04-05 Thread GitBox
SparkQA commented on pull request #32058: URL: https://github.com/apache/spark/pull/32058#issuecomment-813815644 **[Test build #136922 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136922/testReport)** for PR 32058 at commit [`26b5104`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
SparkQA commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813808272 **[Test build #136931 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136931/testReport)** for PR 31920 at commit [`20e5170`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31968: [SPARK-34873][SQL] Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-04-05 Thread GitBox
SparkQA commented on pull request #31968: URL: https://github.com/apache/spark/pull/31968#issuecomment-813808206 **[Test build #136930 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136930/testReport)** for PR 31968 at commit [`c89e32d`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813806973 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136927/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
SparkQA removed a comment on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813806433 **[Test build #136927 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136927/testReport)** for PR 31920 at commit [`db2f4a6`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
SparkQA commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813806963 **[Test build #136927 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136927/testReport)** for PR 31920 at commit [`db2f4a6`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813806973 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136927/ -- This

[GitHub] [spark] beliefer removed a comment on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
beliefer removed a comment on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813805370 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [spark] SparkQA commented on pull request #31548: [SPARK-34127][SQL] Support table valued command

2021-04-05 Thread GitBox
SparkQA commented on pull request #31548: URL: https://github.com/apache/spark/pull/31548#issuecomment-813806572 **[Test build #136929 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136929/testReport)** for PR 31548 at commit [`399b028`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31791: [SPARK-34678][SQL] Add table function registry

2021-04-05 Thread GitBox
SparkQA commented on pull request #31791: URL: https://github.com/apache/spark/pull/31791#issuecomment-813806489 **[Test build #136928 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136928/testReport)** for PR 31791 at commit [`0e17fd9`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
SparkQA commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813806433 **[Test build #136927 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136927/testReport)** for PR 31920 at commit [`db2f4a6`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #32037: [SPARK-34944][SQL][TESTS] Employ correct data type for web_returns and store_returns in TPCDS tests

2021-04-05 Thread GitBox
SparkQA commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-813806392 **[Test build #136926 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136926/testReport)** for PR 32037 at commit [`081fd00`](https://github.com

[GitHub] [spark] beliefer commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
beliefer commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-813805370 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] beliefer commented on a change in pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
beliefer commented on a change in pull request #31920: URL: https://github.com/apache/spark/pull/31920#discussion_r607480900 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/errors/QueryCompilationErrors.scala ## @@ -1087,4 +1087,42 @@ private[spark] object Query

[GitHub] [spark] beliefer commented on a change in pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
beliefer commented on a change in pull request #31920: URL: https://github.com/apache/spark/pull/31920#discussion_r607479034 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/errors/QueryParsingErrors.scala ## @@ -303,4 +303,64 @@ object QueryParsingErrors {

[GitHub] [spark] beliefer commented on a change in pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-04-05 Thread GitBox
beliefer commented on a change in pull request #31920: URL: https://github.com/apache/spark/pull/31920#discussion_r607478785 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/errors/QueryParsingErrors.scala ## @@ -303,4 +303,64 @@ object QueryParsingErrors {

[GitHub] [spark] HyukjinKwon closed pull request #32036: [SPARK-34890][PYTHON] Port/integrate Koalas main codes into PySpark

2021-04-05 Thread GitBox
HyukjinKwon closed pull request #32036: URL: https://github.com/apache/spark/pull/32036 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, pl

[GitHub] [spark] HyukjinKwon commented on pull request #32036: [SPARK-34890][PYTHON] Port/integrate Koalas main codes into PySpark

2021-04-05 Thread GitBox
HyukjinKwon commented on pull request #32036: URL: https://github.com/apache/spark/pull/32036#issuecomment-813799219 Merged to master. Thanks all! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [spark] allisonwang-db commented on a change in pull request #31791: [SPARK-34678][SQL] Add table function registry

2021-04-05 Thread GitBox
allisonwang-db commented on a change in pull request #31791: URL: https://github.com/apache/spark/pull/31791#discussion_r607467949 ## File path: sql/core/src/test/resources/sql-tests/results/postgreSQL/numeric.sql.out ## @@ -4793,33 +4793,43 @@ Infinity -- !query select * fr

[GitHub] [spark] wangshuo128 commented on a change in pull request #31968: [SPARK-34873][SQL] Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-04-05 Thread GitBox
wangshuo128 commented on a change in pull request #31968: URL: https://github.com/apache/spark/pull/31968#discussion_r607461493 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LocalRelation.scala ## @@ -49,11 +49,13 @@ object LocalRelation

[GitHub] [spark] wangshuo128 commented on a change in pull request #31968: [SPARK-34873][SQL] Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-04-05 Thread GitBox
wangshuo128 commented on a change in pull request #31968: URL: https://github.com/apache/spark/pull/31968#discussion_r607459192 ## File path: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLDriverSuite.scala ## @@ -0,0 +1,65 @@ +/* + * Licen

[GitHub] [spark] SparkQA removed a comment on pull request #31791: [SPARK-34678][SQL] Add table function registry

2021-04-05 Thread GitBox
SparkQA removed a comment on pull request #31791: URL: https://github.com/apache/spark/pull/31791#issuecomment-813731368 **[Test build #136923 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136923/testReport)** for PR 31791 at commit [`0b1617e`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31791: [SPARK-34678][SQL] Add table function registry

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #31791: URL: https://github.com/apache/spark/pull/31791#issuecomment-813774391 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136923/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31791: [SPARK-34678][SQL] Add table function registry

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #31791: URL: https://github.com/apache/spark/pull/31791#issuecomment-813774391 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136923/ -- This

[GitHub] [spark] SparkQA commented on pull request #31791: [SPARK-34678][SQL] Add table function registry

2021-04-05 Thread GitBox
SparkQA commented on pull request #31791: URL: https://github.com/apache/spark/pull/31791#issuecomment-813774244 **[Test build #136923 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136923/testReport)** for PR 31791 at commit [`0b1617e`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32017: [SPARK-34923][SQL] Metadata output should be empty for more plans

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #32017: URL: https://github.com/apache/spark/pull/32017#issuecomment-813770411 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41502/

[GitHub] [spark] AmplabJenkins commented on pull request #32017: [SPARK-34923][SQL] Metadata output should be empty for more plans

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #32017: URL: https://github.com/apache/spark/pull/32017#issuecomment-813770411 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41502/ -- T

[GitHub] [spark] SparkQA commented on pull request #32017: [SPARK-34923][SQL] Metadata output should be empty for more plans

2021-04-05 Thread GitBox
SparkQA commented on pull request #32017: URL: https://github.com/apache/spark/pull/32017#issuecomment-813770396 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] AmplabJenkins removed a comment on pull request #24559: [SPARK-27658][SQL] Add FunctionCatalog API

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #24559: URL: https://github.com/apache/spark/pull/24559#issuecomment-813768990 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136919/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32056: [SPARK-34667][SQL] Support casting of year-month intervals to strings

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #32056: URL: https://github.com/apache/spark/pull/32056#issuecomment-813768986 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136921/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31887: [SPARK-34794][SQL] Fix nested transform issue

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #31887: URL: https://github.com/apache/spark/pull/31887#issuecomment-813768985 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41501/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32054: [SPARK-34946][SQL] Block unsupported correlated scalar subquery in Aggregate

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #32054: URL: https://github.com/apache/spark/pull/32054#issuecomment-813768988 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136918/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32017: [SPARK-34923][SQL] Metadata output should be empty for more plans

2021-04-05 Thread GitBox
AmplabJenkins removed a comment on pull request #32017: URL: https://github.com/apache/spark/pull/32017#issuecomment-813768989 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136920/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32056: [SPARK-34667][SQL] Support casting of year-month intervals to strings

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #32056: URL: https://github.com/apache/spark/pull/32056#issuecomment-813768986 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136921/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32054: [SPARK-34946][SQL] Block unsupported correlated scalar subquery in Aggregate

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #32054: URL: https://github.com/apache/spark/pull/32054#issuecomment-813768988 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136918/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32017: [SPARK-34923][SQL] Metadata output should be empty for more plans

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #32017: URL: https://github.com/apache/spark/pull/32017#issuecomment-813768989 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136920/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #24559: [SPARK-27658][SQL] Add FunctionCatalog API

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #24559: URL: https://github.com/apache/spark/pull/24559#issuecomment-813768990 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136919/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #31887: [SPARK-34794][SQL] Fix nested transform issue

2021-04-05 Thread GitBox
AmplabJenkins commented on pull request #31887: URL: https://github.com/apache/spark/pull/31887#issuecomment-813768985 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41501/ -- T

[GitHub] [spark] SparkQA commented on pull request #31887: [SPARK-34794][SQL] Fix nested transform issue

2021-04-05 Thread GitBox
SparkQA commented on pull request #31887: URL: https://github.com/apache/spark/pull/31887#issuecomment-813766925 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] SparkQA removed a comment on pull request #32056: [SPARK-34667][SQL] Support casting of year-month intervals to strings

2021-04-05 Thread GitBox
SparkQA removed a comment on pull request #32056: URL: https://github.com/apache/spark/pull/32056#issuecomment-813651887 **[Test build #136921 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136921/testReport)** for PR 32056 at commit [`d203e1e`](https://gi

  1   2   3   4   >