[GitHub] [spark] AmplabJenkins removed a comment on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt.

AmplabJenkins removed a comment on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt. URL: https://github.com/apache/spark/pull/24017#issuecomment-470771745 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt.

AmplabJenkins commented on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt. URL: https://github.com/apache/spark/pull/24017#issuecomment-470771745 Merged build finished. Test PASSed. Thi

[GitHub] [spark] SparkQA commented on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt.

SparkQA commented on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt. URL: https://github.com/apache/spark/pull/24017#issuecomment-470771684 **[Test build #103183 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103183/

[GitHub] [spark] AmplabJenkins commented on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt.

AmplabJenkins commented on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt. URL: https://github.com/apache/spark/pull/24017#issuecomment-470771748 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] HeartSaVioR commented on a change in pull request #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters

HeartSaVioR commented on a change in pull request #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters URL: https://github.com/apache/spark/pull/24016#discussion_r263639009 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expr

[GitHub] [spark] 10110346 commented on a change in pull request #23695: [SPARK-26780][CORE]Improve shuffle read using ReadAheadInputStream

10110346 commented on a change in pull request #23695: [SPARK-26780][CORE]Improve shuffle read using ReadAheadInputStream URL: https://github.com/apache/spark/pull/23695#discussion_r263638969 ## File path: core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.sc

[GitHub] [spark] AmplabJenkins removed a comment on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder

AmplabJenkins removed a comment on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder URL: https://github.com/apache/spark/pull/24014#issuecomment-470770191 Test PASSed. Refer to this link for build results (access rights to C

[GitHub] [spark] AmplabJenkins commented on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder

AmplabJenkins commented on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder URL: https://github.com/apache/spark/pull/24014#issuecomment-470770191 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder

AmplabJenkins removed a comment on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder URL: https://github.com/apache/spark/pull/24014#issuecomment-470770187 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder

AmplabJenkins commented on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder URL: https://github.com/apache/spark/pull/24014#issuecomment-470770187 Merged build finished. Test PASSed. ---

[GitHub] [spark] 10110346 commented on issue #23695: [SPARK-26780][CORE]Improve shuffle read using ReadAheadInputStream

10110346 commented on issue #23695: [SPARK-26780][CORE]Improve shuffle read using ReadAheadInputStream URL: https://github.com/apache/spark/pull/23695#issuecomment-470770070 > > > Could you please share the performance difference running TPCDS with and without this improvement?

[GitHub] [spark] SparkQA removed a comment on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder

SparkQA removed a comment on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder URL: https://github.com/apache/spark/pull/24014#issuecomment-470698242 **[Test build #103169 has started](https://amplab.cs.berkeley.edu/jenkins/job

[GitHub] [spark] SparkQA commented on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder

SparkQA commented on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder URL: https://github.com/apache/spark/pull/24014#issuecomment-470769726 **[Test build #103169 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkP

[GitHub] [spark] SparkQA removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

SparkQA removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470685103 **[Test build #103164 has started](https://amplab.cs.berkeley.edu/jenkins/jo

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470769468 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470769464 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470769468 Test PASSed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470769464 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470768965 **[Test build #103164 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spark

[GitHub] [spark] Ngone51 commented on issue #24007: [SPARK-23433][SPARK-25250] [CORE][BRANCH-2.3] Later created TaskSet should learn about the finished partitions

Ngone51 commented on issue #24007: [SPARK-23433][SPARK-25250] [CORE][BRANCH-2.3] Later created TaskSet should learn about the finished partitions URL: https://github.com/apache/spark/pull/24007#issuecomment-470768420 Thanks @squito . ---

[GitHub] [spark] zjf2012 commented on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor

zjf2012 commented on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#issuecomment-470768296 @attilapiros, both *.io.serverThreads and *.io.clientThreads were 8, which is maximum allowed value at t

[GitHub] [spark] AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470767880 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] AmplabJenkins commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

AmplabJenkins commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470767874 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470767874 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

AmplabJenkins commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470767880 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkin

[GitHub] [spark] SparkQA removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

SparkQA removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470687712 **[Test build #103165 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103165/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt.

AmplabJenkins removed a comment on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt. URL: https://github.com/apache/spark/pull/24017#issuecomment-470766840 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt.

AmplabJenkins removed a comment on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt. URL: https://github.com/apache/spark/pull/24017#issuecomment-470766847 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] SparkQA commented on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt.

SparkQA commented on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt. URL: https://github.com/apache/spark/pull/24017#issuecomment-470767177 **[Test build #103183 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103183/t

[GitHub] [spark] SparkQA commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

SparkQA commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470767188 **[Test build #103165 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103165/testReport)** for PR 2391

[GitHub] [spark] SongYadong commented on issue #23985: [SQL][MINOR] List SparkSql reserved keywords in alphabet order

SongYadong commented on issue #23985: [SQL][MINOR] List SparkSql reserved keywords in alphabet order URL: https://github.com/apache/spark/pull/23985#issuecomment-470766969 I got it. Let me try now. This is an automated messag

[GitHub] [spark] AmplabJenkins commented on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt.

AmplabJenkins commented on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt. URL: https://github.com/apache/spark/pull/24017#issuecomment-470766847 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins commented on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt.

AmplabJenkins commented on issue #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt. URL: https://github.com/apache/spark/pull/24017#issuecomment-470766840 Merged build finished. Test PASSed. Thi

[GitHub] [spark] vanzin commented on a change in pull request #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt.

vanzin commented on a change in pull request #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt. URL: https://github.com/apache/spark/pull/24017#discussion_r263635288 ## File path: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Appl

[GitHub] [spark] vanzin opened a new pull request #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt.

vanzin opened a new pull request #24017: [SPARK-27094][YARN] Work around RackResolver swallowing thread interrupt. URL: https://github.com/apache/spark/pull/24017 To avoid the case where the YARN libraries would swallow the exception and prevent YarnAllocator from shutting down, call the

[GitHub] [spark] maropu commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

maropu commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#discussion_r263634734 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimize

[GitHub] [spark] AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470763848 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/

[GitHub] [spark] AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470763847 Merged build finished. Test PASSed. This is an automated mes

[GitHub] [spark] maropu commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

maropu commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#discussion_r263633113 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimize

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470763761 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470763769 Test PASSed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470763848 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470763769 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470763847 Merged build finished. Test PASSed. This is an automated message fro

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470763761 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

SparkQA removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470675145 **[Test build #103157 has started](https://amplab.cs.berkeley.edu/jenkins/jo

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470763286 **[Test build #103157 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spark

[GitHub] [spark] hehuiyuan commented on a change in pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's ann

hehuiyuan commented on a change in pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's annotations URL: https://github.com/apache/spark/pull/24009#discussion_r263628017 ## File path

[GitHub] [spark] srowen commented on issue #23985: [SQL][MINOR] List SparkSql reserved keywords in alphabet order

srowen commented on issue #23985: [SQL][MINOR] List SparkSql reserved keywords in alphabet order URL: https://github.com/apache/spark/pull/23985#issuecomment-470762760 I don't mind letting this file grow long if it helps readability by adopting PostgreSQL style. I don't think it has to

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470762446 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

SparkQA commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470762710 **[Test build #103182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103182/testReport)** for PR 23783 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470762451 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470762446 Merged build finished. Test PASSed. --

[GitHub] [spark] srowen closed pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's annotations

srowen closed pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's annotations URL: https://github.com/apache/spark/pull/24009 -

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470762451 Test PASSed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470762080 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] srowen commented on a change in pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's annota

srowen commented on a change in pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's annotations URL: https://github.com/apache/spark/pull/24009#discussion_r263631814 ## File path: c

[GitHub] [spark] SongYadong commented on issue #23985: [SQL][MINOR] List SparkSql reserved keywords in alphabet order

SongYadong commented on issue #23985: [SQL][MINOR] List SparkSql reserved keywords in alphabet order URL: https://github.com/apache/spark/pull/23985#issuecomment-470762232 Indeed it's clearer in PostgreSQL style. But that makes files too long. I'm not sure how to balance.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470762079 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

AmplabJenkins commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470762080 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkin

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470761987 **[Test build #103155 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spark

[GitHub] [spark] AmplabJenkins commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

AmplabJenkins commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470762079 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] SparkQA removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

SparkQA removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470672614 **[Test build #103155 has started](https://amplab.cs.berkeley.edu/jenkins/jo

[GitHub] [spark] SparkQA removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

SparkQA removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470684998 **[Test build #103161 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103161/testReport)** for

[GitHub] [spark] SparkQA commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

SparkQA commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470761565 **[Test build #103161 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103161/testReport)** for PR 2401

[GitHub] [spark] srowen commented on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite

srowen commented on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite URL: https://github.com/apache/spark/pull/23958#issuecomment-470761047 I'm not sure it follows that this causes people to turn off event logs; it just doesn't seem that big. It's also useful

[GitHub] [spark] hehuiyuan commented on a change in pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's ann

hehuiyuan commented on a change in pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's annotations URL: https://github.com/apache/spark/pull/24009#discussion_r263628017 ## File path

[GitHub] [spark] hehuiyuan commented on a change in pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's ann

hehuiyuan commented on a change in pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's annotations URL: https://github.com/apache/spark/pull/24009#discussion_r263628017 ## File path

[GitHub] [spark] AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470760461 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] AmplabJenkins commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

AmplabJenkins commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470760458 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470760458 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

AmplabJenkins commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470760461 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkin

[GitHub] [spark] SparkQA removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

SparkQA removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470684991 **[Test build #103162 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103162/testReport)** for

[GitHub] [spark] SparkQA commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

SparkQA commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470760064 **[Test build #103162 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103162/testReport)** for PR 2391

[GitHub] [spark] dongjoon-hyun commented on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite

dongjoon-hyun commented on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite URL: https://github.com/apache/spark/pull/23958#issuecomment-470759247 If we provide a reasonable configuration to control the degree of size, they will not turn off it. Otherwise, we

[GitHub] [spark] dongjoon-hyun edited a comment on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite

dongjoon-hyun edited a comment on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite URL: https://github.com/apache/spark/pull/23958#issuecomment-470759247 If we provide a reasonable configuration to control the degree of size, they will not turn it off. Otherwi

[GitHub] [spark] AmplabJenkins removed a comment on issue #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2

AmplabJenkins removed a comment on issue #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2 URL: https://github.com/apache/spark/pull/24002#issuecomment-470758827 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins removed a comment on issue #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2

AmplabJenkins removed a comment on issue #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2 URL: https://github.com/apache/spark/pull/24002#issuecomment-470758822 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2

AmplabJenkins commented on issue #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2 URL: https://github.com/apache/spark/pull/24002#issuecomment-470758822 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] AmplabJenkins commented on issue #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2

AmplabJenkins commented on issue #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2 URL: https://github.com/apache/spark/pull/24002#issuecomment-470758827 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] [spark] SparkQA removed a comment on issue #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2

SparkQA removed a comment on issue #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2 URL: https://github.com/apache/spark/pull/24002#issuecomment-470664608 **[Test build #103152 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103152/testRe

[GitHub] [spark] SparkQA commented on issue #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2

SparkQA commented on issue #24002: [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2 URL: https://github.com/apache/spark/pull/24002#issuecomment-470758352 **[Test build #103152 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103152/testReport)**

[GitHub] [spark] hehuiyuan commented on a change in pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's ann

hehuiyuan commented on a change in pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's annotations URL: https://github.com/apache/spark/pull/24009#discussion_r263628017 ## File path

[GitHub] [spark] dongjoon-hyun commented on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2

dongjoon-hyun commented on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#issuecomment-470757828 Sure, @gatorsmile . I'll try to take a look more tonight. -

[GitHub] [spark] SparkQA commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

SparkQA commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#issuecomment-470757155 **[Test build #103181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103

[GitHub] [spark] AmplabJenkins removed a comment on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

AmplabJenkins removed a comment on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#issuecomment-470756711 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

AmplabJenkins removed a comment on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#issuecomment-470756714 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

AmplabJenkins commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#issuecomment-470756711 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

AmplabJenkins commented on issue #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#issuecomment-470756714 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

dongjoon-hyun commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#discussion_r263617985 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/o

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

dongjoon-hyun commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#discussion_r263622325 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/o

[GitHub] [spark] HyukjinKwon commented on a change in pull request #23977: [SPARK-26923][SQL][R] Refactor ArrowRRunner and RRunner to share one BaseRRunner

HyukjinKwon commented on a change in pull request #23977: [SPARK-26923][SQL][R] Refactor ArrowRRunner and RRunner to share one BaseRRunner URL: https://github.com/apache/spark/pull/23977#discussion_r263334756 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/objec

[GitHub] [spark] HyukjinKwon commented on a change in pull request #23977: [SPARK-26923][SQL][R] Refactor ArrowRRunner and RRunner to share one BaseRRunner

HyukjinKwon commented on a change in pull request #23977: [SPARK-26923][SQL][R] Refactor ArrowRRunner and RRunner to share one BaseRRunner URL: https://github.com/apache/spark/pull/23977#discussion_r263334756 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/objec

[GitHub] [spark] gatorsmile commented on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2

gatorsmile commented on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#issuecomment-470750293 cc @HyukjinKwon @dongjoon-hyun Are you interested in the code review for this PR? ---

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

dongjoon-hyun commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#discussion_r263620410 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/o

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition

dongjoon-hyun commented on a change in pull request #23964: [SPARK-26975][SQL] Support nested-column pruning over limit/sample/repartition URL: https://github.com/apache/spark/pull/23964#discussion_r263617985 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/o

[GitHub] [spark] dongjoon-hyun edited a comment on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite

dongjoon-hyun edited a comment on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite URL: https://github.com/apache/spark/pull/23958#issuecomment-470743431 @srowen . I know a few customers which turned off Spark event logs due to the traffic issue. Not every clu

[GitHub] [spark] srowen commented on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite

srowen commented on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite URL: https://github.com/apache/spark/pull/23958#issuecomment-470744172 If you turn off event logs, does what gets logged matter? --

[GitHub] [spark] dongjoon-hyun edited a comment on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite

dongjoon-hyun edited a comment on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite URL: https://github.com/apache/spark/pull/23958#issuecomment-470743431 @srowen . I know a few customers which turned off Spark event logs due to the traffic issue. Not every clu

[GitHub] [spark] dongjoon-hyun commented on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite

dongjoon-hyun commented on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite URL: https://github.com/apache/spark/pull/23958#issuecomment-470743431 @srowen . I know a few customers which turned off Spark event logs due to the traffic issue. Not every clusters a

<    1   2   3   4   5   6   7   8   9   10   >