[GitHub] [spark] holdenk commented on issue #23380: [SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

holdenk commented on issue #23380: [SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470742406 Filed a follow up JIRA for the set -ex problem I found :( https://issues.apache.org/jira/browse/SPARK-2709

[GitHub] [spark] holdenk commented on issue #23380: [SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

holdenk commented on issue #23380: [SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470742276 cc @ifilonenko This is an automated mess

[GitHub] [spark] holdenk commented on a change in pull request #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

holdenk commented on a change in pull request #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#discussion_r263612534 ## File path: resource-managers/kubernetes/integration-tests/scripts/setup

[GitHub] [spark] srowen commented on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite

srowen commented on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite URL: https://github.com/apache/spark/pull/23958#issuecomment-470742048 Two configs? this seems excessive. Are people going to find, set and maintain these? What's the default? _If_ it's 0, th

[GitHub] [spark] SparkQA commented on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters

SparkQA commented on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters URL: https://github.com/apache/spark/pull/24016#issuecomment-470739871 **[Test build #103180 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103

[GitHub] [spark] AmplabJenkins removed a comment on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters

AmplabJenkins removed a comment on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters URL: https://github.com/apache/spark/pull/24016#issuecomment-470737285 Can one of the admins verify this patch? --

[GitHub] [spark] SparkQA commented on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters

SparkQA commented on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters URL: https://github.com/apache/spark/pull/24016#issuecomment-470737955 **[Test build #103178 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103

[GitHub] [spark] SparkQA commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer

SparkQA commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer URL: https://github.com/apache/spark/pull/24015#issuecomment-470737936 **[Test build #103179 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103179/te

[GitHub] [spark] AmplabJenkins removed a comment on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters

AmplabJenkins removed a comment on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters URL: https://github.com/apache/spark/pull/24016#issuecomment-470737121 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins commented on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters

AmplabJenkins commented on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters URL: https://github.com/apache/spark/pull/24016#issuecomment-470737285 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins commented on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters

AmplabJenkins commented on issue #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters URL: https://github.com/apache/spark/pull/24016#issuecomment-470737121 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins removed a comment on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor

AmplabJenkins removed a comment on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#issuecomment-470736088 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor

AmplabJenkins removed a comment on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#issuecomment-470736096 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor

AmplabJenkins commented on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#issuecomment-470736088 Merged build finished. Test PASSed. --

[GitHub] [spark] HeartSaVioR opened a new pull request #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters

HeartSaVioR opened a new pull request #24016: [MINOR][SQL] Deduplicate huge if statements in get between specialized getters URL: https://github.com/apache/spark/pull/24016 ## What changes were proposed in this pull request? This patch deduplicates the huge if statements regarding ge

[GitHub] [spark] AmplabJenkins commented on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor

AmplabJenkins commented on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#issuecomment-470736096 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470735067 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA removed a comment on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor

SparkQA removed a comment on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#issuecomment-470634507 **[Test build #103150 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470735059 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA commented on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor

SparkQA commented on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#issuecomment-470735234 **[Test build #103150 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470734973 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470734927 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/testing

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470735067 Test FAILed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470734973 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470735059 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470734969 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470734969 Merged build finished. Test PASSed. ---

[GitHub] [spark] squito commented on a change in pull request #23453: [SPARK-26089][CORE] Handle corruption in large shuffle blocks

squito commented on a change in pull request #23453: [SPARK-26089][CORE] Handle corruption in large shuffle blocks URL: https://github.com/apache/spark/pull/23453#discussion_r263603012 ## File path: core/src/test/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala

[GitHub] [spark] squito commented on a change in pull request #23453: [SPARK-26089][CORE] Handle corruption in large shuffle blocks

squito commented on a change in pull request #23453: [SPARK-26089][CORE] Handle corruption in large shuffle blocks URL: https://github.com/apache/spark/pull/23453#discussion_r263603703 ## File path: core/src/test/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala

[GitHub] [spark] squito commented on a change in pull request #23453: [SPARK-26089][CORE] Handle corruption in large shuffle blocks

squito commented on a change in pull request #23453: [SPARK-26089][CORE] Handle corruption in large shuffle blocks URL: https://github.com/apache/spark/pull/23453#discussion_r263602188 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -335,6 +336,44

[GitHub] [spark] squito commented on a change in pull request #23453: [SPARK-26089][CORE] Handle corruption in large shuffle blocks

squito commented on a change in pull request #23453: [SPARK-26089][CORE] Handle corruption in large shuffle blocks URL: https://github.com/apache/spark/pull/23453#discussion_r263600488 ## File path: core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala ###

[GitHub] [spark] squito commented on a change in pull request #23453: [SPARK-26089][CORE] Handle corruption in large shuffle blocks

squito commented on a change in pull request #23453: [SPARK-26089][CORE] Handle corruption in large shuffle blocks URL: https://github.com/apache/spark/pull/23453#discussion_r263604469 ## File path: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala ## @@ -211,6 +2

[GitHub] [spark] squito commented on a change in pull request #23453: [SPARK-26089][CORE] Handle corruption in large shuffle blocks

squito commented on a change in pull request #23453: [SPARK-26089][CORE] Handle corruption in large shuffle blocks URL: https://github.com/apache/spark/pull/23453#discussion_r263599738 ## File path: core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala ###

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470733710 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/je

[GitHub] [spark] dongjoon-hyun commented on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite

dongjoon-hyun commented on issue #23958: [SPARK-27045] SQL tab in UI shows actual SQL instead of callsite URL: https://github.com/apache/spark/pull/23958#issuecomment-470733301 Yes. @ajithme . Please add two configurations for those maximum length. One for event log and one for the UI.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470732966 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470732848 **[Test build #103176 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470732966 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470732976 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] SparkQA removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

SparkQA removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470727145 **[Test build #103176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470732976 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins removed a comment on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

AmplabJenkins removed a comment on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#issuecomment-470731971 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins removed a comment on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

AmplabJenkins removed a comment on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#issuecomment-470731967 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

AmplabJenkins commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#issuecomment-470731967 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

AmplabJenkins commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#issuecomment-470731971 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] srowen closed pull request #23996: [MINOR][BUILD] Add 2 maven properties(hive.classifier and hive.parquet.group)

srowen closed pull request #23996: [MINOR][BUILD] Add 2 maven properties(hive.classifier and hive.parquet.group) URL: https://github.com/apache/spark/pull/23996 This is an automated message from the Apache Git Service. To re

[GitHub] [spark] SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470730337 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-p

[GitHub] [spark] SparkQA commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

SparkQA commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#issuecomment-470730038 **[Test build #103177 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103177/te

[GitHub] [spark] srowen commented on issue #23996: [MINOR][BUILD] Add 2 maven properties(hive.classifier and hive.parquet.group)

srowen commented on issue #23996: [MINOR][BUILD] Add 2 maven properties(hive.classifier and hive.parquet.group) URL: https://github.com/apache/spark/pull/23996#issuecomment-470729980 Merged to master This is an automated mess

[GitHub] [spark] srowen commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

srowen commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#issuecomment-470729087 Done, I amended the author tag. Let's see if that works. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470727983 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470728260 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470727983 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470727993 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470727963 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/je

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470727993 Test FAILed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] srowen commented on a change in pull request #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

srowen commented on a change in pull request #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#discussion_r263600085 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala

[GitHub] [spark] SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470727145 **[Test build #103176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470726803 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] MaxGekk commented on a change in pull request #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

MaxGekk commented on a change in pull request #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#discussion_r263597221 ## File path: sql/core/src/test/scala/org/apache/spark/sql/internal/SQLConfSuite.scal

[GitHub] [spark] wangyum commented on issue #23996: [MINOR][BUILD] Add 2 maven properties(hive.classifier and hive.parquet.group)

wangyum commented on issue #23996: [MINOR][BUILD] Add 2 maven properties(hive.classifier and hive.parquet.group) URL: https://github.com/apache/spark/pull/23996#issuecomment-470724295 @srowen Could we merge this to the master? ---

[GitHub] [spark] MaxGekk commented on a change in pull request #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

MaxGekk commented on a change in pull request #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#discussion_r263596454 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470724518 **[Test build #103175 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkP

[GitHub] [spark] MaxGekk commented on a change in pull request #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

MaxGekk commented on a change in pull request #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#discussion_r263597221 ## File path: sql/core/src/test/scala/org/apache/spark/sql/internal/SQLConfSuite.scal

[GitHub] [spark] dongjoon-hyun commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

dongjoon-hyun commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#issuecomment-470724083 It seems that I'm bothering you too much. :) Sorry about that. Yes, please do that. I think this GitHub P

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470721755 **[Test build #103174 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkP

[GitHub] [spark] AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470721370 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470721378 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] SparkQA removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

SparkQA removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470716150 **[Test build #103173 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470721370 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470721276 **[Test build #103173 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470721378 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470720536 Test FAILed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470720522 Merged build finished. Test FAILed. ---

[GitHub] [spark] AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470720522 Merged build finished. Test FAILed. ---

[GitHub] [spark] AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470720536 Test FAILed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470720411 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/testing

[GitHub] [spark] SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470719308 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-p

[GitHub] [spark] SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470716150 **[Test build #103173 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] AmplabJenkins removed a comment on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer

AmplabJenkins removed a comment on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer URL: https://github.com/apache/spark/pull/24015#issuecomment-470715383 Test FAILed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] srowen commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

srowen commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#issuecomment-470715921 Are you suggesting something else like amending the author tag? I'm open to it if that's all there is. Cherry-pi

[GitHub] [spark] SparkQA removed a comment on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer

SparkQA removed a comment on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer URL: https://github.com/apache/spark/pull/24015#issuecomment-470710480 **[Test build #103171 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] AmplabJenkins removed a comment on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer

AmplabJenkins removed a comment on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer URL: https://github.com/apache/spark/pull/24015#issuecomment-470715368 Merged build finished. Test FAILed. -

[GitHub] [spark] AmplabJenkins commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer

AmplabJenkins commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer URL: https://github.com/apache/spark/pull/24015#issuecomment-470715383 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer

AmplabJenkins commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer URL: https://github.com/apache/spark/pull/24015#issuecomment-470715368 Merged build finished. Test FAILed. This

[GitHub] [spark] SparkQA commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer

SparkQA commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer URL: https://github.com/apache/spark/pull/24015#issuecomment-470715330 **[Test build #103171 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103171/t

[GitHub] [spark] AmplabJenkins removed a comment on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer

AmplabJenkins removed a comment on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer URL: https://github.com/apache/spark/pull/24015#issuecomment-470709629 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

SparkQA commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-470710510 **[Test build #103172 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuild

[GitHub] [spark] SparkQA commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer

SparkQA commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer URL: https://github.com/apache/spark/pull/24015#issuecomment-470710480 **[Test build #103171 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103171/te

[GitHub] [spark] AmplabJenkins removed a comment on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer

AmplabJenkins removed a comment on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer URL: https://github.com/apache/spark/pull/24015#issuecomment-470709444 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

AmplabJenkins removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-470709792 Test PASSed. Refer to this link for build results (access rights to CI server neede

[GitHub] [spark] AmplabJenkins removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

AmplabJenkins removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-470709782 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-470709782 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

AmplabJenkins commented on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-470709792 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer

AmplabJenkins commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer URL: https://github.com/apache/spark/pull/24015#issuecomment-470709629 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer

AmplabJenkins commented on issue #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer URL: https://github.com/apache/spark/pull/24015#issuecomment-470709444 Can one of the admins verify this patch?

[GitHub] [spark] dongjoon-hyun commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

dongjoon-hyun commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#issuecomment-470709270 @srowen . If you are busy, could you change the authorship when you merge this PR? That's just what we ne

[GitHub] [spark] HeartSaVioR commented on a change in pull request #23908: [SPARK-27001][SQL] Refactor "serializerFor" method between ScalaReflection and JavaTypeInference

HeartSaVioR commented on a change in pull request #23908: [SPARK-27001][SQL] Refactor "serializerFor" method between ScalaReflection and JavaTypeInference URL: https://github.com/apache/spark/pull/23908#discussion_r263583167 ## File path: sql/catalyst/src/main/scala/org/apache/spa

[GitHub] [spark] HeartSaVioR opened a new pull request #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer

HeartSaVioR opened a new pull request #24015: [SPARK-27001][SQL][FOLLOWUP] Address primitive array type for serializer URL: https://github.com/apache/spark/pull/24015 ## What changes were proposed in this pull request? This is follow-up PR which addresses review comment in PR for SPA

[GitHub] [spark] vanzin commented on a change in pull request #23951: [SPARK-27038][CORE][YARN] Re-implement RackResolver to reduce resolving time

vanzin commented on a change in pull request #23951: [SPARK-27038][CORE][YARN] Re-implement RackResolver to reduce resolving time URL: https://github.com/apache/spark/pull/23951#discussion_r263582555 ## File path: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala

<    1   2   3   4   5   6   7   8   9   10   >