[GitHub] [spark] dongjoon-hyun commented on pull request #29973: [SPARK-33082][SPARK-20202][BUILD][SQL][FOLLOW-UP] Remove Hive 1.2 workarounds and Hive 1.2 profile in Jenkins script

2020-10-08 Thread GitBox
dongjoon-hyun commented on pull request #29973: URL: https://github.com/apache/spark/pull/29973#issuecomment-706008368 Oh, nice catch, @wangyum ! This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [spark] sarutak commented on a change in pull request #29958: [SPARK-33079][TESTS] Add Scala 2.13 build test in GitHub Action for SBT

2020-10-08 Thread GitBox
sarutak commented on a change in pull request #29958: URL: https://github.com/apache/spark/pull/29958#discussion_r502226000 ## File path: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala ## @@ -91,7 +91,7 @@ class KinesisBacked

[GitHub] [spark] LuciferYang commented on a change in pull request #29958: [SPARK-33079][TESTS] Add Scala 2.13 build test in GitHub Action for SBT

2020-10-08 Thread GitBox
LuciferYang commented on a change in pull request #29958: URL: https://github.com/apache/spark/pull/29958#discussion_r502223867 ## File path: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisBackedBlockRDD.scala ## @@ -91,7 +91,7 @@ class KinesisBa

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29975: [SPARK-33092][SQL] Support subexpression elimination in ProjectExec

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29975: URL: https://github.com/apache/spark/pull/29975#issuecomment-705990710 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] wangyum commented on pull request #29973: [SPARK-33082][SPARK-20202][BUILD][SQL][FOLLOW-UP] Remove Hive 1.2 workarounds and Hive 1.2 profile in Jenkins script

2020-10-08 Thread GitBox
wangyum commented on pull request #29973: URL: https://github.com/apache/spark/pull/29973#issuecomment-706000169 Remove [spark-deps-hadoop-2.7-hive-1.2](https://github.com/apache/spark/blob/master/dev/deps/spark-deps-hadoop-2.7-hive-1.2)? --

[GitHub] [spark] duanmeng commented on pull request #29907: [SPARK-33022] partition length is wrong after merge partition segment…

2020-10-08 Thread GitBox
duanmeng commented on pull request #29907: URL: https://github.com/apache/spark/pull/29907#issuecomment-705995805 > > This is related to disk/kernel but we can avoid it in spark without any performance loss. > > Do you have any reference regarding the kernel issue?In other words, do

[GitHub] [spark] dongjoon-hyun commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout conf in ExecutorPodsAllocator

2020-10-08 Thread GitBox
dongjoon-hyun commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705994406 Hi, @HyukjinKwon . Could you review this please? This is an automated message from the Apache Git Service.

[GitHub] [spark] zero323 commented on pull request #29978: [SPARK-32793][FOLLOW-UP] Minor corrections for PySpark annotations and SparkR

2020-10-08 Thread GitBox
zero323 commented on pull request #29978: URL: https://github.com/apache/spark/pull/29978#issuecomment-705993393 Thanks @HyukjinKwon This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] viirya commented on a change in pull request #29950: [SPARK-32945][SQL] Avoid collapsing projects if reaching max allowed common exprs

2020-10-08 Thread GitBox
viirya commented on a change in pull request #29950: URL: https://github.com/apache/spark/pull/29950#discussion_r502211597 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/CollapseProjectSuite.scala ## @@ -170,4 +171,34 @@ class CollapseProject

[GitHub] [spark] SparkQA commented on pull request #29975: [SPARK-33092][SQL] Support subexpression elimination in ProjectExec

2020-10-08 Thread GitBox
SparkQA commented on pull request #29975: URL: https://github.com/apache/spark/pull/29975#issuecomment-705990693 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34182/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #29975: [SPARK-33092][SQL] Support subexpression elimination in ProjectExec

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29975: URL: https://github.com/apache/spark/pull/29975#issuecomment-705990710 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] maropu commented on a change in pull request #29950: [SPARK-32945][SQL] Avoid collapsing projects if reaching max allowed common exprs

2020-10-08 Thread GitBox
maropu commented on a change in pull request #29950: URL: https://github.com/apache/spark/pull/29950#discussion_r502206637 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/CollapseProjectSuite.scala ## @@ -170,4 +171,34 @@ class CollapseProject

[GitHub] [spark] tanelk commented on a change in pull request #29950: [SPARK-32945][SQL] Avoid collapsing projects if reaching max allowed common exprs

2020-10-08 Thread GitBox
tanelk commented on a change in pull request #29950: URL: https://github.com/apache/spark/pull/29950#discussion_r502204585 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/CollapseProjectSuite.scala ## @@ -170,4 +171,34 @@ class CollapseProject

[GitHub] [spark] tanelk commented on a change in pull request #29950: [SPARK-32945][SQL] Avoid collapsing projects if reaching max allowed common exprs

2020-10-08 Thread GitBox
tanelk commented on a change in pull request #29950: URL: https://github.com/apache/spark/pull/29950#discussion_r502206361 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/CollapseProjectSuite.scala ## @@ -170,4 +171,34 @@ class CollapseProject

[GitHub] [spark] tanelk commented on a change in pull request #29950: [SPARK-32945][SQL] Avoid collapsing projects if reaching max allowed common exprs

2020-10-08 Thread GitBox
tanelk commented on a change in pull request #29950: URL: https://github.com/apache/spark/pull/29950#discussion_r502204585 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/CollapseProjectSuite.scala ## @@ -170,4 +171,34 @@ class CollapseProject

[GitHub] [spark] SparkQA commented on pull request #29975: [SPARK-33092][SQL] Support subexpression elimination in ProjectExec

2020-10-08 Thread GitBox
SparkQA commented on pull request #29975: URL: https://github.com/apache/spark/pull/29975#issuecomment-705984808 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34182/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout conf in ExecutorPodsAllocator

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705976134 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] viirya commented on a change in pull request #29950: [SPARK-32945][SQL] Avoid collapsing projects if reaching max allowed common exprs

2020-10-08 Thread GitBox
viirya commented on a change in pull request #29950: URL: https://github.com/apache/spark/pull/29950#discussion_r502200210 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/CollapseProjectSuite.scala ## @@ -170,4 +171,34 @@ class CollapseProject

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout conf in ExecutorPodsAllocator

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705978829 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34181/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout conf in ExecutorPodsAllocator

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705978843 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout conf in ExecutorPodsAllocator

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705976116 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34180/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout conf in ExecutorPodsAllocator

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705976134 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29975: [SPARK-33092][SQL] Support subexpression elimination in ProjectExec

2020-10-08 Thread GitBox
SparkQA commented on pull request #29975: URL: https://github.com/apache/spark/pull/29975#issuecomment-705972359 **[Test build #129577 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129577/testReport)** for PR 29975 at commit [`fe92bfe`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout conf in ExecutorPodsAllocator

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705971930 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34181/ -

[GitHub] [spark] viirya commented on a change in pull request #29975: [SPARK-33092][SQL] Support subexpression elimination in ProjectExec

2020-10-08 Thread GitBox
viirya commented on a change in pull request #29975: URL: https://github.com/apache/spark/pull/29975#discussion_r502192867 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/DataSourceV2Suite.scala ## @@ -268,7 +268,7 @@ class DataSourceV2Suite extends QueryT

[GitHub] [spark] viirya commented on a change in pull request #29975: [SPARK-33092][SQL] Support subexpression elimination in ProjectExec

2020-10-08 Thread GitBox
viirya commented on a change in pull request #29975: URL: https://github.com/apache/spark/pull/29975#discussion_r502192867 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/DataSourceV2Suite.scala ## @@ -268,7 +268,7 @@ class DataSourceV2Suite extends QueryT

[GitHub] [spark] AmplabJenkins commented on pull request #29959: [WIP][SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-705971167 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout conf in ExecutorPodsAllocator

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705971195 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34180/ -

[GitHub] [spark] dongjoon-hyun commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
dongjoon-hyun commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705970963 cc @holdenk , @dbtsai , @viirya This is an automated message from the Apache Git Service. To respond to t

[GitHub] [spark] SparkQA removed a comment on pull request #29959: [WIP][SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

2020-10-08 Thread GitBox
SparkQA removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-705930551 **[Test build #129571 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129571/testReport)** for PR 29959 at commit [`f582b17`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29959: [WIP][SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

2020-10-08 Thread GitBox
SparkQA commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-705970583 **[Test build #129571 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129571/testReport)** for PR 29959 at commit [`f582b17`](https://github.co

[GitHub] [spark] HyukjinKwon commented on pull request #29973: [SPARK-33082][SPARK-20202][BUILD][SQL][FOLLOW-UP] Remove Hive 1.2 workarounds and Hive 1.2 profile in Jenkins script

2020-10-08 Thread GitBox
HyukjinKwon commented on pull request #29973: URL: https://github.com/apache/spark/pull/29973#issuecomment-705969339 Sure will update! This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705967684 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705967684 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705967674 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34179/ ---

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29881: [SPARK-32852][SQL] spark.sql.hive.metastore.jars support HDFS location

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29881: URL: https://github.com/apache/spark/pull/29881#issuecomment-705966172 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29881: [SPARK-32852][SQL] spark.sql.hive.metastore.jars support HDFS location

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29881: URL: https://github.com/apache/spark/pull/29881#issuecomment-705966172 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705965766 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29881: [SPARK-32852][SQL] spark.sql.hive.metastore.jars support HDFS location

2020-10-08 Thread GitBox
SparkQA removed a comment on pull request #29881: URL: https://github.com/apache/spark/pull/29881#issuecomment-705937731 **[Test build #129572 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129572/testReport)** for PR 29881 at commit [`9278404`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #29972: [SPARK-33081][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2 dialect)

2020-10-08 Thread GitBox
SparkQA removed a comment on pull request #29972: URL: https://github.com/apache/spark/pull/29972#issuecomment-705915047 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705959286 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29881: [SPARK-32852][SQL] spark.sql.hive.metastore.jars support HDFS location

2020-10-08 Thread GitBox
SparkQA commented on pull request #29881: URL: https://github.com/apache/spark/pull/29881#issuecomment-705965778 **[Test build #129572 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129572/testReport)** for PR 29881 at commit [`9278404`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705965766 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29972: [SPARK-33081][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2 dialect)

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29972: URL: https://github.com/apache/spark/pull/29972#issuecomment-705957305 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29958: [SPARK-33079][TESTS] Add Scala 2.13 build test in GitHub Action for SBT

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29958: URL: https://github.com/apache/spark/pull/29958#issuecomment-705956082 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29792: [SPARK-32858][SQL] UnwrapCastInBinaryComparison: support other numeric types

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29792: URL: https://github.com/apache/spark/pull/29792#issuecomment-705960336 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
SparkQA removed a comment on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705956031 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] SparkQA removed a comment on pull request #29792: [SPARK-32858][SQL] UnwrapCastInBinaryComparison: support other numeric types

2020-10-08 Thread GitBox
SparkQA removed a comment on pull request #29792: URL: https://github.com/apache/spark/pull/29792#issuecomment-705891447 **[Test build #129566 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129566/testReport)** for PR 29792 at commit [`94942bf`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #29958: [SPARK-33079][TESTS] Add Scala 2.13 build test in GitHub Action for SBT

2020-10-08 Thread GitBox
SparkQA removed a comment on pull request #29958: URL: https://github.com/apache/spark/pull/29958#issuecomment-705911154 **[Test build #129568 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129568/testReport)** for PR 29958 at commit [`47a4806`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705965672 **[Test build #129576 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129576/testReport)** for PR 29981 at commit [`f5fe24e`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705964122 **[Test build #129575 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129575/testReport)** for PR 29981 at commit [`22dbbea`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705964226 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705963815 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34179/ -

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705962951 **[Test build #129576 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129576/testReport)** for PR 29981 at commit [`f5fe24e`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705962169 **[Test build #129574 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129574/testReport)** for PR 29981 at commit [`8d242b5`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705962236 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705961244 **[Test build #129575 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129575/testReport)** for PR 29981 at commit [`22dbbea`](https://github.com

[GitHub] [spark] sunchao commented on pull request #29792: [SPARK-32858][SQL] UnwrapCastInBinaryComparison: support other numeric types

2020-10-08 Thread GitBox
sunchao commented on pull request #29792: URL: https://github.com/apache/spark/pull/29792#issuecomment-705960760 @cloud-fan added an e2e test suite. Please take another look, thanks. This is an automated message from the Apac

[GitHub] [spark] AmplabJenkins commented on pull request #29792: [SPARK-32858][SQL] UnwrapCastInBinaryComparison: support other numeric types

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29792: URL: https://github.com/apache/spark/pull/29792#issuecomment-705960336 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29792: [SPARK-32858][SQL] UnwrapCastInBinaryComparison: support other numeric types

2020-10-08 Thread GitBox
SparkQA commented on pull request #29792: URL: https://github.com/apache/spark/pull/29792#issuecomment-705959731 **[Test build #129566 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129566/testReport)** for PR 29792 at commit [`94942bf`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705959514 **[Test build #129574 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129574/testReport)** for PR 29981 at commit [`8d242b5`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705959286 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705959146 **[Test build #129573 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129573/testReport)** for PR 29981 at commit [`7b53528`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29972: [SPARK-33081][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2 dialect)

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29972: URL: https://github.com/apache/spark/pull/29972#issuecomment-705958525 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29972: [SPARK-33081][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2 dialect)

2020-10-08 Thread GitBox
SparkQA commented on pull request #29972: URL: https://github.com/apache/spark/pull/29972#issuecomment-705958079 **[Test build #129570 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129570/testReport)** for PR 29972 at commit [`0f9284b`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29972: [SPARK-33081][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2 dialect)

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29972: URL: https://github.com/apache/spark/pull/29972#issuecomment-705957305 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29972: [SPARK-33081][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2 dialect)

2020-10-08 Thread GitBox
SparkQA commented on pull request #29972: URL: https://github.com/apache/spark/pull/29972#issuecomment-705956794 **[Test build #129569 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129569/testReport)** for PR 29972 at commit [`6c2919d`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29958: [SPARK-33079][TESTS] Add Scala 2.13 build test in GitHub Action for SBT

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29958: URL: https://github.com/apache/spark/pull/29958#issuecomment-705956077 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
SparkQA commented on pull request #29981: URL: https://github.com/apache/spark/pull/29981#issuecomment-705956031 **[Test build #129573 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129573/testReport)** for PR 29981 at commit [`7b53528`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #29958: [SPARK-33079][TESTS] Add Scala 2.13 build test in GitHub Action for SBT

2020-10-08 Thread GitBox
SparkQA commented on pull request #29958: URL: https://github.com/apache/spark/pull/29958#issuecomment-705955584 **[Test build #129568 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129568/testReport)** for PR 29958 at commit [`47a4806`](https://github.co

[GitHub] [spark] dongjoon-hyun opened a new pull request #29981: [SPARK-33099][K8S] Respect executor idle timeout configuration

2020-10-08 Thread GitBox
dongjoon-hyun opened a new pull request #29981: URL: https://github.com/apache/spark/pull/29981 ### What changes were proposed in this pull request? This PR aims to protect the executor pod request or pending pod during executor idle timeout. ### Why are the changes needed?

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29881: [SPARK-32852][SQL] spark.sql.hive.metastore.jars support HDFS location

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29881: URL: https://github.com/apache/spark/pull/29881#issuecomment-705953863 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29881: [SPARK-32852][SQL] spark.sql.hive.metastore.jars support HDFS location

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29881: URL: https://github.com/apache/spark/pull/29881#issuecomment-705953853 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on pull request #29881: [SPARK-32852][SQL] spark.sql.hive.metastore.jars support HDFS location

2020-10-08 Thread GitBox
SparkQA commented on pull request #29881: URL: https://github.com/apache/spark/pull/29881#issuecomment-705953840 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34178/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #29881: [SPARK-32852][SQL] spark.sql.hive.metastore.jars support HDFS location

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29881: URL: https://github.com/apache/spark/pull/29881#issuecomment-705953853 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #29975: [SPARK-33092][SQL] Support subexpression elimination in ProjectExec

2020-10-08 Thread GitBox
SparkQA removed a comment on pull request #29975: URL: https://github.com/apache/spark/pull/29975#issuecomment-705903281 **[Test build #129567 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129567/testReport)** for PR 29975 at commit [`0d958e9`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29975: [SPARK-33092][SQL] Support subexpression elimination in ProjectExec

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29975: URL: https://github.com/apache/spark/pull/29975#issuecomment-705947564 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29959: [WIP][SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-705947958 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29975: [SPARK-33092][SQL] Support subexpression elimination in ProjectExec

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29975: URL: https://github.com/apache/spark/pull/29975#issuecomment-705947569 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/129

[GitHub] [spark] SparkQA commented on pull request #29881: [SPARK-32852][SQL] spark.sql.hive.metastore.jars support HDFS location

2020-10-08 Thread GitBox
SparkQA commented on pull request #29881: URL: https://github.com/apache/spark/pull/29881#issuecomment-705948739 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34178/ -

[GitHub] [spark] AmplabJenkins commented on pull request #29959: [WIP][SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-705947958 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29959: [WIP][SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

2020-10-08 Thread GitBox
SparkQA commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-705947952 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34177/ ---

[GitHub] [spark] beliefer commented on a change in pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-10-08 Thread GitBox
beliefer commented on a change in pull request #29800: URL: https://github.com/apache/spark/pull/29800#discussion_r502165838 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/window/WindowFunctionFrame.scala ## @@ -151,10 +169,69 @@ final class OffsetWindowF

[GitHub] [spark] AmplabJenkins commented on pull request #29975: [SPARK-33092][SQL] Support subexpression elimination in ProjectExec

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29975: URL: https://github.com/apache/spark/pull/29975#issuecomment-705947564 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29975: [SPARK-33092][SQL] Support subexpression elimination in ProjectExec

2020-10-08 Thread GitBox
SparkQA commented on pull request #29975: URL: https://github.com/apache/spark/pull/29975#issuecomment-705947353 **[Test build #129567 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129567/testReport)** for PR 29975 at commit [`0d958e9`](https://github.co

[GitHub] [spark] beliefer commented on a change in pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-10-08 Thread GitBox
beliefer commented on a change in pull request #29800: URL: https://github.com/apache/spark/pull/29800#discussion_r502165124 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/window/WindowExecBase.scala ## @@ -136,8 +136,15 @@ trait WindowExecBase extends Un

[GitHub] [spark] SparkQA commented on pull request #29959: [WIP][SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

2020-10-08 Thread GitBox
SparkQA commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-705943824 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34177/ -

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29933: [SPARK-26533][SQL] Support query auto timeout cancel on thriftserver

2020-10-08 Thread GitBox
AngersZh commented on a change in pull request #29933: URL: https://github.com/apache/spark/pull/29933#discussion_r502162237 ## File path: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala ## @@ -329,17 +339,21

[GitHub] [spark] AngersZhuuuu commented on pull request #29966: [SPARK-33084][CORE][SQL]Add jar support ivy path

2020-10-08 Thread GitBox
AngersZh commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-705941915 cc @dongjoon-hyun As I have mentioned in https://issues.apache.org/jira/browse/SPARK-29288, make this pr support ivy path like https://issues.apache.org/jira/browse/HIVE

[GitHub] [spark] SparkQA commented on pull request #29881: [SPARK-32852][SQL] spark.sql.hive.metastore.jars support HDFS location

2020-10-08 Thread GitBox
SparkQA commented on pull request #29881: URL: https://github.com/apache/spark/pull/29881#issuecomment-705937731 **[Test build #129572 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129572/testReport)** for PR 29881 at commit [`9278404`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29972: [SPARK-33081][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2 dialect)

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29972: URL: https://github.com/apache/spark/pull/29972#issuecomment-705934012 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29972: [SPARK-33081][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2 dialect)

2020-10-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29972: URL: https://github.com/apache/spark/pull/29972#issuecomment-705932263 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29972: [SPARK-33081][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2 dialect)

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29972: URL: https://github.com/apache/spark/pull/29972#issuecomment-705934006 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29972: [SPARK-33081][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2 dialect)

2020-10-08 Thread GitBox
SparkQA commented on pull request #29972: URL: https://github.com/apache/spark/pull/29972#issuecomment-705934000 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34176/ ---

[GitHub] [spark] SparkQA commented on pull request #29972: [SPARK-33081][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2 dialect)

2020-10-08 Thread GitBox
SparkQA commented on pull request #29972: URL: https://github.com/apache/spark/pull/29972#issuecomment-705932254 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34175/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #29972: [SPARK-33081][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2 dialect)

2020-10-08 Thread GitBox
AmplabJenkins commented on pull request #29972: URL: https://github.com/apache/spark/pull/29972#issuecomment-705932263 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29933: [SPARK-26533][SQL] Support query auto timeout cancel on thriftserver

2020-10-08 Thread GitBox
AngersZh commented on a change in pull request #29933: URL: https://github.com/apache/spark/pull/29933#discussion_r502147007 ## File path: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala ## @@ -329,17 +339,21

[GitHub] [spark] wangyum commented on a change in pull request #29893: [SPARK-32976][SQL]Support column list in INSERT statement

2020-10-08 Thread GitBox
wangyum commented on a change in pull request #29893: URL: https://github.com/apache/spark/pull/29893#discussion_r502146835 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ## @@ -337,8 +337,8 @@ query ; insertInto -: INSER

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29933: [SPARK-26533][SQL] Support query auto timeout cancel on thriftserver

2020-10-08 Thread GitBox
AngersZh commented on a change in pull request #29933: URL: https://github.com/apache/spark/pull/29933#discussion_r502146652 ## File path: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala ## @@ -329,17 +339,21

[GitHub] [spark] SparkQA commented on pull request #29959: [WIP][SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

2020-10-08 Thread GitBox
SparkQA commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-705930551 **[Test build #129571 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129571/testReport)** for PR 29959 at commit [`f582b17`](https://github.com

  1   2   3   4   5   >