[GitHub] [spark] SparkQA removed a comment on pull request #29696: [SPARK-32794][SS] Fixed rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 sources

2020-09-09 Thread GitBox
SparkQA removed a comment on pull request #29696: URL: https://github.com/apache/spark/pull/29696#issuecomment-689726791 **[Test build #128460 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128460/testReport)** for PR 29696 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29696: [SPARK-32794][SS] Fixed rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 sources

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29696: URL: https://github.com/apache/spark/pull/29696#issuecomment-689727769 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29696: [SPARK-32794][SS] Fixed rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 sources

2020-09-09 Thread GitBox
SparkQA commented on pull request #29696: URL: https://github.com/apache/spark/pull/29696#issuecomment-689727747 **[Test build #128460 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128460/testReport)** for PR 29696 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29695: [SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29695: URL: https://github.com/apache/spark/pull/29695#issuecomment-689727592 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29696: [SPARK-32794][SS] Fixed rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 sources

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29696: URL: https://github.com/apache/spark/pull/29696#issuecomment-689727484 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29696: [SPARK-32794][SS] Fixed rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 sources

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29696: URL: https://github.com/apache/spark/pull/29696#issuecomment-689727769 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29696: [SPARK-32794][SS] Fixed rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 sources

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29696: URL: https://github.com/apache/spark/pull/29696#issuecomment-689727484 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29696: [SPARK-32794][SS] Fixed rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 sources

2020-09-09 Thread GitBox
SparkQA commented on pull request #29696: URL: https://github.com/apache/spark/pull/29696#issuecomment-689726791 **[Test build #128460 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128460/testReport)** for PR 29696 at commit

[GitHub] [spark] SparkQA commented on pull request #29695: [SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

2020-09-09 Thread GitBox
SparkQA commented on pull request #29695: URL: https://github.com/apache/spark/pull/29695#issuecomment-689726834 **[Test build #128461 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128461/testReport)** for PR 29695 at commit

[GitHub] [spark] tdas commented on a change in pull request #29696: [SPARK-32794][SS] Fixed rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 sources

2020-09-09 Thread GitBox
tdas commented on a change in pull request #29696: URL: https://github.com/apache/spark/pull/29696#discussion_r485812904 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecutionSuite.scala ## @@ -19,8 +19,14 @@ package

[GitHub] [spark] tdas commented on a change in pull request #29696: [SPARK-32794][SS] Fixed rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 sources

2020-09-09 Thread GitBox
tdas commented on a change in pull request #29696: URL: https://github.com/apache/spark/pull/29696#discussion_r485812904 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecutionSuite.scala ## @@ -19,8 +19,14 @@ package

[GitHub] [spark] tdas opened a new pull request #29696: [SPARK-32794][SS] Fixed rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 sources

2020-09-09 Thread GitBox
tdas opened a new pull request #29696: URL: https://github.com/apache/spark/pull/29696 ### What changes were proposed in this pull request? Make MicroBatchExecution explicitly call `getBatch` when the start and end offsets are the same. ### Why are the changes needed?

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29565: [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types

2020-09-09 Thread GitBox
dongjoon-hyun commented on a change in pull request #29565: URL: https://github.com/apache/spark/pull/29565#discussion_r485812296 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/UnwrapCastInBinaryComparison.scala ## @@ -0,0 +1,204 @@ +/* + *

[GitHub] [spark] huaxingao opened a new pull request #29695: [SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

2020-09-09 Thread GitBox
huaxingao opened a new pull request #29695: URL: https://github.com/apache/spark/pull/29695 ### What changes were proposed in this pull request? Push down JDBC aggregate to datasource layer ### Why are the changes needed? for better performance ### Does this PR

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29565: [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types

2020-09-09 Thread GitBox
dongjoon-hyun commented on a change in pull request #29565: URL: https://github.com/apache/spark/pull/29565#discussion_r485809871 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/UnwrapCastInBinaryComparison.scala ## @@ -0,0 +1,204 @@ +/* + *

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29693: [SPARK-32831][SS] Refactor SupportsStreamingUpdate to represent actual meaning of the behavior

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29693: URL: https://github.com/apache/spark/pull/29693#issuecomment-689721168 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29693: [SPARK-32831][SS] Refactor SupportsStreamingUpdate to represent actual meaning of the behavior

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29693: URL: https://github.com/apache/spark/pull/29693#issuecomment-689721168 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29461: [SPARK-32456][SS][FOLLOWUP] Update doc to note about using SQL statement with streaming Dataset

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29461: URL: https://github.com/apache/spark/pull/29461#issuecomment-689720478 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] imback82 commented on a change in pull request #29543: [SPARK-32516][SQL][FOLLOWUP] 'path' option cannot coexist with path parameter for DataFrameWriter.save(), DataStreamReader.load(

2020-09-09 Thread GitBox
imback82 commented on a change in pull request #29543: URL: https://github.com/apache/spark/pull/29543#discussion_r485804705 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala ## @@ -284,6 +285,12 @@ final class DataFrameWriter[T] private[sql](ds:

[GitHub] [spark] AmplabJenkins commented on pull request #29461: [SPARK-32456][SS][FOLLOWUP] Update doc to note about using SQL statement with streaming Dataset

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29461: URL: https://github.com/apache/spark/pull/29461#issuecomment-689720478 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29693: [SPARK-32831][SS] Refactor SupportsStreamingUpdate to represent actual meaning of the behavior

2020-09-09 Thread GitBox
SparkQA removed a comment on pull request #29693: URL: https://github.com/apache/spark/pull/29693#issuecomment-689524767 **[Test build #128449 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128449/testReport)** for PR 29693 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29461: [SPARK-32456][SS][FOLLOWUP] Update doc to note about using SQL statement with streaming Dataset

2020-09-09 Thread GitBox
SparkQA removed a comment on pull request #29461: URL: https://github.com/apache/spark/pull/29461#issuecomment-68957 **[Test build #128450 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128450/testReport)** for PR 29461 at commit

[GitHub] [spark] SparkQA commented on pull request #29693: [SPARK-32831][SS] Refactor SupportsStreamingUpdate to represent actual meaning of the behavior

2020-09-09 Thread GitBox
SparkQA commented on pull request #29693: URL: https://github.com/apache/spark/pull/29693#issuecomment-689720033 **[Test build #128449 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128449/testReport)** for PR 29693 at commit

[GitHub] [spark] SparkQA commented on pull request #29461: [SPARK-32456][SS][FOLLOWUP] Update doc to note about using SQL statement with streaming Dataset

2020-09-09 Thread GitBox
SparkQA commented on pull request #29461: URL: https://github.com/apache/spark/pull/29461#issuecomment-689719267 **[Test build #128450 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128450/testReport)** for PR 29461 at commit

[GitHub] [spark] asfgit closed pull request #29651: [SPARK-32794][SS] Fixed rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 sources

2020-09-09 Thread GitBox
asfgit closed pull request #29651: URL: https://github.com/apache/spark/pull/29651 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] viirya commented on a change in pull request #29693: [SPARK-32831][SS] Refactor SupportsStreamingUpdate to represent actual meaning of the behavior

2020-09-09 Thread GitBox
viirya commented on a change in pull request #29693: URL: https://github.com/apache/spark/pull/29693#discussion_r485795016 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/console.scala ## @@ -73,12 +73,11 @@ object ConsoleTable extends Table

[GitHub] [spark] rdblue commented on pull request #29693: [SPARK-32831][SS] Refactor SupportsStreamingUpdate to represent actual meaning of the behavior

2020-09-09 Thread GitBox
rdblue commented on pull request #29693: URL: https://github.com/apache/spark/pull/29693#issuecomment-689687863 Looks reasonable to me. +1 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] tdas commented on a change in pull request #29651: [SPARK-32794][SS] Fixed rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 sources

2020-09-09 Thread GitBox
tdas commented on a change in pull request #29651: URL: https://github.com/apache/spark/pull/29651#discussion_r485769555 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamTest.scala ## @@ -306,6 +306,14 @@ trait StreamTest extends QueryTest with

[GitHub] [spark] tanelk commented on pull request #29650: [SPARK-32801][SQL] Make InferFiltersFromConstraints take into account EqualNullSafe

2020-09-09 Thread GitBox
tanelk commented on pull request #29650: URL: https://github.com/apache/spark/pull/29650#issuecomment-689674825 Perhaps @gengliangwang and @gatorsmile could take a look? It seems like you have also worked on related topics

[GitHub] [spark] dongjoon-hyun commented on pull request #29160: [SPARK-32364][SQL] Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-09-09 Thread GitBox
dongjoon-hyun commented on pull request #29160: URL: https://github.com/apache/spark/pull/29160#issuecomment-689673091 Got it. If the PR is ready, I'll ping both of you. :) This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29672: [SPARK-32818][SQL] Make `CONVERT_METASTORE_PARQUET` and `CONVERT_METASTORE_ORC` session level configurable

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29672: URL: https://github.com/apache/spark/pull/29672#issuecomment-689669060 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29672: [SPARK-32818][SQL] Make `CONVERT_METASTORE_PARQUET` and `CONVERT_METASTORE_ORC` session level configurable

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29672: URL: https://github.com/apache/spark/pull/29672#issuecomment-689669060 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29672: [SPARK-32818][SQL] Make `CONVERT_METASTORE_PARQUET` and `CONVERT_METASTORE_ORC` session level configurable

2020-09-09 Thread GitBox
SparkQA removed a comment on pull request #29672: URL: https://github.com/apache/spark/pull/29672#issuecomment-689568176 **[Test build #128454 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128454/testReport)** for PR 29672 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689666007 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #29672: [SPARK-32818][SQL] Make `CONVERT_METASTORE_PARQUET` and `CONVERT_METASTORE_ORC` session level configurable

2020-09-09 Thread GitBox
SparkQA commented on pull request #29672: URL: https://github.com/apache/spark/pull/29672#issuecomment-689667064 **[Test build #128454 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128454/testReport)** for PR 29672 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29653: [SPARK-32804][Launcher] Fix run-example command builder bug

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29653: URL: https://github.com/apache/spark/pull/29653#issuecomment-689665211 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #29691: [SPARK-32828][SQL] Cast from a derived user-defined type to a base type

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29691: URL: https://github.com/apache/spark/pull/29691#issuecomment-689666249 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689665998 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29691: [SPARK-32828][SQL] Cast from a derived user-defined type to a base type

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29691: URL: https://github.com/apache/spark/pull/29691#issuecomment-689666249 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29653: [SPARK-32804][Launcher] Fix run-example command builder bug

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29653: URL: https://github.com/apache/spark/pull/29653#issuecomment-689665189 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689665998 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
SparkQA removed a comment on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689582283 **[Test build #128456 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128456/testReport)** for PR 29694 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29653: [SPARK-32804][Launcher] Fix run-example command builder bug

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29653: URL: https://github.com/apache/spark/pull/29653#issuecomment-689665189 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
SparkQA commented on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689664638 **[Test build #128456 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128456/testReport)** for PR 29694 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29691: [SPARK-32828][SQL] Cast from a derived user-defined type to a base type

2020-09-09 Thread GitBox
SparkQA removed a comment on pull request #29691: URL: https://github.com/apache/spark/pull/29691#issuecomment-689474457 **[Test build #128447 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128447/testReport)** for PR 29691 at commit

[GitHub] [spark] SparkQA commented on pull request #29691: [SPARK-32828][SQL] Cast from a derived user-defined type to a base type

2020-09-09 Thread GitBox
SparkQA commented on pull request #29691: URL: https://github.com/apache/spark/pull/29691#issuecomment-689664139 **[Test build #128447 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128447/testReport)** for PR 29691 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29653: [SPARK-32804][Launcher] Fix run-example command builder bug

2020-09-09 Thread GitBox
SparkQA removed a comment on pull request #29653: URL: https://github.com/apache/spark/pull/29653#issuecomment-689545414 **[Test build #128451 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128451/testReport)** for PR 29653 at commit

[GitHub] [spark] SparkQA commented on pull request #29653: [SPARK-32804][Launcher] Fix run-example command builder bug

2020-09-09 Thread GitBox
SparkQA commented on pull request #29653: URL: https://github.com/apache/spark/pull/29653#issuecomment-689663253 **[Test build #128451 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128451/testReport)** for PR 29653 at commit

[GitHub] [spark] xkrogen commented on pull request #29688: [SPARK-32827][SQL] Add spark.sql.maxMetadataStringLength config

2020-09-09 Thread GitBox
xkrogen commented on pull request #29688: URL: https://github.com/apache/spark/pull/29688#issuecomment-689643372 Glad to see this happening @ulysses-you ! We have a similar internal patch we added recently that we've been planning to open source. Nice to see that the changes are even

[GitHub] [spark] HyukjinKwon closed pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
HyukjinKwon closed pull request #29694: URL: https://github.com/apache/spark/pull/29694 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] cloud-fan commented on pull request #29502: [SPARK-32677][SQL] Load function resource before create

2020-09-09 Thread GitBox
cloud-fan commented on pull request #29502: URL: https://github.com/apache/spark/pull/29502#issuecomment-689615806 Sorry I have to revert it. This breaks a use case that: the udf class is not accessible in the cluster that creates the function, but people use this function in another

[GitHub] [spark] cloud-fan commented on a change in pull request #29673: [SPARK-32816][SQL] Fix analyzer bug when aggregating multiple distinct DECIMAL columns

2020-09-09 Thread GitBox
cloud-fan commented on a change in pull request #29673: URL: https://github.com/apache/spark/pull/29673#discussion_r485670399 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala ## @@ -2555,6 +2555,15 @@ class DataFrameSuite extends QueryTest

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29688: [SPARK-32827][SQL] Add spark.sql.maxMetadataStringLength config

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29688: URL: https://github.com/apache/spark/pull/29688#issuecomment-689609462 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] LuciferYang commented on pull request #29689: [SPARK-32755][SQL][FOLLOWUP] Ensure `--` method of AttributeSet have same behavior under Scala 2.12 and 2.13

2020-09-09 Thread GitBox
LuciferYang commented on pull request #29689: URL: https://github.com/apache/spark/pull/29689#issuecomment-689610145 thx @cloud-fan @srowen @hvanhovell @dbaliafroozeh ~ This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689608894 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689608884 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29688: [SPARK-32827][SQL] Add spark.sql.maxMetadataStringLength config

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29688: URL: https://github.com/apache/spark/pull/29688#issuecomment-689609462 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
SparkQA removed a comment on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689554579 **[Test build #128452 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128452/testReport)** for PR 29694 at commit

[GitHub] [spark] SparkQA commented on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
SparkQA commented on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689608506 **[Test build #128452 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128452/testReport)** for PR 29694 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689608884 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] cloud-fan commented on pull request #29160: [SPARK-32364][SQL] Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-09-09 Thread GitBox
cloud-fan commented on pull request #29160: URL: https://github.com/apache/spark/pull/29160#issuecomment-689608155 Yea, I was wanting @HeartSaVioR to review your PR :) This is an automated message from the Apache Git

[GitHub] [spark] cloud-fan closed pull request #29689: [SPARK-32755][SQL][FOLLOWUP] Ensure `--` method of AttributeSet have same behavior under Scala 2.12 and 2.13

2020-09-09 Thread GitBox
cloud-fan closed pull request #29689: URL: https://github.com/apache/spark/pull/29689 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] SparkQA removed a comment on pull request #29688: [SPARK-32827][SQL] Add spark.sql.maxMetadataStringLength config

2020-09-09 Thread GitBox
SparkQA removed a comment on pull request #29688: URL: https://github.com/apache/spark/pull/29688#issuecomment-689427681 **[Test build #128443 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128443/testReport)** for PR 29688 at commit

[GitHub] [spark] cloud-fan commented on pull request #29689: [SPARK-32755][SQL][FOLLOWUP] Ensure `--` method of AttributeSet have same behavior under Scala 2.12 and 2.13

2020-09-09 Thread GitBox
cloud-fan commented on pull request #29689: URL: https://github.com/apache/spark/pull/29689#issuecomment-689607577 github action passed, merging to master, thanks! This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29688: [SPARK-32827][SQL] Add spark.sql.maxMetadataStringLength config

2020-09-09 Thread GitBox
SparkQA commented on pull request #29688: URL: https://github.com/apache/spark/pull/29688#issuecomment-689607610 **[Test build #128443 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128443/testReport)** for PR 29688 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #27246: URL: https://github.com/apache/spark/pull/27246#issuecomment-689606074 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #27246: URL: https://github.com/apache/spark/pull/27246#issuecomment-689606074 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements

2020-09-09 Thread GitBox
SparkQA removed a comment on pull request #27246: URL: https://github.com/apache/spark/pull/27246#issuecomment-689498795 **[Test build #128448 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128448/testReport)** for PR 27246 at commit

[GitHub] [spark] SparkQA commented on pull request #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements

2020-09-09 Thread GitBox
SparkQA commented on pull request #27246: URL: https://github.com/apache/spark/pull/27246#issuecomment-689604701 **[Test build #128448 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128448/testReport)** for PR 27246 at commit

[GitHub] [spark] KevinSmile commented on pull request #29644: [SPARK-32598][Scheduler] Fix missing driver logs under UI App-Executors tab in standalone mode

2020-09-09 Thread GitBox
KevinSmile commented on pull request #29644: URL: https://github.com/apache/spark/pull/29644#issuecomment-689601351 @zsxwing @Ngone51 Do you have time to review this? Thanks! This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29286: [WIP][SPARK-21708][BUILD] Migrate build to sbt 1.x

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29286: URL: https://github.com/apache/spark/pull/29286#issuecomment-689595711 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29286: [WIP][SPARK-21708][BUILD] Migrate build to sbt 1.x

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29286: URL: https://github.com/apache/spark/pull/29286#issuecomment-689595697 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29286: [WIP][SPARK-21708][BUILD] Migrate build to sbt 1.x

2020-09-09 Thread GitBox
SparkQA removed a comment on pull request #29286: URL: https://github.com/apache/spark/pull/29286#issuecomment-689582379 **[Test build #128458 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128458/testReport)** for PR 29286 at commit

[GitHub] [spark] SparkQA commented on pull request #29286: [WIP][SPARK-21708][BUILD] Migrate build to sbt 1.x

2020-09-09 Thread GitBox
SparkQA commented on pull request #29286: URL: https://github.com/apache/spark/pull/29286#issuecomment-689595649 **[Test build #128458 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128458/testReport)** for PR 29286 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29286: [WIP][SPARK-21708][BUILD] Migrate build to sbt 1.x

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29286: URL: https://github.com/apache/spark/pull/29286#issuecomment-689595697 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-09-09 Thread GitBox
SparkQA commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-689587269 **[Test build #128459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128459/testReport)** for PR 27690 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29688: [SPARK-32827][SQL] Add spark.sql.maxMetadataStringLength config

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29688: URL: https://github.com/apache/spark/pull/29688#issuecomment-689585569 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29688: [SPARK-32827][SQL] Add spark.sql.maxMetadataStringLength config

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29688: URL: https://github.com/apache/spark/pull/29688#issuecomment-689585554 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29688: [SPARK-32827][SQL] Add spark.sql.maxMetadataStringLength config

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29688: URL: https://github.com/apache/spark/pull/29688#issuecomment-689585554 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29688: [SPARK-32827][SQL] Add spark.sql.maxMetadataStringLength config

2020-09-09 Thread GitBox
SparkQA removed a comment on pull request #29688: URL: https://github.com/apache/spark/pull/29688#issuecomment-689432286 **[Test build #128444 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128444/testReport)** for PR 29688 at commit

[GitHub] [spark] SparkQA commented on pull request #29688: [SPARK-32827][SQL] Add spark.sql.maxMetadataStringLength config

2020-09-09 Thread GitBox
SparkQA commented on pull request #29688: URL: https://github.com/apache/spark/pull/29688#issuecomment-689584269 **[Test build #128444 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128444/testReport)** for PR 29688 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29286: [WIP][SPARK-21708][BUILD] Migrate build to sbt 1.x

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29286: URL: https://github.com/apache/spark/pull/29286#issuecomment-689583125 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29689: [SPARK-32755][SQL][FOLLOWUP] Ensure `--` method of AttributeSet have same behavior under Scala 2.12 and 2.13

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29689: URL: https://github.com/apache/spark/pull/29689#issuecomment-689583003 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-689583097 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29286: [WIP][SPARK-21708][BUILD] Migrate build to sbt 1.x

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29286: URL: https://github.com/apache/spark/pull/29286#issuecomment-689583125 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689583064 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-689583097 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689583064 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29689: [SPARK-32755][SQL][FOLLOWUP] Ensure `--` method of AttributeSet have same behavior under Scala 2.12 and 2.13

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29689: URL: https://github.com/apache/spark/pull/29689#issuecomment-689583003 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
SparkQA commented on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689582283 **[Test build #128456 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128456/testReport)** for PR 29694 at commit

[GitHub] [spark] SparkQA commented on pull request #29286: [WIP][SPARK-21708][BUILD] Migrate build to sbt 1.x

2020-09-09 Thread GitBox
SparkQA commented on pull request #29286: URL: https://github.com/apache/spark/pull/29286#issuecomment-689582379 **[Test build #128458 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128458/testReport)** for PR 29286 at commit

[GitHub] [spark] SparkQA commented on pull request #29689: [SPARK-32755][SQL][FOLLOWUP] Ensure `--` method of AttributeSet have same behavior under Scala 2.12 and 2.13

2020-09-09 Thread GitBox
SparkQA commented on pull request #29689: URL: https://github.com/apache/spark/pull/29689#issuecomment-689582346 **[Test build #128457 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128457/testReport)** for PR 29689 at commit

[GitHub] [spark] kiszk commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-09-09 Thread GitBox
kiszk commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-689582089 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] LuciferYang commented on pull request #29660: [SPARK-32808][SQL] Fix some test cases of `sql/core` module in scala 2.13

2020-09-09 Thread GitBox
LuciferYang commented on pull request #29660: URL: https://github.com/apache/spark/pull/29660#issuecomment-689581400 thx @srowen @xuanyuanking This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] srowen commented on pull request #29689: [SPARK-32755][SQL][FOLLOWUP] Ensure `--` method of AttributeSet have same behavior under Scala 2.12 and 2.13

2020-09-09 Thread GitBox
srowen commented on pull request #29689: URL: https://github.com/apache/spark/pull/29689#issuecomment-689581007 Jenkins retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] srowen commented on pull request #29286: [WIP][SPARK-21708][BUILD] Migrate build to sbt 1.x

2020-09-09 Thread GitBox
srowen commented on pull request #29286: URL: https://github.com/apache/spark/pull/29286#issuecomment-689580228 Jenkins retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29565: [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29565: URL: https://github.com/apache/spark/pull/29565#issuecomment-689579352 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29565: [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types

2020-09-09 Thread GitBox
AmplabJenkins commented on pull request #29565: URL: https://github.com/apache/spark/pull/29565#issuecomment-689579352 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon commented on pull request #29694: [DO-NOT-MERGE] Remove temporary fallbacks in HiveExternalCatalogVersionsSuite

2020-09-09 Thread GitBox
HyukjinKwon commented on pull request #29694: URL: https://github.com/apache/spark/pull/29694#issuecomment-689579722 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29316: [SPARK-32508][SQL] Disallow empty part col values in partition spec before static partition writing

2020-09-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29316: URL: https://github.com/apache/spark/pull/29316#issuecomment-689578540 This is an automated message from the Apache Git Service. To respond to the message, please log on

<    1   2   3   4   5   6   >