[GitHub] [spark] SparkQA removed a comment on pull request #32397: [SPARK-35084][CORE] Spark 3: supporting "--packages" in k8s cluster mode

2021-05-11 Thread GitBox
SparkQA removed a comment on pull request #32397: URL: https://github.com/apache/spark/pull/32397#issuecomment-838564651 **[Test build #138380 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138380/testReport)** for PR 32397 at commit

[GitHub] [spark] sarutak opened a new pull request #32506: [SPARK-35374][SQL] Add string-to-number conversion support to JacksonParser

2021-05-11 Thread GitBox
sarutak opened a new pull request #32506: URL: https://github.com/apache/spark/pull/32506 ### What changes were proposed in this pull request? This PR proposes to add string-to-number conversion support to `JacksonParser`. In the current implementation, `spark.read.json` doesn't

[GitHub] [spark] SparkQA commented on pull request #32397: [SPARK-35084][CORE] Spark 3: supporting "--packages" in k8s cluster mode

2021-05-11 Thread GitBox
SparkQA commented on pull request #32397: URL: https://github.com/apache/spark/pull/32397#issuecomment-838821428 **[Test build #138380 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138380/testReport)** for PR 32397 at commit

[GitHub] [spark] peter-toth commented on pull request #32298: [WIP][SPARK-34079][SQL] Merge non-correlated scalar subqueries to multi-column scalar subqueries for better reuse

2021-05-11 Thread GitBox
peter-toth commented on pull request #32298: URL: https://github.com/apache/spark/pull/32298#issuecomment-838806407 I move this back to WIP for now: - to discuss if (1) in https://github.com/apache/spark/pull/32298#discussion_r627800694 is acceptable approach and - to fix a few

[GitHub] [spark] viirya commented on pull request #31986: [SPARK-34888][SS] Introduce UpdatingSessionIterator adjusting session window on elements

2021-05-11 Thread GitBox
viirya commented on pull request #31986: URL: https://github.com/apache/spark/pull/31986#issuecomment-838800572 Thanks for updating! I will take another look. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] SparkQA commented on pull request #32498: [SPARK-35368][SQL] Update histogram statistics for RANGE operator for stats estimation

2021-05-11 Thread GitBox
SparkQA commented on pull request #32498: URL: https://github.com/apache/spark/pull/32498#issuecomment-838797638 **[Test build #138387 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138387/testReport)** for PR 32498 at commit

[GitHub] [spark] shahidki31 commented on pull request #32498: [SPARK-35368][SQL] Update histogram statistics for RANGE operator for stats estimation

2021-05-11 Thread GitBox
shahidki31 commented on pull request #32498: URL: https://github.com/apache/spark/pull/32498#issuecomment-838796881 cc @wangyum @cloud-fan @HyukjinKwon Kindly review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [spark] szeiger commented on a change in pull request #32315: [SPARK-35206][TESTS][SQL] Extract common used get project path into a function in SparkFunctionSuite

2021-05-11 Thread GitBox
szeiger commented on a change in pull request #32315: URL: https://github.com/apache/spark/pull/32315#discussion_r630338398 ## File path: core/src/test/scala/org/apache/spark/SparkFunSuite.scala ## @@ -119,6 +121,26 @@ abstract class SparkFunSuite file } + /** + *

[GitHub] [spark] SparkQA commented on pull request #32389: [SPARK-35263] [TEST] Refactor ShuffleBlockFetcherIteratorSuite to reduce duplicated code

2021-05-11 Thread GitBox
SparkQA commented on pull request #32389: URL: https://github.com/apache/spark/pull/32389#issuecomment-838776322 **[Test build #138386 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138386/testReport)** for PR 32389 at commit

[GitHub] [spark] SparkQA commented on pull request #32411: [SPARK-28551][SQL]CTAS with LOCATION , should not allow to a non-empty directory.

2021-05-11 Thread GitBox
SparkQA commented on pull request #32411: URL: https://github.com/apache/spark/pull/32411#issuecomment-838776197 **[Test build #138385 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138385/testReport)** for PR 32411 at commit

[GitHub] [spark] SparkQA commented on pull request #32505: [SPARK-35373][BUILD] Check Maven artifact checksum in build/mvn

2021-05-11 Thread GitBox
SparkQA commented on pull request #32505: URL: https://github.com/apache/spark/pull/32505#issuecomment-838775701 **[Test build #138384 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138384/testReport)** for PR 32505 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32504: [Minor][SPARK-35013]Don't allow to set spark.driver.cores=0

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-838773096 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42906/

[GitHub] [spark] AmplabJenkins commented on pull request #32504: [Minor][SPARK-35013]Don't allow to set spark.driver.cores=0

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-838773096 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42906/ --

[GitHub] [spark] srowen commented on a change in pull request #32505: [SPARK-35373][BUILD] Check Maven artifact checksum in build/mvn

2021-05-11 Thread GitBox
srowen commented on a change in pull request #32505: URL: https://github.com/apache/spark/pull/32505#discussion_r630332629 ## File path: build/mvn ## @@ -26,36 +26,67 @@ _COMPILE_JVM_OPTS="-Xmx2g -XX:ReservedCodeCacheSize=1g" # Installs any application tarball given a URL,

[GitHub] [spark] cloud-fan commented on a change in pull request #32497: [SPARK-35366][SQL] Avoid using deprecated `buildForBatch` and `buildForStreaming`

2021-05-11 Thread GitBox
cloud-fan commented on a change in pull request #32497: URL: https://github.com/apache/spark/pull/32497#discussion_r630332390 ## File path: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaWrite.scala ## @@ -0,0 +1,39 @@ +/* + * Licensed to the Apache

[GitHub] [spark] srowen commented on a change in pull request #32505: [SPARK-35373][BUILD] Check Maven artifact checksum in build/mvn

2021-05-11 Thread GitBox
srowen commented on a change in pull request #32505: URL: https://github.com/apache/spark/pull/32505#discussion_r630330154 ## File path: build/mvn ## @@ -26,36 +26,67 @@ _COMPILE_JVM_OPTS="-Xmx2g -XX:ReservedCodeCacheSize=1g" # Installs any application tarball given a URL,

[GitHub] [spark] srowen opened a new pull request #32505: [SPARK-35373][BUILD] Check Maven artifact checksum in build/mvn

2021-05-11 Thread GitBox
srowen opened a new pull request #32505: URL: https://github.com/apache/spark/pull/32505 ### What changes were proposed in this pull request? `./build/mvn` now downloads the .sha512 checksum of Maven artifacts it downloads, and checks the checksum after download. ### Why are

[GitHub] [spark] SparkQA commented on pull request #32504: [Minor][SPARK-35013]Don't allow to set spark.driver.cores=0

2021-05-11 Thread GitBox
SparkQA commented on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-838767730 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42906/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32504: [Minor][SPARK-35013]Don't allow to set spark.driver.cores=0

2021-05-11 Thread GitBox
SparkQA commented on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-838752727 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42906/ -- This is an automated message from the Apache

[GitHub] [spark] maryannxue commented on a change in pull request #32439: [SPARK-35298][SQL] Migrate to transformWithPruning for rules in Optimizer.scala

2021-05-11 Thread GitBox
maryannxue commented on a change in pull request #32439: URL: https://github.com/apache/spark/pull/32439#discussion_r630320937 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -745,7 +754,8 @@ object

[GitHub] [spark] otterc commented on a change in pull request #32389: [SPARK-35263] [TEST] Refactor ShuffleBlockFetcherIteratorSuite to reduce duplicated code

2021-05-11 Thread GitBox
otterc commented on a change in pull request #32389: URL: https://github.com/apache/spark/pull/32389#discussion_r630293317 ## File path: .idea/vcs.xml ## @@ -1,24 +1,16 @@ - Review comment: Nit: This seems to be picked up by error -- This is an automated message

[GitHub] [spark] vinodkc commented on a change in pull request #32411: [SPARK-28551][SQL]CTAS with LOCATION , should not allow to a non-empty directory.

2021-05-11 Thread GitBox
vinodkc commented on a change in pull request #32411: URL: https://github.com/apache/spark/pull/32411#discussion_r630301266 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1604,6 +1604,15 @@ object SQLConf { .booleanConf

[GitHub] [spark] linhongliu-db commented on pull request #32497: [SPARK-35366][SQL] Avoid using deprecated `buildForBatch` and `buildForStreaming`

2021-05-11 Thread GitBox
linhongliu-db commented on pull request #32497: URL: https://github.com/apache/spark/pull/32497#issuecomment-838712951 cc @cloud-fan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] xkrogen commented on a change in pull request #32389: [SPARK-35263] [TEST] Refactor ShuffleBlockFetcherIteratorSuite to reduce duplicated code

2021-05-11 Thread GitBox
xkrogen commented on a change in pull request #32389: URL: https://github.com/apache/spark/pull/32389#discussion_r630300027 ## File path: .idea/vcs.xml ## @@ -1,24 +1,16 @@ - Review comment: Oops! Good catch @otterc, thank you! -- This is an automated message

[GitHub] [spark] otterc commented on a change in pull request #32389: [SPARK-35263] [TEST] Refactor ShuffleBlockFetcherIteratorSuite to reduce duplicated code

2021-05-11 Thread GitBox
otterc commented on a change in pull request #32389: URL: https://github.com/apache/spark/pull/32389#discussion_r630293317 ## File path: .idea/vcs.xml ## @@ -1,24 +1,16 @@ - Review comment: Nit: This seems to be picked up by error -- This is an automated message

[GitHub] [spark] vinodkc commented on a change in pull request #32411: [SPARK-28551][SQL]CTAS with LOCATION , should not allow to a non-empty directory.

2021-05-11 Thread GitBox
vinodkc commented on a change in pull request #32411: URL: https://github.com/apache/spark/pull/32411#discussion_r630278821 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/command/DataWritingCommand.scala ## @@ -96,4 +98,23 @@ object DataWritingCommand {

[GitHub] [spark] otterc commented on pull request #32389: [SPARK-35263] [TEST] Refactor ShuffleBlockFetcherIteratorSuite to reduce duplicated code

2021-05-11 Thread GitBox
otterc commented on pull request #32389: URL: https://github.com/apache/spark/pull/32389#issuecomment-838683440 @xkrogen @Ngone51 @mridulm Gentle ping folks to check if this PR can be merged. To me it looks like it is ready. I need to rework the tests in my

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32503: [WIP] better error message

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32503: URL: https://github.com/apache/spark/pull/32503#issuecomment-838674983 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42905/

[GitHub] [spark] AmplabJenkins commented on pull request #32503: [WIP] better error message

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32503: URL: https://github.com/apache/spark/pull/32503#issuecomment-838674983 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42905/ --

[GitHub] [spark] SparkQA commented on pull request #32503: [WIP] better error message

2021-05-11 Thread GitBox
SparkQA commented on pull request #32503: URL: https://github.com/apache/spark/pull/32503#issuecomment-838674855 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] vinodkc commented on a change in pull request #32411: [SPARK-28551][SQL]CTAS with LOCATION , should not allow to a non-empty directory.

2021-05-11 Thread GitBox
vinodkc commented on a change in pull request #32411: URL: https://github.com/apache/spark/pull/32411#discussion_r630278821 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/command/DataWritingCommand.scala ## @@ -96,4 +98,23 @@ object DataWritingCommand {

[GitHub] [spark] SparkQA commented on pull request #32504: [Minor][SPARK-35013]Don't allow to set spark.driver.cores=0

2021-05-11 Thread GitBox
SparkQA commented on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-838669907 **[Test build #138383 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138383/testReport)** for PR 32504 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31756: [SPARK-34637] [SQL] Support DPP + AQE when the broadcast exchange can be reused

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #31756: URL: https://github.com/apache/spark/pull/31756#issuecomment-838665138 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138376/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32397: [SPARK-35084][CORE] Spark 3: supporting "--packages" in k8s cluster mode

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32397: URL: https://github.com/apache/spark/pull/32397#issuecomment-838665141 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42903/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32499: [SPARK-29145][SQL][FOLLOWUP] Support sub-queries in join conditions

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32499: URL: https://github.com/apache/spark/pull/32499#issuecomment-838665143 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42904/

[GitHub] [spark] AmplabJenkins commented on pull request #32397: [SPARK-35084][CORE] Spark 3: supporting "--packages" in k8s cluster mode

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32397: URL: https://github.com/apache/spark/pull/32397#issuecomment-838665141 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42903/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31756: [SPARK-34637] [SQL] Support DPP + AQE when the broadcast exchange can be reused

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #31756: URL: https://github.com/apache/spark/pull/31756#issuecomment-838665138 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138376/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32499: [SPARK-29145][SQL][FOLLOWUP] Support sub-queries in join conditions

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32499: URL: https://github.com/apache/spark/pull/32499#issuecomment-838665143 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42904/ --

[GitHub] [spark] huaxingao commented on pull request #32473: [SPARK-35345][SQL] Add Parquet tests to BloomFilterBenchmark

2021-05-11 Thread GitBox
huaxingao commented on pull request #32473: URL: https://github.com/apache/spark/pull/32473#issuecomment-838657326 @ggershinsky Hi Gidon, thank you very much for your explanation. It's very helpful. I will rerun the test per your suggestion. This test only uses toy data. For the real data

[GitHub] [spark] shahidki31 opened a new pull request #32504: [Minor][SPARK-35013]Don't allow to set spark.driver.cores=0

2021-05-11 Thread GitBox
shahidki31 opened a new pull request #32504: URL: https://github.com/apache/spark/pull/32504 ### What changes were proposed in this pull request? Currently spark is not allowing to set spark.driver.memory, spark.executor.cores, spark.executor.memory to 0, but allowing driver

[GitHub] [spark] ocworld commented on pull request #32397: [SPARK-35084][CORE] Spark 3: supporting "--packages" in k8s cluster mode

2021-05-11 Thread GitBox
ocworld commented on pull request #32397: URL: https://github.com/apache/spark/pull/32397#issuecomment-838655508 @dongjoon-hyun I reviewed "BasicTestsSuite" and "DepsTestsSuite" I think it is hard to add test case in it. It's because it is needed to get spark.jars in the

[GitHub] [spark] SparkQA commented on pull request #32499: [SPARK-29145][SQL][FOLLOWUP] Support sub-queries in join conditions

2021-05-11 Thread GitBox
SparkQA commented on pull request #32499: URL: https://github.com/apache/spark/pull/32499#issuecomment-838642472 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32397: [SPARK-35084][CORE] Spark 3: supporting "--packages" in k8s cluster mode

2021-05-11 Thread GitBox
SparkQA commented on pull request #32397: URL: https://github.com/apache/spark/pull/32397#issuecomment-838627447 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42903/ --

[GitHub] [spark] SparkQA removed a comment on pull request #31756: [SPARK-34637] [SQL] Support DPP + AQE when the broadcast exchange can be reused

2021-05-11 Thread GitBox
SparkQA removed a comment on pull request #31756: URL: https://github.com/apache/spark/pull/31756#issuecomment-838222479 **[Test build #138376 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138376/testReport)** for PR 31756 at commit

[GitHub] [spark] SparkQA commented on pull request #31756: [SPARK-34637] [SQL] Support DPP + AQE when the broadcast exchange can be reused

2021-05-11 Thread GitBox
SparkQA commented on pull request #31756: URL: https://github.com/apache/spark/pull/31756#issuecomment-838597502 **[Test build #138376 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138376/testReport)** for PR 31756 at commit

[GitHub] [spark] SparkQA commented on pull request #32503: [WIP] better error message

2021-05-11 Thread GitBox
SparkQA commented on pull request #32503: URL: https://github.com/apache/spark/pull/32503#issuecomment-838590574 **[Test build #138382 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138382/testReport)** for PR 32503 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32503: [WIP] better error message

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32503: URL: https://github.com/apache/spark/pull/32503#issuecomment-838574770 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42902/

[GitHub] [spark] AmplabJenkins commented on pull request #32503: [WIP] better error message

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32503: URL: https://github.com/apache/spark/pull/32503#issuecomment-838574770 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42902/ --

[GitHub] [spark] SparkQA commented on pull request #32503: [WIP] better error message

2021-05-11 Thread GitBox
SparkQA commented on pull request #32503: URL: https://github.com/apache/spark/pull/32503#issuecomment-838574716 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42902/ --

[GitHub] [spark] SparkQA removed a comment on pull request #32503: [WIP] better error message

2021-05-11 Thread GitBox
SparkQA removed a comment on pull request #32503: URL: https://github.com/apache/spark/pull/32503#issuecomment-838564058 **[Test build #138379 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138379/testReport)** for PR 32503 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32503: [WIP] better error message

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32503: URL: https://github.com/apache/spark/pull/32503#issuecomment-838572412 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138379/

[GitHub] [spark] SparkQA commented on pull request #32503: [WIP] better error message

2021-05-11 Thread GitBox
SparkQA commented on pull request #32503: URL: https://github.com/apache/spark/pull/32503#issuecomment-838572305 **[Test build #138379 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138379/testReport)** for PR 32503 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32503: [WIP] better error message

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32503: URL: https://github.com/apache/spark/pull/32503#issuecomment-838572412 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138379/ -- This

[GitHub] [spark] SparkQA commented on pull request #32499: [SPARK-29145][SQL][FOLLOWUP] Support sub-queries in join conditions

2021-05-11 Thread GitBox
SparkQA commented on pull request #32499: URL: https://github.com/apache/spark/pull/32499#issuecomment-838571340 **[Test build #138381 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138381/testReport)** for PR 32499 at commit

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32499: [SPARK-29145][SQL][FOLLOWUP] Support sub-queries in join conditions

2021-05-11 Thread GitBox
AngersZh commented on a change in pull request #32499: URL: https://github.com/apache/spark/pull/32499#discussion_r630214465 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -2353,7 +2353,7 @@ class Analyzer(override

[GitHub] [spark] SparkQA commented on pull request #32397: [SPARK-35084][CORE] Spark 3: supporting "--packages" in k8s cluster mode

2021-05-11 Thread GitBox
SparkQA commented on pull request #32397: URL: https://github.com/apache/spark/pull/32397#issuecomment-838564651 **[Test build #138380 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138380/testReport)** for PR 32397 at commit

[GitHub] [spark] SparkQA commented on pull request #32503: [WIP] better error message

2021-05-11 Thread GitBox
SparkQA commented on pull request #32503: URL: https://github.com/apache/spark/pull/32503#issuecomment-838564058 **[Test build #138379 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138379/testReport)** for PR 32503 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32482: [SPARK-35332][SQL] Make cache plan disable configs configurable

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32482: URL: https://github.com/apache/spark/pull/32482#issuecomment-838556903 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138373/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32452: [SPARK-35243][SQL] Support columnar execution on ANSI interval types

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32452: URL: https://github.com/apache/spark/pull/32452#issuecomment-838556901 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42901/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32476: [SPARK-35349][SQL] Add code-gen for left/right outer sort merge join

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32476: URL: https://github.com/apache/spark/pull/32476#issuecomment-838556913 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138374/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32497: [SPARK-35366][SQL] Avoid using deprecated `buildForBatch` and `buildForStreaming`

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32497: URL: https://github.com/apache/spark/pull/32497#issuecomment-838556904 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138372/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32502: [SPARK-35372][BUILD] Increase stack size for Scala compilation in Maven build

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32502: URL: https://github.com/apache/spark/pull/32502#issuecomment-838556910 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138377/

[GitHub] [spark] AmplabJenkins commented on pull request #32452: [SPARK-35243][SQL] Support columnar execution on ANSI interval types

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32452: URL: https://github.com/apache/spark/pull/32452#issuecomment-838556901 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42901/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32502: [SPARK-35372][BUILD] Increase stack size for Scala compilation in Maven build

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32502: URL: https://github.com/apache/spark/pull/32502#issuecomment-838556910 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138377/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32476: [SPARK-35349][SQL] Add code-gen for left/right outer sort merge join

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32476: URL: https://github.com/apache/spark/pull/32476#issuecomment-838556913 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138374/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32497: [SPARK-35366][SQL] Avoid using deprecated `buildForBatch` and `buildForStreaming`

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32497: URL: https://github.com/apache/spark/pull/32497#issuecomment-838556904 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138372/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32482: [SPARK-35332][SQL] Make cache plan disable configs configurable

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32482: URL: https://github.com/apache/spark/pull/32482#issuecomment-838556903 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138373/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32502: [SPARK-35372][BUILD] Increase stack size for Scala compilation in Maven build

2021-05-11 Thread GitBox
SparkQA removed a comment on pull request #32502: URL: https://github.com/apache/spark/pull/32502#issuecomment-838376772 **[Test build #138377 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138377/testReport)** for PR 32502 at commit

[GitHub] [spark] SparkQA commented on pull request #32502: [SPARK-35372][BUILD] Increase stack size for Scala compilation in Maven build

2021-05-11 Thread GitBox
SparkQA commented on pull request #32502: URL: https://github.com/apache/spark/pull/32502#issuecomment-838539679 **[Test build #138377 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138377/testReport)** for PR 32502 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #32499: [SPARK-29145][SQL][FOLLOWUP] Support sub-queries in join conditions

2021-05-11 Thread GitBox
cloud-fan commented on a change in pull request #32499: URL: https://github.com/apache/spark/pull/32499#discussion_r630196986 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -2353,7 +2353,7 @@ class Analyzer(override val

[GitHub] [spark] SparkQA commented on pull request #32452: [SPARK-35243][SQL] Support columnar execution on ANSI interval types

2021-05-11 Thread GitBox
SparkQA commented on pull request #32452: URL: https://github.com/apache/spark/pull/32452#issuecomment-838528206 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] cloud-fan opened a new pull request #32503: [WIP] better error message

2021-05-11 Thread GitBox
cloud-fan opened a new pull request #32503: URL: https://github.com/apache/spark/pull/32503 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How

[GitHub] [spark] SparkQA removed a comment on pull request #32497: [SPARK-35366][SQL] Avoid using deprecated `buildForBatch` and `buildForStreaming`

2021-05-11 Thread GitBox
SparkQA removed a comment on pull request #32497: URL: https://github.com/apache/spark/pull/32497#issuecomment-838140355 **[Test build #138372 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138372/testReport)** for PR 32497 at commit

[GitHub] [spark] SparkQA commented on pull request #32497: [SPARK-35366][SQL] Avoid using deprecated `buildForBatch` and `buildForStreaming`

2021-05-11 Thread GitBox
SparkQA commented on pull request #32497: URL: https://github.com/apache/spark/pull/32497#issuecomment-838517376 **[Test build #138372 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138372/testReport)** for PR 32497 at commit

[GitHub] [spark] gengliangwang commented on a change in pull request #32224: [SPARK-35128][UI] Some columns in table Data Distribution of storage page shows incorrectly when sorted

2021-05-11 Thread GitBox
gengliangwang commented on a change in pull request #32224: URL: https://github.com/apache/spark/pull/32224#discussion_r630187803 ## File path: core/src/main/resources/org/apache/spark/ui/static/sorttable.js ## @@ -505,3 +521,27 @@ var forEach = function(object, block,

[GitHub] [spark] SparkQA removed a comment on pull request #32482: [SPARK-35332][SQL] Make cache plan disable configs configurable

2021-05-11 Thread GitBox
SparkQA removed a comment on pull request #32482: URL: https://github.com/apache/spark/pull/32482#issuecomment-838140394 **[Test build #138373 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138373/testReport)** for PR 32482 at commit

[GitHub] [spark] SparkQA commented on pull request #32482: [SPARK-35332][SQL] Make cache plan disable configs configurable

2021-05-11 Thread GitBox
SparkQA commented on pull request #32482: URL: https://github.com/apache/spark/pull/32482#issuecomment-838507414 **[Test build #138373 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138373/testReport)** for PR 32482 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32476: [SPARK-35349][SQL] Add code-gen for left/right outer sort merge join

2021-05-11 Thread GitBox
SparkQA removed a comment on pull request #32476: URL: https://github.com/apache/spark/pull/32476#issuecomment-838140683 **[Test build #138374 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138374/testReport)** for PR 32476 at commit

[GitHub] [spark] SparkQA commented on pull request #32476: [SPARK-35349][SQL] Add code-gen for left/right outer sort merge join

2021-05-11 Thread GitBox
SparkQA commented on pull request #32476: URL: https://github.com/apache/spark/pull/32476#issuecomment-838500689 **[Test build #138374 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138374/testReport)** for PR 32476 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32452: [SPARK-35243][SQL] Support columnar execution on ANSI interval types

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32452: URL: https://github.com/apache/spark/pull/32452#issuecomment-833399479 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [spark] SparkQA commented on pull request #32452: [SPARK-35243][SQL] Support columnar execution on ANSI interval types

2021-05-11 Thread GitBox
SparkQA commented on pull request #32452: URL: https://github.com/apache/spark/pull/32452#issuecomment-838464756 **[Test build #138378 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138378/testReport)** for PR 32452 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32478: [SPARK-35063][SQL] Group exception messages in sql/catalyst

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32478: URL: https://github.com/apache/spark/pull/32478#issuecomment-838457588 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138369/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32502: [SPARK-35372][BUILD] Increase stack size for Scala compilation in Maven build

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32502: URL: https://github.com/apache/spark/pull/32502#issuecomment-838457598 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42900/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32482: [SPARK-35332][SQL] Make cache plan disable configs configurable

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32482: URL: https://github.com/apache/spark/pull/32482#issuecomment-838457586 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138371/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32499: [SPARK-29145][SQL][FOLLOWUP] Support sub-queries in join conditions

2021-05-11 Thread GitBox
AmplabJenkins removed a comment on pull request #32499: URL: https://github.com/apache/spark/pull/32499#issuecomment-838457593 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #32478: [SPARK-35063][SQL] Group exception messages in sql/catalyst

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32478: URL: https://github.com/apache/spark/pull/32478#issuecomment-838457588 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138369/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32482: [SPARK-35332][SQL] Make cache plan disable configs configurable

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32482: URL: https://github.com/apache/spark/pull/32482#issuecomment-838457586 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138371/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32499: [SPARK-29145][SQL][FOLLOWUP] Support sub-queries in join conditions

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32499: URL: https://github.com/apache/spark/pull/32499#issuecomment-838457593 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #32502: [SPARK-35372][BUILD] Increase stack size for Scala compilation in Maven build

2021-05-11 Thread GitBox
AmplabJenkins commented on pull request #32502: URL: https://github.com/apache/spark/pull/32502#issuecomment-838457598 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42900/ --

[GitHub] [spark] SparkQA commented on pull request #32502: [SPARK-35372][BUILD] Increase stack size for Scala compilation in Maven build

2021-05-11 Thread GitBox
SparkQA commented on pull request #32502: URL: https://github.com/apache/spark/pull/32502#issuecomment-838439275 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA removed a comment on pull request #32499: [SPARK-29145][SQL][FOLLOWUP] Support sub-queries in join conditions

2021-05-11 Thread GitBox
SparkQA removed a comment on pull request #32499: URL: https://github.com/apache/spark/pull/32499#issuecomment-838055316 **[Test build #138368 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138368/testReport)** for PR 32499 at commit

[GitHub] [spark] SparkQA commented on pull request #32499: [SPARK-29145][SQL][FOLLOWUP] Support sub-queries in join conditions

2021-05-11 Thread GitBox
SparkQA commented on pull request #32499: URL: https://github.com/apache/spark/pull/32499#issuecomment-838433142 **[Test build #138368 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138368/testReport)** for PR 32499 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32478: [SPARK-35063][SQL] Group exception messages in sql/catalyst

2021-05-11 Thread GitBox
SparkQA removed a comment on pull request #32478: URL: https://github.com/apache/spark/pull/32478#issuecomment-838055562 **[Test build #138369 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138369/testReport)** for PR 32478 at commit

[GitHub] [spark] SparkQA commented on pull request #32478: [SPARK-35063][SQL] Group exception messages in sql/catalyst

2021-05-11 Thread GitBox
SparkQA commented on pull request #32478: URL: https://github.com/apache/spark/pull/32478#issuecomment-838431168 **[Test build #138369 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138369/testReport)** for PR 32478 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32452: [SPARK-35243][SQL] Support columnar execution on ANSI interval types

2021-05-11 Thread GitBox
HyukjinKwon commented on a change in pull request #32452: URL: https://github.com/apache/spark/pull/32452#discussion_r630142773 ## File path: sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala ## @@ -1187,6 +1188,20 @@ class CachedTableSuite extends QueryTest

[GitHub] [spark] HyukjinKwon commented on pull request #32452: [SPARK-35243][SQL] Support columnar execution on ANSI interval types

2021-05-11 Thread GitBox
HyukjinKwon commented on pull request #32452: URL: https://github.com/apache/spark/pull/32452#issuecomment-838428535 ok to test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA removed a comment on pull request #32499: [SPARK-29145][SQL][FOLLOWUP] Support sub-queries in join conditions

2021-05-11 Thread GitBox
SparkQA removed a comment on pull request #32499: URL: https://github.com/apache/spark/pull/32499#issuecomment-838066402 **[Test build #138370 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138370/testReport)** for PR 32499 at commit

[GitHub] [spark] gengliangwang closed pull request #32381: [SPARK-35229][WEBUI] Limit the maximum number of items on the timeline view.

2021-05-11 Thread GitBox
gengliangwang closed pull request #32381: URL: https://github.com/apache/spark/pull/32381 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] SparkQA commented on pull request #32499: [SPARK-29145][SQL][FOLLOWUP] Support sub-queries in join conditions

2021-05-11 Thread GitBox
SparkQA commented on pull request #32499: URL: https://github.com/apache/spark/pull/32499#issuecomment-838421957 **[Test build #138370 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138370/testReport)** for PR 32499 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32482: [SPARK-35332][SQL] Make cache plan disable configs configurable

2021-05-11 Thread GitBox
SparkQA removed a comment on pull request #32482: URL: https://github.com/apache/spark/pull/32482#issuecomment-838066417 **[Test build #138371 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138371/testReport)** for PR 32482 at commit

<    1   2   3   4   5   6   7   8   >