[GitHub] [spark] maropu commented on pull request #29932: [SPARK-33052][SQL][TEST] Make database versions up-to-date for integration tests
maropu commented on pull request #29932: URL: https://github.com/apache/spark/pull/29932#issuecomment-702541181 okay, thanks for the check, @HyukjinKwon This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
AmplabJenkins removed a comment on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702538991 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
AmplabJenkins commented on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702538991 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] maropu commented on pull request #29932: [SPARK-33052][SQL][TEST] Make database versions up-to-date for integration tests
maropu commented on pull request #29932: URL: https://github.com/apache/spark/pull/29932#issuecomment-702538831 cc: @HyukjinKwon @dongjoon-hyun This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] maropu opened a new pull request #29932: [SPARK-33052][SQL][TEST] Make database versions up-to-date for integration tests
maropu opened a new pull request #29932: URL: https://github.com/apache/spark/pull/29932 ### What changes were proposed in this pull request? This PR intends to update database versions below for integration tests; - ibmcom/db2:11.5.0.0a => ibmcom/db2:11.5.4.0 in `DB2[Krb]IntegrationSuite` - mysql:5.7.28 => mysql:5.7.31 in `MySQLIntegrationSuite` - postgres:12.0 => postgres:13.0 in `Postgres[Krb]IntegrationSuite` Also, this added environmental variables so that we can test with any database version. ### Why are the changes needed? To improve tests. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Manually checked. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
SparkQA removed a comment on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702485307 **[Test build #129332 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129332/testReport)** for PR 29927 at commit [`833c2dd`](https://github.com/apache/spark/commit/833c2dd380a155d0487dd6d2a6179ac9d8d85ea9). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
SparkQA commented on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702536583 **[Test build #129332 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129332/testReport)** for PR 29927 at commit [`833c2dd`](https://github.com/apache/spark/commit/833c2dd380a155d0487dd6d2a6179ac9d8d85ea9). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29831: [SPARK-32351][SQL] Show partially pushed down partition filters in explain()
SparkQA commented on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-702535182 **[Test build #129336 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129336/testReport)** for PR 29831 at commit [`15ec353`](https://github.com/apache/spark/commit/15ec3534e345631fd775d5679507e651291e0552). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29586: [SPARK-32743][SQL] Add distinct info at UnresolvedFunction toString
SparkQA commented on pull request #29586: URL: https://github.com/apache/spark/pull/29586#issuecomment-702535196 **[Test build #129337 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129337/testReport)** for PR 29586 at commit [`95a3e02`](https://github.com/apache/spark/commit/95a3e028b2d1c83eaeab4baf15c07870df4a66ad). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29918: [SPARK-33017][PYTHON] Add getCheckpointDir method to PySpark Context
SparkQA commented on pull request #29918: URL: https://github.com/apache/spark/pull/29918#issuecomment-702535179 **[Test build #129335 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129335/testReport)** for PR 29918 at commit [`3f05f9c`](https://github.com/apache/spark/commit/3f05f9c7fffec7548213a18d25ff56d8fed08787). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29931: [SPARK-33051][INFRA][R] Uses setup-r to install R in GitHub Actions build
SparkQA commented on pull request #29931: URL: https://github.com/apache/spark/pull/29931#issuecomment-702534902 **[Test build #129333 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129333/testReport)** for PR 29931 at commit [`0dd8ff9`](https://github.com/apache/spark/commit/0dd8ff90c64867008fb786db866089812629d761). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29929: [WIP][CORE][SPARK-33049] Decommission shuffle block test is flaky
SparkQA commented on pull request #29929: URL: https://github.com/apache/spark/pull/29929#issuecomment-702534954 **[Test build #129334 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129334/testReport)** for PR 29929 at commit [`6518153`](https://github.com/apache/spark/commit/65181534fcbfa0390f65f90378c528f62413f8fb). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #29930: [SPARK-33050][BUILD] Upgrade Apache ORC to 1.5.12
HyukjinKwon commented on pull request #29930: URL: https://github.com/apache/spark/pull/29930#issuecomment-702534837 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29930: [SPARK-33050][BUILD] Upgrade Apache ORC to 1.5.12
AmplabJenkins removed a comment on pull request #29930: URL: https://github.com/apache/spark/pull/29930#issuecomment-702533909 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/129330/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29930: [SPARK-33050][BUILD] Upgrade Apache ORC to 1.5.12
AmplabJenkins removed a comment on pull request #29930: URL: https://github.com/apache/spark/pull/29930#issuecomment-702533903 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon edited a comment on pull request #29906: [SPARK-32037][CORE] Rename blacklisting feature
HyukjinKwon edited a comment on pull request #29906: URL: https://github.com/apache/spark/pull/29906#issuecomment-702525542 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29929: [WIP][CORE][SPARK-33049] Decommission shuffle block test is flaky
AmplabJenkins commented on pull request #29929: URL: https://github.com/apache/spark/pull/29929#issuecomment-702534119 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29929: [WIP][CORE][SPARK-33049] Decommission shuffle block test is flaky
AmplabJenkins removed a comment on pull request #29929: URL: https://github.com/apache/spark/pull/29929#issuecomment-702534123 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29930: [SPARK-33050][BUILD] Upgrade Apache ORC to 1.5.12
AmplabJenkins commented on pull request #29930: URL: https://github.com/apache/spark/pull/29930#issuecomment-702533903 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #29931: [SPARK-33051][INFRA][R] Uses setup-r to install R in GitHub Actions build
HyukjinKwon commented on pull request #29931: URL: https://github.com/apache/spark/pull/29931#issuecomment-702531023 cc @dongjoon-hyun. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] holdenk commented on pull request #29929: [WIP][CORE][SPARK-33049] Decommission shuffle block test is flaky
holdenk commented on pull request #29929: URL: https://github.com/apache/spark/pull/29929#issuecomment-702529640 cc @dongjoon-hyun This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] holdenk commented on pull request #29929: [WIP][CORE][SPARK-33049] Decommission shuffle block test is flaky
holdenk commented on pull request #29929: URL: https://github.com/apache/spark/pull/29929#issuecomment-702529445 jenkins retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon edited a comment on pull request #29906: [SPARK-32037][CORE] Rename blacklisting feature
HyukjinKwon edited a comment on pull request #29906: URL: https://github.com/apache/spark/pull/29906#issuecomment-702525542 > I'm confused by why the build and test report test results says failed when everything passed. @dongjoon-hyun @HyukjinKwon have you seen that before, am I perhaps missing something? Yes, I think I have seen this few times. The failure error message was somewhat not very deterministic so I was kept monitoring it. Seems like it fails when there are no JUnit XML generated, and there's nothing to report. Did the test failure like https://github.com/apache/spark/runs/1196184007? Let me take a quick look. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #29929: [WIP][CORE][SPARK-33049] Decommission shuffle block test is flaky
SparkQA removed a comment on pull request #29929: URL: https://github.com/apache/spark/pull/29929#issuecomment-702481818 **[Test build #129328 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129328/testReport)** for PR 29929 at commit [`6518153`](https://github.com/apache/spark/commit/65181534fcbfa0390f65f90378c528f62413f8fb). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29929: [WIP][CORE][SPARK-33049] Decommission shuffle block test is flaky
SparkQA commented on pull request #29929: URL: https://github.com/apache/spark/pull/29929#issuecomment-702529103 **[Test build #129328 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129328/testReport)** for PR 29929 at commit [`6518153`](https://github.com/apache/spark/commit/65181534fcbfa0390f65f90378c528f62413f8fb). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #29586: [SPARK-32743][SQL] Add distinct info at UnresolvedFunction toString
HyukjinKwon commented on pull request #29586: URL: https://github.com/apache/spark/pull/29586#issuecomment-702527232 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon opened a new pull request #29931: [DO-NOT-MERGE] Uses setup-r to install R in GitHub Actions build
HyukjinKwon opened a new pull request #29931: URL: https://github.com/apache/spark/pull/29931 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #29930: [SPARK-33050][BUILD] Upgrade Apache ORC to 1.5.12
SparkQA removed a comment on pull request #29930: URL: https://github.com/apache/spark/pull/29930#issuecomment-702485278 **[Test build #129330 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129330/testReport)** for PR 29930 at commit [`fc5c331`](https://github.com/apache/spark/commit/fc5c33157b2f6b3dcc682a1e3c56242e2748d164). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29930: [SPARK-33050][BUILD] Upgrade Apache ORC to 1.5.12
SparkQA commented on pull request #29930: URL: https://github.com/apache/spark/pull/29930#issuecomment-702526382 **[Test build #129330 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129330/testReport)** for PR 29930 at commit [`fc5c331`](https://github.com/apache/spark/commit/fc5c33157b2f6b3dcc682a1e3c56242e2748d164). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #29906: [SPARK-32037][CORE] Rename blacklisting feature
HyukjinKwon commented on pull request #29906: URL: https://github.com/apache/spark/pull/29906#issuecomment-702525542 > I'm confused by why the build and test report test results says failed when everything passed. @dongjoon-hyun @HyukjinKwon have you seen that before, am I perhaps missing something? Yes, I think I have seen this few times. The failure error message was somewhat not very deterministic so I was kept monitoring it. Feel free to just screen shot or copy/paste the error message and leave it in the comment when you guys see it before retriggering. I will take a look deeper. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on a change in pull request #29925: [SPARK-33043][ML] Handle spark.driver.maxResultSize=0 in RowMatrix heuristic computation
HyukjinKwon commented on a change in pull request #29925:
URL: https://github.com/apache/spark/pull/29925#discussion_r498617697
##
File path:
mllib/src/test/scala/org/apache/spark/mllib/linalg/distributed/RowMatrixSuite.scala
##
@@ -121,6 +122,20 @@ class RowMatrixSuite extends SparkFunSuite with
MLlibTestSparkContext {
assert(objectBiggerThanResultSize.getMessage.contains("it's bigger than
maxResultSize"))
}
+ test("getTreeAggregateIdealDepth with unlimited driver size") {
Review comment:
nit but I would add a JIRA prefix like `SPARK-33043: getTree ..` in the
test name.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on a change in pull request #29925: [SPARK-33043][ML] Handle spark.driver.maxResultSize=0 in RowMatrix heuristic computation
HyukjinKwon commented on a change in pull request #29925:
URL: https://github.com/apache/spark/pull/29925#discussion_r498617631
##
File path:
mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/RowMatrix.scala
##
@@ -786,11 +786,15 @@ class RowMatrix @Since("1.0.0") (
* Based on the formulae: (numPartitions)^(1/depth) * objectSize <=
DriverMaxResultSize
* @param aggregatedObjectSizeInBytes the size, in megabytes, of the object
being tree aggregated
*/
- private[spark] def getTreeAggregateIdealDepth(aggregatedObjectSizeInBytes:
Long) = {
+ private[spark] def getTreeAggregateIdealDepth(aggregatedObjectSizeInBytes:
Long): Int = {
require(aggregatedObjectSizeInBytes > 0,
"Cannot compute aggregate depth heuristic based on a zero-size object to
aggregate")
val maxDriverResultSizeInBytes = rows.conf.get[Long](MAX_RESULT_SIZE)
+if (maxDriverResultSizeInBytes == 0) {
Review comment:
nit but should be do it via: `maxDriverResultSizeInBytes <= 0`
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29918: [SPARK-33017][PYTHON] Add getCheckpointDir method to PySpark Context
AmplabJenkins removed a comment on pull request #29918: URL: https://github.com/apache/spark/pull/29918#issuecomment-701706950 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #29918: [SPARK-33017][PYTHON] Add getCheckpointDir method to PySpark Context
HyukjinKwon commented on pull request #29918: URL: https://github.com/apache/spark/pull/29918#issuecomment-702521513 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on a change in pull request #29918: [SPARK-33017][PYTHON] Add getCheckpointDir method to PySpark Context
HyukjinKwon commented on a change in pull request #29918: URL: https://github.com/apache/spark/pull/29918#discussion_r498615956 ## File path: python/pyspark/context.py ## @@ -956,6 +956,15 @@ def setCheckpointDir(self, dirName): """ self._jsc.sc().setCheckpointDir(dirName) +def getCheckpointDir(self): Review comment: Should also add the corresponding type hint below https://github.com/apache/spark/blob/master/python/pyspark/context.pyi#L154 line. cc @zero323 FYI. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on a change in pull request #29918: [SPARK-33017][PYTHON] Add getCheckpointDir method to PySpark Context
HyukjinKwon commented on a change in pull request #29918: URL: https://github.com/apache/spark/pull/29918#discussion_r498615825 ## File path: python/pyspark/context.py ## @@ -956,6 +956,15 @@ def setCheckpointDir(self, dirName): """ self._jsc.sc().setCheckpointDir(dirName) +def getCheckpointDir(self): Review comment: Let's also decorate this with `@since(3.1)`. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] CodingCat commented on a change in pull request #29831: [SPARK-32351][SQL] Show partially pushed down partition filters in explain()
CodingCat commented on a change in pull request #29831:
URL: https://github.com/apache/spark/pull/29831#discussion_r498615640
##
File path:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PrunePartitionSuiteBase.scala
##
@@ -46,30 +46,39 @@ abstract class PrunePartitionSuiteBase extends QueryTest
with SQLTestUtils with
}
assertPrunedPartitions(
- "SELECT * FROM t WHERE p = '1' OR (p = '2' AND i = 1)", 2)
+ "SELECT * FROM t WHERE p = '1' OR (p = '2' AND i = 1)", 2, 1)
assertPrunedPartitions(
- "SELECT * FROM t WHERE (p = '1' AND i = 2) OR (i = 1 OR p = '2')", 4)
+ "SELECT * FROM t WHERE (p = '1' AND i = 2) OR (i = 1 OR p = '2')",
4, 0)
assertPrunedPartitions(
- "SELECT * FROM t WHERE (p = '1' AND i = 2) OR (p = '3' AND i = 3 )",
2)
+ "SELECT * FROM t WHERE (p = '1' AND i = 2) OR (p = '3' AND i = 3 )",
2, 1)
assertPrunedPartitions(
- "SELECT * FROM t WHERE (p = '1' AND i = 2) OR (p = '2' OR p = '3')",
3)
+ "SELECT * FROM t WHERE (p = '1' AND i = 2) OR (p = '2' OR p = '3')",
3, 1)
assertPrunedPartitions(
- "SELECT * FROM t", 4)
+ "SELECT * FROM t", 4, 0)
assertPrunedPartitions(
- "SELECT * FROM t WHERE p = '1' AND i = 2", 1)
+ "SELECT * FROM t WHERE p = '1' AND i = 2", 1, 2)
assertPrunedPartitions(
"""
|SELECT i, COUNT(1) FROM (
|SELECT * FROM t WHERE p = '1' OR (p = '2' AND i = 1)
|) tmp GROUP BY i
- """.stripMargin, 2)
+ """.stripMargin, 2, 1)
}
}
}
- protected def assertPrunedPartitions(query: String, expected: Long): Unit = {
-val plan = sql(query).queryExecution.sparkPlan
-assert(getScanExecPartitionSize(plan) == expected)
+ protected def assertPrunedPartitions(
+ query: String,
+ expectedPartitionCount: Long,
+ expectedPushedDownFilterCount: Int): Unit = {
Review comment:
I originally meant that the information like whether partition filters
are correctly picked up should have been handled in other unit test, so here
only checking the count would be enough
but sure, we can make it more comprehensive, just revised by comparing based
on string
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #29917: [SPARK-33040][R][ML] Add SparkR wrapper for vector_to_array
HyukjinKwon commented on pull request #29917: URL: https://github.com/apache/spark/pull/29917#issuecomment-702521009 cc @WeichenXu123 and @mengxr. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] sunchao commented on pull request #29843: [WIP][SPARK-29250][test-maven][test-hadoop2.7] Upgrade to Hadoop 3.2.1 and move to shaded client
sunchao commented on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-702520516 Just one last test failure: "Exception: Python in worker has different version 3.6 than that in driver 3.8, PySpark cannot run with different minor versions. Please check environment variables PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON are correctly set." @HyukjinKwon do you happen to know the reason for this? looking at the CI script it seems it should install either Python 3.6 or 3.8, but not both. I'm also not sure which part of this PR could affect the Yarn/Python tests. I tried on my own Spark fork with some dummy change in `YarnClusterSuite` (just to trigger tests on `ExtendedYarnTest`) and the tests there all passed, so it seems the failure is indeed related to this PR. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29916: [SPARK-33037] Remove knownManagers to support user's custom shuffle manager plugin
AmplabJenkins commented on pull request #29916: URL: https://github.com/apache/spark/pull/29916#issuecomment-702520157 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/129325/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29916: [SPARK-33037] Remove knownManagers to support user's custom shuffle manager plugin
AmplabJenkins removed a comment on pull request #29916: URL: https://github.com/apache/spark/pull/29916#issuecomment-702520157 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/129325/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29916: [SPARK-33037] Remove knownManagers to support user's custom shuffle manager plugin
AmplabJenkins removed a comment on pull request #29916: URL: https://github.com/apache/spark/pull/29916#issuecomment-702519959 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29916: [SPARK-33037] Remove knownManagers to support user's custom shuffle manager plugin
AmplabJenkins commented on pull request #29916: URL: https://github.com/apache/spark/pull/29916#issuecomment-702519959 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] c21 commented on pull request #29804: [SPARK-32859][SQL] Introduce physical rule to decide bucketing dynamically
c21 commented on pull request #29804: URL: https://github.com/apache/spark/pull/29804#issuecomment-702516837 Thank you @maropu , @viirya and @cloud-fan for all discussion and help! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
AmplabJenkins commented on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702514900 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/129324/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
AmplabJenkins removed a comment on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702514900 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/129324/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
AmplabJenkins removed a comment on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702514671 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
AmplabJenkins commented on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702514671 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #29916: [SPARK-33037] Remove knownManagers to support user's custom shuffle manager plugin
SparkQA removed a comment on pull request #29916: URL: https://github.com/apache/spark/pull/29916#issuecomment-702463123 **[Test build #129325 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129325/testReport)** for PR 29916 at commit [`bb6acdc`](https://github.com/apache/spark/commit/bb6acdc0948200388a9710c73ad018ecc0a764d8). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon closed pull request #29024: [SPARK-32001][SQL]Create JDBC authentication provider developer API
HyukjinKwon closed pull request #29024: URL: https://github.com/apache/spark/pull/29024 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #29024: [SPARK-32001][SQL]Create JDBC authentication provider developer API
HyukjinKwon commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-702514012 Merged to master. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29916: [SPARK-33037] Remove knownManagers to support user's custom shuffle manager plugin
SparkQA commented on pull request #29916: URL: https://github.com/apache/spark/pull/29916#issuecomment-702513991 **[Test build #129325 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129325/testReport)** for PR 29916 at commit [`bb6acdc`](https://github.com/apache/spark/commit/bb6acdc0948200388a9710c73ad018ecc0a764d8). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
SparkQA removed a comment on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702463115 **[Test build #129324 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129324/testReport)** for PR 29927 at commit [`833c2dd`](https://github.com/apache/spark/commit/833c2dd380a155d0487dd6d2a6179ac9d8d85ea9). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
SparkQA commented on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702511559 **[Test build #129324 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129324/testReport)** for PR 29927 at commit [`833c2dd`](https://github.com/apache/spark/commit/833c2dd380a155d0487dd6d2a6179ac9d8d85ea9). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] LuciferYang commented on pull request #29903: [SPARK-33024][SQL] Fix CodeGen fallback issue of UDFSuite in Scala 2.13
LuciferYang commented on pull request #29903: URL: https://github.com/apache/spark/pull/29903#issuecomment-702505111 thx ~ @srowen This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29930: [SPARK-33050][BUILD] Upgrade Apache ORC to 1.5.12
AmplabJenkins commented on pull request #29930: URL: https://github.com/apache/spark/pull/29930#issuecomment-702499246 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29930: [SPARK-33050][BUILD] Upgrade Apache ORC to 1.5.12
SparkQA commented on pull request #29930: URL: https://github.com/apache/spark/pull/29930#issuecomment-702499238 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33944/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29930: [SPARK-33050][BUILD] Upgrade Apache ORC to 1.5.12
AmplabJenkins removed a comment on pull request #29930: URL: https://github.com/apache/spark/pull/29930#issuecomment-702499246 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
AmplabJenkins commented on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702499061 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
AmplabJenkins removed a comment on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702499061 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
SparkQA commented on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702498879 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33943/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29928: [WIP][SPARK-32741][SQL][FOLLOWUP][test-maven] Run plan integrity check only for effective plans
AmplabJenkins removed a comment on pull request #29928: URL: https://github.com/apache/spark/pull/29928#issuecomment-702497525 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/33942/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29929: [WIP][CORE][SPARK-33049] Decommission shuffle block test is flaky
AmplabJenkins removed a comment on pull request #29929: URL: https://github.com/apache/spark/pull/29929#issuecomment-702497444 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29929: [WIP][CORE][SPARK-33049] Decommission shuffle block test is flaky
SparkQA commented on pull request #29929: URL: https://github.com/apache/spark/pull/29929#issuecomment-702497374 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33941/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29929: [WIP][CORE][SPARK-33049] Decommission shuffle block test is flaky
AmplabJenkins commented on pull request #29929: URL: https://github.com/apache/spark/pull/29929#issuecomment-702497444 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29928: [WIP][SPARK-32741][SQL][FOLLOWUP][test-maven] Run plan integrity check only for effective plans
AmplabJenkins commented on pull request #29928: URL: https://github.com/apache/spark/pull/29928#issuecomment-702497520 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29928: [WIP][SPARK-32741][SQL][FOLLOWUP][test-maven] Run plan integrity check only for effective plans
SparkQA commented on pull request #29928: URL: https://github.com/apache/spark/pull/29928#issuecomment-702497506 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33942/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29928: [WIP][SPARK-32741][SQL][FOLLOWUP][test-maven] Run plan integrity check only for effective plans
AmplabJenkins removed a comment on pull request #29928: URL: https://github.com/apache/spark/pull/29928#issuecomment-702497520 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29930: [SPARK-33050][BUILD] Upgrade Apache ORC to 1.5.12
SparkQA commented on pull request #29930: URL: https://github.com/apache/spark/pull/29930#issuecomment-702495490 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33944/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] viirya closed pull request #29914: [SPARK-32996][Web-UI][3.0] Handle empty ExecutorMetrics in ExecutorMetricsJsonSerializer
viirya closed pull request #29914: URL: https://github.com/apache/spark/pull/29914 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] viirya commented on pull request #29914: [SPARK-32996][Web-UI][3.0] Handle empty ExecutorMetrics in ExecutorMetricsJsonSerializer
viirya commented on pull request #29914: URL: https://github.com/apache/spark/pull/29914#issuecomment-702493310 Thanks! Merging to branch-3.0. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
SparkQA commented on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702493109 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33943/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29928: [WIP][SPARK-32741][SQL][FOLLOWUP][test-maven] Run plan integrity check only for effective plans
SparkQA commented on pull request #29928: URL: https://github.com/apache/spark/pull/29928#issuecomment-702493074 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33942/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29929: [WIP][CORE][SPARK-33049] Decommission shuffle block test is flaky
SparkQA commented on pull request #29929: URL: https://github.com/apache/spark/pull/29929#issuecomment-702491799 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33941/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] gaborgsomogyi commented on pull request #29729: [SPARK-32032][SS] Avoid infinite wait in driver because of KafkaConsumer.poll(long) API
gaborgsomogyi commented on pull request #29729: URL: https://github.com/apache/spark/pull/29729#issuecomment-702491670 @zsxwing you understand it right, actually it removes permissions needed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] maropu commented on a change in pull request #29695: [SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down
maropu commented on a change in pull request #29695:
URL: https://github.com/apache/spark/pull/29695#discussion_r498593284
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala
##
@@ -643,6 +647,34 @@ object DataSourceStrategy {
(nonconvertiblePredicates ++ unhandledPredicates, pushedFilters,
handledFilters)
}
+ def translateAggregate(aggregates: AggregateExpression):
Option[AggregateFunc] = {
+
+def columnAsString(e: Expression): String = e match {
+ case AttributeReference(name, _, _, _) => name
+ case Cast(child, _, _) => child match {
Review comment:
For example, how about the fractional case? If `e` is float, we should
not remove the cast but pass it into a database side for computing double-typed
partial aggregated values?
```
case Sum(e @ FractionalType()) if e.dataType != DoubleType => Sum(Cast(e,
DoubleType))
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29928: [WIP][SPARK-32741][SQL][FOLLOWUP][test-maven] Run plan integrity check only for effective plans
SparkQA commented on pull request #29928: URL: https://github.com/apache/spark/pull/29928#issuecomment-702485304 **[Test build #129331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129331/testReport)** for PR 29928 at commit [`6582f90`](https://github.com/apache/spark/commit/6582f9014338adab33b121c724d270233ce2f642). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
SparkQA commented on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702485307 **[Test build #129332 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129332/testReport)** for PR 29927 at commit [`833c2dd`](https://github.com/apache/spark/commit/833c2dd380a155d0487dd6d2a6179ac9d8d85ea9). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29843: [WIP][SPARK-29250][test-maven][test-hadoop2.7] Upgrade to Hadoop 3.2.1 and move to shaded client
AmplabJenkins removed a comment on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-702484960 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/129326/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29930: [SPARK-33050][BUILD] Upgrade Apache ORC to 1.5.12
SparkQA commented on pull request #29930: URL: https://github.com/apache/spark/pull/29930#issuecomment-702485278 **[Test build #129330 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129330/testReport)** for PR 29930 at commit [`fc5c331`](https://github.com/apache/spark/commit/fc5c33157b2f6b3dcc682a1e3c56242e2748d164). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #29843: [WIP][SPARK-29250][test-maven][test-hadoop2.7] Upgrade to Hadoop 3.2.1 and move to shaded client
SparkQA removed a comment on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-702466810 **[Test build #129326 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129326/testReport)** for PR 29843 at commit [`8cc4204`](https://github.com/apache/spark/commit/8cc4204d7b0d589a2050201b3aff40d1a543bcc6). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29843: [WIP][SPARK-29250][test-maven][test-hadoop2.7] Upgrade to Hadoop 3.2.1 and move to shaded client
SparkQA commented on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-702484929 **[Test build #129326 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129326/testReport)** for PR 29843 at commit [`8cc4204`](https://github.com/apache/spark/commit/8cc4204d7b0d589a2050201b3aff40d1a543bcc6). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29843: [WIP][SPARK-29250][test-maven][test-hadoop2.7] Upgrade to Hadoop 3.2.1 and move to shaded client
AmplabJenkins commented on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-702484958 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29843: [WIP][SPARK-29250][test-maven][test-hadoop2.7] Upgrade to Hadoop 3.2.1 and move to shaded client
AmplabJenkins removed a comment on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-702484958 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29928: [WIP][SPARK-32741][SQL][FOLLOWUP][test-maven] Run plan integrity check only for effective plans
SparkQA commented on pull request #29928: URL: https://github.com/apache/spark/pull/29928#issuecomment-702484151 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33940/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29928: [WIP][SPARK-32741][SQL][FOLLOWUP][test-maven] Run plan integrity check only for effective plans
AmplabJenkins commented on pull request #29928: URL: https://github.com/apache/spark/pull/29928#issuecomment-702484173 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29928: [WIP][SPARK-32741][SQL][FOLLOWUP][test-maven] Run plan integrity check only for effective plans
AmplabJenkins removed a comment on pull request #29928: URL: https://github.com/apache/spark/pull/29928#issuecomment-702484173 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29843: [WIP][SPARK-29250][test-maven][test-hadoop2.7] Upgrade to Hadoop 3.2.1 and move to shaded client
AmplabJenkins removed a comment on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-702483812 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29843: [WIP][SPARK-29250][test-maven][test-hadoop2.7] Upgrade to Hadoop 3.2.1 and move to shaded client
AmplabJenkins commented on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-702483812 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29843: [WIP][SPARK-29250][test-maven][test-hadoop2.7] Upgrade to Hadoop 3.2.1 and move to shaded client
SparkQA commented on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-702483734 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33939/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun opened a new pull request #29930: [SPARK-33050][BUILD] Upgrade Apache ORC to 1.5.12
dongjoon-hyun opened a new pull request #29930: URL: https://github.com/apache/spark/pull/29930 ### What changes were proposed in this pull request? This PR aims to upgrade Apache ORC to 1.5.12. ### Why are the changes needed? This brings us the latest bug patches like the followings. - ORC-644 nested struct evolution does not respect to orc.force.positional.evolution - ORC-667 ositional mapping for nested struct types should not applied by default ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CI. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] maropu commented on pull request #29928: [WIP][SPARK-32741][SQL][FOLLOWUP][test-maven] Run plan integrity check only for effective plans
maropu commented on pull request #29928: URL: https://github.com/apache/spark/pull/29928#issuecomment-702482043 Thanks for the update, @dongjoon-hyun This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29929: [WIP][CORE][SPARK-33049] Decommission shuffle block test is flaky
SparkQA commented on pull request #29929: URL: https://github.com/apache/spark/pull/29929#issuecomment-702481818 **[Test build #129328 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129328/testReport)** for PR 29929 at commit [`6518153`](https://github.com/apache/spark/commit/65181534fcbfa0390f65f90378c528f62413f8fb). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29928: [WIP][SPARK-32741][SQL][FOLLOWUP][test-maven] Run plan integrity check only for effective plans
SparkQA commented on pull request #29928: URL: https://github.com/apache/spark/pull/29928#issuecomment-702481858 **[Test build #129329 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129329/testReport)** for PR 29928 at commit [`6582f90`](https://github.com/apache/spark/commit/6582f9014338adab33b121c724d270233ce2f642). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
AmplabJenkins removed a comment on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702481366 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/33937/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] sarutak commented on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
sarutak commented on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702481772 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29914: [SPARK-32996][Web-UI][3.0] Handle empty ExecutorMetrics in ExecutorMetricsJsonSerializer
AmplabJenkins removed a comment on pull request #29914: URL: https://github.com/apache/spark/pull/29914#issuecomment-702481449 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29914: [SPARK-32996][Web-UI][3.0] Handle empty ExecutorMetrics in ExecutorMetricsJsonSerializer
AmplabJenkins commented on pull request #29914: URL: https://github.com/apache/spark/pull/29914#issuecomment-702481449 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
AmplabJenkins removed a comment on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702481361 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29927: [SPARK-33048][BUILD] Fix SparkBuild.scala to recognize build settings for Scala 2.13
SparkQA commented on pull request #29927: URL: https://github.com/apache/spark/pull/29927#issuecomment-702481349 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33937/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
