[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user michaelmior commented on the issue: https://github.com/apache/spark/pull/19263 Thanks for the merge! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/19263 Merging to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19263 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82850/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19263 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19263 **[Test build #82850 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82850/testReport)** for PR 19263 at commit [`dc36ec1`](https://github.com/apache/spark/commit/dc36ec12f68a13ee35708aa2bbbd16e03c52bf0b). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user michaelmior commented on the issue: https://github.com/apache/spark/pull/19263 @vanzin Made the changes you recommended. Thanks for the feedback! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19263 **[Test build #82850 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82850/testReport)** for PR 19263 at commit [`dc36ec1`](https://github.com/apache/spark/commit/dc36ec12f68a13ee35708aa2bbbd16e03c52bf0b). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19263 @vanzin, do you have other comments? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user michaelmior commented on the issue: https://github.com/apache/spark/pull/19263 @jerryshao Agreed on both points. Changed! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19263 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82715/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19263 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19263 **[Test build #82715 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82715/testReport)** for PR 19263 at commit [`21b262a`](https://github.com/apache/spark/commit/21b262a4cf945b22ce1ace84acded29852bc73b5). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19263 **[Test build #82715 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82715/testReport)** for PR 19263 at commit [`21b262a`](https://github.com/apache/spark/commit/21b262a4cf945b22ce1ace84acded29852bc73b5). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user michaelmior commented on the issue: https://github.com/apache/spark/pull/19263 @vanzin Just wanted to ping since I believe I addressed your concerns. Let me know if it looks like any other changes are required. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19263 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19263 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82323/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19263 **[Test build #82323 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82323/testReport)** for PR 19263 at commit [`eaeeef2`](https://github.com/apache/spark/commit/eaeeef2025923502cf3804d0d377dc1d2d1c57b0). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19263 **[Test build #82323 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82323/testReport)** for PR 19263 at commit [`eaeeef2`](https://github.com/apache/spark/commit/eaeeef2025923502cf3804d0d377dc1d2d1c57b0). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19263 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19263 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82316/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19263 **[Test build #82316 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82316/testReport)** for PR 19263 at commit [`0bb4130`](https://github.com/apache/spark/commit/0bb4130337e5862d92eaf653fbffdd3ebff7f364). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19263 **[Test build #82316 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82316/testReport)** for PR 19263 at commit [`0bb4130`](https://github.com/apache/spark/commit/0bb4130337e5862d92eaf653fbffdd3ebff7f364). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19263 **[Test build #82293 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82293/testReport)** for PR 19263 at commit [`2a967c3`](https://github.com/apache/spark/commit/2a967c368cf72316b760c5f17503658aa12b901d). * This patch **fails Scala style tests**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19263 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19263 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82293/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19263 **[Test build #82293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82293/testReport)** for PR 19263 at commit [`2a967c3`](https://github.com/apache/spark/commit/2a967c368cf72316b760c5f17503658aa12b901d). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/19263 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19263 I see, thanks for the explanation. @vanzin would you please help to review this PR, thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user michaelmior commented on the issue: https://github.com/apache/spark/pull/19263 @jerryshao I agree that the history server itself doesn't provide useful information but for detailed analysis I've found it helpful to persist the logs and write my own scripts to analyze them. This extra information is helpful for that. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19263 Hi @michaelmalak , history server only shows the last state of application before finished, and cached blocks can be evicted/unpersisted during the middle of application. So you probably cannot get such information from history server. IMHO, looks like such feature is not so useful, but since this is off by default, so I'm neutral on this feature. You can ask other reviewers to give the green light ð . --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19263: [SPARK-22050][CORE] Allow BlockUpdated events to be opti...
Github user michaelmior commented on the issue: https://github.com/apache/spark/pull/19263 Whoops. Sorry about that. I opened the PR via the CLI so I didn't see the pointer on the web interface. I should have known better though. Updated! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org