GitHub user assia6 opened a pull request: https://github.com/apache/spark/pull/20092
Memory and disc usage Hi. I want to get memory and disk usage while running pagerenk aplication, so I wonder to do some manipulations using the code that you proposed. The problem that i have a prebuilt installation of spark and i don t have core folder inside. only bin, conf, sbin, data, jars .... folders Can you please tell me how can I put or extend classes inside my spark installation? How can i get storage memory and execution memory measures even after the execution finished? Thank you Please review http://spark.apache.org/contributing.html before opening a pull request. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ThySinner/spark master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/20092.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #20092 ---- commit 8198e90208b9795185d0df0bf8af6cd6780e8bda Author: Takuya UESHIN <ueshin@...> Date: 2016-10-19T09:06:43Z [SPARK-17985][CORE] Bump commons-lang3 version to 3.5. ## What changes were proposed in this pull request? `SerializationUtils.clone()` of commons-lang3 (<3.5) has a bug that breaks thread safety, which gets stack sometimes caused by race condition of initializing hash map. See https://issues.apache.org/jira/browse/LANG-1251. ## How was this patch tested? Existing tests. Author: Takuya UESHIN <ues...@happy-camper.st> Closes #15548 from ueshin/issues/SPARK-17985. commit 054fa811f22d5b51338326598fa4266fef0f7ad0 Author: Shixiong Zhu <shixiong@...> Date: 2016-12-14T02:36:36Z [SPARK-18588][TESTS] Ignore KafkaSourceStressForDontFailOnDataLossSuite ## What changes were proposed in this pull request? Disable KafkaSourceStressForDontFailOnDataLossSuite for now. ## How was this patch tested? Jenkins Author: Shixiong Zhu <shixi...@databricks.com> Closes #16275 from zsxwing/ignore-flaky-test. ---- --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org