[GitHub] spark pull request: SPARK-10314 [CORE]RDD persist to OFF_HEAP tach...

2015-09-03 Thread romansew
Github user romansew closed the pull request at: https://github.com/apache/spark/pull/8482 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: SPARK-10314 [CORE]RDD persist to OFF_HEAP tach...

2015-09-03 Thread romansew
Github user romansew commented on the pull request: https://github.com/apache/spark/pull/8482#issuecomment-137344930 I open the other one:https://github.com/apache/spark/pull/8562 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: SPARK-10314 [CORE]RDD persist to OFF_HEAP tach...

2015-09-02 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/8482#issuecomment-137332208 Can you close this now that you've opened another one? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: SPARK-10314 [CORE]RDD persist to OFF_HEAP tach...

2015-09-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/8482#issuecomment-136840774 @romansew please submit this patch against the master branch instead. It would be good to have a consistent fix in both newer and older branches. --- If your

[GitHub] spark pull request: SPARK-10314 [CORE]RDD persist to OFF_HEAP tach...

2015-09-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/8482#issuecomment-136841179 Also, I looked at the definition of `BlockStatus#isCached`. Looks like it already takes into account external block store size? Is Tachyon somehow not caching your

[GitHub] spark pull request: SPARK-10314 [CORE]RDD persist to OFF_HEAP tach...

2015-09-01 Thread romansew
Github user romansew commented on the pull request: https://github.com/apache/spark/pull/8482#issuecomment-136911776 @andrewor14 The empty block cache to mem the memSize in BlockStatus#isCached is 4. but the empty block cache to offheap the externalBlockStoreSize is 0. so the

[GitHub] spark pull request: SPARK-10314 [CORE]RDD persist to OFF_HEAP tach...

2015-09-01 Thread romansew
Github user romansew commented on the pull request: https://github.com/apache/spark/pull/8482#issuecomment-136910013 I resubmit the pull request on the master branch https://github.com/apache/spark/pull/8562 --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: SPARK-10314 [CORE]RDD persist to OFF_HEAP tach...

2015-08-27 Thread romansew
GitHub user romansew opened a pull request: https://github.com/apache/spark/pull/8482 SPARK-10314 [CORE]RDD persist to OFF_HEAP tachyon got block rdd_x_x n… SPARK-10314 [CORE]RDD persist to OFF_HEAP tachyon got block rdd_x_x not found exception when parallelism is big than data

[GitHub] spark pull request: SPARK-10314 [CORE]RDD persist to OFF_HEAP tach...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8482#issuecomment-135378312 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your