GitHub user zhengruifeng opened a pull request:
https://github.com/apache/spark/pull/19197
[SPARK-18608][ML] Fix double caching
## What changes were proposed in this pull request?
`df.rdd.getStorageLevel` => `df.storageLevel`
using cmd `find . -name '*.scala' | xargs -i bash -c 'egrep -in
"\.rdd\.getStorageLevel" {} && echo {}'` to make sure all algs involved in this
issue are fixed.
Previous discussion in other PRs:
https://github.com/apache/spark/pull/19107,
https://github.com/apache/spark/pull/17014
## How was this patch tested?
existing tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zhengruifeng/spark double_caching
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19197.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19197
commit b4856147e04c3d57f2bfc70c70e3f136f46fa873
Author: Zheng RuiFeng
Date: 2017-09-12T04:53:35Z
recreate pr
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
