[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-20 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52814658 Probably also a good idea, but tests ought to try to behave well -- write to temp dirs, not the source tree, and clean up reliably. I suppose it helps ensure test state is

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-20 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52813370 Why not just add the checkpoint directory to `.rat_excludes`? Or run `git clean` in the Jenkins scripts? See my comment at https://github.com/apache/spark/pull/1978#i

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-20 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/2046#discussion_r16468398 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/TestSuiteBase.scala --- @@ -119,7 +119,12 @@ trait TestSuiteBase extends FunSuite with BeforeAnd

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52734632 I did that. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52734657 The folder is created by a unit test. So we have to change the checkpointDir setting first and then wipe the workspace. --- If your project is set up for it, you can repl

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52734589 We can just wipe the workspace. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/2046 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52734363 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18919/consoleFull) for PR 2046 at commit [`0d3ec73`](https://github.com/a

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52733635 @mengxr when something like this happens - can you please log into jenkins manually and clear the bad files on all nodes? otherwise this will fail other tests indefinite

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52732017 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18919/consoleFull) for PR 2046 at commit [`0d3ec73`](https://github.com/ap

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52731911 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52731797 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18917/consoleFull) for PR 2046 at commit [`0d3ec73`](https://github.com/a

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52731785 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18917/consoleFull) for PR 2046 at commit [`0d3ec73`](https://github.com/ap

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52731503 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52724351 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18911/consoleFull) for PR 2046 at commit [`0d3ec73`](https://github.com/ap

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52724359 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18911/consoleFull) for PR 2046 at commit [`0d3ec73`](https://github.com/a

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52724036 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52723485 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18904/consoleFull) for PR 2046 at commit [`0d3ec73`](https://github.com/a

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52720723 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18904/consoleFull) for PR 2046 at commit [`0d3ec73`](https://github.com/ap

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52720589 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52720381 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18903/consoleFull) for PR 2046 at commit [`0d3ec73`](https://github.com/a

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52720366 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18903/consoleFull) for PR 2046 at commit [`0d3ec73`](https://github.com/ap

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52719996 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52719952 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52719414 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18901/consoleFull) for PR 2046 at commit [`9797843`](https://github.com/ap

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52719424 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18901/consoleFull) for PR 2046 at commit [`9797843`](https://github.com/a

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52719389 @rxin Could you help clean the Jenkins working directory? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. I

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52718936 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18900/consoleFull) for PR 2046 at commit [`89964ab`](https://github.com/a

[GitHub] spark pull request: [HOTFIX][Streaming][MLlib] use temp folder for...

2014-08-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2046#issuecomment-52718927 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18900/consoleFull) for PR 2046 at commit [`89964ab`](https://github.com/ap