[GitHub] spark pull request: [SPARK-11265] [YARN] YarnClient can't get toke...

2015-11-01 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/9232#issuecomment-152815974 Will do. Same JIRA or a new backport one? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11305] [DOCS] Remove Third-Party Hadoop...

2015-11-01 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9298#issuecomment-152822556 Merged to master for 1.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11389][WIP][CORE] Add support for off-h...

2015-11-01 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9344#issuecomment-152802034 Looking a bit more closely, it looks like all existing implementations of `MemoryConsumer.spill()` will only end up reporting the size of Tugnsten pages that are

[GitHub] spark pull request: [SPARK-11338][WebUI] Prepend app links on Hist...

2015-11-01 Thread ckadner
Github user ckadner commented on the pull request: https://github.com/apache/spark/pull/9291#issuecomment-152799657 @vanzin -- I pushed the nit pickity fixes :mag: -- Thanks :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-11195][CORE] Use correct classloader fo...

2015-11-01 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9367#issuecomment-152822504 @choochootrain are you able to put together a small test like what @yhuai mentions? then I think this is good to go. --- If your project is set up for it, you can reply

[GitHub] spark pull request: SPARK-11344: Made ApplicationDescription and D...

2015-11-01 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9299#issuecomment-152822457 @jacek-lewandowski on one final re-read my last question is -- why does `ApplicationDescription` still have `appUiUrl` then? in several cases it's just copied into an

[GitHub] spark pull request: [SPARK-11338][WebUI] Prepend app links on Hist...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9291#issuecomment-152797984 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9162][SQL] Implement code generation fo...

2015-11-01 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9270#issuecomment-152802120 I'm traveling right now. Will take a look when I get back. cc @davies also. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-11424] Guard against double-close() of ...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9388#issuecomment-152803978 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11314] [YARN] add service API and test ...

2015-11-01 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/9182#issuecomment-152816395 and I've already gone and moved to strings. never mind. the existing attempt IDs are nice for humans in the web UI, and potentially in the rest, but don't

[GitHub] spark pull request: [SPARK-11305] [DOCS] Remove Third-Party Hadoop...

2015-11-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9298 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-11389][WIP][CORE] Add support for off-h...

2015-11-01 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9344#issuecomment-152800152 One bad complication: until we can _completely_ support off-heap memory for execution, we need to perform separate accounting for on-heap and off-heap memory, so

[GitHub] spark pull request: [SPARK-9319][SPARKR] Add support for setting c...

2015-11-01 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/9218#issuecomment-152797513 yes, I agree: throw a complex types not supported error message --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-11413][BUILD] Bump joda-time version to...

2015-11-01 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9379#issuecomment-152822945 Seems OK to me in that the release notes do not indicate any incompatible changes, and the tests pass, and it fixes some bugs. We don't actually use Joda time in Spark;

[GitHub] spark pull request: [SPARK-11265] [YARN] YarnClient can't get toke...

2015-11-01 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/9232#discussion_r43583071 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala --- @@ -142,6 +145,76 @@ class YarnSparkHadoopUtil extends SparkHadoopUtil

[GitHub] spark pull request: [SPARK-11236][CORE] Update Tachyon dependency ...

2015-11-01 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9395#issuecomment-152833844 btw, the profiles that we used in hadoop 1 tests are `-Phadoop-1 -Dhadoop.version=1.2.1 -Pkinesis-asl -Phive-thriftserver -Phive`. --- If your project is set up for it,

[GitHub] spark pull request: [SPARK-11236][CORE] Update Tachyon dependency ...

2015-11-01 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9395#issuecomment-152833780 cc @pwendell @srowen This is the new pr that upgrades Tachyon. I reverted the original one, which caused hadoop 1 test failures. --- If your project is set up for it,

[GitHub] spark pull request: Reduce numSlices for local metrics test of Spa...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152844736 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Reduce numSlices for local metrics test of Spa...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152844739 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Reduce numSlices for local metrics test of Spa...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152844573 **[Test build #44757 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44757/consoleFull)** for PR 9384 at commit

[GitHub] spark pull request: Reduce numSlices for local metrics test of Spa...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152846620 **[Test build #44759 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44759/consoleFull)** for PR 9384 at commit

[GitHub] spark pull request: [SPARK-11112] DAG visualization: display RDD c...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9398#issuecomment-152848394 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152848385 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11112] DAG visualization: display RDD c...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9398#issuecomment-152848384 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152849693 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152849703 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152849692 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11440][CORE][STREAMING][BUILD] Declare ...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9396#issuecomment-152850665 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11440][CORE][STREAMING][BUILD] Declare ...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9396#issuecomment-152850628 **[Test build #44758 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44758/consoleFull)** for PR 9396 at commit

[GitHub] spark pull request: [SPARK-11440][CORE][STREAMING][BUILD] Declare ...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9396#issuecomment-152850666 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11440][CORE][STREAMING][BUILD] Declare ...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9396#issuecomment-152837849 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11440][CORE][STREAMING][BUILD] Declare ...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9396#issuecomment-152839904 **[Test build #44758 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44758/consoleFull)** for PR 9396 at commit

[GitHub] spark pull request: [SPARK-11236][CORE] Update Tachyon dependency ...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9395#issuecomment-152841909 **[Test build #44756 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44756/consoleFull)** for PR 9395 at commit

[GitHub] spark pull request: [SPARK-10500][SPARKR][WIP] sparkr.zip cannot b...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9390#issuecomment-152841955 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10500][SPARKR][WIP] sparkr.zip cannot b...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9390#issuecomment-152841911 **[Test build #44753 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44753/consoleFull)** for PR 9390 at commit

[GitHub] spark pull request: Reduce numSlices for local metrics test of Spa...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152846476 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Reduce numSlices for local metrics test of Spa...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152846483 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11112] DAG visualization: display RDD c...

2015-11-01 Thread andrewor14
GitHub user andrewor14 opened a pull request: https://github.com/apache/spark/pull/9398 [SPARK-2] DAG visualization: display RDD callsite https://cloud.githubusercontent.com/assets/2133137/10870343/2a8cd070-807d-11e5-857a-4ebcace77b5b.png;> @mateiz @sarutak You can merge

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152848393 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152848369 @noel-smith thank you for the review. I rebase this PR with the mater and then updated two parts. - Add `@since` tags to `BGTClassifier` class and object -

[GitHub] spark pull request: [SPARK-11389][WIP][CORE] Add support for off-h...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9344#issuecomment-152850333 **[Test build #44755 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44755/consoleFull)** for PR 9344 at commit

[GitHub] spark pull request: [SPARK-11389][WIP][CORE] Add support for off-h...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9344#issuecomment-152850346 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9364#issuecomment-152853348 **[Test build #44764 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44764/consoleFull)** for PR 9364 at commit

[GitHub] spark pull request: [SPARK-11401] [MLLIB] PMML export for Logistic...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9397#issuecomment-152841751 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152848582 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Reduce numSlices for local metrics test of Spa...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152848571 **[Test build #44760 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44760/consoleFull)** for PR 9384 at commit

[GitHub] spark pull request: SPARK-11435 Stop SparkContext at the end of su...

2015-11-01 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152834222 The goal is to reduce memory consumption of local metrics test. I want a QA run for latest change. --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-11440][CORE][STREAMING][BUILD] Declare ...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9396#issuecomment-152837808 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152848645 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152848657 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Reduce numSlices for local metrics test of Spa...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152852553 **[Test build #44759 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44759/consoleFull)** for PR 9384 at commit

[GitHub] spark pull request: [SPARK-11236][CORE] Update Tachyon dependency ...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9395#issuecomment-152828790 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11236][CORE] Update Tachyon dependency ...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9395#issuecomment-152829433 **[Test build #44756 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44756/consoleFull)** for PR 9395 at commit

[GitHub] spark pull request: [SPARK-11338][WebUI] Prepend app links on Hist...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9291#issuecomment-152829339 **[Test build #44754 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44754/consoleFull)** for PR 9291 at commit

[GitHub] spark pull request: [SPARK-10500][SPARKR][WIP] sparkr.zip cannot b...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9390#issuecomment-152829398 **[Test build #44753 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44753/consoleFull)** for PR 9390 at commit

[GitHub] spark pull request: SPARK-11435 Stop SparkContext at the end of su...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152834119 **[Test build #44757 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44757/consoleFull)** for PR 9384 at commit

[GitHub] spark pull request: SPARK-11435 Stop SparkContext at the end of su...

2015-11-01 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152834147 The changes here are now unrelated it seems. Can you close this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152849701 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152849671 **[Test build #44762 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44762/consoleFull)** for PR 8690 at commit

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152849659 **[Test build #44763 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44763/consoleFull)** for PR 8690 at commit

[GitHub] spark pull request: [SPARK-11389][WIP][CORE] Add support for off-h...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9344#issuecomment-152850349 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-11435 Stop SparkContext at the end of su...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152833893 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-11435 Stop SparkContext at the end of su...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152833927 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11338][WebUI] Prepend app links on Hist...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9291#issuecomment-152842124 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11338][WebUI] Prepend app links on Hist...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9291#issuecomment-152842091 **[Test build #44754 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44754/consoleFull)** for PR 9291 at commit

[GitHub] spark pull request: [SPARK-11236][CORE] Update Tachyon dependency ...

2015-11-01 Thread calvinjia
Github user calvinjia commented on the pull request: https://github.com/apache/spark/pull/9395#issuecomment-152847168 @yhuai Thanks for the the response! The last PR would pass with those parameters, but and would only fail if the entire dev/runtests cycle was ran (specifically

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152848852 **[Test build #44762 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44762/consoleFull)** for PR 8690 at commit

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-152848875 **[Test build #44763 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44763/consoleFull)** for PR 8690 at commit

[GitHub] spark pull request: [SPARK-11112] DAG visualization: display RDD c...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9398#issuecomment-152848818 **[Test build #44761 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44761/consoleFull)** for PR 9398 at commit

[GitHub] spark pull request: [SPARK-11440][CORE][STREAMING][BUILD] Declare ...

2015-11-01 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/9396 [SPARK-11440][CORE][STREAMING][BUILD] Declare rest of @Experimental items non-experimental if they've existed since 1.2.0 Remove `@Experimental` annotations in core, streaming for items that

[GitHub] spark pull request: [SPARK-11236][CORE] Update Tachyon dependency ...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9395#issuecomment-152841958 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10500][SPARKR][WIP] sparkr.zip cannot b...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9390#issuecomment-152841957 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11236][CORE] Update Tachyon dependency ...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9395#issuecomment-152841959 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Reduce numSlices for local metrics test of Spa...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152852593 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11329] [SQL] Support star expansion for...

2015-11-01 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9343#discussion_r43586963 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/unresolved.scala --- @@ -166,26 +166,58 @@ abstract class Star extends

[GitHub] spark pull request: SPARK-6541 - Sort executors by ID (numeric)

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9165#issuecomment-152859815 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9319][SPARKR] Add support for setting c...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9218#issuecomment-152861491 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9319][SPARKR] Add support for setting c...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9218#issuecomment-152861497 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11338][WebUI] Prepend app links on Hist...

2015-11-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9291 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-152865071 **[Test build #44768 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44768/consoleFull)** for PR 9399 at commit

[GitHub] spark pull request: SPARK-11382 Replace example code in mllib-deci...

2015-11-01 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/9378#issuecomment-152866685 @gliptak Why the code changes do not match with the title? I think the SPARK-11382 should fix mllib-decision-tree.md and mllib-ensembles.md. --- If your project is

[GitHub] spark pull request: [SPARK-11389][WIP][CORE] Add support for off-h...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9344#issuecomment-152867810 **[Test build #44770 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44770/consoleFull)** for PR 9344 at commit

[GitHub] spark pull request: SPARK-11442 Reduce numSlices for local metrics...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152868378 **[Test build #44772 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44772/consoleFull)** for PR 9384 at commit

[GitHub] spark pull request: SPARK-11442 Reduce numSlices for local metrics...

2015-11-01 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/9384#issuecomment-152868318 bq. what does this have to do with memory The answer is in SaveStageAndTaskInfo. See the following ``` * A simple listener that saves all task infos and task

[GitHub] spark pull request: [SPARK-9319][SPARKR] Add support for setting c...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9218#issuecomment-152868688 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11443] Reserve space lines

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9400#issuecomment-152868699 **[Test build #44773 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44773/consoleFull)** for PR 9400 at commit

[GitHub] spark pull request: [SPARK][SPARK-10842]Eliminate creating duplica...

2015-11-01 Thread markhamstra
Github user markhamstra commented on the pull request: https://github.com/apache/spark/pull/8923#issuecomment-152869987 I prefer to fix this by changing the result type of `getAncestorShuffleDependencies(rdd: RDD[_])` to be `Set[ShuffleDependency[_, _, _]]` and the result of that

[GitHub] spark pull request: [SPARK-11314] [YARN] add service API and test ...

2015-11-01 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9182#issuecomment-152870622 BTW, if you're keeping `bindToYarn` and friends, you could change `applicationId` and `applicationAttemptId` to return the values you're setting there, which also means

[GitHub] spark pull request: [SPARK-11407][SPARKR] Add doc for running from...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9401#issuecomment-152870725 **[Test build #44774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44774/consoleFull)** for PR 9401 at commit

[GitHub] spark pull request: [SPARK-11424] Guard against double-close() of ...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9388#issuecomment-152871725 **[Test build #44765 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44765/consoleFull)** for PR 9388 at commit

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-152872738 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-152872862 **[Test build #44776 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44776/consoleFull)** for PR 9399 at commit

[GitHub] spark pull request: [SPARK-9722][ML] Pass random seed to spark.ml ...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9402#issuecomment-152874464 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL] Add ...

2015-11-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-152877559 **[Test build #44781 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44781/consoleFull)** for PR 9276 at commit

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-01 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9399#discussion_r43590253 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -266,26 +267,39 @@ private[sql] object

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-01 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9399#discussion_r43590460 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -295,18 +309,20 @@ private[sql] object

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-01 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9399#discussion_r43590582 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/FilteredScanSuite.scala --- @@ -44,16 +44,46 @@ case class SimpleFilteredScan(from: Int, to:

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-01 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9399#discussion_r43590585 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/ParquetHadoopFsRelationSuite.scala --- @@ -145,14 +145,16 @@ class ParquetHadoopFsRelationSuite

[GitHub] spark pull request: [SPARK-9722][ML] Pass random seed to spark.ml ...

2015-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9402#issuecomment-152879812 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-01 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9399#discussion_r43590547 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/FilteredScanSuite.scala --- @@ -101,6 +130,10 @@ object FiltersPushed { var list:

  1   2   3   4   5   >