[GitHub] spark pull request #11887: [SPARK-13041][Mesos]add driver sandbox uri to the...

2016-06-09 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/11887#discussion_r66418116 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/ui/MesosClusterPage.scala --- @@ -68,6 +75,25 @@ private[mesos] class MesosClusterPage(parent: Me

[GitHub] spark pull request #13575: [SPARK-15472][SQL] Add support for writing in `cs...

2016-06-09 Thread lw-lin
GitHub user lw-lin opened a pull request: https://github.com/apache/spark/pull/13575 [SPARK-15472][SQL] Add support for writing in `csv`, `json`, `text` formats in Structured Streaming ## What changes were proposed in this pull request? This patch adds support for writing i

[GitHub] spark pull request #13518: [WIP][SPARK-15472][SQL] Add support for writing i...

2016-06-09 Thread lw-lin
Github user lw-lin closed the pull request at: https://github.com/apache/spark/pull/13518 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #13560: [SPARK-15823][PySpark][ML] Add @property for 'acc...

2016-06-09 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13560#discussion_r66415310 --- Diff: python/pyspark/mllib/evaluation.py --- @@ -183,7 +183,7 @@ class MulticlassMetrics(JavaModelWrapper): 0.66... >>> metrics.recall()

[GitHub] spark issue #13573: [SPARK-15839] Fix Maven doc-jar generation when JAVA_7_H...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13573 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60227/ Test FAILed. ---

[GitHub] spark issue #13573: [SPARK-15839] Fix Maven doc-jar generation when JAVA_7_H...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13573 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13573: [SPARK-15839] Fix Maven doc-jar generation when JAVA_7_H...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13573 **[Test build #60227 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60227/consoleFull)** for PR 13573 at commit [`523487b`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13556: [SPARK-15818] [BUILD] Upgrade to Hadoop 2.7.2

2016-06-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13556 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13556: [SPARK-15818] [BUILD] Upgrade to Hadoop 2.7.2

2016-06-09 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13556 Merged to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13562: [SPARK-15821] [DOCS] Include parallel build info

2016-06-09 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13562 OK fair enough, worth keeping in mind as I know any little helps for build times. For machines that aren't loaded, any parallelism could help, even `-T 2`. For machines that are, in theory things don

[GitHub] spark issue #13574: [SPARK-15841] REPLSuite has incorrect env set for a coup...

2016-06-09 Thread ScrapCodes
Github user ScrapCodes commented on the issue: https://github.com/apache/spark/pull/13574 @zsxwing Please take a look ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #13437: [SPARK-15697] [REPL] Unblock some of the useful repl com...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13437 **[Test build #60229 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60229/consoleFull)** for PR 13437 at commit [`13e1e0c`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #13437: [SPARK-15697] [REPL] Unblock some of the useful repl com...

2016-06-09 Thread ScrapCodes
Github user ScrapCodes commented on the issue: https://github.com/apache/spark/pull/13437 I have decided to leave out reset as blocked as we can discuss the semantics of having it in an another issue. @zsxwing Please take a look ! --- If your project is set up for it, you ca

[GitHub] spark issue #13574: [SPARK-15841] REPLSuite has incorrect env set for a coup...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13574 **[Test build #60228 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60228/consoleFull)** for PR 13574 at commit [`72b2ff6`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #13574: [SPARK-15841] REPLSuite has incorrect env set for...

2016-06-09 Thread ScrapCodes
GitHub user ScrapCodes opened a pull request: https://github.com/apache/spark/pull/13574 [SPARK-15841] REPLSuite has incorrect env set for a couple of tests. ## What changes were proposed in this pull request? Description from JIRA. In ReplSuite, for a test that can be

[GitHub] spark issue #13572: [SPARK-15838] [SQL] CACHE TABLE AS SELECT should not rep...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13572 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60224/ Test PASSed. ---

[GitHub] spark issue #13572: [SPARK-15838] [SQL] CACHE TABLE AS SELECT should not rep...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13572 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60225/ Test PASSed. ---

[GitHub] spark pull request #13552: [SPARK-15813] Use past tense for the cancel conta...

2016-06-09 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13552#discussion_r66404015 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -353,7 +353,7 @@ private[yarn] class YarnAllocator( } els

[GitHub] spark issue #13572: [SPARK-15838] [SQL] CACHE TABLE AS SELECT should not rep...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13572 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13572: [SPARK-15838] [SQL] CACHE TABLE AS SELECT should not rep...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13572 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13572: [SPARK-15838] [SQL] CACHE TABLE AS SELECT should not rep...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13572 **[Test build #60225 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60225/consoleFull)** for PR 13572 at commit [`bd66c7e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13572: [SPARK-15838] [SQL] CACHE TABLE AS SELECT should not rep...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13572 **[Test build #60224 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60224/consoleFull)** for PR 13572 at commit [`082c8f2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-09 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 Hi @sun-rui, hi @shivaram, I've overwritten the stringArgs - I've pushed my changes in the following branch. I haven't created a jira yet. https://github.com/apache/spark/commit/939dbd

[GitHub] spark issue #13403: [SPARK-15660][CORE] RDD and Dataset should show the cons...

2016-06-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13403 Although we can not change old API, I think it's a good idea to add `popVariance` and `popStdev` clearly. If everything in this PR is now allowed, what about just adding an explicit n

[GitHub] spark issue #13403: [SPARK-15660][CORE] RDD and Dataset should show the cons...

2016-06-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13403 What about just adding an explicit note on old `StatCounter.stdev`? http://spark.apache.org/docs/2.0.0-preview/api/scala/index.html#org.apache.spark.util.StatCounter MLLIB `st

[GitHub] spark pull request #13568: [SPARK-12712] Fix failure in ./dev/test-dependenc...

2016-06-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13568 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13573: [SPARK-15839] Fix Maven doc-jar generation when JAVA_7_H...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13573 **[Test build #60227 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60227/consoleFull)** for PR 13573 at commit [`523487b`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #13568: [SPARK-12712] Fix failure in ./dev/test-dependencies whe...

2016-06-09 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13568 Merging to master, 2.0, and branch-1.6. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #13573: [SPARK-15839] Fix Maven doc-jar generation when J...

2016-06-09 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/13573 [SPARK-15839] Fix Maven doc-jar generation when JAVA_7_HOME is set ## What changes were proposed in this pull request? It looks like the nightly Maven snapshots broke after we set `JAVA_7

[GitHub] spark issue #13558: [SPARK-15820][PySpark][SQL]Add Catalog.refreshTable into...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13558 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13558: [SPARK-15820][PySpark][SQL]Add Catalog.refreshTable into...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13558 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60226/ Test FAILed. ---

[GitHub] spark issue #13558: [SPARK-15820][PySpark][SQL]Add Catalog.refreshTable into...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13558 **[Test build #60226 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60226/consoleFull)** for PR 13558 at commit [`8d87c0f`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13552: [SPARK-15813] Use past tense for the cancel conta...

2016-06-09 Thread peterableda
Github user peterableda commented on a diff in the pull request: https://github.com/apache/spark/pull/13552#discussion_r66394240 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -353,7 +353,7 @@ private[yarn] class YarnAllocator(

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12836 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60223/ Test FAILed. ---

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12836 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13558: [SPARK-15820][PySpark][SQL]Add Catalog.refreshTable into...

2016-06-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13558 **[Test build #60226 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60226/consoleFull)** for PR 13558 at commit [`8d87c0f`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF should ...

2016-06-09 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13483 Thank you @marmbrus @dilipbiswal and @viirya ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

<    1   2   3   4   5