[GitHub] spark pull request: [SPARK-7046] Remove InputMetrics from BlockRes...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5627#issuecomment-95052920 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6939][Streaming][WebUI] Add timeline an...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5533#issuecomment-95050102 [Test build #30735 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30735/consoleFull) for PR 5533 at commit [`ddf741a`](https://githu

[GitHub] spark pull request: [SPARK-6201] [SQL] promote string and do widen...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4945#issuecomment-95047309 [Test build #30734 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30734/consoleFull) for PR 4945 at commit [`71e05cc`](https://githu

[GitHub] spark pull request: [ML][SPARK-6529] Add Word2Vec transformer

2015-04-21 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5596#discussion_r28847697 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/Word2VecSuite.scala --- @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-6752][Streaming] Allow StreamingContext...

2015-04-21 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5428#discussion_r28847514 --- Diff: streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java --- @@ -1707,6 +1708,71 @@ public Integer call(String s) throws Exception {

[GitHub] spark pull request: [SPARK-6568] spark-shell.cmd --jars option doe...

2015-04-21 Thread tsudukim
Github user tsudukim commented on the pull request: https://github.com/apache/spark/pull/5447#issuecomment-95045723 I tested only on Windows, but I noticed I get different results on Linux. This is because... On Windows: ``` scala> new File("C:\\path\\to\\file.txt").toUR

[GitHub] spark pull request: [SPARK-6889] [DOCS] CONTRIBUTING.md updates to...

2015-04-21 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/5623#issuecomment-95045467 lgtm! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request: [SPARK-6443][Spark Submit]Could not submit app...

2015-04-21 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on the pull request: https://github.com/apache/spark/pull/5116#issuecomment-95044838 @andrewor14 I've changed and made some rebase. If everything is ok i'd like to merge it ASAP. Please take a look. --- If your project is set up for it, you can r

[GitHub] spark pull request: [SPARK-7044] [SQL] Fix the deadlock in script ...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5625#issuecomment-95044410 [Test build #30728 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30728/consoleFull) for PR 5625 at commit [`885685a`](https://gith

[GitHub] spark pull request: [SPARK-7044] [SQL] Fix the deadlock in script ...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5625#issuecomment-95044427 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6752][Streaming] Allow StreamingContext...

2015-04-21 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5428#discussion_r28847303 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/StreamingContextSuite.scala --- @@ -328,6 +330,138 @@ class StreamingContextSuite extends FunSuite

[GitHub] spark pull request: [SPARK-6752][Streaming] Allow StreamingContext...

2015-04-21 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5428#discussion_r28847268 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala --- @@ -107,6 +107,15 @@ class StreamingContext private[streaming] (

[GitHub] spark pull request: [SPARK-6967] [SQL] fix date type convertion in...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5590#issuecomment-95044123 [Test build #30727 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30727/consoleFull) for PR 5590 at commit [`f897b81`](https://gith

[GitHub] spark pull request: [SPARK-6967] [SQL] fix date type convertion in...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5590#issuecomment-95044129 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6201] [SQL] promote string and do widen...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4945#issuecomment-95043931 [Test build #30732 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30732/consoleFull) for PR 4945 at commit [`581fa1c`](https://gith

[GitHub] spark pull request: [SPARK-6201] [SQL] promote string and do widen...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4945#issuecomment-95043939 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6827] [mllib] Wrap FPGrowthModel.freqIt...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5614#issuecomment-95042909 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-5894][ML] Add polynomial mapper

2015-04-21 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5245#discussion_r28846979 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/PolynomialMapperSuite.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] spark pull request: [SPARK-6827] [mllib] Wrap FPGrowthModel.freqIt...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5614#issuecomment-95042898 [Test build #30726 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30726/consoleFull) for PR 5614 at commit [`da8c404`](https://gith

[GitHub] spark pull request: [SPARK-1406] Mllib pmml model export

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3062#issuecomment-95042057 [Test build #30733 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30733/consoleFull) for PR 3062 at commit [`25dce33`](https://githu

[GitHub] spark pull request: [SPARK-6201] [SQL] promote string and do widen...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4945#issuecomment-95042053 [Test build #30732 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30732/consoleFull) for PR 4945 at commit [`581fa1c`](https://githu

[GitHub] spark pull request: [PYSPARK] Fix a typo in "fold" function in rdd...

2015-04-21 Thread AiHe
Github user AiHe closed the pull request at: https://github.com/apache/spark/pull/5587 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] spark pull request: [SPARK-5894][ML] Add polynomial mapper

2015-04-21 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5245#discussion_r28846227 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/PolynomialMapper.scala --- @@ -0,0 +1,240 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] spark pull request: [SPARK-5894][ML] Add polynomial mapper

2015-04-21 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5245#discussion_r28846104 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/PolynomialMapper.scala --- @@ -0,0 +1,137 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] spark pull request: [SPARK-6889] [DOCS] CONTRIBUTING.md updates to...

2015-04-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5623 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-6889] [DOCS] CONTRIBUTING.md updates to...

2015-04-21 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5623#issuecomment-95039724 Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-6889] [DOCS] CONTRIBUTING.md updates to...

2015-04-21 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5623#issuecomment-95039735 And branch 1.3. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request: [SPARK-6889] [DOCS] CONTRIBUTING.md updates to...

2015-04-21 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5623#issuecomment-95039685 LGTM too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-7046] Remove InputMetrics from BlockRes...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5627#issuecomment-95039292 [Test build #30731 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30731/consoleFull) for PR 5627 at commit [`a08ca19`](https://githu

[GitHub] spark pull request: [SPARK-7046] Remove InputMetrics from BlockRes...

2015-04-21 Thread kayousterhout
GitHub user kayousterhout opened a pull request: https://github.com/apache/spark/pull/5627 [SPARK-7046] Remove InputMetrics from BlockResult This is a code cleanup. The BlockResult class originally contained an InputMetrics object so that InputMetrics could directly be

[GitHub] spark pull request: [SPARK-6528][ML] Add IDF transformer

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5266#issuecomment-95039019 [Test build #30730 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30730/consoleFull) for PR 5266 at commit [`4338a37`](https://gith

[GitHub] spark pull request: [SPARK-6528][ML] Add IDF transformer

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5266#issuecomment-95039024 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6528][ML] Add IDF transformer

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5266#issuecomment-95038543 [Test build #30730 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30730/consoleFull) for PR 5266 at commit [`4338a37`](https://githu

[GitHub] spark pull request: SPARK-5888. [MLLIB]. Add OneHotEncoder as a Tr...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5500#issuecomment-95038494 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: SPARK-5888. [MLLIB]. Add OneHotEncoder as a Tr...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5500#issuecomment-95038490 [Test build #30725 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30725/consoleFull) for PR 5500 at commit [`7e53579`](https://gith

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5626#issuecomment-95038170 [Test build #30729 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30729/consoleFull) for PR 5626 at commit [`ea3d901`](https://gith

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5626#issuecomment-95038173 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5626#issuecomment-95038036 [Test build #30729 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30729/consoleFull) for PR 5626 at commit [`ea3d901`](https://githu

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-21 Thread jkbradley
GitHub user jkbradley opened a pull request: https://github.com/apache/spark/pull/5626 [SPARK-6113] [ml] Tree ensembles for Pipelines API This is a continuation of [https://github.com/apache/spark/pull/5530] (which was for Decision Trees), but for ensembles: Random Forests and Grad

[GitHub] spark pull request: [SPARK-6829] Added math functions for DataFram...

2015-04-21 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5616#discussion_r28844525 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/mathfunctions.scala --- @@ -0,0 +1,472 @@ +/* + * Licensed to the Apache Software Foundation (AS

[GitHub] spark pull request: [SPARK-6443][Spark Submit]Could not submit app...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5116#issuecomment-95034534 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6443][Spark Submit]Could not submit app...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5116#issuecomment-95034522 [Test build #30724 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30724/consoleFull) for PR 5116 at commit [`f4f972b`](https://gith

[GitHub] spark pull request: [SPARK-7044] [SQL] Fix the deadlock in script ...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5625#issuecomment-95033198 [Test build #30728 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30728/consoleFull) for PR 5625 at commit [`885685a`](https://githu

[GitHub] spark pull request: [SPARK-5213] [SQL] Pluggable SQL Parser Suppor...

2015-04-21 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/4015#issuecomment-95033035 @marmbrus Any more comment? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [SPARK-6113] [ml] Small cleanups after origina...

2015-04-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5567 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-6113] [ml] Small cleanups after origina...

2015-04-21 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/5567#issuecomment-95032416 LGTM. Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7044] [SQL] Fix the deadlock in script ...

2015-04-21 Thread chenghao-intel
GitHub user chenghao-intel opened a pull request: https://github.com/apache/spark/pull/5625 [SPARK-7044] [SQL] Fix the deadlock in script transformation You can merge this pull request into a Git repository by running: $ git pull https://github.com/chenghao-intel/spark transfo

[GitHub] spark pull request: [SPARK-6967] [SQL] fix date type convertion in...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5590#issuecomment-95032103 [Test build #30727 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30727/consoleFull) for PR 5590 at commit [`f897b81`](https://githu

[GitHub] spark pull request: [SPARK-6827] [mllib] Wrap FPGrowthModel.freqIt...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5614#issuecomment-95031269 [Test build #30726 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30726/consoleFull) for PR 5614 at commit [`da8c404`](https://githu

[GitHub] spark pull request: [SPARK-6889] [DOCS] CONTRIBUTING.md updates to...

2015-04-21 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/5623#issuecomment-95031134 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Exte...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-95031060 [Test build #30722 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30722/consoleFull) for PR 5622 at commit [`ad13424`](https://gith

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Exte...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-95031073 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SQL] Rename some apply functions.

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5624#issuecomment-95030327 [Test build #30721 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30721/consoleFull) for PR 5624 at commit [`ee45034`](https://gith

[GitHub] spark pull request: [SQL] Rename some apply functions.

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5624#issuecomment-95030339 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6827] [mllib] Wrap FPGrowthModel.freqIt...

2015-04-21 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/5614#issuecomment-95030241 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-7037] [CORE] Inconsistent behavior for ...

2015-04-21 Thread piaozhexiu
Github user piaozhexiu commented on the pull request: https://github.com/apache/spark/pull/5617#issuecomment-95030168 Thank you for your comments @srowen @sryza . I incorporated your suggestion. Does this look better? --- If your project is set up for it, you can reply to thi

[GitHub] spark pull request: [SPARK-6827] [mllib] Wrap FPGrowthModel.freqIt...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5614#issuecomment-95028436 [Test build #30723 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30723/consoleFull) for PR 5614 at commit [`da8c404`](https://gith

[GitHub] spark pull request: [SPARK-6827] [mllib] Wrap FPGrowthModel.freqIt...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5614#issuecomment-95028469 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [Minor] Comment improvements in ExternalSorter...

2015-04-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5620 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [Minor] Comment improvements in ExternalSorter...

2015-04-21 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/5620#issuecomment-95021845 Thanks for checking this out Sandy, merging it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-5338][MESOS] Add cluster mode support f...

2015-04-21 Thread tnachen
Github user tnachen commented on the pull request: https://github.com/apache/spark/pull/5144#issuecomment-95021665 Another unrelated test failure --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-6065] [MLlib] Optimize word2vec.findSyn...

2015-04-21 Thread MechCoder
Github user MechCoder commented on the pull request: https://github.com/apache/spark/pull/5467#issuecomment-95020437 @jkbradley Could you open a jira for the TODO? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-6889] [DOCS] CONTRIBUTING.md updates to...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5623#issuecomment-95017963 **[Test build #30716 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30716/consoleFull)** for PR 5623 at commit [`03773b1`](https://git

[GitHub] spark pull request: [SPARK-6889] [DOCS] CONTRIBUTING.md updates to...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5623#issuecomment-95017986 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: SPARK-5888. [MLLIB]. Add OneHotEncoder as a Tr...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5500#issuecomment-95017876 [Test build #30725 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30725/consoleFull) for PR 5500 at commit [`7e53579`](https://githu

[GitHub] spark pull request: [SPARK-7037] [CORE] Inconsistent behavior for ...

2015-04-21 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5617#discussion_r28842177 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala --- @@ -61,7 +61,16 @@ private[deploy] class SparkSubmitArguments(args: Seq[St

[GitHub] spark pull request: [SPARK-5213] [SQL] Pluggable SQL Parser Suppor...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4015#issuecomment-95012533 [Test build #30720 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30720/consoleFull) for PR 4015 at commit [`4b4cdfd`](https://gith

[GitHub] spark pull request: [SPARK-5213] [SQL] Pluggable SQL Parser Suppor...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4015#issuecomment-95012547 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6443][Spark Submit]Could not submit app...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5116#issuecomment-95011962 [Test build #30724 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30724/consoleFull) for PR 5116 at commit [`f4f972b`](https://githu

[GitHub] spark pull request: [SPARK-6827] [mllib] Wrap FPGrowthModel.freqIt...

2015-04-21 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/5614#issuecomment-95011704 @mengxr Thank you for your comments and help, I have merged your PR to this PR. I will investigate the pickle/unpickle problems and file another PR to resolve it.

[GitHub] spark pull request: [SPARK-6752][Streaming] Allow StreamingContext...

2015-04-21 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/5428#discussion_r28841893 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/StreamingContextSuite.scala --- @@ -328,6 +330,138 @@ class StreamingContextSuite extends Fun

[GitHub] spark pull request: [SPARK-6752][Streaming] Allow StreamingContext...

2015-04-21 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/5428#discussion_r28841856 --- Diff: streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java --- @@ -1707,6 +1708,71 @@ public Integer call(String s) throws Exception {

[GitHub] spark pull request: [SPARK-6827] [mllib] Wrap FPGrowthModel.freqIt...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5614#issuecomment-95011515 [Test build #30723 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30723/consoleFull) for PR 5614 at commit [`da8c404`](https://githu

[GitHub] spark pull request: [SPARK-6198][SQL] Support "select current_data...

2015-04-21 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/5538#discussion_r28841761 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/sqlUDFCurrentDB.scala --- @@ -0,0 +1,42 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-6198][SQL] Support "select current_data...

2015-04-21 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/5538#discussion_r28841751 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/sqlUDFCurrentDB.scala --- @@ -0,0 +1,42 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-6752][Streaming] Allow StreamingContext...

2015-04-21 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/5428#discussion_r28841681 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala --- @@ -655,6 +656,7 @@ object JavaStreamingContext {

[GitHub] spark pull request: [SPARK-6752][Streaming] Allow StreamingContext...

2015-04-21 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/5428#discussion_r28841661 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala --- @@ -621,19 +636,59 @@ object StreamingContext extends Logging {

[GitHub] spark pull request: [SQL] There are three tests of sql are failed ...

2015-04-21 Thread KaiXinXiaoLei
Github user KaiXinXiaoLei commented on the pull request: https://github.com/apache/spark/pull/5552#issuecomment-95010314 @marmbrus The Jenkins is failed. I just check that the reason of failed is not caused by my code. Please test again. Thank you. --- If your project is set up for i

[GitHub] spark pull request: [SPARK-6738] [CORE] Improve estimate the size ...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5608#issuecomment-95010254 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6738] [CORE] Improve estimate the size ...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5608#issuecomment-95010247 [Test build #30717 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30717/consoleFull) for PR 5608 at commit [`4877eee`](https://gith

[GitHub] spark pull request: [SPARK-6752][Streaming] Allow StreamingContext...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5428#issuecomment-95010237 [Test build #692 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/692/consoleFull) for PR 5428 at commit [`eabd092`](https://githu

[GitHub] spark pull request: [Minor] Comment improvements in ExternalSorter...

2015-04-21 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/5620#issuecomment-95010096 This LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [MLLIB] SPARK-4231, SPARK-3066: Add RankingMet...

2015-04-21 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3098#issuecomment-95009893 @debasish83 Do you have time to update the PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark pull request: [SPARK-6752][Streaming] Allow StreamingContext...

2015-04-21 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/5428#discussion_r28841304 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala --- @@ -107,6 +107,15 @@ class StreamingContext private[streaming] (

[GitHub] spark pull request: [SPARK-6752][Streaming] Allow StreamingContext...

2015-04-21 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/5428#discussion_r28841272 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala --- @@ -271,7 +282,10 @@ object CheckpointReader extends Logging { }

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Exte...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-95008798 [Test build #30722 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30722/consoleFull) for PR 5622 at commit [`ad13424`](https://githu

[GitHub] spark pull request: [SPARK-6973]modify total stages/tasks on the a...

2015-04-21 Thread XuTingjun
Github user XuTingjun commented on the pull request: https://github.com/apache/spark/pull/5550#issuecomment-95008837 @srowen I have update the patch code, delete the skipped stage from completed set. --- If your project is set up for it, you can reply to this email and have your repl

[GitHub] spark pull request: [SQL] Rename some apply functions.

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5624#issuecomment-95007078 [Test build #30721 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30721/consoleFull) for PR 5624 at commit [`ee45034`](https://githu

[GitHub] spark pull request: [SPARK-6198][SQL] Support "select current_data...

2015-04-21 Thread DoingDone9
Github user DoingDone9 commented on a diff in the pull request: https://github.com/apache/spark/pull/5538#discussion_r28840911 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/sqlUDFCurrentDB.scala --- @@ -0,0 +1,42 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-2973] [SQL] Avoid spark job for take on...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5247#issuecomment-95005505 [Test build #30715 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30715/consoleFull) for PR 5247 at commit [`0f623ca`](https://gith

[GitHub] spark pull request: [SQL] Rename some apply functions.

2015-04-21 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/5624 [SQL] Rename some apply functions. I was looking at the code gen code and got confused by a few of use cases of apply, in particular apply on objects. So I went ahead and changed a few of them. Hopefu

[GitHub] spark pull request: [SPARK-2973] [SQL] Avoid spark job for take on...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5247#issuecomment-95005528 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-7026][SQL] make LeftSemiJoin work when ...

2015-04-21 Thread DoingDone9
Github user DoingDone9 closed the pull request at: https://github.com/apache/spark/pull/5610 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-7026][SQL] make LeftSemiJoin work when ...

2015-04-21 Thread DoingDone9
Github user DoingDone9 commented on the pull request: https://github.com/apache/spark/pull/5610#issuecomment-95004242 Get it. This is not a good solution, I will close it . maybe i can do something in LeftSemiJoinHash and BroadcastLeftSemiJoinHash. thank you @marmbrus --- If your p

[GitHub] spark pull request: [SPARK-6752][Streaming] Allow StreamingContext...

2015-04-21 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/5428#issuecomment-95002858 Yes, this is not intended to solve SPARK-5206. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: [SPARK-6738] [CORE] Improve estimate the size ...

2015-04-21 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/5608#issuecomment-95002775 I see, it looks like you changed the last line to fix this. Can you also add some unit tests, and fix the code to match the Spark code style guide (https://cwiki.apache.or

[GitHub] spark pull request: [SPARK-5338][MESOS] Add cluster mode support f...

2015-04-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5144#issuecomment-95001508 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6198][SQL] Support "select current_data...

2015-04-21 Thread DoingDone9
Github user DoingDone9 commented on a diff in the pull request: https://github.com/apache/spark/pull/5538#discussion_r28840547 --- Diff: sql/hive/v0.12.0/src/main/scala/org/apache/spark/sql/hive/Shim12.scala --- @@ -135,7 +135,13 @@ private[hive] object HiveShim { Primit

[GitHub] spark pull request: [SPARK-5338][MESOS] Add cluster mode support f...

2015-04-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5144#issuecomment-95001498 [Test build #30718 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30718/consoleFull) for PR 5144 at commit [`069e946`](https://gith

[GitHub] spark pull request: [SPARK-7026][SQL] Fix bugs when there are non ...

2015-04-21 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/5612#issuecomment-95001462 IMO in left semi join, we would build a hashset for build iterator and filter stream iterator based on the hashset, adding a join predicate field in the lefesemi join may pr

  1   2   3   4   5   6   >