[GitHub] spark pull request: [SPARK-10071][Streaming]Output a warning when ...

2015-09-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8624#issuecomment-138191295 [Test build #42080 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42080/console) for PR 8624 at commit

[GitHub] spark pull request: [SPARK-10071][Streaming]Output a warning when ...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8624#issuecomment-138191351 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10071][Streaming]Output a warning when ...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8624#issuecomment-138191350 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10463] [SQL] remove PromotePrecision du...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8621#issuecomment-138124030 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Update README.md

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8632#issuecomment-138124017 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10463] [SQL] remove PromotePrecision du...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8621#issuecomment-138124031 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10466][SQL] UnsafeRow SerDe exception w...

2015-09-06 Thread chenghao-intel
GitHub user chenghao-intel opened a pull request: https://github.com/apache/spark/pull/8635 [SPARK-10466][SQL] UnsafeRow SerDe exception with data spill Data Spill with UnsafeRow causes assert failure. ``` java.lang.AssertionError: assertion failed at

[GitHub] spark pull request: [SPARK-10466][SQL] UnsafeRow SerDe exception w...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8635#issuecomment-138145857 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10466][SQL] UnsafeRow SerDe exception w...

2015-09-06 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/8635#discussion_r38828491 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/UnsafeRowSerializer.scala --- @@ -72,7 +72,6 @@ private class

[GitHub] spark pull request: [SPARK-10466][SQL] UnsafeRow SerDe exception w...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8635#issuecomment-138145967 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10466][SQL] UnsafeRow SerDe exception w...

2015-09-06 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/8635#issuecomment-138146310 cc @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10301] [SPARK-10428] [SQL] [BRANCH-1.5]...

2015-09-06 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/8583#issuecomment-138184856 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138189158 jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138190408 [Test build #42081 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42081/consoleFull) for PR 8634 at commit

[GitHub] spark pull request: [SPARK-10463] [SQL] remove PromotePrecision du...

2015-09-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8621#issuecomment-138123997 [Test build #42070 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42070/console) for PR 8621 at commit

[GitHub] spark pull request: [SPARK-10273] Add @since annotation to pyspark...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8633#issuecomment-138127363 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138137321 [Test build #42078 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42078/consoleFull) for PR 8634 at commit

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-09-06 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5423#discussion_r38831693 --- Diff: docs/monitoring.md --- @@ -256,6 +255,247 @@ still required, though there is only one application available. Eg. to see the running app,

[GitHub] spark pull request: [SPARK-10468][ MLlib ]Verify schema before Dat...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8636#issuecomment-138186123 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Docs small fixes

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8629#issuecomment-138123816 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9642] [ML] [WIP] LinearRegression shoul...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8631#issuecomment-138123811 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Update README.md

2015-09-06 Thread slaven-s
GitHub user slaven-s opened a pull request: https://github.com/apache/spark/pull/8632 Update README.md Hi, I added section "Books" and a link to the Spark GraphX in Action written by Michael S. Malak and Robin East for Manning Publications. We believe this book is a great

[GitHub] spark pull request: Space out

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8630#issuecomment-138123813 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Update README.md

2015-09-06 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8632#issuecomment-138127770 I don't think this belongs on the project readme. Maybe the wiki. Do you mind closing this PR? --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138134469 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138134481 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10149] [CORE] [WIP] Locality Level is a...

2015-09-06 Thread wulei-bj-cn
Github user wulei-bj-cn commented on a diff in the pull request: https://github.com/apache/spark/pull/8533#discussion_r38831196 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -322,7 +333,12 @@ private[spark] class TaskSetManager( //

[GitHub] spark pull request: [SPARK-10071][Streaming]Output a warning when ...

2015-09-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8624#issuecomment-138185185 [Test build #42080 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42080/consoleFull) for PR 8624 at commit

[GitHub] spark pull request: Space out

2015-09-06 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8630#issuecomment-138127947 This is too trivial to bother with by itself in a PR. Maybe a more comprehensive cleanup of one style issue mkaes sense. Do you mind closing this PR? --- If your

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138134692 [Test build #42077 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42077/consoleFull) for PR 8634 at commit

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138134760 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138134759 [Test build #42077 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42077/console) for PR 8634 at commit

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138134761 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-8813][SQL] Support combine text/parquet...

2015-09-06 Thread watermen
Github user watermen closed the pull request at: https://github.com/apache/spark/pull/7210 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-9552] Add force control for killExecuto...

2015-09-06 Thread GraceH
Github user GraceH commented on a diff in the pull request: https://github.com/apache/spark/pull/7888#discussion_r38828688 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -413,25 +413,38 @@ class

[GitHub] spark pull request: [SPARK-10466][SQL] UnsafeRow SerDe exception w...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8635#issuecomment-138166182 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10466][SQL] UnsafeRow SerDe exception w...

2015-09-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8635#issuecomment-138166137 [Test build #42079 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42079/console) for PR 8635 at commit

[GitHub] spark pull request: [SPARK-10466][SQL] UnsafeRow SerDe exception w...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8635#issuecomment-138166185 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10071][Streaming]Output a warning when ...

2015-09-06 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/8624#issuecomment-138184026 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10468][ MLlib ]Verify schema before Dat...

2015-09-06 Thread vinodkc
GitHub user vinodkc opened a pull request: https://github.com/apache/spark/pull/8636 [SPARK-10468][ MLlib ]Verify schema before Dataframe select API call Loader.checkSchema was called to verify the schema after dataframe.select(...). Schema verification should be done before

[GitHub] spark pull request: [SPARK-9642] [ML] [WIP] LinearRegression shoul...

2015-09-06 Thread rotationsymmetry
GitHub user rotationsymmetry opened a pull request: https://github.com/apache/spark/pull/8631 [SPARK-9642] [ML] [WIP] LinearRegression should supported weighted data In many modeling application, data points are not necessarily sampled with equal probabilities. Linear regression

[GitHub] spark pull request: Space out

2015-09-06 Thread jaceklaskowski
GitHub user jaceklaskowski opened a pull request: https://github.com/apache/spark/pull/8630 Space out You can merge this pull request into a Git repository by running: $ git pull https://github.com/jaceklaskowski/spark build-space-out Alternatively you can review and apply

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-09-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-138124296 [Test build #42076 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42076/console) for PR 8587 at commit

[GitHub] spark pull request: [SPARK-10466][SQL] UnsafeRow SerDe exception w...

2015-09-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8635#issuecomment-138148768 [Test build #42079 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42079/consoleFull) for PR 8635 at commit

[GitHub] spark pull request: [SPARK-10149] [CORE] [WIP] Locality Level is a...

2015-09-06 Thread wulei-bj-cn
Github user wulei-bj-cn commented on the pull request: https://github.com/apache/spark/pull/8533#issuecomment-138171655 @CodingCat It's quite smart to set SPARK_LOCAL_HOSTNAME=`hostname` to save the efforts and energy I mentioned in earlier comments when it comes to deployment and

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138189919 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138189932 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9552] Add force control for killExecuto...

2015-09-06 Thread GraceH
Github user GraceH commented on a diff in the pull request: https://github.com/apache/spark/pull/7888#discussion_r38828767 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -413,25 +413,38 @@ class

[GitHub] spark pull request: [SPARK-10149] [CORE] [WIP] Locality Level is a...

2015-09-06 Thread CodingCat
Github user CodingCat commented on a diff in the pull request: https://github.com/apache/spark/pull/8533#discussion_r38831357 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -322,7 +333,12 @@ private[spark] class TaskSetManager( //

[GitHub] spark pull request: [SPARK-10447][WIP][PYSPARK] upgrade pyspark to...

2015-09-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-138125480 [Test build #42072 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42072/console) for PR 8615 at commit

[GitHub] spark pull request: [SPARK-10273] Add @since annotation to pyspark...

2015-09-06 Thread noel-smith
GitHub user noel-smith opened a pull request: https://github.com/apache/spark/pull/8633 [SPARK-10273] Add @since annotation to pyspark.mllib.feature Duplicated the @since decorator from pyspark.sql into pyspark (also tweaked to handle functions without docstrings). Added

[GitHub] spark pull request: [SPARK-9552] Add force control for killExecuto...

2015-09-06 Thread GraceH
Github user GraceH commented on the pull request: https://github.com/apache/spark/pull/7888#issuecomment-138149073 @andrewor14 Thanks for the feedback. I will take a look at your comments, and to revise the code accordingly. any concern, will let you know. --- If your project is

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138153647 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138153645 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138153614 [Test build #42078 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42078/console) for PR 8634 at commit

[GitHub] spark pull request: [SPARK-10301] [SQL] Fixes schema merging for n...

2015-09-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8509#discussion_r38832984 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/CatalystReadSupport.scala --- @@ -160,4 +101,168 @@ private[parquet]

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread holdenk
GitHub user holdenk opened a pull request: https://github.com/apache/spark/pull/8634 [SPARK-10449][SQL][WIP] Don't merge decimal types with incompatable precision or scales From JIRA: Schema merging should only handle struct fields. But currently we also reconcile decimal

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138137119 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10449][SQL][WIP] Don't merge decimal ty...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8634#issuecomment-138137109 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9552] Add force control for killExecuto...

2015-09-06 Thread GraceH
Github user GraceH commented on the pull request: https://github.com/apache/spark/pull/7888#issuecomment-138161276 @andrewor14 Thanks for the comments. Regarding #1, very good point. That's why I try to return back false if force-killing failed. This is the simplest way.

[GitHub] spark pull request: [SPARK-10071][Streaming]Output a warning when ...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8624#issuecomment-138184450 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10071][Streaming]Output a warning when ...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8624#issuecomment-138184458 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Docs small fixes

2015-09-06 Thread jaceklaskowski
GitHub user jaceklaskowski opened a pull request: https://github.com/apache/spark/pull/8629 Docs small fixes You can merge this pull request into a Git repository by running: $ git pull https://github.com/jaceklaskowski/spark docs-fixes Alternatively you can review and apply

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-138124328 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-138124327 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10447][WIP][PYSPARK] upgrade pyspark to...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-138125497 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10447][WIP][PYSPARK] upgrade pyspark to...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-138125496 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10414][MLlib]Fix hashcode issues in MLL...

2015-09-06 Thread vinodkc
Github user vinodkc commented on the pull request: https://github.com/apache/spark/pull/8565#issuecomment-138167561 Closing this PR, as there is already an existing JIRA & PR on same issue --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-10414][MLlib]Fix hashcode issues in MLL...

2015-09-06 Thread vinodkc
Github user vinodkc closed the pull request at: https://github.com/apache/spark/pull/8565 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10249][ML][Doc]Add Python Code Example ...

2015-09-06 Thread hhbyyh
GitHub user hhbyyh opened a pull request: https://github.com/apache/spark/pull/8620 [SPARK-10249][ML][Doc]Add Python Code Example to StopWordsRemover User Guide jira: Add Python Code Example to StopWordsRemover User Guide You can merge this pull request into a Git repository by

[GitHub] spark pull request: [SPARK-10249][ML][Doc]Add Python Code Example ...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8620#issuecomment-138045192 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10447][WIP][PYSPARK] upgrade pyspark to...

2015-09-06 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-138058959 jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10094] Pyspark ML Feature transformers ...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8623#issuecomment-138059222 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9170][SQL] Use OrcStructInspector to be...

2015-09-06 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/7520#issuecomment-138046382 @liancheng So is there any concern or review for this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-06 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/8599#issuecomment-138046466 ping @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10463] [SQL] remove PromotePrecision du...

2015-09-06 Thread adrian-wang
GitHub user adrian-wang opened a pull request: https://github.com/apache/spark/pull/8621 [SPARK-10463] [SQL] remove PromotePrecision during optimization PromotePrecision is not necessary after HiveTypeCoercion done. Jira:

[GitHub] spark pull request: [SPARK-10463] [SQL] remove PromotePrecision du...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8621#issuecomment-138051536 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10464] [MLlib] Add WeibullGenerator for...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8622#issuecomment-138057985 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10149] [CORE] [WIP] Locality Level is a...

2015-09-06 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8533#issuecomment-138058944 @cmccabe or @kayousterhout or maybe @CodingCat could be a useful reviewer here. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-10149] [CORE] [WIP] Locality Level is a...

2015-09-06 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/8533#discussion_r38819396 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -190,11 +197,15 @@ private[spark] class TaskSetManager( }

[GitHub] spark pull request: [SPARK-10149] [CORE] [WIP] Locality Level is a...

2015-09-06 Thread wulei-bj-cn
Github user wulei-bj-cn commented on the pull request: https://github.com/apache/spark/pull/8533#issuecomment-138051802 Hi Sean, As you suggested, I gave up modifying Utils.scala, and tried to resolve unspecified host names to IP addresses in

[GitHub] spark pull request: [SPARK-10464] [MLlib] Add WeibullGenerator for...

2015-09-06 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/8622 [SPARK-10464] [MLlib] Add WeibullGenerator for RandomDataGenerator Add WeibullGenerator for RandomDataGenerator You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: [SPARK-10447][WIP][PYSPARK] upgrade pyspark to...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-138059037 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10094] Pyspark ML Feature transformers ...

2015-09-06 Thread noel-smith
GitHub user noel-smith opened a pull request: https://github.com/apache/spark/pull/8623 [SPARK-10094] Pyspark ML Feature transformers marked as experimental Modified class-level docstrings to mark all feature transformers in pyspark.ml as experimental. You can merge this pull

[GitHub] spark pull request: SPARK-10329

2015-09-06 Thread HuJiayin
Github user HuJiayin commented on the pull request: https://github.com/apache/spark/pull/8546#issuecomment-138047275 The user doesn't need enlarge the memory to run 1.5 kmeans after apply this fix. They still can use 1.2 configuration and have stable run experience in the same time.

[GitHub] spark pull request: [SPARK-10149] [CORE] [WIP] Locality Level is a...

2015-09-06 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/8533#issuecomment-138085697 Funny conversation, `"I'm Sean"` can we simply add `"SPARK_LOCAL_HOSTNAME = `hostname`"` to the spark-env.sh? --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-10149] [CORE] [WIP] Locality Level is a...

2015-09-06 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/8533#issuecomment-138085791 don't know how to type it correctly ![image](https://cloud.githubusercontent.com/assets/678008/9704543/59335564-5479-11e5-8581-2d262e7f4c0c.png) --- If your

[GitHub] spark pull request: [SPARK-10149] [CORE] [WIP] Locality Level is a...

2015-09-06 Thread CodingCat
Github user CodingCat commented on a diff in the pull request: https://github.com/apache/spark/pull/8533#discussion_r38821456 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -322,7 +333,12 @@ private[spark] class TaskSetManager( //

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-06 Thread Lewuathe
Github user Lewuathe commented on a diff in the pull request: https://github.com/apache/spark/pull/8537#discussion_r38821992 --- Diff: mllib/src/main/scala/org/apache/spark/ml/source/libsvm/package.scala --- @@ -0,0 +1,33 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-10071][Streaming]Output a warning when ...

2015-09-06 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/8624 [SPARK-10071][Streaming]Output a warning when writing QueueInputDStream and throw a better exception when reading QueueInputDStream Output a warning when serializing QueueInputDStream rather than

[GitHub] spark pull request: [SPARK-10071][Streaming]Output a warning when ...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8624#issuecomment-138090858 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9301] [SQL] Add collect_set aggregate f...

2015-09-06 Thread nburoojy
Github user nburoojy commented on the pull request: https://github.com/apache/spark/pull/8592#issuecomment-138091105 That makes sense. To be clear, the new interface is `AlgebraicAggregate` or, if a lower-level interface is needed `AggregateFunction2`, right? --- If your project is

[GitHub] spark pull request: [SPARK-10149] [CORE] [WIP] Locality Level is a...

2015-09-06 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/8533#issuecomment-138086351 I mean to overcome the `large-scale configuration` problem mentioned by @wulei-bj-cn --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-06 Thread Lewuathe
Github user Lewuathe commented on a diff in the pull request: https://github.com/apache/spark/pull/8537#discussion_r38821974 --- Diff: mllib/src/test/java/org/apache/spark/ml/source/JavaLibSVMRelationSuite.java --- @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8537#issuecomment-138090110 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-09-06 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-138091393 @rxin I've updated this patch to use `AlgebraicAggregate` as you suggested. Please take a look when you are available. Thanks. --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-10149] [CORE] [WIP] Locality Level is a...

2015-09-06 Thread wulei-bj-cn
Github user wulei-bj-cn commented on a diff in the pull request: https://github.com/apache/spark/pull/8533#discussion_r38819729 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -190,11 +197,15 @@ private[spark] class TaskSetManager( }

[GitHub] spark pull request: [WIP] [SPARK-8518] [ML] Log-linear models for ...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8611#issuecomment-138069507 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8537#issuecomment-138108129 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10249][ML][Doc]Add Python Code Example ...

2015-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8620#issuecomment-138108131 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

  1   2   >