[GitHub] spark issue #17120: [SPARK-19715][Structured Streaming] Option to Strip Path...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17120 **[Test build #73691 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73691/testReport)** for PR 17120 at commit [`aeb10d1`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #17122: [SPARK-19786][SQL] Facilitate loop optimizations in a JI...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17122 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17122: [SPARK-19786][SQL] Facilitate loop optimizations in a JI...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17122 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73689/ Test PASSed. ---

[GitHub] spark issue #17119: [SPARK-19784][SQL][WIP]refresh table after alter the loc...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17119 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17119: [SPARK-19784][SQL][WIP]refresh table after alter the loc...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17119 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73690/ Test PASSed. ---

[GitHub] spark issue #17120: [SPARK-19715][Structured Streaming] Option to Strip Path...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17120 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15505: [SPARK-18890][CORE] Move task serialization from the Tas...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15505 **[Test build #73694 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73694/testReport)** for PR 15505 at commit [`335b7b9`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #17120: [SPARK-19715][Structured Streaming] Option to Strip Path...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17120 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73691/ Test PASSed. ---

[GitHub] spark issue #16909: [SPARK-13450] Introduce ExternalAppendOnlyUnsafeRowArray...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16909 **[Test build #73701 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73701/testReport)** for PR 16909 at commit [`beb0046`](https://github.com/apache/spark/commit/be

[GitHub] spark issue #15505: [SPARK-18890][CORE] Move task serialization from the Tas...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15505 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15505: [SPARK-18890][CORE] Move task serialization from the Tas...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15505 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73694/ Test FAILed. ---

[GitHub] spark issue #17059: [SPARK-19733][ML]Removed unnecessary castings and refact...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17059 **[Test build #73697 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73697/testReport)** for PR 17059 at commit [`0b49a50`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #17059: [SPARK-19733][ML]Removed unnecessary castings and refact...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17059 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17059: [SPARK-19733][ML]Removed unnecessary castings and refact...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17059 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73697/ Test PASSed. ---

[GitHub] spark issue #17116: [SPARK-18890][CORE](try 2) Move task serialization from ...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17116 **[Test build #73692 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73692/testReport)** for PR 17116 at commit [`1c26e8c`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #17109: [SPARK-19740][MESOS]Add support in Spark to pass arbitra...

2017-03-01 Thread yanji84
Github user yanji84 commented on the issue: https://github.com/apache/spark/pull/17109 @tnachen I will add test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17116: [SPARK-18890][CORE](try 2) Move task serialization from ...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17116 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17116: [SPARK-18890][CORE](try 2) Move task serialization from ...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17116 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73692/ Test FAILed. ---

[GitHub] spark pull request #17108: [SPARK-19636][ML] Feature parity for correlation ...

2017-03-01 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/17108#discussion_r103752932 --- Diff: mllib/src/test/scala/org/apache/spark/ml/stat/StatisticsSuite.scala --- @@ -0,0 +1,102 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] spark issue #17115: [Doc][Minor] Update R doc

2017-03-01 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17115 great thanks! - we could say return a `vector of` in cases it makes sense - `colnames<- does allow the subset assignment` - would be good to add example and tests if we don't have it alre

[GitHub] spark pull request #17108: [SPARK-19636][ML] Feature parity for correlation ...

2017-03-01 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/17108#discussion_r103755434 --- Diff: mllib/src/test/scala/org/apache/spark/ml/stat/StatisticsSuite.scala --- @@ -0,0 +1,102 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] spark issue #17108: [SPARK-19636][ML] Feature parity for correlation statist...

2017-03-01 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/17108 The changes look good to me. I just had a few minor comments. I wish we could just natively implement the correlations in spark to avoid extra copying between the old and new implementations

[GitHub] spark pull request #17067: [SPARK-19602][SQL][TESTS] Add tests for qualified...

2017-03-01 Thread skambha
Github user skambha commented on a diff in the pull request: https://github.com/apache/spark/pull/17067#discussion_r103756083 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala --- @@ -52,6 +52,19 @@ abstract class SQLViewSuite extends QueryTest wit

[GitHub] spark pull request #17122: [SPARK-19786][SQL] Facilitate loop optimizations ...

2017-03-01 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/17122#discussion_r103756297 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala --- @@ -206,6 +210,15 @@ trait CodegenSupport extends SparkPlan

[GitHub] spark issue #17122: [SPARK-19786][SQL] Facilitate loop optimizations in a JI...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17122 **[Test build #73702 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73702/testReport)** for PR 17122 at commit [`6913b45`](https://github.com/apache/spark/commit/69

[GitHub] spark pull request #17102: [SPARK-19345][ML][DOC] Add doc for "coldStartStra...

2017-03-01 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/17102#discussion_r103757179 --- Diff: docs/ml-collaborative-filtering.md --- @@ -59,6 +59,34 @@ This approach is named "ALS-WR" and discussed in the paper It makes `regParam` less

[GitHub] spark pull request #17102: [SPARK-19345][ML][DOC] Add doc for "coldStartStra...

2017-03-01 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/17102#discussion_r103757139 --- Diff: docs/ml-collaborative-filtering.md --- @@ -59,6 +59,34 @@ This approach is named "ALS-WR" and discussed in the paper It makes `regParam` less

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-01 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/17076 Ah ok, makes sense. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark issue #17102: [SPARK-19345][ML][DOC] Add doc for "coldStartStrategy" u...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17102 **[Test build #73703 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73703/testReport)** for PR 17102 at commit [`c422d58`](https://github.com/apache/spark/commit/c4

[GitHub] spark issue #17121: [SPARK-19787][ML] Changing the default parameter of regP...

2017-03-01 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/17121 @datumbox LGTM, thanks. Merged to master. By the way - this is a tiny change and sometimes we don't bother, and if we do it it can have a [MINOR] tag in the PR title. Having said that there's

[GitHub] spark pull request #17121: [SPARK-19787][ML] Changing the default parameter ...

2017-03-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17121 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #17108: [SPARK-19636][ML] Feature parity for correlation ...

2017-03-01 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/17108#discussion_r103761616 --- Diff: mllib/src/main/scala/org/apache/spark/ml/stat/Statistics.scala --- @@ -0,0 +1,89 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] spark issue #17102: [SPARK-19345][ML][DOC] Add doc for "coldStartStrategy" u...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17102 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73703/ Test PASSed. ---

[GitHub] spark issue #17102: [SPARK-19345][ML][DOC] Add doc for "coldStartStrategy" u...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17102 **[Test build #73703 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73703/testReport)** for PR 17102 at commit [`c422d58`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #17102: [SPARK-19345][ML][DOC] Add doc for "coldStartStrategy" u...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17102 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17115: [Doc][Minor][SparkR] Update SparkR doc for names, column...

2017-03-01 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/17115 @HyukjinKwon Thanks. Updated title. @felixcheung Updated doc and added tests. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #17125: [SPARK-19211][SQL] Explicitly prevent Insert into View o...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17125 **[Test build #73696 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73696/testReport)** for PR 17125 at commit [`ae28e4b`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #17115: [Doc][Minor][SparkR] Update SparkR doc for names, column...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17115 **[Test build #73704 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73704/testReport)** for PR 17115 at commit [`921c437`](https://github.com/apache/spark/commit/92

[GitHub] spark issue #17125: [SPARK-19211][SQL] Explicitly prevent Insert into View o...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17125 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73696/ Test PASSed. ---

[GitHub] spark issue #17125: [SPARK-19211][SQL] Explicitly prevent Insert into View o...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17125 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17115: [Doc][Minor][SparkR] Update SparkR doc for names, column...

2017-03-01 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/17115 @srowen @felixcheung Thanks for the clarification. I will open another PR to add real data examples for the SparkDataFrame methods. I have seen lots of R package document the meth

[GitHub] spark pull request #17127: [SPARK-19734][PYTHON][ML] Correct OneHotEncoder d...

2017-03-01 Thread markgrover
GitHub user markgrover opened a pull request: https://github.com/apache/spark/pull/17127 [SPARK-19734][PYTHON][ML] Correct OneHotEncoder doc string to say dropLast ## What changes were proposed in this pull request? Updates the doc string to match up with the code i.e. say dr

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2017-03-01 Thread mariusvniekerk
Github user mariusvniekerk commented on the issue: https://github.com/apache/spark/pull/15666 @holdenk done --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #17076: [SPARK-19745][ML] SVCAggregator captures coeffici...

2017-03-01 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/17076#discussion_r103764323 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LinearSVC.scala --- @@ -463,6 +458,8 @@ private class LinearSVCAggregator( */

[GitHub] spark issue #17127: [SPARK-19734][PYTHON][ML] Correct OneHotEncoder doc stri...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17127 **[Test build #73705 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73705/testReport)** for PR 17127 at commit [`f3f5fd1`](https://github.com/apache/spark/commit/f3

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-01 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/17076 Looks fine to me - @sethah does the `lazy val` for gradient array impact LoR & Linear regression aggregators too? Any others? Since this is a fairly compact change, I think we can maybe go with your

[GitHub] spark issue #17059: [SPARK-19733][ML]Removed unnecessary castings and refact...

2017-03-01 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/17059 @datumbox once a PR is ok'ed to test from a committer, it should automatically retest on each commit. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2017-03-01 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15666 Thanks for updating it @mariusvniekerk, it seems like the update is failing Python style tests though could you take a look at that? --- If your project is set up for it, you can reply to this emai

[GitHub] spark issue #17059: [SPARK-19733][ML]Removed unnecessary castings and refact...

2017-03-01 Thread datumbox
Github user datumbox commented on the issue: https://github.com/apache/spark/pull/17059 @MLnick Cool did not know that. Just updated commit messages. I think I'm good with this PR from my side. --- If your project is set up for it, you can reply to this email and have your reply appe

[GitHub] spark issue #17059: [SPARK-19733][ML]Removed unnecessary castings and refact...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17059 **[Test build #73706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73706/testReport)** for PR 17059 at commit [`361d9cb`](https://github.com/apache/spark/commit/36

[GitHub] spark issue #17121: [SPARK-19787][ML] Changing the default parameter of regP...

2017-03-01 Thread datumbox
Github user datumbox commented on the issue: https://github.com/apache/spark/pull/17121 @MLnick Sounds good to me thanks. :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-01 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/17076 @sethah This is a nice optimization! Small suggestion -- For the shuffle write performance improvement, would it be possible to test this on a larger dataset to highlight the improvements and

[GitHub] spark issue #17127: [SPARK-19734][PYTHON][ML] Correct OneHotEncoder doc stri...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17127 **[Test build #73705 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73705/testReport)** for PR 17127 at commit [`f3f5fd1`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #17127: [SPARK-19734][PYTHON][ML] Correct OneHotEncoder doc stri...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17127 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73705/ Test PASSed. ---

[GitHub] spark issue #17127: [SPARK-19734][PYTHON][ML] Correct OneHotEncoder doc stri...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17127 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16944 **[Test build #73707 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73707/testReport)** for PR 16944 at commit [`a2658fc`](https://github.com/apache/spark/commit/a2

[GitHub] spark issue #17100: [SPARK-13947][PYTHON][SQL] PySpark DataFrames: The error...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17100 **[Test build #73700 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73700/testReport)** for PR 17100 at commit [`ea07688`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #17126: [SPARK-19789][SS]Add the shortcut of .format("parquet")....

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17126 **[Test build #73698 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73698/testReport)** for PR 17126 at commit [`1c76c50`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #17100: [SPARK-13947][PYTHON][SQL] PySpark DataFrames: The error...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17100 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73700/ Test FAILed. ---

[GitHub] spark issue #17100: [SPARK-13947][PYTHON][SQL] PySpark DataFrames: The error...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17100 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17126: [SPARK-19789][SS]Add the shortcut of .format("parquet")....

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17126 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17126: [SPARK-19789][SS]Add the shortcut of .format("parquet")....

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17126 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73698/ Test PASSed. ---

[GitHub] spark issue #17115: [Doc][Minor][SparkR] Update SparkR doc for names, column...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17115 **[Test build #73704 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73704/testReport)** for PR 17115 at commit [`921c437`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #16909: [SPARK-13450] Introduce ExternalAppendOnlyUnsafeRowArray...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16909 **[Test build #73701 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73701/testReport)** for PR 16909 at commit [`beb0046`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #17115: [Doc][Minor][SparkR] Update SparkR doc for names, column...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17115 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17115: [Doc][Minor][SparkR] Update SparkR doc for names, column...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17115 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73704/ Test PASSed. ---

[GitHub] spark issue #16909: [SPARK-13450] Introduce ExternalAppendOnlyUnsafeRowArray...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16909 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73701/ Test FAILed. ---

[GitHub] spark issue #16909: [SPARK-13450] Introduce ExternalAppendOnlyUnsafeRowArray...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16909 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #17128: [SPARK-18352][DOCS] wholeFile JSON update doc and...

2017-03-01 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/17128 [SPARK-18352][DOCS] wholeFile JSON update doc and programming guide ## What changes were proposed in this pull request? Update doc for R, programming. Clarify default behavior for all l

[GitHub] spark issue #17128: [SPARK-18352][DOCS] wholeFile JSON update doc and progra...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17128 **[Test build #73708 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73708/testReport)** for PR 17128 at commit [`d542802`](https://github.com/apache/spark/commit/d5

[GitHub] spark issue #16782: [SPARK-19348][PYTHON][WIP] PySpark keyword_only decorato...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16782 **[Test build #73709 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73709/testReport)** for PR 16782 at commit [`8dafc20`](https://github.com/apache/spark/commit/8d

[GitHub] spark issue #16782: [SPARK-19348][PYTHON] PySpark keyword_only decorator is ...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16782 **[Test build #73710 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73710/testReport)** for PR 16782 at commit [`acf9cf4`](https://github.com/apache/spark/commit/ac

[GitHub] spark pull request #17076: [SPARK-19745][ML] SVCAggregator captures coeffici...

2017-03-01 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/17076#discussion_r103778255 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LinearSVC.scala --- @@ -463,6 +458,8 @@ private class LinearSVCAggregator( *

[GitHub] spark issue #17059: [SPARK-19733][ML]Removed unnecessary castings and refact...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17059 **[Test build #73706 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73706/testReport)** for PR 17059 at commit [`361d9cb`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #17076: [SPARK-19745][ML] SVCAggregator captures coeffici...

2017-03-01 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/17076#discussion_r103778355 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LinearSVC.scala --- @@ -463,6 +458,8 @@ private class LinearSVCAggregator( *

[GitHub] spark issue #17059: [SPARK-19733][ML]Removed unnecessary castings and refact...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17059 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73706/ Test PASSed. ---

[GitHub] spark issue #17059: [SPARK-19733][ML]Removed unnecessary castings and refact...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17059 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-01 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/17076 @MLnick I checked LinearRegression.scala, LogisticRegression.scala, and AFTSurvivalRegression.scala, and all of them already do this. Are there any other aggregators with a similar code struc

[GitHub] spark issue #17128: [SPARK-18352][DOCS] wholeFile JSON update doc and progra...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17128 **[Test build #73711 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73711/testReport)** for PR 17128 at commit [`0fd7f68`](https://github.com/apache/spark/commit/0f

[GitHub] spark issue #17122: [SPARK-19786][SQL] Facilitate loop optimizations in a JI...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17122 **[Test build #73702 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73702/testReport)** for PR 17122 at commit [`6913b45`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #17122: [SPARK-19786][SQL] Facilitate loop optimizations in a JI...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17122 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17122: [SPARK-19786][SQL] Facilitate loop optimizations in a JI...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17122 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73702/ Test PASSed. ---

[GitHub] spark issue #17115: [Doc][Minor][SparkR] Update SparkR doc for names, column...

2017-03-01 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17115 @actuaryzhang can you point me to an example you are thinking of? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #16782: [SPARK-19348][PYTHON] PySpark keyword_only decorator is ...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16782 **[Test build #73710 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73710/testReport)** for PR 16782 at commit [`acf9cf4`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #16782: [SPARK-19348][PYTHON] PySpark keyword_only decorator is ...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16782 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73710/ Test FAILed. ---

[GitHub] spark issue #16782: [SPARK-19348][PYTHON] PySpark keyword_only decorator is ...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16782 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17115: [Doc][Minor][SparkR] Update SparkR doc for names, column...

2017-03-01 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17115 yeah, looking at `columns` the example there isn't that great (in fact, the example for all the sql functions are pretty simplistic) --- If your project is set up for it, you can reply to this

[GitHub] spark issue #17115: [Doc][Minor][SparkR] Update SparkR doc for names, column...

2017-03-01 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17115 this merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark pull request #17115: [Doc][Minor][SparkR] Update SparkR doc for names,...

2017-03-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17115 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16944 **[Test build #73707 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73707/testReport)** for PR 16944 at commit [`a2658fc`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16944 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73707/ Test PASSed. ---

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16944 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17128: [SPARK-18352][DOCS] wholeFile JSON update doc and progra...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17128 **[Test build #73708 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73708/testReport)** for PR 17128 at commit [`d542802`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #17128: [SPARK-18352][DOCS] wholeFile JSON update doc and progra...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17128 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17128: [SPARK-18352][DOCS] wholeFile JSON update doc and progra...

2017-03-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17128 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73708/ Test PASSed. ---

[GitHub] spark issue #16954: [SPARK-18874][SQL] First phase: Deferring the correlated...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16954 **[Test build #73712 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73712/testReport)** for PR 16954 at commit [`3b4bb90`](https://github.com/apache/spark/commit/3b

[GitHub] spark issue #17113: [SPARK-13669][Core] Improve the blacklist mechanism to h...

2017-03-01 Thread markhamstra
Github user markhamstra commented on the issue: https://github.com/apache/spark/pull/17113 "Current Spark's blacklist mechanism": please be more precise. The most recent released version of Spark, 2.1.0, does not include a lot of recent changes to blacklisting (mostly https://github.

[GitHub] spark issue #16782: [SPARK-19348][PYTHON] PySpark keyword_only decorator is ...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16782 **[Test build #73713 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73713/testReport)** for PR 16782 at commit [`e578320`](https://github.com/apache/spark/commit/e5

[GitHub] spark pull request #17110: [SPARK-19635][ML] DataFrame-based API for chi squ...

2017-03-01 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/17110#discussion_r103804058 --- Diff: mllib/src/main/scala/org/apache/spark/ml/stat/ChiSquare.scala --- @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark issue #17128: [SPARK-18352][DOCS] wholeFile JSON update doc and progra...

2017-03-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17128 **[Test build #73711 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73711/testReport)** for PR 17128 at commit [`0fd7f68`](https://github.com/apache/spark/commit/0

<    1   2   3   4   5   6   >