[GitHub] spark issue #16161: [SPARK-18717][SQL] Make code generation for Scala Map wo...

2016-12-06 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16161 can you highlight your approach to fix this bug? It looks to me that this is not a general fix, e.g. `mutable.Map` will still fail. --- If your project is set up for it, you can reply to this ema

[GitHub] spark issue #16014: [SPARK-18590][SPARKR] build R source package when making...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16014 **[Test build #69712 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69712/consoleFull)** for PR 16014 at commit [`6ef26fe`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16014: [SPARK-18590][SPARKR] build R source package when making...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16014 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16068: [SPARK-18637][SQL]Stateful UDF should be considered as n...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16068 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69715/ Test FAILed. ---

[GitHub] spark issue #16068: [SPARK-18637][SQL]Stateful UDF should be considered as n...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16068 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16068: [SPARK-18637][SQL]Stateful UDF should be considered as n...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16068 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69716/ Test FAILed. ---

[GitHub] spark issue #16014: [SPARK-18590][SPARKR] build R source package when making...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16014 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69712/ Test PASSed. ---

[GitHub] spark issue #16128: [SPARK-18671][SS][TEST] Added tests to ensure stability ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16128 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16068: [SPARK-18637][SQL]Stateful UDF should be considered as n...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16068 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16128: [SPARK-18671][SS][TEST] Added tests to ensure stability ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16128 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69714/ Test FAILed. ---

[GitHub] spark pull request #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers exam...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16148#discussion_r91005161 --- Diff: docs/ml-classification-regression.md --- @@ -75,6 +75,13 @@ More details on parameters can be found in the [Python API documentation](api/py

[GitHub] spark pull request #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers exam...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16148#discussion_r91024054 --- Diff: examples/src/main/r/ml/ml.R --- @@ -0,0 +1,64 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contribu

[GitHub] spark pull request #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers exam...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16148#discussion_r91024237 --- Diff: docs/sparkr.md --- @@ -512,39 +512,33 @@ head(teenagers) # Machine Learning -SparkR supports the following machine learning

[GitHub] spark pull request #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers exam...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16148#discussion_r91022054 --- Diff: docs/sparkr.md --- @@ -512,39 +512,33 @@ head(teenagers) # Machine Learning -SparkR supports the following machine learning

[GitHub] spark pull request #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers exam...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16148#discussion_r91022606 --- Diff: examples/src/main/r/ml/gaussianMixture.R --- @@ -0,0 +1,42 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark pull request #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers exam...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16148#discussion_r91024114 --- Diff: examples/src/main/r/ml/randomForest.R --- @@ -0,0 +1,63 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +

[GitHub] spark pull request #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers exam...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16148#discussion_r91022864 --- Diff: examples/src/main/r/ml/isoreg.R --- @@ -0,0 +1,42 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# cont

[GitHub] spark issue #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers example cod...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16148 **[Test build #69717 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69717/consoleFull)** for PR 16148 at commit [`b8a42f2`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers exam...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16148#discussion_r91022027 --- Diff: docs/sparkr.md --- @@ -512,39 +512,33 @@ head(teenagers) # Machine Learning -SparkR supports the following machine learning

[GitHub] spark pull request #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers exam...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16148#discussion_r91023264 --- Diff: examples/src/main/r/ml/lda.R --- @@ -0,0 +1,46 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contrib

[GitHub] spark pull request #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers exam...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16148#discussion_r91005531 --- Diff: docs/ml-classification-regression.md --- @@ -847,6 +893,14 @@ Refer to the [`IsotonicRegression` Python docs](api/python/pyspark.ml.html#pyspa

[GitHub] spark pull request #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers exam...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16148#discussion_r91023297 --- Diff: examples/src/main/r/ml/lda.R --- @@ -0,0 +1,46 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contrib

[GitHub] spark pull request #16068: [SPARK-18637][SQL]Stateful UDF should be consider...

2016-12-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16068#discussion_r91027951 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDFSuite.scala --- @@ -487,6 +488,52 @@ class HiveUDFSuite extends QueryTest wit

[GitHub] spark issue #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers example cod...

2016-12-06 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/16148 @felixcheung That's a good question. We don't run all MLlib examples for testing until [SPARK-12347](https://issues.apache.org/jira/browse/SPARK-12347) was resolved. --- If your project is set

[GitHub] spark issue #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers example cod...

2016-12-06 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16148 hmm, yea, I suspect these example can be easily forgotten while changes are made - they could end up getting out of sync easily --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #16014: [SPARK-18590][SPARKR] build R source package when making...

2016-12-06 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16014 thanks, updated. @rxin could you please review release-build.sh? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #16117: [SPARK-18686][SparkR][ML] Several cleanup and improvemen...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16117 **[Test build #69718 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69718/consoleFull)** for PR 16117 at commit [`914c9ac`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers example cod...

2016-12-06 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/16148 Yeah, I have the same concerns, so we should push forward SPARK-12347 and it should not be very hard to do that. --- If your project is set up for it, you can reply to this email and have your r

[GitHub] spark issue #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers example cod...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16148 **[Test build #69717 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69717/consoleFull)** for PR 16148 at commit [`b8a42f2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers example cod...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16148 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69717/ Test PASSed. ---

[GitHub] spark issue #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers example cod...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16148 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16099 **[Test build #69719 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69719/consoleFull)** for PR 16099 at commit [`ddb4128`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16099 **[Test build #69719 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69719/consoleFull)** for PR 16099 at commit [`ddb4128`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16099 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16099 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69719/ Test PASSed. ---

[GitHub] spark pull request #16006: [SPARK-18580] [DStreams] [external/kafka-0-10] Us...

2016-12-06 Thread omuravskiy
Github user omuravskiy commented on a diff in the pull request: https://github.com/apache/spark/pull/16006#discussion_r91035292 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/DirectKafkaInputDStream.scala --- @@ -67,6 +67,10 @@ private[spark] clas

[GitHub] spark pull request #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge...

2016-12-06 Thread AnthonyTruchet
Github user AnthonyTruchet commented on a diff in the pull request: https://github.com/apache/spark/pull/16037#discussion_r91036283 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/optimization/LBFGS.scala --- @@ -241,16 +241,27 @@ object LBFGS extends Logging { val

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-06 Thread AnthonyTruchet
Github user AnthonyTruchet commented on the issue: https://github.com/apache/spark/pull/16037 @sethah Agreed, that's why I uggested to add a dedicated treeAggregate wrapper to MLlin Utils which would take care of that without fiddling with sparsity for each seqOP and comboOp. See clos

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16099 **[Test build #69720 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69720/consoleFull)** for PR 16099 at commit [`501d121`](https://github.com/apache/spark/commit/5

[GitHub] spark pull request #16006: [SPARK-18580] [DStreams] [external/kafka-0-10] Us...

2016-12-06 Thread omuravskiy
Github user omuravskiy commented on a diff in the pull request: https://github.com/apache/spark/pull/16006#discussion_r91038777 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/DirectKafkaInputDStream.scala --- @@ -143,9 +147,14 @@ private[spark] cl

[GitHub] spark issue #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers example cod...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16148 **[Test build #69721 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69721/consoleFull)** for PR 16148 at commit [`747ca68`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #16117: [SPARK-18686][SparkR][ML] Several cleanup and improvemen...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16117 **[Test build #69718 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69718/consoleFull)** for PR 16117 at commit [`914c9ac`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16117: [SPARK-18686][SparkR][ML] Several cleanup and improvemen...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16117 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69718/ Test PASSed. ---

[GitHub] spark issue #16117: [SPARK-18686][SparkR][ML] Several cleanup and improvemen...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16117 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-06 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r91039840 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -132,50 +153,80 @@ case class CreateMap(childr

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-06 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r91039854 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -132,50 +153,80 @@ case class CreateMap(childr

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-06 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r91039873 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala --- @@ -59,12 +59,36 @@ trait ExpressionEvalHelper

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #69723 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69723/consoleFull)** for PR 13909 at commit [`41a5435`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16037 **[Test build #69722 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69722/consoleFull)** for PR 16037 at commit [`3b59ab2`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-06 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r91039919 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -56,28 +56,49 @@ case class CreateArray(childr

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-12-06 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r91039898 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -56,28 +56,49 @@ case class CreateArray(childr

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69723/ Test FAILed. ---

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #69723 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69723/consoleFull)** for PR 13909 at commit [`41a5435`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16099 **[Test build #69720 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69720/consoleFull)** for PR 16099 at commit [`501d121`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16099 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69720/ Test PASSed. ---

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16099 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers example cod...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16148 **[Test build #69721 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69721/consoleFull)** for PR 16148 at commit [`747ca68`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers example cod...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16148 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69721/ Test PASSed. ---

[GitHub] spark issue #16148: [SPARK-18325][SparkR][ML] SparkR ML wrappers example cod...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16148 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-06 Thread lichenglin
Github user lichenglin commented on the issue: https://github.com/apache/spark/pull/15819 I'm using spark 2.0.2 I got a really big hive-stage folder. May I delete the folder Manually ? does it make any bad affect on warehouse? --- If your project is set up for it, you can rep

[GitHub] spark issue #15467: [SPARK-17912][SQL] Refactor code generation to get data ...

2016-12-06 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/15467 @andrewor14 would it be possible to review this code? Or, could you please create the similar PR from https://github.com/apache/spark/pull/13899? Your original refactoring was great. In addition to

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-12-06 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/15468 @andrewor14 would it be possible to review this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #16168: [SPARK-18209][SQL] More robust view canonicalizat...

2016-12-06 Thread jiangxb1987
GitHub user jiangxb1987 opened a pull request: https://github.com/apache/spark/pull/16168 [SPARK-18209][SQL] More robust view canonicalization without full SQL expansion ## What changes were proposed in this pull request? Currently we canonicalize the view definition to pro

[GitHub] spark issue #16168: [SPARK-18209][SQL] More robust view canonicalization wit...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16168 **[Test build #69724 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69724/consoleFull)** for PR 16168 at commit [`aa81a36`](https://github.com/apache/spark/commit/a

[GitHub] spark pull request #16139: [SPARK-18705][ML][DOC] Update user guide to refle...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16139#discussion_r91049472 --- Diff: docs/ml-advanced.md --- @@ -59,17 +59,22 @@ Given $n$ weighted observations $(w_i, a_i, b_i)$: The number of features for each observa

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16037 **[Test build #69722 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69722/consoleFull)** for PR 16037 at commit [`3b59ab2`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #16139: [SPARK-18705][ML][DOC] Update user guide to refle...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16139#discussion_r91047347 --- Diff: docs/ml-advanced.md --- @@ -59,17 +59,22 @@ Given $n$ weighted observations $(w_i, a_i, b_i)$: The number of features for each observa

[GitHub] spark pull request #16139: [SPARK-18705][ML][DOC] Update user guide to refle...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16139#discussion_r91047063 --- Diff: docs/ml-advanced.md --- @@ -59,17 +59,22 @@ Given $n$ weighted observations $(w_i, a_i, b_i)$: The number of features for each observa

[GitHub] spark pull request #16139: [SPARK-18705][ML][DOC] Update user guide to refle...

2016-12-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16139#discussion_r91046684 --- Diff: docs/ml-advanced.md --- @@ -59,17 +59,22 @@ Given $n$ weighted observations $(w_i, a_i, b_i)$: The number of features for each observa

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16037 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16037 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69722/ Test PASSed. ---

[GitHub] spark pull request #16169: [SPARK-18326][SPARKR][ML] Review SparkR ML wrappe...

2016-12-06 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/16169 [SPARK-18326][SPARKR][ML] Review SparkR ML wrappers API for 2.1 ## What changes were proposed in this pull request? Reviewing SparkR ML wrappers API for 2.1 release, mainly issues include:

[GitHub] spark issue #16169: [SPARK-18326][SPARKR][ML] Review SparkR ML wrappers API ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16169 **[Test build #69725 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69725/consoleFull)** for PR 16169 at commit [`a5c3b8b`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #16168: [SPARK-18209][SQL] More robust view canonicalization wit...

2016-12-06 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/16168 cc @rxin @srinathshankar @nsyca --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16170: [SPARK-18634][SQL][TRIVIAL] Touch-up Generate

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16170 **[Test build #69726 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69726/consoleFull)** for PR 16170 at commit [`8bf57e0`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #16170: [SPARK-18634][SQL][TRIVIAL] Touch-up Generate

2016-12-06 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/16170 cc @cloud-fan @viirya --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark pull request #16170: [SPARK-18634][SQL][TRIVIAL] Touch-up Generate

2016-12-06 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/16170 [SPARK-18634][SQL][TRIVIAL] Touch-up Generate ## What changes were proposed in this pull request? I jumped the gun on merging https://github.com/apache/spark/pull/16120, and missed a tiny po

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16099 **[Test build #69727 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69727/consoleFull)** for PR 16099 at commit [`40894a1`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #69728 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69728/consoleFull)** for PR 13909 at commit [`185ddf5`](https://github.com/apache/spark/commit/1

[GitHub] spark pull request #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge...

2016-12-06 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/16037#discussion_r91061168 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/optimization/LBFGS.scala --- @@ -241,16 +241,27 @@ object LBFGS extends Logging { val bcW = d

[GitHub] spark issue #16169: [SPARK-18326][SPARKR][ML] Review SparkR ML wrappers API ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16169 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69725/ Test PASSed. ---

[GitHub] spark issue #16169: [SPARK-18326][SPARKR][ML] Review SparkR ML wrappers API ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16169 **[Test build #69725 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69725/consoleFull)** for PR 16169 at commit [`a5c3b8b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16169: [SPARK-18326][SPARKR][ML] Review SparkR ML wrappers API ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16169 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16099 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69727/ Test PASSed. ---

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16099 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16099: [SPARK-18665][SQL] set statement state to "ERROR" after ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16099 **[Test build #69727 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69727/consoleFull)** for PR 16099 at commit [`40894a1`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16168: [SPARK-18209][SQL] More robust view canonicalization wit...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16168 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16168: [SPARK-18209][SQL] More robust view canonicalization wit...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16168 **[Test build #69724 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69724/consoleFull)** for PR 16168 at commit [`aa81a36`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16168: [SPARK-18209][SQL] More robust view canonicalization wit...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16168 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69724/ Test FAILed. ---

[GitHub] spark pull request #16171: [SPARK-18739][ML][PYSPARK] Models in pyspark.clas...

2016-12-06 Thread zhengruifeng
GitHub user zhengruifeng opened a pull request: https://github.com/apache/spark/pull/16171 [SPARK-18739][ML][PYSPARK] Models in pyspark.classification support setXXXCol methods ## What changes were proposed in this pull request? 1, add `setFeaturesCol` and `setPredictionCol` in

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Models in pyspark.classificat...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #69729 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69729/consoleFull)** for PR 16171 at commit [`e24169d`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Models in pyspark.classificat...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Models in pyspark.classificat...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #69729 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69729/consoleFull)** for PR 16171 at commit [`e24169d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Models in pyspark.classificat...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69729/ Test FAILed. ---

[GitHub] spark issue #16168: [SPARK-18209][SQL] More robust view canonicalization wit...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16168 **[Test build #69730 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69730/consoleFull)** for PR 16168 at commit [`434009e`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #16170: [SPARK-18634][SQL][TRIVIAL] Touch-up Generate

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16170 **[Test build #69726 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69726/consoleFull)** for PR 16170 at commit [`8bf57e0`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16170: [SPARK-18634][SQL][TRIVIAL] Touch-up Generate

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16170 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16170: [SPARK-18634][SQL][TRIVIAL] Touch-up Generate

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16170 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69726/ Test PASSed. ---

[GitHub] spark pull request #16168: [SPARK-18209][SQL] More robust view canonicalizat...

2016-12-06 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16168#discussion_r91064795 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -114,9 +117,26 @@ private[hive] class HiveMetastoreCatalog(s

  1   2   3   4   5   6   >