[GitHub] spark pull request: [SPARK-14654][CORE] New accumulator API

2016-04-28 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/12612#discussion_r61414486 --- Diff: core/src/main/scala/org/apache/spark/NewAccumulator.scala --- @@ -0,0 +1,391 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[GitHub] spark pull request: [SPARK-14521][SQL]StackOverflowError in Kryo w...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12598#issuecomment-215399829 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14521][SQL]StackOverflowError in Kryo w...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12598#issuecomment-215399831 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14521][SQL]StackOverflowError in Kryo w...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12598#issuecomment-215399590 **[Test build #57242 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57242/consoleFull)** for PR 12598 at commit [`72785fe`](https://g

[GitHub] spark pull request: [SPARK-12810][PySpark] PySpark CrossValidatorM...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12464#issuecomment-215399547 **[Test build #57249 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57249/consoleFull)** for PR 12464 at commit [`51b412f`](https://gi

[GitHub] spark pull request: [SPARK-12810][PySpark] PySpark CrossValidatorM...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12464#issuecomment-215398781 **[Test build #57248 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57248/consoleFull)** for PR 12464 at commit [`cfe6a66`](https://g

[GitHub] spark pull request: [SPARK-12810][PySpark] PySpark CrossValidatorM...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12464#issuecomment-215398656 **[Test build #57248 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57248/consoleFull)** for PR 12464 at commit [`cfe6a66`](https://gi

[GitHub] spark pull request: [SPARK-12810][PySpark] PySpark CrossValidatorM...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12464#issuecomment-215398789 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12810][PySpark] PySpark CrossValidatorM...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12464#issuecomment-215398785 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14576] [Web UI] Spark console should di...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12341#issuecomment-215393510 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14576] [Web UI] Spark console should di...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12341#issuecomment-215393512 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14576] [Web UI] Spark console should di...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12341#issuecomment-215393363 **[Test build #57240 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57240/consoleFull)** for PR 12341 at commit [`ac02b51`](https://g

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215392196 **[Test build #57247 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57247/consoleFull)** for PR 12718 at commit [`9ef9a51`](https://gi

[GitHub] spark pull request: [SPARK-7424] [ML] ML ClassificationModel shoul...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12066#issuecomment-215389944 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-7424] [ML] ML ClassificationModel shoul...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12066#issuecomment-215389945 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-7424] [ML] ML ClassificationModel shoul...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12066#issuecomment-215389914 **[Test build #57244 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57244/consoleFull)** for PR 12066 at commit [`d5c5689`](https://g

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215389458 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215389461 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215389452 **[Test build #57246 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57246/consoleFull)** for PR 12718 at commit [`8863991`](https://g

[GitHub] spark pull request: [SPARK-7424] [ML] ML ClassificationModel shoul...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12066#issuecomment-215388708 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-7424] [ML] ML ClassificationModel shoul...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12066#issuecomment-215388671 **[Test build #57243 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57243/consoleFull)** for PR 12066 at commit [`d4ffc6a`](https://g

[GitHub] spark pull request: [SPARK-7424] [ML] ML ClassificationModel shoul...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12066#issuecomment-215388707 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215388583 **[Test build #57246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57246/consoleFull)** for PR 12718 at commit [`8863991`](https://gi

[GitHub] spark pull request: [SPARK-3767] [CORE] Support wildcard in Spark ...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12753#issuecomment-215386512 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-3767] [CORE] Support wildcard in Spark ...

2016-04-28 Thread devaraj-kavali
GitHub user devaraj-kavali opened a pull request: https://github.com/apache/spark/pull/12753 [SPARK-3767] [CORE] Support wildcard in Spark properties ## What changes were proposed in this pull request? Added provision to specify the 'spark.executor.extraJavaOptions' value in

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215386110 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215386113 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215385743 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215385781 **[Test build #57239 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57239/consoleFull)** for PR 12640 at commit [`f6964f9`](https://g

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215385737 **[Test build #57245 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57245/consoleFull)** for PR 12718 at commit [`df5e917`](https://g

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215385742 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215385539 **[Test build #57245 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57245/consoleFull)** for PR 12718 at commit [`df5e917`](https://gi

[GitHub] spark pull request: [SPARK-7424] [ML] ML ClassificationModel shoul...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12066#issuecomment-215379968 **[Test build #57244 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57244/consoleFull)** for PR 12066 at commit [`d5c5689`](https://gi

[GitHub] spark pull request: [SPARK-7424] [ML] ML ClassificationModel shoul...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12066#issuecomment-215379043 **[Test build #57243 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57243/consoleFull)** for PR 12066 at commit [`d4ffc6a`](https://gi

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215374433 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215374404 **[Test build #57241 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57241/consoleFull)** for PR 12640 at commit [`d445022`](https://g

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215374427 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14487][SQL] User Defined Type registrat...

2016-04-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12259#discussion_r61401723 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/UDTRegistration.scala --- @@ -0,0 +1,133 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215372214 **[Test build #57241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57241/consoleFull)** for PR 12640 at commit [`d445022`](https://gi

[GitHub] spark pull request: [SPARK-14521][SQL]StackOverflowError in Kryo w...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12598#issuecomment-215372240 **[Test build #57242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57242/consoleFull)** for PR 12598 at commit [`72785fe`](https://gi

[GitHub] spark pull request: [SPARK-14521][SQL]StackOverflowError in Kryo w...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12598#issuecomment-215371295 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215370955 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215370951 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215370706 **[Test build #57237 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57237/consoleFull)** for PR 12640 at commit [`a7b7694`](https://g

[GitHub] spark pull request: [SPARK-14914] Normalize Paths/URIs for windows...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12695#issuecomment-215369309 Isn't the URI just `file:///D:/test`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12640#discussion_r61399541 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/linalg/UDTSerializationBenchmark.scala --- @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache S

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215367423 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215367301 **[Test build #57238 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57238/consoleFull)** for PR 12718 at commit [`9584026`](https://g

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215367425 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14576] [Web UI] Spark console should di...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12341#issuecomment-215366802 **[Test build #57240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57240/consoleFull)** for PR 12341 at commit [`ac02b51`](https://gi

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215366426 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215366419 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215366183 **[Test build #57233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57233/consoleFull)** for PR 12746 at commit [`e61aa8a`](https://g

[GitHub] spark pull request: [SPARK-14098][SQL] Generate Java code that get...

2016-04-28 Thread kiszk
Github user kiszk commented on the pull request: https://github.com/apache/spark/pull/11956#issuecomment-215365815 ping @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request: [SPARK-13973][PYSPARK] Make pyspark fail noisi...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12528#issuecomment-215365706 Thanks @shearerp but can you also very briefly mention how to invoke `jupyter` in the programming guide? just a sentence would suffice, so that people are clear this is

[GitHub] spark pull request: [SPARK-14576] [Web UI] Spark console should di...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12341#issuecomment-215365299 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12752#discussion_r61397728 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala --- @@ -195,10 +195,13 @@ class FileInputDStream[K, V, F <: NewI

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12640#discussion_r61397517 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/linalg/UDTSerializationBenchmark.scala --- @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache S

[GitHub] spark pull request: [SPARK-14969][MLLib] Remove duplicate implemen...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12747#issuecomment-215363871 You can also remove the one in `ANNGradient` right? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215363656 **[Test build #57239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57239/consoleFull)** for PR 12640 at commit [`f6964f9`](https://gi

[GitHub] spark pull request: [SPARK-14661] [MLlib] trim PCAModel by require...

2016-04-28 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12419#discussion_r61395945 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/RowMatrix.scala --- @@ -379,15 +379,21 @@ class RowMatrix @Since("1.0.0") (

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-215359267 If the base change is just bringing the `PMMLExportable` trait to ML in a reasonable form, that seems fine. I might not know enough to know if I'm missing something, but

[GitHub] spark pull request: [SPARK-14511][Build] Upgrade genjavadoc to lat...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12707#issuecomment-215357914 Yeah, the problem is that Java 8 has a much stricter javadoc tool. `@group` isn't a valid javadoc tag, so when `ALSModel.scala` gets translated to Java to javadoc it, it

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215357553 **[Test build #57238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57238/consoleFull)** for PR 12718 at commit [`9584026`](https://gi

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12752#issuecomment-215357222 **[Test build #57236 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57236/consoleFull)** for PR 12752 at commit [`ba8d1e5`](https://g

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12752#issuecomment-215357266 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12752#issuecomment-215357267 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61393700 --- Diff: python/pyspark/ml/tests.py --- @@ -929,6 +932,50 @@ def test_apply_binary_term_freqs(self): ": expected " + s

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215355549 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215355548 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215355402 **[Test build #57235 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57235/consoleFull)** for PR 12718 at commit [`530f037`](https://g

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215355291 **[Test build #57237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57237/consoleFull)** for PR 12640 at commit [`a7b7694`](https://gi

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61392731 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite assert(getFactors(model.user

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61392206 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite assert(getFactors(model.user

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61391861 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite assert(getFactors(model.user

[GitHub] spark pull request: SPARK-11402: Use ChildRunnerProvider to create...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9354#issuecomment-215353152 Yes, this PR should be closed. Per discussion in the JIRA, this just is too much SPI to open up for not obvious gain. There may be much more modest refactorings that coul

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215352568 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215352565 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215352327 **[Test build #57230 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57230/consoleFull)** for PR 12640 at commit [`f4d2cbb`](https://g

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61391277 --- Diff: python/pyspark/ml/tests.py --- @@ -929,6 +932,50 @@ def test_apply_binary_term_freqs(self): ": expected " + s

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61391177 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite assert(getFactors(model.user

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61391003 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite assert(getFactors(model.user

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61391033 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite assert(getFactors(model.user

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12660#discussion_r61390984 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -512,6 +514,55 @@ class ALSSuite assert(getFactors(model.user

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12752#issuecomment-215350745 **[Test build #57236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57236/consoleFull)** for PR 12752 at commit [`ba8d1e5`](https://gi

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread mwws
Github user mwws commented on the pull request: https://github.com/apache/spark/pull/12752#issuecomment-215350461 @chenghao-intel --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [Spark-14976][Streaming] make StreamingContext...

2016-04-28 Thread mwws
GitHub user mwws opened a pull request: https://github.com/apache/spark/pull/12752 [Spark-14976][Streaming] make StreamingContext.textFileStream support wildcard ## What changes were proposed in this pull request? make StreamingContext.textFileStream support wildcard like /h

[GitHub] spark pull request: [SPARK-14412][ML][PYSPARK] Add StorageLevel pa...

2016-04-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12660#issuecomment-215350491 If it's just porting old API params to the new API, seems sensible. The implementation looks sensible to me. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12640#discussion_r61389927 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -336,4 +336,62 @@ public UnsafeArrayData copy()

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12640#discussion_r61389700 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -336,4 +336,62 @@ public UnsafeArrayData copy()

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215347510 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215347507 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14945][PYTHON] SparkSession Python API

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12746#issuecomment-215347337 **[Test build #57234 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57234/consoleFull)** for PR 12746 at commit [`e61aa8a`](https://g

[GitHub] spark pull request: [SPARK-14487][SQL] User Defined Type registrat...

2016-04-28 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/12259#issuecomment-215346566 @mengxr @dbtsai Thanks for reviewing this! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14487][SQL] User Defined Type registrat...

2016-04-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12259 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-14487][SQL] User Defined Type registrat...

2016-04-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/12259#issuecomment-215345283 Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-14938][ML] replace some RDD.map with Da...

2016-04-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12718#issuecomment-215344251 **[Test build #57235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57235/consoleFull)** for PR 12718 at commit [`530f037`](https://gi

[GitHub] spark pull request: [SPARK-14850][ML] convert primitive array from...

2016-04-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/12640#issuecomment-215343973 @cloud-fan Could you also update the benchmark? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-12660] [SPARK-14967] [SQL] Implement Ex...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12736#issuecomment-215342856 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12660] [SPARK-14967] [SQL] Implement Ex...

2016-04-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12736#issuecomment-215342854 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

<    3   4   5   6   7   8   9   >