[GitHub] spark pull request: [MESOS][SPARK-8873] Clean up external shuffle ...

2015-08-01 Thread tnachen
Github user tnachen commented on a diff in the pull request: https://github.com/apache/spark/pull/7820#discussion_r36040223 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -261,7 +269,27 @@ private[spark] class Coarse

[GitHub] spark pull request: [SPARK-9404][SQL] unsafe array data

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7752#issuecomment-126995402 [Test build #39410 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39410/consoleFull) for PR 7752 at commit [`d56708e`](https://gith

[GitHub] spark pull request: [SPARK-9404][SQL] unsafe array data

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7752#issuecomment-126995349 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-9526][SQL][WIP] Utilize randomized test...

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7855#issuecomment-126995347 [Test build #39409 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39409/consoleFull) for PR 7855 at commit [`e3bbe4c`](https://gith

[GitHub] spark pull request: [SPARK-9404][SQL] unsafe array data

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7752#issuecomment-126995355 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-9526][SQL][WIP] Utilize randomized test...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7855#issuecomment-126995242 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9526][SQL][WIP] Utilize randomized test...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7855#issuecomment-126995240 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9529] [SQL] improve TungstenSort on Dec...

2015-08-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7857 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-9529] [SQL] improve TungstenSort on Dec...

2015-08-01 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7857#issuecomment-126994958 LGTM. Merging. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request: [SPARK-9529] [SQL] improve TungstenSort on Dec...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7857#issuecomment-126994895 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9529] [SQL] improve TungstenSort on Dec...

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7857#issuecomment-126994885 [Test build #39404 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39404/console) for PR 7857 at commit [`2433959`](https://github.

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7860#issuecomment-126994001 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9404][SQL] unsafe array data

2015-08-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7752#discussion_r36039963 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -0,0 +1,354 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-9000][MLlib] Support generic item types...

2015-08-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7837 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-9000][MLlib]Support generic item type i...

2015-08-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7400 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-9000][MLlib] Support generic item types...

2015-08-01 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/7837#issuecomment-126993421 Okay. Let's merge this first. I will submit a PR for `PrefixSpanModel`. --- If your project is set up for it, you can reply to this email and have your reply appear on Gi

[GitHub] spark pull request: [SPARK-9404][SQL] unsafe array data

2015-08-01 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/7752#discussion_r36039953 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -0,0 +1,354 @@ +/* + * Licensed to the Apac

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7860#issuecomment-126993196 [Test build #39408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39408/consoleFull) for PR 7860 at commit [`599317c`](https://gith

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/7774#issuecomment-126993170 @zsxwing This looks great. One high level question: why are there so few dataframe operations with `withNewExecutionId`? Are you wrapping only those that will trigger

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7860#issuecomment-126993151 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7860#issuecomment-126993156 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039912 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ui/SQLSparkListener.scala --- @@ -0,0 +1,281 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039908 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ui/SQLSparkListener.scala --- @@ -0,0 +1,281 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7860#issuecomment-126993039 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7860#issuecomment-126993034 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039885 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ui/SQLSparkListener.scala --- @@ -0,0 +1,281 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039880 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ui/SQLSparkListener.scala --- @@ -0,0 +1,281 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039851 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ui/AllExecutionsPage.scala --- @@ -0,0 +1,230 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/7860#discussion_r36039849 --- Diff: core/src/test/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorterSuite.java --- @@ -82,6 +82,8 @@ public int compare(

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/7860#discussion_r36039846 --- Diff: core/src/test/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorterSuite.java --- @@ -82,6 +82,8 @@ public int compare(

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039842 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoin.scala --- @@ -58,13 +58,26 @@ case class BroadcastHashJoin(

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039834 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSQLExecution.scala --- @@ -0,0 +1,84 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039831 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSQLExecution.scala --- @@ -0,0 +1,84 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039811 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashOuterJoin.scala --- @@ -57,13 +57,26 @@ case class BroadcastHashOuterJoin(

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039774 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ui/SQLSparkListener.scala --- @@ -0,0 +1,281 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039772 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ui/SQLSparkListener.scala --- @@ -0,0 +1,281 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039764 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ui/ExecutionPage.scala --- @@ -0,0 +1,154 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039762 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSQLExecution.scala --- @@ -0,0 +1,84 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039755 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashOuterJoin.scala --- @@ -57,13 +57,26 @@ case class BroadcastHashOuterJ

[GitHub] spark pull request: SPARK-8064, build against Hive 1.2.1

2015-08-01 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/7191#issuecomment-126992068 I'm looking into the failures caused by Parquet dependency. Hive shades Parquet classes into its own private namespace. I think we miss a shading somewhere in the upda

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039742 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSQLExecution.scala --- @@ -0,0 +1,84 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039730 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoin.scala --- @@ -58,13 +58,26 @@ case class BroadcastHashJoin(

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039711 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/LocalTableScan.scala --- @@ -34,9 +34,16 @@ private[sql] case class LocalTableScan(

[GitHub] spark pull request: [SPARK-8231][SQL] Add array_contains

2015-08-01 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/7580#discussion_r36039702 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -35,3 +37,62 @@ case class Size(child: Expre

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7279#issuecomment-126989862 [Test build #39406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39406/consoleFull) for PR 7279 at commit [`3be5aea`](https://gith

[GitHub] spark pull request: [SPARK-8231][SQL] Add array_contains

2015-08-01 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/7580#discussion_r36039703 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -35,3 +37,62 @@ case class Size(child: Expre

[GitHub] spark pull request: [SPARK-9112] [ML] Implement Stats for Logistic...

2015-08-01 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/7538#issuecomment-126989567 Is it still called logistic regression when there's multiple classes (I've always called the multi class version softmax)? In any case, I think this pr i

[GitHub] spark pull request: [SPARK-8069][ML] add cutoff aka thresholds to ...

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7205#issuecomment-126989400 [Test build #39403 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39403/console) for PR 7205 at commit [`d5b0a2f`](https://github.

[GitHub] spark pull request: [SPARK-8069][ML] add cutoff aka thresholds to ...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7205#issuecomment-126989469 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8231][SQL] Add array_contains

2015-08-01 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/7580#discussion_r36039697 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -35,3 +37,62 @@ case class Size(child: Expre

[GitHub] spark pull request: [SPARK-8862][SPARK-8862][SQL][WIP] Add basic i...

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7774#discussion_r36039688 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala --- @@ -75,6 +76,13 @@ class SQLContext(@transient val sparkContext: SparkContext)

[GitHub] spark pull request: [SPARK-8231][SQL] Add array_contains

2015-08-01 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/7580#discussion_r36039684 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -35,3 +37,62 @@ case class Size(child: Expre

[GitHub] spark pull request: [SPARK-8231][SQL] Add array_contains

2015-08-01 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/7580#discussion_r36039682 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -35,3 +37,62 @@ case class Size(child: Expre

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/7279#discussion_r36039679 --- Diff: core/src/test/scala/org/apache/spark/rdd/LocalCheckpointSuite.scala --- @@ -0,0 +1,330 @@ +/* + * Licensed to the Apache Software Foundation (A

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7279#issuecomment-126988591 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7279#issuecomment-126988594 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/7279#issuecomment-126988580 OK, I fixed the concern with the local `doCheckpoint()`. That was a good catch. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-8231][SQL] Add array_contains

2015-08-01 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/7580#discussion_r36039664 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -35,3 +37,62 @@ case class Size(child: Expre

[GitHub] spark pull request: [SPARK-8231][SQL] Add array_contains

2015-08-01 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/7580#discussion_r36039658 --- Diff: python/pyspark/sql/functions.py --- @@ -850,6 +851,22 @@ def size(col): return Column(sc._jvm.functions.size(_to_java_column(col)))

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/7279#discussion_r36039659 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1448,33 +1468,92 @@ abstract class RDD[T: ClassTag]( /** * Mark this RDD

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7860#issuecomment-126988441 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7860#issuecomment-126988440 [Test build #39405 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39405/console) for PR 7860 at commit [`3efae38`](https://github.

[GitHub] spark pull request: [SPARK-9000][MLlib] Support generic item types...

2015-08-01 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/7837#issuecomment-126988403 @mengxr Java compatibility might require API changes since `Item` type parameter will not be inferred in Java's call to: ```scala def run[Item, Basket

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7860#issuecomment-126988407 [Test build #39405 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39405/consoleFull) for PR 7860 at commit [`3efae38`](https://gith

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7860#issuecomment-126988320 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7860#issuecomment-126988317 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7279#discussion_r36039556 --- Diff: core/src/main/scala/org/apache/spark/rdd/LocalRDDCheckpointData.scala --- @@ -0,0 +1,83 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7279#discussion_r36039531 --- Diff: core/src/test/scala/org/apache/spark/ContextCleanerSuite.scala --- @@ -52,6 +51,7 @@ abstract class ContextCleanerSuiteBase(val shuffleManager: C

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7279#discussion_r36039535 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1448,33 +1468,92 @@ abstract class RDD[T: ClassTag]( /** * Mark th

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7279#discussion_r36039523 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1448,33 +1468,92 @@ abstract class RDD[T: ClassTag]( /** * Mark th

[GitHub] spark pull request: [SPARK-9529] [SQL] improve TungstenSort on Dec...

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7857#issuecomment-126987953 [Test build #39404 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39404/consoleFull) for PR 7857 at commit [`2433959`](https://gith

[GitHub] spark pull request: [SPARK-8069][ML] add cutoff aka thresholds to ...

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7205#issuecomment-126987942 [Test build #39403 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39403/consoleFull) for PR 7205 at commit [`d5b0a2f`](https://gith

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7279#discussion_r36039515 --- Diff: core/src/test/scala/org/apache/spark/rdd/LocalCheckpointSuite.scala --- @@ -0,0 +1,330 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/7279#discussion_r36039509 --- Diff: core/src/test/scala/org/apache/spark/rdd/LocalCheckpointSuite.scala --- @@ -0,0 +1,330 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] spark pull request: [SPARK-9531][SQL] UnsafeFixedWidthAggregationM...

2015-08-01 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/7860#discussion_r36039502 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java --- @@ -66,14 +67,29 @@ private final LinkedList

[GitHub] spark pull request: [SPARK-9529] [SQL] improve TungstenSort on Dec...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7857#issuecomment-126987854 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8069][ML] add cutoff aka thresholds to ...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7205#issuecomment-126987853 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8069][ML] add cutoff aka thresholds to ...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7205#issuecomment-126987846 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9459] [SQL] use generated FromUnsafePro...

2015-08-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7840 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-9529] [SQL] improve TungstenSort on Dec...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7857#issuecomment-126987845 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9459] [SQL] use generated FromUnsafePro...

2015-08-01 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/7840#issuecomment-126987571 I'm going to merge this to unblock others (unsafe array and map). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub a

[GitHub] spark pull request: [SPARK-8185][SPARK-8188][SPARK-8191][SQL]funct...

2015-08-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7847 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-8269][SQL]string function: initcap

2015-08-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7208 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-8185][SPARK-8188][SPARK-8191][SQL]funct...

2015-08-01 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/7847#issuecomment-126987489 I'm going to merge this, if there is something we could improve, could do it later. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-8269][SQL] string function: initcap

2015-08-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7850 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-8269][SQL] string function: initcap

2015-08-01 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/7850#issuecomment-126987472 Merged into master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-9404][SQL] unsafe array data

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7752#issuecomment-126987352 [Test build #39402 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39402/console) for PR 7752 at commit [`2d6af4b`](https://github.

[GitHub] spark pull request: [SPARK-9404][SQL] unsafe array data

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7752#issuecomment-126987355 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9404][SQL] unsafe array data

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7752#issuecomment-126987305 [Test build #39402 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39402/consoleFull) for PR 7752 at commit [`2d6af4b`](https://gith

[GitHub] spark pull request: [SPARK-9092] Fixed incompatibility when both n...

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7657#issuecomment-126987284 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9092] Fixed incompatibility when both n...

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7657#issuecomment-126987279 [Test build #39397 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39397/console) for PR 7657 at commit [`7aa4a92`](https://github.

[GitHub] spark pull request: [SPARK-5895][ML] add vector slicer

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5731#issuecomment-126987226 [Test build #39401 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39401/console) for PR 5731 at commit [`ecbf2d3`](https://github.

[GitHub] spark pull request: [SPARK-5895][ML] add vector slicer

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5731#issuecomment-126987227 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9404][SQL] unsafe array data

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7752#issuecomment-126987209 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9404][SQL] unsafe array data

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7752#issuecomment-126987205 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-5895][ML] add vector slicer

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5731#issuecomment-126987192 [Test build #39401 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39401/consoleFull) for PR 5731 at commit [`ecbf2d3`](https://gith

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/7279#discussion_r36039428 --- Diff: core/src/main/scala/org/apache/spark/rdd/LocalRDDCheckpointData.scala --- @@ -0,0 +1,83 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: [SPARK-1855] Local checkpointing

2015-08-01 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/7279#issuecomment-126987159 I did a pass. And there is one critical question that is not clear to me -- how does the LocalCheckpointRDDData.doCheckpoint() work in a distributed manner. --- If your

[GitHub] spark pull request: [SPARK-8269][SQL] string function: initcap

2015-08-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7850#issuecomment-126987156 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8269][SQL] string function: initcap

2015-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7850#issuecomment-126987149 [Test build #39396 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39396/console) for PR 7850 at commit [`72aea9d`](https://github.

  1   2   3   4   5   6   7   >