[GitHub] spark pull request: [SPARK-5097][WIP] DataFrame as the common abst...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4173#issuecomment-71604079 [Test build #26150 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26150/consoleFull) for PR 4173 at commit [`16934ee`](https://githu

[GitHub] spark pull request: [SPARK-5419][Mllib] Fix the logic in Vectors.s...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4217#issuecomment-71604007 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5419][Mllib] Fix the logic in Vectors.s...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4217#issuecomment-71604002 [Test build #26147 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26147/consoleFull) for PR 4217 at commit [`e8b0b3d`](https://gith

[GitHub] spark pull request: [SPARK-5419][Mllib] Fix the logic in Vectors.s...

2015-01-26 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/4217#issuecomment-71603219 LGTM pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3732#issuecomment-71602934 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3732#issuecomment-71602931 [Test build #26146 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26146/consoleFull) for PR 3732 at commit [`d6715fc`](https://gith

[GitHub] spark pull request: SPARK-5393. Flood of util.RackResolver log mes...

2015-01-26 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/4192#discussion_r23591435 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -60,6 +62,9 @@ private[yarn] class YarnAllocator( import Yarn

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23591427 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/linalg/MatricesSuite.scala --- @@ -212,6 +284,17 @@ class MatricesSuite extends FunSuite { asser

[GitHub] spark pull request: [SPARK-5097][WIP] DataFrame as the common abst...

2015-01-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4173#discussion_r23591326 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -0,0 +1,598 @@ +/* +* Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: SPARK-4687. [WIP] Add an addDirectory API

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3670#issuecomment-71601199 [Test build #26149 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26149/consoleFull) for PR 3670 at commit [`9899623`](https://githu

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3732#issuecomment-71601166 [Test build #26148 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26148/consoleFull) for PR 3732 at commit [`024c9a6`](https://githu

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-01-26 Thread adrian-wang
Github user adrian-wang commented on the pull request: https://github.com/apache/spark/pull/3732#issuecomment-71600826 cc @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request: [SPARK-5052] Add common/base classes to fix gu...

2015-01-26 Thread elmer-garduno
Github user elmer-garduno commented on the pull request: https://github.com/apache/spark/pull/3874#issuecomment-71600458 Thanks for merging! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [SPARK-5097][WIP] DataFrame as the common abst...

2015-01-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4173#discussion_r23590914 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -0,0 +1,598 @@ +/* +* Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: [SPARK-5097][WIP] DataFrame as the common abst...

2015-01-26 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/4173#discussion_r23590711 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -0,0 +1,598 @@ +/* +* Licensed to the Apache Software Foundation (ASF) und

[GitHub] spark pull request: [WIP][SPARK-4251][SPARK-2352][MLLIB]Add RBM, A...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3222#issuecomment-71599365 [Test build #26145 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26145/consoleFull) for PR 3222 at commit [`612c7bd`](https://gith

[GitHub] spark pull request: [WIP][SPARK-4251][SPARK-2352][MLLIB]Add RBM, A...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3222#issuecomment-71599372 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5419][Mllib] Fix the logic in Vectors.s...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4217#issuecomment-71597558 [Test build #26147 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26147/consoleFull) for PR 4217 at commit [`e8b0b3d`](https://githu

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589919 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/linalg/MatricesSuite.scala --- @@ -212,6 +284,17 @@ class MatricesSuite extends FunSuite { asser

[GitHub] spark pull request: [SPARK-5419][Mllib] Fix the logic in Vectors.s...

2015-01-26 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/4217#issuecomment-71597388 New commit is added for the comments. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3732#issuecomment-71597172 [Test build #26146 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26146/consoleFull) for PR 3732 at commit [`d6715fc`](https://githu

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589813 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -92,6 +87,15 @@ sealed trait Matrix extends Serializable { * backin

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589803 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/linalg/MatricesSuite.scala --- @@ -161,6 +161,68 @@ class MatricesSuite extends FunSuite { asser

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589796 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -341,6 +430,37 @@ class SparseMatrix( this } + ov

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589806 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/linalg/MatricesSuite.scala --- @@ -161,6 +161,68 @@ class MatricesSuite extends FunSuite { asser

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589789 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -281,31 +344,53 @@ class SparseMatrix( require(values.length ==

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589792 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -341,6 +430,37 @@ class SparseMatrix( this } + ov

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589798 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -341,6 +430,37 @@ class SparseMatrix( this } + ov

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589785 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -114,7 +118,24 @@ class DenseMatrix(val numRows: Int, val numCols: Int, val

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589805 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/linalg/MatricesSuite.scala --- @@ -161,6 +161,68 @@ class MatricesSuite extends FunSuite { asser

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589782 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -52,10 +58,13 @@ sealed trait Matrix extends Serializable { /** Get a

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589786 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -148,6 +178,40 @@ class DenseMatrix(val numRows: Int, val numCols: Int, val

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589775 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/BLAS.scala --- @@ -257,30 +257,30 @@ private[spark] object BLAS extends Serializable with Logging

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589776 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/BLAS.scala --- @@ -257,30 +257,30 @@ private[spark] object BLAS extends Serializable with Logging

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23589781 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -34,6 +34,12 @@ sealed trait Matrix extends Serializable { /** Number

[GitHub] spark pull request: [SPARK-5264][SQL] support `drop table` DDL com...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4060#issuecomment-71596700 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5264][SQL] support `drop table` DDL com...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4060#issuecomment-71596695 [Test build #26144 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26144/consoleFull) for PR 4060 at commit [`dc1c9a0`](https://gith

[GitHub] spark pull request: [SPARK-5264][SQL] support `drop table` DDL com...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4060#issuecomment-71596340 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5264][SQL] support `drop table` DDL com...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4060#issuecomment-71596334 [Test build #26143 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26143/consoleFull) for PR 4060 at commit [`1e47f8a`](https://gith

[GitHub] spark pull request: [SPARK-5259][CORE]Make sure mapStage.pendingta...

2015-01-26 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/4055#discussion_r23589395 --- Diff: core/src/main/scala/org/apache/spark/scheduler/Task.scala --- @@ -106,7 +106,21 @@ private[spark] abstract class Task[T](val stageId: Int, var par

[GitHub] spark pull request: [SPARK-5259][CORE]Make sure mapStage.pendingta...

2015-01-26 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/4055#discussion_r23589410 --- Diff: core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala --- @@ -540,6 +540,52 @@ class DAGSchedulerSuite extends TestKit(ActorSyst

[GitHub] spark pull request: [SPARK-5259][CORE]Make sure mapStage.pendingta...

2015-01-26 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/4055#discussion_r23589337 --- Diff: core/src/main/scala/org/apache/spark/scheduler/ResultTask.scala --- @@ -65,4 +65,6 @@ private[spark] class ResultTask[T, U]( override def p

[GitHub] spark pull request: [SPARK-3974][MLlib] Distributed Block Matrix A...

2015-01-26 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/3200#discussion_r23589329 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/BlockMatrix.scala --- @@ -0,0 +1,242 @@ +/* + * Licensed to the Apache Softwa

[GitHub] spark pull request: [WIP][SPARK-4251][SPARK-2352][MLLIB]Add RBM, A...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3222#issuecomment-71594155 [Test build #26145 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26145/consoleFull) for PR 3222 at commit [`612c7bd`](https://githu

[GitHub] spark pull request: SPARK-4337. [YARN] Add ability to cancel pendi...

2015-01-26 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4141#issuecomment-71593861 @lianhuiwang I am not sure I can comment on this PR. I am unfamiliar with this piece of code. --- If your project is set up for it, you can reply to this email and have yo

[GitHub] spark pull request: [SPARK-5264][SQL] support `drop table` DDL com...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4060#issuecomment-71593801 [Test build #26144 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26144/consoleFull) for PR 4060 at commit [`dc1c9a0`](https://githu

[GitHub] spark pull request: [SPARK-5264][SQL] support `drop table` DDL com...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4060#issuecomment-71593453 [Test build #26143 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26143/consoleFull) for PR 4060 at commit [`1e47f8a`](https://githu

[GitHub] spark pull request: [SPARK-5414] Add SparkFirehoseListener class f...

2015-01-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4210#discussion_r23587232 --- Diff: core/src/main/java/org/apache/spark/SparkFirehoseListener.java --- @@ -0,0 +1,114 @@ +/* + * Licensed to the Apache Software Foundation (ASF) un

[GitHub] spark pull request: [SPARK-3298][SQL] Add flag control overwrite r...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4175#issuecomment-71589586 [Test build #26141 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26141/consoleFull) for PR 4175 at commit [`26c6011`](https://gith

[GitHub] spark pull request: [SPARK-3298][SQL] Add flag control overwrite r...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4175#issuecomment-71589589 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5384][mllib] Vectors.sqdist returns inc...

2015-01-26 Thread hhbyyh
Github user hhbyyh commented on the pull request: https://github.com/apache/spark/pull/4183#issuecomment-71589499 Thanks @mengxr . I saw a PR from @viirya for the issue which seems is good enough for now. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-5422] Add support for sending Graphite ...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4218#issuecomment-71589336 [Test build #26142 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26142/consoleFull) for PR 4218 at commit [`ebae393`](https://gith

[GitHub] spark pull request: [SPARK-5422] Add support for sending Graphite ...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4218#issuecomment-71589339 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-26 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-71588806 @tdas pinged me saying this needs more consensus on design before commenting on details so I will stop :) Anyway, I pointed out a few ways that hopefully can make this PR si

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23586770 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaRDD.scala --- @@ -0,0 +1,199 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23586739 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaRDD.scala --- @@ -0,0 +1,199 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23586712 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaRDD.scala --- @@ -0,0 +1,199 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23586726 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaRDD.scala --- @@ -0,0 +1,199 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23586631 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala --- @@ -0,0 +1,313 @@ +/* + * Licensed to the Apache Software Found

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23586598 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala --- @@ -0,0 +1,313 @@ +/* + * Licensed to the Apache Software Found

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23586515 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala --- @@ -0,0 +1,318 @@ +/* + * Licensed to the Apache Software Found

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23586464 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala --- @@ -0,0 +1,318 @@ +/* + * Licensed to the Apache Software Found

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4109#issuecomment-71587461 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4109#issuecomment-71587457 [Test build #26140 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26140/consoleFull) for PR 4109 at commit [`c524770`](https://gith

[GitHub] spark pull request: [SPARK-5419][Mllib] Fix the logic in Vectors.s...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4217#issuecomment-71586983 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5419][Mllib] Fix the logic in Vectors.s...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4217#issuecomment-71586980 [Test build #26139 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26139/consoleFull) for PR 4217 at commit [`314c424`](https://gith

[GitHub] spark pull request: [SPARK-5419][Mllib] Fix the logic in Vectors.s...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4217#discussion_r23585795 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Vectors.scala --- @@ -371,17 +371,19 @@ object Vectors { squaredDistance += score *

[GitHub] spark pull request: [SPARK-5419][Mllib] Fix the logic in Vectors.s...

2015-01-26 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4217#discussion_r23585794 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Vectors.scala --- @@ -371,17 +371,19 @@ object Vectors { squaredDistance += score *

[GitHub] spark pull request: [SPARK-3726] [MLlib] Allow sampling_rate not e...

2015-01-26 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/4073#issuecomment-71585503 Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-3726] [MLlib] Allow sampling_rate not e...

2015-01-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4073 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-5422] Add support for sending Graphite ...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4218#issuecomment-71584864 [Test build #26142 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26142/consoleFull) for PR 4218 at commit [`ebae393`](https://githu

[GitHub] spark pull request: [SPARK-5422] Add support for sending Graphite ...

2015-01-26 Thread ryan-williams
GitHub user ryan-williams opened a pull request: https://github.com/apache/spark/pull/4218 [SPARK-5422] Add support for sending Graphite metrics via UDP Depends on [SPARK-5413](https://issues.apache.org/jira/browse/SPARK-5413) / #4209, included here, will rebase once the latter's me

[GitHub] spark pull request: [SPARK-3726] [MLlib] Allow sampling_rate not e...

2015-01-26 Thread MechCoder
Github user MechCoder commented on the pull request: https://github.com/apache/spark/pull/4073#issuecomment-71584396 @mengxr This can also be viewd as a bugfix which prevents overwriting of the param `subSamplingRate`, which was hardcoded to 1.0 --- If your project is set up for it,

[GitHub] spark pull request: [WIP][SPARK-5388] Provide a stable application...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4216#issuecomment-71583774 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [WIP][SPARK-5388] Provide a stable application...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4216#issuecomment-71583770 [Test build #26138 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26138/consoleFull) for PR 4216 at commit [`6568ca5`](https://gith

[GitHub] spark pull request: [SPARK-4786][SQL]: Parquet filter pushdown for...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4156#issuecomment-71583576 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-3298][SQL] Add flag control overwrite r...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4175#issuecomment-71583562 [Test build #26141 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26141/consoleFull) for PR 4175 at commit [`26c6011`](https://githu

[GitHub] spark pull request: [SPARK-4786][SQL]: Parquet filter pushdown for...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4156#issuecomment-71583569 [Test build #26137 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26137/consoleFull) for PR 4156 at commit [`a403979`](https://gith

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4109#issuecomment-71582792 [Test build #26140 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26140/consoleFull) for PR 4109 at commit [`c524770`](https://githu

[GitHub] spark pull request: [SPARK-5419][Mllib] Fix the logic in Vectors.s...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4217#issuecomment-71582448 [Test build #26139 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26139/consoleFull) for PR 4217 at commit [`314c424`](https://githu

[GitHub] spark pull request: [SPARK-5419][Mllib] Fix the logic in Vectors.s...

2015-01-26 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/4217 [SPARK-5419][Mllib] Fix the logic in Vectors.sqdist The current implementation in Vectors.sqdist is not efficient because of allocating temp arrays. There is also a bug in the code `v1.indices.length

[GitHub] spark pull request: [WIP][SPARK-5341] Use maven coordinates as dep...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4215#issuecomment-71582038 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [WIP][SPARK-5341] Use maven coordinates as dep...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4215#issuecomment-71582029 [Test build #26135 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26135/consoleFull) for PR 4215 at commit [`6645af4`](https://gith

[GitHub] spark pull request: [WIP][SPARK-5341] Use maven coordinates as dep...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4215#issuecomment-71581842 [Test build #26136 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26136/consoleFull) for PR 4215 at commit [`a0870af`](https://gith

[GitHub] spark pull request: [WIP][SPARK-5341] Use maven coordinates as dep...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4215#issuecomment-71581847 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-4955]With executor dynamic scaling enab...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3962#issuecomment-71581696 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-4955]With executor dynamic scaling enab...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3962#issuecomment-71581689 [Test build #26134 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26134/consoleFull) for PR 3962 at commit [`48d9ebb`](https://gith

[GitHub] spark pull request: [SPARK-5321] Support for transposing local mat...

2015-01-26 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/4109#discussion_r23583664 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -34,6 +34,9 @@ sealed trait Matrix extends Serializable { /** Number

[GitHub] spark pull request: [SPARK-5417] Remove redundant executor-id set(...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4213#issuecomment-71580340 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5417] Remove redundant executor-id set(...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4213#issuecomment-71580332 [Test build #26132 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26132/consoleFull) for PR 4213 at commit [`b3e4f7b`](https://gith

[GitHub] spark pull request: [SPARK-5416] init Executor.threadPool before E...

2015-01-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4212#issuecomment-71579938 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5416] init Executor.threadPool before E...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4212#issuecomment-71579925 [Test build #26131 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26131/consoleFull) for PR 4212 at commit [`236f2ad`](https://gith

[GitHub] spark pull request: [WIP][SPARK-5388] Provide a stable application...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4216#issuecomment-71579669 [Test build #26138 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26138/consoleFull) for PR 4216 at commit [`6568ca5`](https://githu

[GitHub] spark pull request: [WIP][SPARK-5388] Provide a stable application...

2015-01-26 Thread andrewor14
GitHub user andrewor14 opened a pull request: https://github.com/apache/spark/pull/4216 [WIP][SPARK-5388] Provide a stable application submission gateway The goal is to provide a stable application submission gateway that is not inherently based on Akka, which is unstable across ver

[GitHub] spark pull request: [SPARK-5259][CORE]Make sure mapStage.pendingta...

2015-01-26 Thread suyanNone
Github user suyanNone commented on the pull request: https://github.com/apache/spark/pull/4055#issuecomment-71579227 @cloud-fan ZhangLei, SunHongLiang, HanLi, ChenXingYu, blabla...I am ZhangLei's classmate in ZJU. --- If your project is set up for it, you can reply to this email an

[GitHub] spark pull request: [SPARK-5384][mllib] Vectors.sqdist returns inc...

2015-01-26 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/4183#issuecomment-71579048 @hhbyyh Great. I created a JIRA for this issue and assigned it to you: https://issues.apache.org/jira/browse/SPARK-5419 Thanks!! --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-4786][SQL]: Parquet filter pushdown for...

2015-01-26 Thread saucam
Github user saucam commented on the pull request: https://github.com/apache/spark/pull/4156#issuecomment-71578360 fixed the styling issues. @liancheng thanks for the feedback! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as wel

[GitHub] spark pull request: [SPARK-4786][SQL]: Parquet filter pushdown for...

2015-01-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4156#issuecomment-71578336 [Test build #26137 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26137/consoleFull) for PR 4156 at commit [`a403979`](https://githu

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-26 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-71577982 @koeninger I doubt that we want to go this route in this case, but just in case you're interested, I think a much better way to handle multiple errors gracefully is wi

[GitHub] spark pull request: [SPARK-3298][SQL] Add flag control overwrite r...

2015-01-26 Thread OopsOutOfMemory
Github user OopsOutOfMemory commented on the pull request: https://github.com/apache/spark/pull/4175#issuecomment-71577816 Thanks, squito :) I'm working on this issue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

  1   2   3   4   5   6   >