[GitHub] spark pull request: WIP: re-enable flaky test to catch failure in ...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5459#issuecomment-92453291 [Test build #30173 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30173/consoleFull) for PR 5459 at commit [`2ead85b`](https://gith

[GitHub] spark pull request: WIP: re-enable flaky test to catch failure in ...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5459#issuecomment-92453329 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5236#issuecomment-92453148 [Test build #30176 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30176/consoleFull) for PR 5236 at commit [`951ca2d`](https://gith

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5236#issuecomment-92452711 [Test build #30176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30176/consoleFull) for PR 5236 at commit [`951ca2d`](https://githu

[GitHub] spark pull request: [Spark-6839] BlockManger.dataDeserialize must ...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5463#issuecomment-92452706 [Test build #30175 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30175/consoleFull) for PR 5463 at commit [`3241d66`](https://githu

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread ilganeli
Github user ilganeli commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28264329 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -35,7 +36,64 @@ import org.apache.hadoop.fs.Path import org.apache.spark.Spar

[GitHub] spark pull request: [SPARK-6879][HistoryServer]check if app is com...

2015-04-13 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/5491#issuecomment-92451595 > I can easily imagine sparks applications that running in "jobserver" mode that sit idle for a long time between active jobs. I can see that, but I wonder it a d

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread ilganeli
Github user ilganeli commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28263954 --- Diff: docs/configuration.md --- @@ -429,10 +441,10 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark pull request: [WIP][SQL][SPARK-6632]: Read schema from each ...

2015-04-13 Thread saucam
Github user saucam commented on the pull request: https://github.com/apache/spark/pull/5298#issuecomment-92450385 ok @liancheng Thanks for the comments. In the meantime let me try to address your suggestions. Can we keep this open in WIP state for now ? --- If your project is se

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread ilganeli
Github user ilganeli commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28263636 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -35,7 +36,64 @@ import org.apache.hadoop.fs.Path import org.apache.spark.Spar

[GitHub] spark pull request: [SPARK-6881][SparkR] Changes the checkpoint di...

2015-04-13 Thread hlin09
Github user hlin09 commented on a diff in the pull request: https://github.com/apache/spark/pull/5493#discussion_r28263584 --- Diff: R/pkg/inst/tests/test_rdd.R --- @@ -141,7 +141,8 @@ test_that("PipelinedRDD support actions: cache(), persist(), unpersist(), checkp unpersist

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28262452 --- Diff: docs/configuration.md --- @@ -35,8 +35,20 @@ val conf = new SparkConf() val sc = new SparkContext(conf) {% endhighlight %} -No

[GitHub] spark pull request: [SPARK-6879][HistoryServer]check if app is com...

2015-04-13 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/5491#issuecomment-92447578 @vanzin as a counterpoint -- I can easily imagine sparks applications that running in "jobserver" mode that sit idle for a long time between active jobs. Can we ju

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28262232 --- Diff: docs/configuration.md --- @@ -429,10 +441,10 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark pull request: [Spark-6839] BlockManger.dataDeserialize must ...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5463#issuecomment-92445803 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [Spark-6839] BlockManger.dataDeserialize must ...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5463#issuecomment-92445769 [Test build #30169 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30169/consoleFull) for PR 5463 at commit [`7797c69`](https://gith

[GitHub] spark pull request: [SPARK-6881][SparkR] Changes the checkpoint di...

2015-04-13 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5493#discussion_r28261741 --- Diff: R/pkg/inst/tests/test_rdd.R --- @@ -141,7 +141,8 @@ test_that("PipelinedRDD support actions: cache(), persist(), unpersist(), checkp unpersist

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28261494 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -35,7 +36,64 @@ import org.apache.hadoop.fs.Path import org.apache.spark.Sp

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28261526 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -35,7 +36,64 @@ import org.apache.hadoop.fs.Path import org.apache.spark.Sp

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28261462 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -35,7 +36,64 @@ import org.apache.hadoop.fs.Path import org.apache.spark.Sp

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28261343 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -174,6 +174,35 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with Logging {

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28261212 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -1011,6 +1013,22 @@ private[spark] object Utils extends Logging { }

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28261106 --- Diff: core/src/main/scala/org/apache/spark/util/AkkaUtils.scala --- @@ -78,8 +78,10 @@ private[spark] object AkkaUtils extends Logging {

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28260990 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -848,16 +848,14 @@ private[spark] class TaskSetManager( }

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28260825 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -174,6 +174,35 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with Loggi

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28260637 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -174,6 +174,35 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with Loggi

[GitHub] spark pull request: [SPARK-6881][SparkR] Changes the checkpoint di...

2015-04-13 Thread hlin09
Github user hlin09 commented on a diff in the pull request: https://github.com/apache/spark/pull/5493#discussion_r28260573 --- Diff: R/pkg/inst/tests/test_rdd.R --- @@ -141,7 +141,7 @@ test_that("PipelinedRDD support actions: cache(), persist(), unpersist(), checkp unpersist

[GitHub] spark pull request: [SPARK-6352] [SQL] Add DirectParquetOutputComm...

2015-04-13 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/5042#issuecomment-92442370 Actually, on giving this a closer look I'm not sure whether this faithfully respects all of the possible Parquet configurations for controlling OutputCommitter behavior

[GitHub] spark pull request: [SPARK-6662][YARN] Allow variable substitution...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5321#issuecomment-92441280 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6352] [SQL] Add DirectParquetOutputComm...

2015-04-13 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/5042#issuecomment-92441217 We can't change this now, but note that the commit message / PR description here is slightly out of date w.r.t. the actual changes being committed, since we now use the

[GitHub] spark pull request: [SPARK-6662][YARN] Allow variable substitution...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5321#issuecomment-92441261 [Test build #30171 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30171/consoleFull) for PR 5321 at commit [`e37de75`](https://gith

[GitHub] spark pull request: [SPARK-2691][Mesos] Support for Mesos DockerIn...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3074#issuecomment-92441238 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-2691][Mesos] Support for Mesos DockerIn...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3074#issuecomment-92441223 [Test build #30170 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30170/consoleFull) for PR 3074 at commit [`d8ed2b6`](https://gith

[GitHub] spark pull request: [SPARK-6879][HistoryServer]check if app is com...

2015-04-13 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/5491#issuecomment-92437781 Question: did you actually run into this problem or is this theoretical? Because I'd expect a live application to be updating the event log, in which case its modi

[GitHub] spark pull request: [SPARK-6229] Add SASL encryption to network li...

2015-04-13 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/5377#issuecomment-92436434 I'm definitely not an expert on this, but the code seemed OK to me. My only concern -- is it possible to add a test that ensures data is actually getting encrypting? Oth

[GitHub] spark pull request: [SPARK-6796][Streaming][WebUI] Add "Active Bat...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5434#issuecomment-92428758 [Test build #30174 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30174/consoleFull) for PR 5434 at commit [`be50fc6`](https://githu

[GitHub] spark pull request: [CORE] SPARK-6880: Fixed null check when all t...

2015-04-13 Thread pankajarora12
Github user pankajarora12 commented on a diff in the pull request: https://github.com/apache/spark/pull/5494#discussion_r28257067 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -818,13 +818,12 @@ class DAGScheduler( } }

[GitHub] spark pull request: WIP: re-enable flaky test to catch failure in ...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5459#issuecomment-92425507 [Test build #30173 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30173/consoleFull) for PR 5459 at commit [`2ead85b`](https://githu

[GitHub] spark pull request: [CORE] SPARK-6880: Fixed null check when all t...

2015-04-13 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5494#discussion_r28256591 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -818,13 +818,12 @@ class DAGScheduler( } } -

[GitHub] spark pull request: WIP: re-enable flaky test to catch failure in ...

2015-04-13 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/5459#issuecomment-92424828 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6796][Streaming][WebUI] Add "Active Bat...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5434#issuecomment-92423907 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6796][Streaming][WebUI] Add "Active Bat...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5434#issuecomment-92423905 [Test build #30172 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30172/consoleFull) for PR 5434 at commit [`51b792e`](https://gith

[GitHub] spark pull request: [SPARK-6796][Streaming][WebUI] Add "Active Bat...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5434#issuecomment-92423613 [Test build #30172 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30172/consoleFull) for PR 5434 at commit [`51b792e`](https://githu

[GitHub] spark pull request: [SPARK-6796][Streaming][WebUI] Add "Active Bat...

2015-04-13 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/5434#issuecomment-92423211 @tdas I fixed as per your suggestion. I also made "startTime" more readable. Here is the new screenshot: ![streaming](https://cloud.githubusercontent.com/assets/

[GitHub] spark pull request: [CORE] SPARK-6880: Fixed null check when all t...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5494#issuecomment-92422400 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [CORE] SPARK-6880: Fixed null check when all t...

2015-04-13 Thread pankajarora12
GitHub user pankajarora12 opened a pull request: https://github.com/apache/spark/pull/5494 [CORE] SPARK-6880: Fixed null check when all the dependent stages are cancelled due to previous stage failure Fixed null check when all the dependent stages are cancelled due to previous stag

[GitHub] spark pull request: [SPARK-6765] Enable scalastyle on test code.

2015-04-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5486 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-6229] Add SASL encryption to network li...

2015-04-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/5377#discussion_r28253379 --- Diff: network/common/src/main/java/org/apache/spark/network/sasl/SaslClientBootstrap.java --- @@ -62,13 +76,26 @@ public void doBootstrap(TransportClient

[GitHub] spark pull request: [SPARK-6881][SparkR] Changes the checkpoint di...

2015-04-13 Thread hlin09
Github user hlin09 commented on a diff in the pull request: https://github.com/apache/spark/pull/5493#discussion_r28253099 --- Diff: R/pkg/R/RDD.R --- @@ -279,7 +279,7 @@ setMethod("unpersist", #' @examples #'\dontrun{ #' sc <- sparkR.init() -#' setCheckpointDir(s

[GitHub] spark pull request: [WIP][SQL][SPARK-6632]: Read schema from each ...

2015-04-13 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5298#issuecomment-92414575 @saucam Right now I feel kinda hesitant to have this. As explained in my previous comment, the major bottleneck for Parquet metadata handling happens when reading foote

[GitHub] spark pull request: [SPARK-6662][YARN] Allow variable substitution...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5321#issuecomment-92412524 [Test build #30171 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30171/consoleFull) for PR 5321 at commit [`e37de75`](https://githu

[GitHub] spark pull request: [SPARK-6662][YARN] Allow variable substitution...

2015-04-13 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/5321#issuecomment-92412093 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6881][SparkR] Changes the checkpoint di...

2015-04-13 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5493#discussion_r28251542 --- Diff: R/pkg/R/RDD.R --- @@ -279,7 +279,7 @@ setMethod("unpersist", #' @examples #'\dontrun{ #' sc <- sparkR.init() -#' setCheckpointDir(s

[GitHub] spark pull request: [SPARK-6881][SparkR] Changes the checkpoint di...

2015-04-13 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5493#discussion_r28251580 --- Diff: R/pkg/inst/tests/test_rdd.R --- @@ -141,7 +141,7 @@ test_that("PipelinedRDD support actions: cache(), persist(), unpersist(), checkp unpersist

[GitHub] spark pull request: [SPARK-2669] [yarn] Distribute client configur...

2015-04-13 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/4142#discussion_r28251498 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -679,6 +755,9 @@ object Client extends Logging { // Distribution-define

[GitHub] spark pull request: [SPARK-2669] [yarn] Distribute client configur...

2015-04-13 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/4142#discussion_r28251368 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -303,6 +326,59 @@ private[spark] class Client( } /** +

[GitHub] spark pull request: [SPARK-6881][SparkR] Changes the checkpoint di...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5493#issuecomment-92411267 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-6881][SparkR] Changes the checkpoint di...

2015-04-13 Thread hlin09
GitHub user hlin09 opened a pull request: https://github.com/apache/spark/pull/5493 [SPARK-6881][SparkR] Changes the checkpoint directory name. You can merge this pull request into a Git repository by running: $ git pull https://github.com/hlin09/spark fixCheckpointDir Altern

[GitHub] spark pull request: [SPARK-6845] [MLlib] [PySpark] Add isTranposed...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5455#issuecomment-92409636 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6845] [MLlib] [PySpark] Add isTranposed...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5455#issuecomment-92409622 [Test build #30168 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30168/consoleFull) for PR 5455 at commit [`0330540`](https://gith

[GitHub] spark pull request: [SPARK-2669] [yarn] Distribute client configur...

2015-04-13 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/4142#discussion_r28250584 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -303,6 +326,59 @@ private[spark] class Client( } /** +

[GitHub] spark pull request: [SPARK-5931][CORE] Use consistent naming for t...

2015-04-13 Thread ilganeli
Github user ilganeli commented on a diff in the pull request: https://github.com/apache/spark/pull/5236#discussion_r28250502 --- Diff: core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala --- @@ -62,14 +62,17 @@ private[spark] class HeartbeatReceiver(sc: SparkContext)

[GitHub] spark pull request: [SPARK-2691][Mesos] Support for Mesos DockerIn...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3074#issuecomment-92408362 [Test build #30170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30170/consoleFull) for PR 3074 at commit [`d8ed2b6`](https://githu

[GitHub] spark pull request: [Spark-6839] BlockManger.dataDeserialize must ...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5463#issuecomment-92408211 [Test build #30169 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30169/consoleFull) for PR 5463 at commit [`7797c69`](https://githu

[GitHub] spark pull request: [SPARK-6694][SQL]SparkSQL CLI must be able to ...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5345#issuecomment-92402436 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6694][SQL]SparkSQL CLI must be able to ...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5345#issuecomment-92402424 [Test build #30167 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30167/consoleFull) for PR 5345 at commit [`846f83e`](https://gith

[GitHub] spark pull request: SPARK-4783 [CORE] System.exit() calls in Spark...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5492#issuecomment-92399477 [Test build #30164 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30164/consoleFull) for PR 5492 at commit [`60dc682`](https://gith

[GitHub] spark pull request: SPARK-4783 [CORE] System.exit() calls in Spark...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5492#issuecomment-92399518 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6879][HistoryServer]check if app is com...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5491#issuecomment-92395785 [Test build #30166 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30166/consoleFull) for PR 5491 at commit [`9872a9d`](https://gith

[GitHub] spark pull request: [SPARK-6879][HistoryServer]check if app is com...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5491#issuecomment-92395847 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6675][SQL]Hive setConf issue

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5457#issuecomment-92390218 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6675][SQL]Hive setConf issue

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5457#issuecomment-92390185 [Test build #30165 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30165/consoleFull) for PR 5457 at commit [`6c2ae87`](https://gith

[GitHub] spark pull request: [SPARK-6207] [YARN] [SQL] Adds delegation toke...

2015-04-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5031 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-6207] [YARN] [SQL] Adds delegation toke...

2015-04-13 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/5031#issuecomment-92387087 lgtm. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-5689][Doc] Document what can be run in ...

2015-04-13 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/5490#issuecomment-92386326 For this I was actually thinking just making a statement about specifically what can be run in either mode. Perhaps around paragraph on line 215 where we discuss the t

[GitHub] spark pull request: [SPARK-6845] [MLlib] [PySpark] Add isTranposed...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5455#issuecomment-92385865 [Test build #30168 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30168/consoleFull) for PR 5455 at commit [`0330540`](https://githu

[GitHub] spark pull request: [SPARK-5689][Doc] Document what can be run in ...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5490#issuecomment-92383409 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-5689][Doc] Document what can be run in ...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5490#issuecomment-92383367 [Test build #30163 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30163/consoleFull) for PR 5490 at commit [`908bb72`](https://gith

[GitHub] spark pull request: SPARK-6878 [CORE] Fix for sum on empty RDD fai...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5489#issuecomment-92379643 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: SPARK-6878 [CORE] Fix for sum on empty RDD fai...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5489#issuecomment-92379601 [Test build #30162 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30162/consoleFull) for PR 5489 at commit [`1c91954`](https://gith

[GitHub] spark pull request: [SPARK-5689][Doc] Document what can be run in ...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5490#issuecomment-92377906 [Test build #30161 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30161/consoleFull) for PR 5490 at commit [`8ca1efe`](https://gith

[GitHub] spark pull request: [SPARK-5689][Doc] Document what can be run in ...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5490#issuecomment-92377969 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [WIP][SQL][SPARK-6632]: Read schema from each ...

2015-04-13 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/5298#discussion_r28241331 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableSupport.scala --- @@ -98,12 +98,32 @@ private[parquet] class RowReadSupport exte

[GitHub] spark pull request: [WIP][SQL][SPARK-6632]: Read schema from each ...

2015-04-13 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/5298#discussion_r28241260 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableSupport.scala --- @@ -98,12 +98,32 @@ private[parquet] class RowReadSupport exte

[GitHub] spark pull request: [SPARK-6879][HistoryServer]check if app is com...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5491#issuecomment-92368706 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-5689][Doc] Document what can be run in ...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5490#issuecomment-92369282 [Test build #30160 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30160/consoleFull) for PR 5490 at commit [`97ba6a8`](https://gith

[GitHub] spark pull request: [SPARK-5689][Doc] Document what can be run in ...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5490#issuecomment-92369302 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [WIP][SQL][SPARK-6632]: Read schema from each ...

2015-04-13 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/5298#discussion_r28240423 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableSupport.scala --- @@ -98,12 +98,32 @@ private[parquet] class RowReadSupport exte

[GitHub] spark pull request: [SPARK-6879][HistoryServer]check if app is com...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5491#issuecomment-92368689 [Test build #30159 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30159/consoleFull) for PR 5491 at commit [`fdef4d6`](https://gith

[GitHub] spark pull request: [SPARK-6352] [SQL] Add DirectParquetOutputComm...

2015-04-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5042 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-6694][SQL]SparkSQL CLI must be able to ...

2015-04-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5345#issuecomment-92367238 [Test build #30167 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30167/consoleFull) for PR 5345 at commit [`846f83e`](https://githu

[GitHub] spark pull request: [SPARK-6694][SQL]SparkSQL CLI must be able to ...

2015-04-13 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5345#issuecomment-92367025 The last Scala style check failure should be irrelevant. Left a few minor styling comments. Otherwise this LGTM pending Jenkins. Thanks for working on this! -

[GitHub] spark pull request: [SPARK-6694][SQL]SparkSQL CLI must be able to ...

2015-04-13 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5345#issuecomment-92366721 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-6694][SQL]SparkSQL CLI must be able to ...

2015-04-13 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/5345#discussion_r28239846 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/CliSuite.scala --- @@ -125,4 +133,23 @@ class CliSuite extends FunSui

[GitHub] spark pull request: [SPARK-6694][SQL]SparkSQL CLI must be able to ...

2015-04-13 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/5345#discussion_r28239774 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/CliSuite.scala --- @@ -125,4 +133,23 @@ class CliSuite extends FunSui

[GitHub] spark pull request: [SPARK-6694][SQL]SparkSQL CLI must be able to ...

2015-04-13 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/5345#discussion_r28239813 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/CliSuite.scala --- @@ -125,4 +133,23 @@ class CliSuite extends FunSui

[GitHub] spark pull request: [SPARK-2691][Mesos] Support for Mesos DockerIn...

2015-04-13 Thread hellertime
Github user hellertime commented on a diff in the pull request: https://github.com/apache/spark/pull/3074#discussion_r28239714 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -0,0 +1,117 @@ +/* + * Licensed to t

[GitHub] spark pull request: [SPARK-6694][SQL]SparkSQL CLI must be able to ...

2015-04-13 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/5345#discussion_r28239541 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/CliSuite.scala --- @@ -26,22 +26,32 @@ import scala.concurrent.{Await

[GitHub] spark pull request: [SPARK-6694][SQL]SparkSQL CLI must be able to ...

2015-04-13 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/5345#discussion_r28239350 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/CliSuite.scala --- @@ -26,22 +26,32 @@ import scala.concurrent.{Await

[GitHub] spark pull request: SPARK-6878 [CORE] Fix for sum on empty RDD fai...

2015-04-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5489#issuecomment-92360598 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

<    1   2   3   4   5   6   7   >