[GitHub] spark pull request: [SPARK-11182] HDFS Delegation Token will be ex...

2015-10-22 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/9168#discussion_r42779515 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -130,6 +130,21 @@ class SparkHadoopUtil extends Logging {

[GitHub] spark pull request: [SPARK-9319][SPARKR] Add support for setting c...

2015-10-22 Thread falaki
Github user falaki commented on a diff in the pull request: https://github.com/apache/spark/pull/9218#discussion_r42785428 --- Diff: R/pkg/R/DataFrame.R --- @@ -276,6 +276,57 @@ setMethod("names<-", } }) +#' @rdname columns +#' @name

[GitHub] spark pull request: [SPARK-11232][Core]Use 'offer' instead of 'put...

2015-10-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9198 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10641][WIP][SQL] Add Skewness and Kurto...

2015-10-22 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/9003#discussion_r42790961 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala --- @@ -168,6 +191,28 @@ object QueryTest { return None } +

[GitHub] spark pull request: [SPARK-11262][ML] Unit test for gradient, loss...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9229#issuecomment-150323128 **[Test build #44163 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44163/consoleFull)** for PR 9229 at commit

[GitHub] spark pull request: [SPARK-10641][WIP][SQL] Add Skewness and Kurto...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9003#issuecomment-150324367 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9876] [SQL] Bumps parquet-mr to 1.8.1

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9225#issuecomment-150324875 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9876] [SQL] Bumps parquet-mr to 1.8.1

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9225#issuecomment-150324813 **[Test build #44151 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44151/console)** for PR 9225 at commit

[GitHub] spark pull request: [SPARK-11262][ML] Unit test for gradient, loss...

2015-10-22 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/9229#discussion_r42794818 --- Diff: mllib/src/main/scala/org/apache/spark/ml/ann/LossFunction.scala --- @@ -0,0 +1,117 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Fix a (very tiny) typo

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9230#issuecomment-150333016 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11262][ML] Unit test for gradient, loss...

2015-10-22 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/9229#discussion_r42795707 --- Diff: mllib/src/main/scala/org/apache/spark/ml/ann/Layer.scala --- @@ -546,65 +446,83 @@ private[ml] object FeedForwardTopology { * Model of

[GitHub] spark pull request: [SPARK-11188][SQL][WIP] Elide stacktraces in b...

2015-10-22 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/9194#issuecomment-150333267 @marmbrus Michael, i tried putting "retest this please" in the comment but it does not seem to start the tests ? Is there a way to restart the tests ? --- If

[GitHub] spark pull request: [SPARK-11116] [SQL] First Draft of Dataset API

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9190#issuecomment-150304953 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11216][SQL][follow-up] add encoder/deco...

2015-10-22 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/9212#issuecomment-150305127 Thanks, merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10857] [SQL] Block SQL injection vulner...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9202#issuecomment-150304899 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10971][SPARKR] RRunner should allow set...

2015-10-22 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/9179#issuecomment-150311495 +1 on `spark.r.driver.command` and `spark.r.command` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-9876] [SQL] Bumps parquet-mr to 1.8.1

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9225#issuecomment-150311140 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARKR] [SPARK-11199] Improve R context manag...

2015-10-22 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/9185#issuecomment-150318041 I vote for simplicity for SparkR and not have multiple session. In fact I observe it is already messy to handle DataFrame created by a different SparkContext

[GitHub] spark pull request: [SPARK-11262][ML] Unit test for gradient, loss...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9229#issuecomment-150323648 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11264] ./bin/spark-class can't find ass...

2015-10-22 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9231#issuecomment-150334254 Jenkins, this is ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8658] [SQL] AttributeReference's equals...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9216#issuecomment-150126161 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-8658] [SQL] AttributeReference's equals...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9216#issuecomment-150126159 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8658] [SQL] AttributeReference's equals...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9216#issuecomment-150126107 **[Test build #44134 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44134/consoleFull)** for PR 9216 at commit

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-150126146 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-150126127 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r42717743 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -40,7 +42,8 @@ private[streaming] case class

[GitHub] spark pull request: update twitter4j to 4.0.4 version

2015-10-22 Thread pronix
GitHub user pronix opened a pull request: https://github.com/apache/spark/pull/9221 update twitter4j to 4.0.4 version update twitter4j to 4.0.4 version https://issues.apache.org/jira/browse/SPARK-11245 You can merge this pull request into a Git repository by running: $

[GitHub] spark pull request: [SPARK-11244][SPARKR] sparkR.stop() should rem...

2015-10-22 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/9205#issuecomment-150119806 is it possible for lin-r to skip # comment with code outside a function body? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-10903] [SPARKR] R - Simplify SQLContext...

2015-10-22 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/9192#discussion_r42716848 --- Diff: R/pkg/R/SQLContext.R --- @@ -17,6 +17,34 @@ # SQLcontext.R: SQLContext-driven functions +#' Temporary function to reroute

[GitHub] spark pull request: [SPARK-10971][SPARKR] RRunner should allow set...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9179#issuecomment-150127390 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10971][SPARKR] RRunner should allow set...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9179#issuecomment-150127393 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10903] [SPARKR] R - Simplify SQLContext...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9192#issuecomment-150127311 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10971][SPARKR] RRunner should allow set...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9179#issuecomment-150127206 **[Test build #44130 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44130/consoleFull)** for PR 9179 at commit

[GitHub] spark pull request: [SPARK-10903] [SPARKR] R - Simplify SQLContext...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9192#issuecomment-150127349 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10997] [core] Add "client mode" to nett...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9210#issuecomment-150128910 **[Test build #44127 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44127/consoleFull)** for PR 9210 at commit

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r42721029 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -235,8 +350,67 @@ private[streaming] class

[GitHub] spark pull request: [SPARK-10708] Consolidate sort shuffle impleme...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-150139509 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r42720937 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -235,8 +350,67 @@ private[streaming] class

[GitHub] spark pull request: [SPARK-10708] Consolidate sort shuffle impleme...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-150139383 **[Test build #44135 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44135/consoleFull)** for PR 8829 at commit

[GitHub] spark pull request: [SPARK-10708] Consolidate sort shuffle impleme...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-150139507 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6785][SQL] fix DateTimeUtils for dates ...

2015-10-22 Thread ckadner
Github user ckadner commented on a diff in the pull request: https://github.com/apache/spark/pull/6983#discussion_r42723887 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveQuerySuite.scala --- @@ -324,20 +324,6 @@ class HiveQuerySuite extends

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r42724272 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -428,6 +441,9 @@ class ReceiverTracker(ssc:

[GitHub] spark pull request: [SPARK-10749][MESOS] Support multiple roles wi...

2015-10-22 Thread dragos
Github user dragos commented on a diff in the pull request: https://github.com/apache/spark/pull/8872#discussion_r42725306 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -443,9 +444,13 @@ private[spark] class

[GitHub] spark pull request: [SPARK-11102] [SQL] Uninformative exception wh...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9142#issuecomment-150124297 **[Test build #44136 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44136/consoleFull)** for PR 9142 at commit

[GitHub] spark pull request: [SPARK-6328] [Python] Python API for Streaming...

2015-10-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9186#discussion_r42715990 --- Diff: python/pyspark/streaming/listener.py --- @@ -0,0 +1,75 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +#

[GitHub] spark pull request: [SPARK-11243] [SQL] zero out padding bytes in ...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9217#issuecomment-150127544 **[Test build #44132 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44132/consoleFull)** for PR 9217 at commit

[GitHub] spark pull request: [SPARK-11243] [SQL] zero out padding bytes in ...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9217#issuecomment-150127698 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-150127788 **[Test build #44138 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44138/consoleFull)** for PR 5267 at commit

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r42720841 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -195,31 +285,56 @@ private[streaming] class

[GitHub] spark pull request: [SPARK-10292][SQL] make metadata query-able by...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8461#issuecomment-150142131 **[Test build #44141 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44141/consoleFull)** for PR 8461 at commit

[GitHub] spark pull request: [SPARK-10749][MESOS] Support multiple roles wi...

2015-10-22 Thread dragos
Github user dragos commented on a diff in the pull request: https://github.com/apache/spark/pull/8872#discussion_r42724448 --- Diff: core/src/test/scala/org/apache/spark/scheduler/mesos/MesosClusterSchedulerSuite.scala --- @@ -72,4 +78,56 @@ class MesosClusterSchedulerSuite

[GitHub] spark pull request: SPARK-11258 Remove quadratic runtime complexit...

2015-10-22 Thread FRosner
GitHub user FRosner opened a pull request: https://github.com/apache/spark/pull/9222 SPARK-11258 Remove quadratic runtime complexity for converting a Spark DataFrame into an R data.frame https://issues.apache.org/jira/browse/SPARK-11258 I was not able to locate an existing

[GitHub] spark pull request: [SPARK-9319][SPARKR] Add support for setting c...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9218#issuecomment-150125119 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9319][SPARKR] Add support for setting c...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9218#issuecomment-150125099 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11253][SQL] reset all accumulators in p...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9215#issuecomment-150126796 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11253][SQL] reset all accumulators in p...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9215#issuecomment-150126583 **[Test build #44129 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44129/consoleFull)** for PR 9215 at commit

[GitHub] spark pull request: [SPARK-9319][SPARKR] Add support for setting c...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9218#issuecomment-150126793 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9319][SPARKR] Add support for setting c...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9218#issuecomment-150126792 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9319][SPARKR] Add support for setting c...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9218#issuecomment-150126791 **[Test build #44137 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44137/consoleFull)** for PR 9218 at commit

[GitHub] spark pull request: [SPARK-11253][SQL] reset all accumulators in p...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9215#issuecomment-150126795 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9319][SPARKR] Add support for setting c...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9218#issuecomment-150126758 **[Test build #44137 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44137/consoleFull)** for PR 9218 at commit

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r42719354 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -235,8 +350,67 @@ private[streaming] class

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r42719713 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -40,7 +42,8 @@ private[streaming] case class

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-22 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-150147496 My 2 cents about this PR: is it possible to create a new `WriteAheadLog` (such as, BatchWriteAheadLog) that wraps the existing `WriteAheadLog` and implement the new

[GitHub] spark pull request: SPARK-11258 Remove quadratic runtime complexit...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9222#issuecomment-150153510 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10749][MESOS] Support multiple roles wi...

2015-10-22 Thread dragos
Github user dragos commented on a diff in the pull request: https://github.com/apache/spark/pull/8872#discussion_r42724611 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -358,9 +358,10 @@ private[spark] class

[GitHub] spark pull request: [SPARK-11253][SQL] reset all accumulators in p...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9215#issuecomment-150119572 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11253][SQL] reset all accumulators in p...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9215#issuecomment-150119571 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6328] [Python] Python API for Streaming...

2015-10-22 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9186#issuecomment-150125077 I suggest adding some Python friendly classes for `BatchInfo`, `ReceiverInfo`, `OutputOperationInfo` and converting these Scala objects to them. Some Scala things, like

[GitHub] spark pull request: [SPARK-11243] [SQL] zero out padding bytes in ...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9217#issuecomment-150127697 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11256] Mark all Stage/ResultStage/Shuff...

2015-10-22 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/9219 [SPARK-11256] Mark all Stage/ResultStage/ShuffleMapStage internal state as private. You can merge this pull request into a Git repository by running: $ git pull https://github.com/rxin/spark

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r42719627 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -235,8 +350,67 @@ private[streaming] class

[GitHub] spark pull request: [SPARK-10708] Consolidate sort shuffle impleme...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-150136623 **[Test build #1937 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1937/consoleFull)** for PR 8829 at commit

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-150136686 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-150136685 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5966][WIP]

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9220#issuecomment-150138610 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: update twitter4j to 4.0.4 version

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9221#issuecomment-150138607 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10152] [SQL] Support Init script for hi...

2015-10-22 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/8355#discussion_r42722019 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2.scala --- @@ -67,6 +68,46 @@ object

[GitHub] spark pull request: update twitter4j to 4.0.4 version

2015-10-22 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/9221#issuecomment-150151459 Looking @ the twitter4j poms, their dependencies pull in a com.googlecode.kryo -given the kryo pain its a possible troublespot. However, that com.googlecode

[GitHub] spark pull request: [SPARK-11188][SQL][WIP] Elide stacktraces in b...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9194#issuecomment-150154140 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11188][SQL][WIP] Elide stacktraces in b...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9194#issuecomment-150154176 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11256] Mark all Stage/ResultStage/Shuff...

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9219#issuecomment-150131640 **[Test build #44140 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44140/consoleFull)** for PR 9219 at commit

[GitHub] spark pull request: [SPARK-11251] Fix page size calculation in loc...

2015-10-22 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9209#issuecomment-150117603 Seems like there is a real failure? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-9319][SPARKR] Add support for setting c...

2015-10-22 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/9218 [SPARK-9319][SPARKR] Add support for setting column names, types Add support for for colnames, colnames<-, coltypes<- I will merge with PR 8984 (coltypes) once it is in, possibly

[GitHub] spark pull request: [SPARK-10997] [core] Add "client mode" to nett...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9210#issuecomment-150129053 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6785][SQL] fix DateTimeUtils for dates ...

2015-10-22 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/6983#discussion_r42717418 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveQuerySuite.scala --- @@ -324,20 +324,6 @@ class HiveQuerySuite extends

[GitHub] spark pull request: [SPARK-10997] [core] Add "client mode" to nett...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9210#issuecomment-150129051 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5966]

2015-10-22 Thread kevinyu98
GitHub user kevinyu98 opened a pull request: https://github.com/apache/spark/pull/9220 [SPARK-5966] You can merge this pull request into a Git repository by running: $ git pull https://github.com/kevinyu98/spark working_on_spark-5966 Alternatively you can review and apply these

[GitHub] spark pull request: [SPARK-10292][SQL] make metadata query-able by...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8461#issuecomment-150140230 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-22 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r42721281 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -477,7 +493,12 @@ class ReceiverTracker(ssc:

[GitHub] spark pull request: [SPARK-10292][SQL] make metadata query-able by...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8461#issuecomment-150140247 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10292][SQL] make metadata query-able by...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8461#issuecomment-150155085 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11188][SQL][WIP] Elide stacktraces in b...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9194#issuecomment-150155092 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10292][SQL] make metadata query-able by...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8461#issuecomment-150155083 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-150155027 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-150155055 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11116] [SQL] First Draft of Dataset API

2015-10-22 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/9190#discussion_r42780810 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -0,0 +1,398 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-11116] [SQL] First Draft of Dataset API

2015-10-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9190#issuecomment-150305783 **[Test build #44162 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44162/consoleFull)** for PR 9190 at commit

[GitHub] spark pull request: [SPARK-6328] [Python] Python API for Streaming...

2015-10-22 Thread djalova
Github user djalova commented on a diff in the pull request: https://github.com/apache/spark/pull/9186#discussion_r42782220 --- Diff: python/pyspark/streaming/listener.py --- @@ -0,0 +1,75 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +#

[GitHub] spark pull request: [SPARK-11261] [Core] Provide a more flexible a...

2015-10-22 Thread rmarsch
GitHub user rmarsch opened a pull request: https://github.com/apache/spark/pull/9228 [SPARK-11261] [Core] Provide a more flexible alternative to Jdbc RDD -Provide JdbcPartitioningRDD that allows fine grained control of the queries run per Spark partition against the JDBC

  1   2   3   4   5   6   7   8   >