[GitHub] spark pull request: [SPARK-4226][SQL] SparkSQL - Add support for s...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3249#issuecomment-65758205 [Test build #24177 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24177/consoleFull) for PR 3249 at commit

[GitHub] spark pull request: [SPARK-4226][SQL] SparkSQL - Add support for s...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3249#issuecomment-65758275 [Test build #24177 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24177/consoleFull) for PR 3249 at commit

[GitHub] spark pull request: [SPARK-4226][SQL] SparkSQL - Add support for s...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3249#issuecomment-65758277 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4714][CORE]: Add checking info is null ...

2014-12-05 Thread suyanNone
Github user suyanNone commented on a diff in the pull request: https://github.com/apache/spark/pull/3574#discussion_r21359660 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1089,15 +1089,17 @@ private[spark] class BlockManager( val info

[GitHub] spark pull request: [SPARK-4005][CORE] handle message replies in r...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2853#issuecomment-65759456 [Test build #541 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/541/consoleFull) for PR 2853 at commit

[GitHub] spark pull request: [SPARK-4226][SQL] SparkSQL - Add support for s...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3249#issuecomment-65760473 [Test build #24178 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24178/consoleFull) for PR 3249 at commit

[GitHub] spark pull request: [SPARK-4528][SQL] add comment support for Spar...

2014-12-05 Thread tsingfu
Github user tsingfu commented on the pull request: https://github.com/apache/spark/pull/3501#issuecomment-65760992 @marmbrus Need we do something more. If this implement is pretty complex, We may consider that reduce the number of comment support styles(only support -- as comment

[GitHub] spark pull request: [SPARK-4688] Have a single shared network time...

2014-12-05 Thread varunsaxena
Github user varunsaxena commented on the pull request: https://github.com/apache/spark/pull/3562#issuecomment-65761296 @rxin , I will just summarize what are the configuration defaults I have used. I put a value of 100 in initial pull request with the intention of having a futher

[GitHub] spark pull request: [spark-4691][shuffle]Code improvement for aggr...

2014-12-05 Thread maji2014
Github user maji2014 commented on the pull request: https://github.com/apache/spark/pull/3553#issuecomment-65761712 @pwendell any idea about this title?/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-4688] Have a single shared network time...

2014-12-05 Thread varunsaxena
Github user varunsaxena commented on a diff in the pull request: https://github.com/apache/spark/pull/3562#discussion_r21361036 --- Diff: docs/configuration.md --- @@ -777,6 +777,16 @@ Apart from these, the following properties are also available, and may be useful /td

[GitHub] spark pull request: SPARK-4762: Add support for tuples in 'where i...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3618#issuecomment-65764171 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-4762: Add support for tuples in 'where i...

2014-12-05 Thread saucam
GitHub user saucam opened a pull request: https://github.com/apache/spark/pull/3618 SPARK-4762: Add support for tuples in 'where in' clause query Currently, in the where in clause the filter is applied only on a single column. We can enhance it to accept filter on multiple

[GitHub] spark pull request: SPARK-4762: Add support for tuples in 'where i...

2014-12-05 Thread saucam
Github user saucam commented on the pull request: https://github.com/apache/spark/pull/3618#issuecomment-65764552 @pwendell this PR requires a change in the hive parser for which i created a PR against hive trunk here : https://github.com/apache/hive/pull/25 can you please

[GitHub] spark pull request: [SPARK-2554][SQL] Supporting SumDistinct parti...

2014-12-05 Thread ravipesala
Github user ravipesala commented on the pull request: https://github.com/apache/spark/pull/3348#issuecomment-65766741 I have Rebased with master,Please review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-4226][SQL] SparkSQL - Add support for s...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3249#issuecomment-65767090 [Test build #24178 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24178/consoleFull) for PR 3249 at commit

[GitHub] spark pull request: SPARK-4338. Ditch yarn-alpha.

2014-12-05 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/3215#issuecomment-65767093 @tgravescs @andrewor14 do you feel comfortable merging this now that 1.2 is out the door? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-4226][SQL] SparkSQL - Add support for s...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3249#issuecomment-65767098 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-4762: Add support for tuples in 'where i...

2014-12-05 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/3618#issuecomment-65767357 @saucam mind tagging this PR as [SQL]? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: SPARK-4338. Ditch yarn-alpha.

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3215#issuecomment-65767819 [Test build #24180 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24180/consoleFull) for PR 3215 at commit

[GitHub] spark pull request: SPARK-4338. Ditch yarn-alpha.

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3215#issuecomment-65768623 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4763] All-pairs shortest paths algorith...

2014-12-05 Thread ankurdave
GitHub user ankurdave opened a pull request: https://github.com/apache/spark/pull/3619 [SPARK-4763] All-pairs shortest paths algorithm for GraphX Computes unweighted all-pairs shortest paths, returning an RDD containing the shortest-path distance between all pairs of reachable

[GitHub] spark pull request: [SPARK-4763] All-pairs shortest paths algorith...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3619#issuecomment-65769987 [Test build #24181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24181/consoleFull) for PR 3619 at commit

[GitHub] spark pull request: SPARK-4338. Ditch yarn-alpha.

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3215#issuecomment-65776868 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-4338. Ditch yarn-alpha.

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3215#issuecomment-65776860 [Test build #24180 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24180/consoleFull) for PR 3215 at commit

[GitHub] spark pull request: [SPARK-4763] All-pairs shortest paths algorith...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3619#issuecomment-65778564 [Test build #24181 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24181/consoleFull) for PR 3619 at commit

[GitHub] spark pull request: [SPARK-4763] All-pairs shortest paths algorith...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3619#issuecomment-65778569 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4714][CORE]: Add checking info is null ...

2014-12-05 Thread suyanNone
Github user suyanNone commented on the pull request: https://github.com/apache/spark/pull/3574#issuecomment-65779235 @JoshRosen ThreadA into RemoveBlock(), and got info for blockId1 ThreadB into DropFromMemory(), and got info for blockId1 now Thread A, B all want got

[GitHub] spark pull request: [SPARK-4006] In long running contexts, we enco...

2014-12-05 Thread tsliwowicz
Github user tsliwowicz commented on the pull request: https://github.com/apache/spark/pull/2914#issuecomment-65783784 Seems like an issue with Jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...

2014-12-05 Thread tsliwowicz
Github user tsliwowicz commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-65783822 Seems like an issue with Jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: do you mean inadvertently?

2014-12-05 Thread CrazyJvm
GitHub user CrazyJvm opened a pull request: https://github.com/apache/spark/pull/3620 do you mean inadvertently? You can merge this pull request into a Git repository by running: $ git pull https://github.com/CrazyJvm/spark streaming-foreachRDD Alternatively you can review

[GitHub] spark pull request: Streaming doc : do you mean inadvertently?

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3620#issuecomment-65791786 [Test build #24182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24182/consoleFull) for PR 3620 at commit

[GitHub] spark pull request: Streaming doc : do you mean inadvertently?

2014-12-05 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3620#issuecomment-65791847 Correct, but this is really trivial. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-4734][Streaming]limit the file Dstream ...

2014-12-05 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3597#issuecomment-65792502 See my comments in https://issues.apache.org/jira/browse/SPARK-4734 as to why I don't think this is a good idea. In particular, this solution clearly has the potential to

[GitHub] spark pull request: SPARK-3926 [CORE] Reopened: result of JavaRDD ...

2014-12-05 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/3587#discussion_r21372796 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaUtils.scala --- @@ -32,7 +33,65 @@ private[spark] object JavaUtils { def

[GitHub] spark pull request: [SPARK-3405] add subnet-id and vpc-id options ...

2014-12-05 Thread brdw
Github user brdw commented on the pull request: https://github.com/apache/spark/pull/2872#issuecomment-65801064 I'd love to see this as well. We have a strict vpc policy. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: Streaming doc : do you mean inadvertently?

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3620#issuecomment-65802460 [Test build #24182 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24182/consoleFull) for PR 3620 at commit

[GitHub] spark pull request: Streaming doc : do you mean inadvertently?

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3620#issuecomment-65802466 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4761][SQL] Enables Kryo by default in S...

2014-12-05 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/3621 [SPARK-4761][SQL] Enables Kryo by default in Spark SQL Thrift server Enables Kryo and disables reference tracking by default in Spark SQL Thrift server. Configurations explicitly defined by users

[GitHub] spark pull request: [SPARK-4763] All-pairs shortest paths algorith...

2014-12-05 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/3619#discussion_r21377222 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/Pregel.scala --- @@ -139,6 +146,14 @@ object Pregel extends Logging { // get to send

[GitHub] spark pull request: [SPARK-4761][SQL] Enables Kryo by default in S...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3621#issuecomment-65804482 [Test build #24183 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24183/consoleFull) for PR 3621 at commit

[GitHub] spark pull request: SPARK-3926 [CORE] Reopened: result of JavaRDD ...

2014-12-05 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/3587#discussion_r21377699 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaUtils.scala --- @@ -32,7 +33,65 @@ private[spark] object JavaUtils { def

[GitHub] spark pull request: SPARK-3926 [CORE] Reopened: result of JavaRDD ...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3587#issuecomment-65805992 [Test build #24184 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24184/consoleFull) for PR 3587 at commit

[GitHub] spark pull request: SPARK-3926 [CORE] Reopened: result of JavaRDD ...

2014-12-05 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/3587#issuecomment-65806925 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-4461][YARN] pass extra java options to ...

2014-12-05 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/3409#issuecomment-65812731 I'm personally not a fan of executorLauncher. Cluster mode also launches executors and users shouldn't really have to know executorLauncher = client mode. If you

[GitHub] spark pull request: [SPARK-4761][SQL] Enables Kryo by default in S...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3621#issuecomment-65814668 [Test build #24183 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24183/consoleFull) for PR 3621 at commit

[GitHub] spark pull request: [SPARK-4761][SQL] Enables Kryo by default in S...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3621#issuecomment-65814677 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3778] newAPIHadoopRDD doesn't properly ...

2014-12-05 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/2676#discussion_r21382056 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -641,6 +641,7 @@ class SparkContext(config: SparkConf) extends Logging {

[GitHub] spark pull request: [SPARK-3405] add subnet-id and vpc-id options ...

2014-12-05 Thread changetip
Github user changetip commented on the pull request: https://github.com/apache/spark/pull/2872#issuecomment-65814859 Hi mvj101, dreid93 sent you a Bitcoin tip worth 1 lunch (21,255 bits/$8.00), and I'm here to deliver it ➔ **[collect your tip at

[GitHub] spark pull request: [SPARK-3778] newAPIHadoopRDD doesn't properly ...

2014-12-05 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/2676#issuecomment-65814785 I was waiting for clarification from @pwendell on my question about his comment. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-3405] add subnet-id and vpc-id options ...

2014-12-05 Thread dreid93
Github user dreid93 commented on the pull request: https://github.com/apache/spark/pull/2872#issuecomment-65814791 I'll buy anyone willing to take care of this merge lunch via @ChangeTip :) --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: SPARK-3926 [CORE] Reopened: result of JavaRDD ...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3587#issuecomment-65819459 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-3926 [CORE] Reopened: result of JavaRDD ...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3587#issuecomment-65819448 [Test build #24184 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24184/consoleFull) for PR 3587 at commit

[GitHub] spark pull request: [SPARK-3967] don’t redundantly overwrite exe...

2014-12-05 Thread ryan-williams
Github user ryan-williams commented on a diff in the pull request: https://github.com/apache/spark/pull/2848#discussion_r21386174 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -412,6 +403,48 @@ private[spark] object Utils extends Logging { }

[GitHub] spark pull request: [SPARK-3967] don’t redundantly overwrite exe...

2014-12-05 Thread ryan-williams
Github user ryan-williams commented on a diff in the pull request: https://github.com/apache/spark/pull/2848#discussion_r21386186 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -412,6 +403,48 @@ private[spark] object Utils extends Logging { }

[GitHub] spark pull request: [SPARK-3967] don’t redundantly overwrite exe...

2014-12-05 Thread ryan-williams
Github user ryan-williams commented on a diff in the pull request: https://github.com/apache/spark/pull/2848#discussion_r21386332 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -412,6 +403,48 @@ private[spark] object Utils extends Logging { }

[GitHub] spark pull request: [SPARK-3967] don’t redundantly overwrite exe...

2014-12-05 Thread ryan-williams
Github user ryan-williams commented on a diff in the pull request: https://github.com/apache/spark/pull/2848#discussion_r21386398 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -412,6 +403,48 @@ private[spark] object Utils extends Logging { }

[GitHub] spark pull request: [SPARK-3967] don’t redundantly overwrite exe...

2014-12-05 Thread ryan-williams
Github user ryan-williams commented on a diff in the pull request: https://github.com/apache/spark/pull/2848#discussion_r21386447 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -412,6 +403,48 @@ private[spark] object Utils extends Logging { }

[GitHub] spark pull request: [SPARK-3967] don’t redundantly overwrite exe...

2014-12-05 Thread ryan-williams
Github user ryan-williams commented on a diff in the pull request: https://github.com/apache/spark/pull/2848#discussion_r21386501 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -412,6 +403,48 @@ private[spark] object Utils extends Logging { }

[GitHub] spark pull request: [SPARK-3967] don’t redundantly overwrite exe...

2014-12-05 Thread ryan-williams
Github user ryan-williams commented on a diff in the pull request: https://github.com/apache/spark/pull/2848#discussion_r21386652 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -412,6 +403,48 @@ private[spark] object Utils extends Logging { }

[GitHub] spark pull request: [SPARK-4461][YARN] pass extra java options to ...

2014-12-05 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/3409#issuecomment-65826773 @tgravescs that makes sense. clientmode.am sounds good to me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-3967] don’t redundantly overwrite exe...

2014-12-05 Thread ryan-williams
Github user ryan-williams commented on a diff in the pull request: https://github.com/apache/spark/pull/2848#discussion_r21386945 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -412,6 +403,48 @@ private[spark] object Utils extends Logging { }

[GitHub] spark pull request: [SPARK-3967] don’t redundantly overwrite exe...

2014-12-05 Thread ryan-williams
Github user ryan-williams commented on the pull request: https://github.com/apache/spark/pull/2848#issuecomment-65827581 Thanks for the review pass, @JoshRosen. As I mentioned in some of the comments, this was attempting to shoehorn 4 basically-identical blocks of code from

[GitHub] spark pull request: add foldLeftByKey to PairRDDFunctions for redu...

2014-12-05 Thread koertkuipers
Github user koertkuipers commented on a diff in the pull request: https://github.com/apache/spark/pull/2963#discussion_r21387829 --- Diff: core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala --- @@ -460,6 +461,63 @@ class PairRDDFunctions[K, V](self: RDD[(K, V)])

[GitHub] spark pull request: add foldLeftByKey to PairRDDFunctions for redu...

2014-12-05 Thread koertkuipers
Github user koertkuipers commented on the pull request: https://github.com/apache/spark/pull/2963#issuecomment-65828969 Hey @zsxwing, In Scala Seq the order in which the values get processed in foldLeft is well defined. But can we make any assumptions at all about the

[GitHub] spark pull request: [SPARK-3967] don’t redundantly overwrite exe...

2014-12-05 Thread ryan-williams
Github user ryan-williams commented on a diff in the pull request: https://github.com/apache/spark/pull/2848#discussion_r21389032 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -412,6 +403,48 @@ private[spark] object Utils extends Logging { }

[GitHub] spark pull request: [SPARK-4761][SQL] Enables Kryo by default in S...

2014-12-05 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/3621#issuecomment-65832481 Awesome, thanks Cheng. This is great. I forgot we can still modify the SparkConf before we pass it to the SparkContext constructor. --- If your project is set up for

[GitHub] spark pull request: [SPARK-4761][SQL] Enables Kryo by default in S...

2014-12-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3621 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-4421] Wrong link in spark-standalone.ht...

2014-12-05 Thread tsudukim
Github user tsudukim closed the pull request at: https://github.com/apache/spark/pull/3280 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-4421] Wrong link in spark-standalone.ht...

2014-12-05 Thread tsudukim
Github user tsudukim commented on the pull request: https://github.com/apache/spark/pull/3280#issuecomment-65834528 Thank you! @JoshRosen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-4756][SQL] FIX: sessionToActivePool gro...

2014-12-05 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/3617#issuecomment-65834619 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-3967] don’t redundantly overwrite exe...

2014-12-05 Thread ryan-williams
Github user ryan-williams commented on the pull request: https://github.com/apache/spark/pull/2848#issuecomment-65834877 OK @JoshRosen I fixed and cleaned things up. * the two overloaded `maybeMoveFile` signatures are more distinctly named (`downloadStreamAndMove` and

[GitHub] spark pull request: [SPARK-4756][SQL] FIX: sessionToActivePool gro...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3617#issuecomment-65835734 [Test build #24185 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24185/consoleFull) for PR 3617 at commit

[GitHub] spark pull request: [SPARK-4668] Fix some documentation typos.

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3523#issuecomment-65836128 [Test build #24186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24186/consoleFull) for PR 3523 at commit

[GitHub] spark pull request: [SPARK-4756][SQL] FIX: sessionToActivePool gro...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3617#issuecomment-65836379 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4756][SQL] FIX: sessionToActivePool gro...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3617#issuecomment-65836374 [Test build #24185 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24185/consoleFull) for PR 3617 at commit

[GitHub] spark pull request: [SPARK-4668] Fix some documentation typos.

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3523#issuecomment-65837247 [Test build #24187 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24187/consoleFull) for PR 3523 at commit

[GitHub] spark pull request: [SPARK-2188] Support sbt/sbt for Windows

2014-12-05 Thread tsudukim
Github user tsudukim commented on the pull request: https://github.com/apache/spark/pull/3591#issuecomment-65837669 I wonder which is good but I tend not to think to submit this to upstream. It is a good idea if this was made from the latest sbt script, but unfortunately this is made

[GitHub] spark pull request: [SPARK-4765] Make GC time always shown in UI.

2014-12-05 Thread kayousterhout
GitHub user kayousterhout opened a pull request: https://github.com/apache/spark/pull/3622 [SPARK-4765] Make GC time always shown in UI. This commit removes the GC time for each task from the set of optional, additional metrics, and instead always shows it for each task.

[GitHub] spark pull request: [SPARK-4765] Make GC time always shown in UI.

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3622#issuecomment-65840120 [Test build #24188 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24188/consoleFull) for PR 3622 at commit

[GitHub] spark pull request: [SPARK-4763] All-pairs shortest paths algorith...

2014-12-05 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/3619#discussion_r21393556 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/Pregel.scala --- @@ -139,6 +146,14 @@ object Pregel extends Logging { // get to send

[GitHub] spark pull request: [SPARK-3625][SPARK-3623][GraphX] GraphX should...

2014-12-05 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/2631#issuecomment-65841397 Due to https://issues.apache.org/jira/browse/SPARK-4672, we now support checkpointing graphs (by checkpointing their constituent vertices and edges) with the same

[GitHub] spark pull request: Clear local copies of accumulators as soon as ...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-65844299 [Test build #24189 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24189/consoleFull) for PR 3570 at commit

[GitHub] spark pull request: [SPARK-4005][CORE] handle message replies in r...

2014-12-05 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2853#issuecomment-65845790 LGTM. Since this is code-cleanup and not a bugfix, I'm only going to merge this into `master` (1.3.0). Thanks! --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-4005][CORE] handle message replies in r...

2014-12-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/2853 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Add a Note on jsonFile having separate JSON ob...

2014-12-05 Thread petervandenabeele
Github user petervandenabeele commented on the pull request: https://github.com/apache/spark/pull/3517#issuecomment-65846515 More problematic (and sorry I had not seen that before) ... there already _is_ an example file named `people.txt` with a different format: ``` $

[GitHub] spark pull request: SPARK-4767: Add support for launching in a spe...

2014-12-05 Thread holdenk
GitHub user holdenk opened a pull request: https://github.com/apache/spark/pull/3623 SPARK-4767: Add support for launching in a specified placement group to spark_ec2 Placement groups are cool and all the cool kids are using them. Lets add support for them to spark_ec2.py because

[GitHub] spark pull request: [SPARK-4668] Fix some documentation typos.

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3523#issuecomment-65847289 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4668] Fix some documentation typos.

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3523#issuecomment-65847280 [Test build #24186 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24186/consoleFull) for PR 3523 at commit

[GitHub] spark pull request: SPARK-4767: Add support for launching in a spe...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3623#issuecomment-65847864 [Test build #24190 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24190/consoleFull) for PR 3623 at commit

[GitHub] spark pull request: [SPARK-4668] Fix some documentation typos.

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3523#issuecomment-65848971 [Test build #24187 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24187/consoleFull) for PR 3523 at commit

[GitHub] spark pull request: [SPARK-4668] Fix some documentation typos.

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3523#issuecomment-65848977 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4765] Make GC time always shown in UI.

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3622#issuecomment-65851401 [Test build #24188 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24188/consoleFull) for PR 3622 at commit

[GitHub] spark pull request: [SPARK-4765] Make GC time always shown in UI.

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3622#issuecomment-65851408 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4765] Make GC time always shown in UI.

2014-12-05 Thread kayousterhout
Github user kayousterhout commented on the pull request: https://github.com/apache/spark/pull/3622#issuecomment-65852060 MIMA tests pass locally; I rebased this on master to see if that makes the tests pass --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-4765] Make GC time always shown in UI.

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3622#issuecomment-65852692 [Test build #24191 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24191/consoleFull) for PR 3622 at commit

[GitHub] spark pull request: SPARK-4770. [DOC] [YARN] spark.scheduler.minRe...

2014-12-05 Thread sryza
GitHub user sryza opened a pull request: https://github.com/apache/spark/pull/3624 SPARK-4770. [DOC] [YARN] spark.scheduler.minRegisteredResourcesRatio doc... ...umented default is incorrect for YARN You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: SPARK-4770. [DOC] [YARN] spark.scheduler.minRe...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3624#issuecomment-65854478 [Test build #24192 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24192/consoleFull) for PR 3624 at commit

[GitHub] spark pull request: Clear local copies of accumulators as soon as ...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-65855809 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Clear local copies of accumulators as soon as ...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-65855799 [Test build #24189 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24189/consoleFull) for PR 3570 at commit

[GitHub] spark pull request: [SPARK-4740] [WIP] Create multiple concurrent ...

2014-12-05 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/3625 [SPARK-4740] [WIP] Create multiple concurrent connections between two peer nodes in Netty. Need to test add test cases. You can merge this pull request into a Git repository by running: $ git

  1   2   >