[GitHub] spark pull request: [SPARK-2075][Core] Make the compiler generate ...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3740#issuecomment-67608353 [Test build #24635 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24635/consoleFull) for PR 3740 at commit [`734bac9`](https://githu

[GitHub] spark pull request: [SPARK-2075][Core] Make the compiler generate ...

2014-12-18 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/3740#discussion_r22093377 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1174,6 +1174,14 @@ abstract class RDD[T: ClassTag]( * Save this RDD as a text file

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-12-18 Thread tnachen
Github user tnachen commented on the pull request: https://github.com/apache/spark/pull/60#issuecomment-67607923 Seems like the original author is no longer going to work on this, I'll take this up again. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-12-18 Thread tdna
Github user tdna commented on the pull request: https://github.com/apache/spark/pull/60#issuecomment-67607842 If somebody uses mesos with more framework it is a very important feature (like us), please somebody file an issue on the Jira. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-4094][CORE] checkpoint should still be ...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2956#issuecomment-67607694 [Test build #24629 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24629/consoleFull) for PR 2956 at commit [`be7c1fa`](https://gith

[GitHub] spark pull request: [SPARK-4094][CORE] checkpoint should still be ...

2014-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2956#issuecomment-67607704 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4883][Shuffle] Add a name to the direct...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3734#issuecomment-67607387 [Test build #24634 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24634/consoleFull) for PR 3734 at commit [`cc74727`](https://githu

[GitHub] spark pull request: [SPARK-4749] [mllib]: Allow initializing KMean...

2014-12-18 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3610#issuecomment-67607352 LGTM except minor inline comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4883][Shuffle] Add a name to the direct...

2014-12-18 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/3734#discussion_r22092977 --- Diff: network/shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockManager.java --- @@ -60,8 +61,11 @@ private final Transpo

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092935 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092959 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092957 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092963 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/stat/impl/MultivariateGaussian.scala --- @@ -0,0 +1,39 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092960 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092939 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092937 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092942 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092953 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092956 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092938 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092962 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/stat/impl/MultivariateGaussian.scala --- @@ -0,0 +1,39 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092955 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092934 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092952 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092954 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092927 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: Small refactoring to pass SparkEnv into Execut...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3738#issuecomment-67607055 [Test build #24633 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24633/consoleFull) for PR 3738 at commit [`82e02cc`](https://githu

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092924 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092941 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092918 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModel.scala --- @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache Softwa

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092908 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/DenseGmmEM.scala --- @@ -0,0 +1,65 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092933 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092923 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModel.scala --- @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache Softwa

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092920 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModel.scala --- @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache Softwa

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092926 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModelEM.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Sof

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092915 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModel.scala --- @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Softwa

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092921 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModel.scala --- @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache Softwa

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092909 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/DenseGmmEM.scala --- @@ -0,0 +1,65 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092917 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModel.scala --- @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache Softwa

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-18 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3022#discussion_r22092919 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModel.scala --- @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache Softwa

[GitHub] spark pull request: [SPARK-2075][Core] Make the compiler generate ...

2014-12-18 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/3740#discussion_r22092697 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1174,6 +1174,14 @@ abstract class RDD[T: ClassTag]( * Save this RDD as a text fil

[GitHub] spark pull request: [SPARK-4883][Shuffle] Add a name to the direct...

2014-12-18 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/3734#discussion_r22092572 --- Diff: network/shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockManager.java --- @@ -60,8 +61,11 @@ private final Transp

[GitHub] spark pull request: [SPARK-1953][YARN]yarn client mode Application...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3607#issuecomment-67606014 [Test build #24628 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24628/consoleFull) for PR 3607 at commit [`2b27928`](https://gith

[GitHub] spark pull request: [SPARK-1953][YARN]yarn client mode Application...

2014-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3607#issuecomment-67606019 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4893] Add test fixture for resetting sy...

2014-12-18 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/3739#issuecomment-67606021 > The trickiness of this trait ordering might be an argument against this approach. Yeah. But if it's well documented, I won't be against it. Really a convenient

[GitHub] spark pull request: Small refactoring to pass SparkEnv into Execut...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3738#issuecomment-67605600 [Test build #24632 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24632/consoleFull) for PR 3738 at commit [`217062a`](https://githu

[GitHub] spark pull request: [SPARK-4465] runAsSparkUser doesn't affect Tas...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3741#issuecomment-67605602 [Test build #24631 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24631/consoleFull) for PR 3741 at commit [`3d6631f`](https://githu

[GitHub] spark pull request: [SPARK-4893] Add test fixture for resetting sy...

2014-12-18 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3739#issuecomment-67605537 > Ideally, a test should not modify environment shared by other tests. Or we cannot make the tests run in parallel. We can achieve parallelism by running multip

[GitHub] spark pull request: [SPARK-4893] Add test fixture for resetting sy...

2014-12-18 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3739#issuecomment-67605441 That looks like a [legitimate test failure](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24618/testReport/). It looks like the issue there was th

[GitHub] spark pull request: [SPARK-4465] runAsSparkUser doesn't affect Tas...

2014-12-18 Thread jongyoul
GitHub user jongyoul opened a pull request: https://github.com/apache/spark/pull/3741 [SPARK-4465] runAsSparkUser doesn't affect TaskRunner in Mesos environme... ...nt at all. - fixed a scope of runAsSparkUser from MesosExecutorDriver.run to MesosExecutorBackend.launchTask

[GitHub] spark pull request: [SPARK-4893] Add test fixture for resetting sy...

2014-12-18 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/3739#issuecomment-67605399 Ideally, a test should not modify environment shared by other tests. Or we cannot make the tests run in parallel. --- If your project is set up for it, you can reply to

[GitHub] spark pull request: Small refactoring to pass SparkEnv into Execut...

2014-12-18 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3738#issuecomment-67605336 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-4573] [SQL] Add SettableStructObjectIns...

2014-12-18 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/3429#discussion_r22092141 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveInspectors.scala --- @@ -119,12 +269,44 @@ private[hive] trait HiveInspectors { S

[GitHub] spark pull request: [SPARK-4573] [SQL] Add SettableStructObjectIns...

2014-12-18 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/3429#discussion_r22092047 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveInspectors.scala --- @@ -119,12 +269,44 @@ private[hive] trait HiveInspectors { S

[GitHub] spark pull request: [SPARK-4890] Upgrade Boto to 2.34.0; automatic...

2014-12-18 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3737#issuecomment-67604433 The deprecation warning idea was good; it turns out that there's a pending deprecation which will change the semantics of one of the methods we use, so I upgraded the c

[GitHub] spark pull request: [SPARK-4890] Upgrade Boto to 2.34.0; automatic...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3737#issuecomment-67604418 [Test build #24630 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24630/consoleFull) for PR 3737 at commit [`f02935d`](https://githu

[GitHub] spark pull request: [SPARK-4873][Streaming] WriteAheadLogBasedBloc...

2014-12-18 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/3721#discussion_r22091865 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/util/WriteAheadLogManager.scala --- @@ -125,7 +125,7 @@ private[streaming] class WriteAheadLogM

[GitHub] spark pull request: SPARK-4297 [BUILD] Build warning fixes omnibus

2014-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3157#issuecomment-67604251 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: SPARK-4297 [BUILD] Build warning fixes omnibus

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3157#issuecomment-67604244 [Test build #24626 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24626/consoleFull) for PR 3157 at commit [`cd50b2b`](https://gith

[GitHub] spark pull request: [SPARK-4873][Streaming] WriteAheadLogBasedBloc...

2014-12-18 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/3721#discussion_r22091804 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/util/WriteAheadLogManager.scala --- @@ -125,7 +125,7 @@ private[streaming] class WriteAheadLogM

[GitHub] spark pull request: [SPARK-4871][SQL] Show sql statement in spark ...

2014-12-18 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/3718#issuecomment-67604099 @marmbrus, is this ok to go? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [WIP][SPARK-4844][MLLIB]SGD should support cus...

2014-12-18 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/3729#issuecomment-67603907 The PR is temporarily close. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [WIP][SPARK-4844][MLLIB]SGD should support cus...

2014-12-18 Thread witgo
Github user witgo closed the pull request at: https://github.com/apache/spark/pull/3729 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: SPARK-3428. TaskMetrics for running tasks is m...

2014-12-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3684 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: SPARK-3428. TaskMetrics for running tasks is m...

2014-12-18 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3684#issuecomment-67603755 This looks good to me, so I'm going to merge this into `master` (1.3.0), `branch-1.2` (1.2.1) and `branch-1.1`, (1.1.2). Thanks! --- If your project is set up for it,

[GitHub] spark pull request: [SPARK-4871][SQL] Show sql statement in spark ...

2014-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3718#issuecomment-67603749 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4871][SQL] Show sql statement in spark ...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3718#issuecomment-67603746 [Test build #24625 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24625/consoleFull) for PR 3718 at commit [`e0d6b5d`](https://gith

[GitHub] spark pull request: Test parallelization WIP

2014-12-18 Thread JoshRosen
Github user JoshRosen closed the pull request at: https://github.com/apache/spark/pull/3681 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] spark pull request: [SPARK-4094][CORE] checkpoint should still be ...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2956#issuecomment-67603039 [Test build #24629 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24629/consoleFull) for PR 2956 at commit [`be7c1fa`](https://githu

[GitHub] spark pull request: [branch-1.0][SPARK-4148][PySpark] fix seed dis...

2014-12-18 Thread mengxr
Github user mengxr closed the pull request at: https://github.com/apache/spark/pull/3106 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-2075][Core] Make the compiler generate ...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3740#issuecomment-67602317 [Test build #24624 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24624/consoleFull) for PR 3740 at commit [`ca03559`](https://gith

[GitHub] spark pull request: [SPARK-2075][Core] Make the compiler generate ...

2014-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3740#issuecomment-67602319 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4526][MLLIB]Gradient should be added ba...

2014-12-18 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3677#issuecomment-67602032 Had an offline discussion with @witgo . The iterator interface looks good to me, but creating composite methods could be avoided. --- If your project is set up for it, yo

[GitHub] spark pull request: [WIP][SPARK-4844][MLLIB]SGD should support cus...

2014-12-18 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3729#issuecomment-67601970 Had an offline discussion with @witgo . The current implementation takes advantage of Parquet's serialization over Java's. However, this is too special for this particular

[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-67601642 [Test build #24627 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24627/consoleFull) for PR 2854 at commit [`95ae4db`](https://gith

[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...

2014-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-67601648 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-3967] don’t redundantly overwrite exe...

2014-12-18 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2848#issuecomment-67601524 This looks good to me, so I'm ready to merge it. One final little thing, though: since we have two separate PRs that address SPARK-3967, I'd like to create a new JIRA

[GitHub] spark pull request: [SPARK-1953][YARN]yarn client mode Application...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3607#issuecomment-67601463 [Test build #24628 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24628/consoleFull) for PR 3607 at commit [`2b27928`](https://githu

[GitHub] spark pull request: [SPARK-1953][YARN]yarn client mode Application...

2014-12-18 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on a diff in the pull request: https://github.com/apache/spark/pull/3607#discussion_r22090815 --- Diff: docs/running-on-yarn.md --- @@ -22,6 +22,14 @@ Most of the configs are the same for Spark on YARN as for other deployment modes P

[GitHub] spark pull request: [SPARK-4140] Document dynamic allocation

2014-12-18 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/3731#discussion_r22090703 --- Diff: docs/job-scheduling.md --- @@ -56,6 +56,112 @@ the same RDDs. For example, the [Shark](http://shark.cs.berkeley.edu) JDBC serve queries. In futur

[GitHub] spark pull request: [SPARK-4674] Refactor getCallSite

2014-12-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3532 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-4674] Refactor getCallSite

2014-12-18 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3532#issuecomment-67600571 This looks good to me (most of the diff is just an indentation change), so I'm going to merge this to `master` (1.3.0). Thanks! Just out of curiosity, what mot

[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-67600250 [Test build #24627 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24627/consoleFull) for PR 2854 at commit [`95ae4db`](https://githu

[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...

2014-12-18 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-67600208 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-1953][YARN]yarn client mode Application...

2014-12-18 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/3607#discussion_r22090369 --- Diff: docs/running-on-yarn.md --- @@ -22,6 +22,14 @@ Most of the configs are the same for Spark on YARN as for other deployment modes Property Na

[GitHub] spark pull request: [SPARK-1953][YARN]yarn client mode Application...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3607#issuecomment-67599686 [Test build #24623 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24623/consoleFull) for PR 3607 at commit [`b7acbb2`](https://gith

[GitHub] spark pull request: [SPARK-1953][YARN]yarn client mode Application...

2014-12-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3607#issuecomment-67599691 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: SPARK-4297 [BUILD] Build warning fixes omnibus

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3157#issuecomment-67599082 [Test build #24626 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24626/consoleFull) for PR 3157 at commit [`cd50b2b`](https://githu

[GitHub] spark pull request: SPARK-4297 [BUILD] Build warning fixes omnibus

2014-12-18 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3157#issuecomment-67598898 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-4728][MLLib] Add exponential, gamma, an...

2014-12-18 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3680#issuecomment-67598867 LGTM. Merged into master. I've assigned the Python API JIRA to you and set the target version to 1.3.0. So it is not in a hurry. Happy holidays! --- If your project is se

[GitHub] spark pull request: [SPARK-4728][MLLib] Add exponential, gamma, an...

2014-12-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3680 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-3000][CORE] drop old blocks to disk in ...

2014-12-18 Thread liyezhang556520
Github user liyezhang556520 commented on the pull request: https://github.com/apache/spark/pull/2134#issuecomment-67598353 Hi @andrewor14 , [PR#3629](https://github.com/apache/spark/pull/3629) solved the problem that I pointed out in your original patch [PR#1165](https://github.co

[GitHub] spark pull request: [SPARK-4871][SQL] Show sql statement in spark ...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3718#issuecomment-67598149 [Test build #24625 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24625/consoleFull) for PR 3718 at commit [`e0d6b5d`](https://githu

[GitHub] spark pull request: [SPARK-4861][SQL] Refactory command in spark s...

2014-12-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3712 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-4861][SQL] Refactory command in spark s...

2014-12-18 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/3712#issuecomment-67597165 Thanks! Merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-4573] [SQL] Add SettableStructObjectIns...

2014-12-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3429 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-2075][Core] Make the compiler generate ...

2014-12-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3740#issuecomment-67597016 [Test build #24624 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24624/consoleFull) for PR 3740 at commit [`ca03559`](https://githu

[GitHub] spark pull request: [SPARK-4573] [SQL] Add SettableStructObjectIns...

2014-12-18 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/3429#issuecomment-67596996 Thanks! Merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2554][SQL] Supporting SumDistinct parti...

2014-12-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3348 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-2554][SQL] Supporting SumDistinct parti...

2014-12-18 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/3348#issuecomment-67596915 Thanks! Merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

  1   2   3   4   5   >