[GitHub] spark pull request: some trivial fixes

2015-01-08 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3947#issuecomment-69157174 I'm not sure about most of these. - Why is tempDir a field? - _ is more idiomatic in Scala than null for a reference field's default value. - Why remove

[GitHub] spark pull request: some trivial fixes

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3947#issuecomment-69158629 [Test build #25214 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25214/consoleFull) for PR 3947 at commit

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22643358 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLSessionManager.scala --- @@ -50,6 +51,7 @@ private[hive]

[GitHub] spark pull request: some trivial fixes

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3947#issuecomment-69158640 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4970] Do not read spark.executor.memory...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3805#issuecomment-69159079 [Test build #25213 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25213/consoleFull) for PR 3805 at commit

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3820#issuecomment-69160063 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3820#issuecomment-69160056 [Test build #25211 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25211/consoleFull) for PR 3820 at commit

[GitHub] spark pull request: SPARK-4963 [SQL] Add copy to SQL's Sample oper...

2015-01-08 Thread yanbohappy
Github user yanbohappy commented on the pull request: https://github.com/apache/spark/pull/3827#issuecomment-69160371 Can anyone verify and merge this patch? It's a bug appeared frequently and fix it asap will be better. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/3946#issuecomment-69160716 @tianyi I understand that because Hive 0.13.1 made incompatible changes to `SessionManager.openSession`, and you'd like to avoid adding new stuff to the shim layer.

[GitHub] spark pull request: [SPARK-4861][SQL] Refactory command in spark s...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3948#issuecomment-69161493 [Test build #25220 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25220/consoleFull) for PR 3948 at commit

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3935#issuecomment-69162373 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3935#issuecomment-69162366 [Test build #25216 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25216/consoleFull) for PR 3935 at commit

[GitHub] spark pull request: Document that groupByKey will OOM for large ke...

2015-01-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/3936#discussion_r22644880 --- Diff: core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala --- @@ -437,6 +437,9 @@ class PairRDDFunctions[K, V](self: RDD[(K, V)]) *

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22645139 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/ui/ThriftServerPage.scala --- @@ -0,0 +1,179 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-4861][SQL] Refactory command in spark s...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3948#issuecomment-69163952 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4861][SQL] Refactory command in spark s...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3948#issuecomment-69163949 [Test build #25218 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25218/consoleFull) for PR 3948 at commit

[GitHub] spark pull request: [SPARK-4861][SQL] Refactory command in spark s...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3948#issuecomment-69156592 [Test build #25218 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25218/consoleFull) for PR 3948 at commit

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22642887 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suite.scala --- @@ -121,7 +152,16 @@ class

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/3946#issuecomment-69158309 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22643231 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suite.scala --- @@ -70,6 +73,34 @@ class

[GitHub] spark pull request: [SPARK-4406] [MLib] FIX: Validate k in SVD

2015-01-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/3945#discussion_r22643219 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/IndexedRowMatrix.scala --- @@ -102,6 +102,9 @@ class IndexedRowMatrix( k:

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22643277 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2.scala --- @@ -28,6 +28,7 @@ import

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22643431 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/ui/ThriftServerUIEventListener.scala --- @@ -0,0 +1,182 @@ +/*

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3946#issuecomment-69158816 [Test build #25219 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25219/consoleFull) for PR 3946 at commit

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22643414 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/ui/ThriftServerTab.scala --- @@ -0,0 +1,45 @@ +/* + *

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3946#issuecomment-69158918 [Test build #25219 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25219/consoleFull) for PR 3946 at commit

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3946#issuecomment-69158921 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread tianyi
Github user tianyi commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22644087 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suite.scala --- @@ -121,7 +152,16 @@ class

[GitHub] spark pull request: Spark 3883: SSL support for HttpServer and Akk...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3571#issuecomment-69162117 [Test build #25215 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25215/consoleFull) for PR 3571 at commit

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22644599 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/ui/ThriftServerPage.scala --- @@ -0,0 +1,179 @@ +/* + * Licensed

[GitHub] spark pull request: Spark 3883: SSL support for HttpServer and Akk...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3571#issuecomment-69162123 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22645081 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/ui/ThriftServerPage.scala --- @@ -0,0 +1,179 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22645935 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/ui/ThriftServerPage.scala --- @@ -0,0 +1,179 @@ +/* + * Licensed

[GitHub] spark pull request: some trivial fixes

2015-01-08 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3947#issuecomment-69166176 @prabeesh my question about `/tmp` was why it is not a local variable. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22642963 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suite.scala --- @@ -379,4 +421,33 @@ class

[GitHub] spark pull request: [SPARK-5009][SQL] [WIP] Long keyword support i...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3926#issuecomment-69159164 [Test build #25212 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25212/consoleFull) for PR 3926 at commit

[GitHub] spark pull request: [SPARK-4970] Do not read spark.executor.memory...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3805#issuecomment-69159092 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5009][SQL] [WIP] Long keyword support i...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3926#issuecomment-69159170 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5100][SQL] add thriftserver-ui support

2015-01-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/3946#discussion_r22643566 --- Diff: sql/hive-thriftserver/v0.12.0/src/main/scala/org/apache/spark/sql/hive/thriftserver/Shim12.scala --- @@ -184,8 +184,10 @@ private[hive] class

[GitHub] spark pull request: [SPARK-5145][Mllib] Add BLAS.dsyr and use it i...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3949#issuecomment-69162577 [Test build #25221 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25221/consoleFull) for PR 3949 at commit

[GitHub] spark pull request: Add BLAS.dsyr and use it in GaussianMixtureEM

2015-01-08 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/3949 Add BLAS.dsyr and use it in GaussianMixtureEM This pr uses BLAS.dsyr to replace few implementations in GaussianMixtureEM. You can merge this pull request into a Git repository by running: $ git

[GitHub] spark pull request: some trivial fixes

2015-01-08 Thread prabeesh
Github user prabeesh commented on the pull request: https://github.com/apache/spark/pull/3947#issuecomment-69165253 - the hard code '\tmp' may be creating garbage. so created temp directory using internal methods and deleting after the use. - revert to _ - added the finally

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-08 Thread huitseeker
Github user huitseeker commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r22646185 --- Diff: external/kafka/pom.xml --- @@ -44,7 +44,7 @@ dependency groupIdorg.apache.kafka/groupId

[GitHub] spark pull request: [SPARK-4697][YARN]System properties should ove...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3557#issuecomment-69177950 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4697][YARN]System properties should ove...

2015-01-08 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on the pull request: https://github.com/apache/spark/pull/3557#issuecomment-69177980 I've tested it and results are: Before this patch: Setting|name in client mode|name in cluster mode

[GitHub] spark pull request: [SPARK-4697][YARN]System properties should ove...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3557#issuecomment-69177938 [Test build #25224 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25224/consoleFull) for PR 3557 at commit

[GitHub] spark pull request: [SPARK-5064][GraphX] Add numEdges upperbound v...

2015-01-08 Thread kj-ki
GitHub user kj-ki opened a pull request: https://github.com/apache/spark/pull/3950 [SPARK-5064][GraphX] Add numEdges upperbound validation for R-MAT graph generator to prevent infinite loop I looked into GraphGenerators#chooseCell, and found that chooseCell can't generate more

[GitHub] spark pull request: [SPARK-5064][GraphX] Add numEdges upperbound v...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3950#issuecomment-69179479 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-4406] [MLib] FIX: Validate k in SVD

2015-01-08 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3945#issuecomment-69180828 @MechCoder your patch has no merge conflicts. Do you mean Jenkins? As you can see above he's waiting for authorization from an admin to test your patch, since you're not

[GitHub] spark pull request: [SPARK-4284] BinaryClassificationMetrics preci...

2015-01-08 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3933#issuecomment-69181021 @Lewuathe FWIW I vote for deprecating existing methods, but leaving the behavior the same, and introducing new methods like `prCurve` whose return value is 'corrected'.

[GitHub] spark pull request: [SPARK-3541][MLLIB] New ALS implementation wit...

2015-01-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/3720#discussion_r22652092 --- Diff: examples/src/main/scala/org/apache/spark/examples/ml/MovieLensALS.scala --- @@ -0,0 +1,173 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-3541][MLLIB] New ALS implementation wit...

2015-01-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/3720#discussion_r22652129 --- Diff: mllib/src/main/scala/org/apache/spark/ml/recommendation/ALS.scala --- @@ -0,0 +1,964 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-4871][SQL] Show sql statement in spark ...

2015-01-08 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/3718#issuecomment-69181757 This LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-3541][MLLIB] New ALS implementation wit...

2015-01-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/3720#discussion_r22652354 --- Diff: mllib/src/main/scala/org/apache/spark/ml/recommendation/ALS.scala --- @@ -0,0 +1,964 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-5094][MLlib] Add Pythoin API for Gradie...

2015-01-08 Thread kazk1018
GitHub user kazk1018 opened a pull request: https://github.com/apache/spark/pull/3951 [SPARK-5094][MLlib] Add Pythoin API for Gradient Boosted Trees This PR is implementing the Gradient Boosted Trees for Python API. You can merge this pull request into a Git repository by running:

[GitHub] spark pull request: [SPARK-5094][MLlib] Add Pythoin API for Gradie...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3951#issuecomment-69182335 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-5136 [DOCS] Improve documentation around...

2015-01-08 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/3952 SPARK-5136 [DOCS] Improve documentation around setting up Spark IntelliJ project This PR simply points to the IntelliJ wiki page instead of also including IntelliJ notes in the docs. The intent

[GitHub] spark pull request: SPARK-5087. [YARN] Merge yarn.Client and yarn....

2015-01-08 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3896#issuecomment-69214673 Ok LGTM I'm merging this into master thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: some trivial fixes

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3947#issuecomment-69215957 [Test build #25236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25236/consoleFull) for PR 3947 at commit

[GitHub] spark pull request: SPARK-2168 [Spark core] Use relative URIs for ...

2015-01-08 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/1160#issuecomment-69217006 Looks like branch-1.0 is consistently failing tests (not related to this PR) --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-4891][PySpark][MLlib] Add gamma/log nor...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3955#issuecomment-69217503 [Test build #25237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25237/consoleFull) for PR 3955 at commit

[GitHub] spark pull request: [SPARK-4973][CORE] Local directory in the driv...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3811#issuecomment-69217497 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4973][CORE] Local directory in the driv...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3811#issuecomment-69217485 [Test build #25233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25233/consoleFull) for PR 3811 at commit

[GitHub] spark pull request: [SPARK-4949]shutdownCallback in SparkDeploySch...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3781#issuecomment-69217872 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4949]shutdownCallback in SparkDeploySch...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3781#issuecomment-69217857 [Test build #25235 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25235/consoleFull) for PR 3781 at commit

[GitHub] spark pull request: [Minor] Fix the value represented by spark.exe...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3812#issuecomment-69218489 [Test build #25234 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25234/consoleFull) for PR 3812 at commit

[GitHub] spark pull request: [SPARK-4891][PySpark][MLlib] Add gamma/log nor...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3955#issuecomment-69219960 [Test build #25239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25239/consoleFull) for PR 3955 at commit

[GitHub] spark pull request: SPARK-5087. [YARN] Merge yarn.Client and yarn....

2015-01-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3896 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3935#issuecomment-69215161 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3935#issuecomment-69215154 [Test build #25232 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25232/consoleFull) for PR 3935 at commit

[GitHub] spark pull request: [SPARK-4891][PySpark][MLlib] Add gamma/log nor...

2015-01-08 Thread rnowling
GitHub user rnowling opened a pull request: https://github.com/apache/spark/pull/3955 [SPARK-4891][PySpark][MLlib] Add gamma/log normal/exp dist sampling to P... ...ySpark MLlib This is a follow up to PR3680 https://github.com/apache/spark/pull/3680 . You can merge this

[GitHub] spark pull request: [SPARK-4857] [CORE] Adds Executor membership e...

2015-01-08 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3711#issuecomment-69216849 Ok, latest changes look fine to me. Any other comments @pwendell @JoshRosen? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-4891][PySpark][MLlib] Add gamma/log nor...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3955#issuecomment-69217633 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4891][PySpark][MLlib] Add gamma/log nor...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3955#issuecomment-69217630 [Test build #25237 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25237/consoleFull) for PR 3955 at commit

[GitHub] spark pull request: [Minor] Fix the value represented by spark.exe...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3812#issuecomment-69218500 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5064][GraphX] Add numEdges upperbound v...

2015-01-08 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/3950#issuecomment-69219030 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-4697][YARN]System properties should ove...

2015-01-08 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/3557#issuecomment-69218980 Actually that's a little bit surprising. SparkPi.scala sets the app name to Spark Pi, so I'd expect that to show up when the user does not explicitly override it. Also,

[GitHub] spark pull request: [SPARK-4891][PySpark][MLlib] Add gamma/log nor...

2015-01-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3955#issuecomment-69219260 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4891][PySpark][MLlib] Add gamma/log nor...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3955#issuecomment-69219256 [Test build #25238 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25238/consoleFull) for PR 3955 at commit

[GitHub] spark pull request: [SPARK-4891][PySpark][MLlib] Add gamma/log nor...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3955#issuecomment-69219108 [Test build #25238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25238/consoleFull) for PR 3955 at commit

[GitHub] spark pull request: [SPARK-4917] Add a function to convert into a ...

2015-01-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3760 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-4917] Add a function to convert into a ...

2015-01-08 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/3760#issuecomment-69219680 Thanks! Merged into master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5064][GraphX] Add numEdges upperbound v...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3950#issuecomment-69219964 [Test build #25240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25240/consoleFull) for PR 3950 at commit

[GitHub] spark pull request: [SPARK-5135][SQL] Add support for describe [ex...

2015-01-08 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/3935#issuecomment-69220158 @OopsOutOfMemory, test failed for hive describe cmd, this is because now hive describe will go into ddlParser not hiveQL ``` new SchemaRDD(this,

[GitHub] spark pull request: [SPARK-4951][Core] Fix the issue that a busy e...

2015-01-08 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3783#discussion_r22668329 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -315,7 +314,7 @@ private[spark] class ExecutorAllocationManager(

[GitHub] spark pull request: Support for Mesos DockerInfo

2015-01-08 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3074#issuecomment-69221016 This is failing tests because `conf/docker.properties.template` does not have the apache license header. You'll need to add this file to `.rat-excludes`. --- If your

[GitHub] spark pull request: Support for Mesos DockerInfo

2015-01-08 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3074#issuecomment-69221113 @hellertime could you add `[SPARK-2691]` to the title? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-4406] [MLib] FIX: Validate k in SVD

2015-01-08 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3945#issuecomment-69221378 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-4406] [MLib] FIX: Validate k in SVD

2015-01-08 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3945#issuecomment-69221364 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-5148 [MLlib] Make usersOut/productsOut s...

2015-01-08 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3953#issuecomment-69221662 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-4406] [MLib] FIX: Validate k in SVD

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3945#issuecomment-69221605 [Test build #25241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25241/consoleFull) for PR 3945 at commit

[GitHub] spark pull request: SPARK-5148 [MLlib] Make usersOut/productsOut s...

2015-01-08 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/3953#discussion_r22668716 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/recommendation/ALSSuite.scala --- @@ -17,17 +17,16 @@ package

[GitHub] spark pull request: SPARK-5148 [MLlib] Make usersOut/productsOut s...

2015-01-08 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3953#issuecomment-69221669 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: SPARK-5148 [MLlib] Make usersOut/productsOut s...

2015-01-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3953#issuecomment-69222360 [Test build #25242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/25242/consoleFull) for PR 3953 at commit

[GitHub] spark pull request: [SPARK-4951][Core] Fix the issue that a busy e...

2015-01-08 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3783#discussion_r22668989 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -426,39 +426,44 @@ private[spark] class ExecutorAllocationManager(

[GitHub] spark pull request: [SPARK-4949]shutdownCallback in SparkDeploySch...

2015-01-08 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/3781#issuecomment-69222403 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [YARN]HOTFIX: fetch the correct max attempts

2015-01-08 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/3942#issuecomment-69222511 ah ok. can you please file jira and link to the pr. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [Minor] Fix the value represented by spark.exe...

2015-01-08 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/3812#issuecomment-69222728 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-4951][Core] Fix the issue that a busy e...

2015-01-08 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3783#discussion_r22669152 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -426,39 +426,44 @@ private[spark] class ExecutorAllocationManager(

[GitHub] spark pull request: [SPARK-4951][Core] Fix the issue that a busy e...

2015-01-08 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3783#discussion_r22669098 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -478,6 +486,8 @@ private[spark] class ExecutorAllocationManager(

<    1   2   3   4   5   6   7   8   >