[GitHub] spark pull request: [SPARK-5000][SQL] Alias support string literal...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3837#issuecomment-68336967 [Test build #24885 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24885/consoleFull) for PR 3837 at commit [`6d9ec95`](https://gith

[GitHub] spark pull request: [SPARK-5000][SQL] Alias support string literal...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3837#issuecomment-68336970 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4574][SQL] Adding support for defining ...

2014-12-29 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/3431#issuecomment-68336828 Hi @marmbrus, still working on this, tomorrow i will update this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark pull request: [SPARK-4574][SQL] Adding support for defining ...

2014-12-29 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/3431#issuecomment-68336623 ping. any progress here? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-4988][SQL] Fix: 'Create table ..as sele...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3821#issuecomment-68336490 [Test build #24887 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24887/consoleFull) for PR 3821 at commit [`1bab9e4`](https://githu

[GitHub] spark pull request: [SPARK-4988][SQL] Fix: 'Create table ..as sele...

2014-12-29 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/3821#issuecomment-68336405 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request: [SPARK-4990][Deploy]to find default properties...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3823#issuecomment-68335760 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4990][Deploy]to find default properties...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3823#issuecomment-68335758 [Test build #24883 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24883/consoleFull) for PR 3823 at commit [`55300bc`](https://gith

[GitHub] spark pull request: [SPARK-5002][SQL] Using ascending by default w...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3838#issuecomment-68335223 [Test build #24886 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24886/consoleFull) for PR 3838 at commit [`114b64a`](https://githu

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3820#issuecomment-68335236 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3820#issuecomment-68335232 [Test build #24884 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24884/consoleFull) for PR 3820 at commit [`dc6eaba`](https://gith

[GitHub] spark pull request: [SPARK-5002][SQL] Using ascending by default w...

2014-12-29 Thread scwf
GitHub user scwf opened a pull request: https://github.com/apache/spark/pull/3838 [SPARK-5002][SQL] Using ascending by default when not specify order in order by spark sql does not support ```SELECT a, b FROM testData2 ORDER BY a desc, b```. You can merge this pull request into a

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-29 Thread FlytxtRnD
Github user FlytxtRnD commented on the pull request: https://github.com/apache/spark/pull/3022#issuecomment-68335194 @tgaloppo Good Work @mengxr Thanks for giving us a chance to be a part of this contribution --- If your project is set up for it, you can reply to this email and ha

[GitHub] spark pull request: [SPARK-5000][SQL] Alias support string literal...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3837#issuecomment-68334080 [Test build #24885 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24885/consoleFull) for PR 3837 at commit [`6d9ec95`](https://githu

[GitHub] spark pull request: [SPARK-5000][SQL] Alias support string literal...

2014-12-29 Thread scwf
GitHub user scwf opened a pull request: https://github.com/apache/spark/pull/3837 [SPARK-5000][SQL] Alias support string literal in spark sql parser Alias support string literal in spark sql parser, such as select key , value as 'vvv' from tableA; You can merge this pull request

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2014-12-29 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/3820#discussion_r22339701 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableSupport.scala --- @@ -84,7 +86,8 @@ private[parquet] class RowReadSupport exte

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3820#issuecomment-68333255 [Test build #24884 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24884/consoleFull) for PR 3820 at commit [`dc6eaba`](https://githu

[GitHub] spark pull request: [SPARK-4990][Deploy]to find default properties...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3823#issuecomment-68332440 [Test build #24883 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24883/consoleFull) for PR 3823 at commit [`55300bc`](https://githu

[GitHub] spark pull request: [SPARK-4920][UI] add version on master and wor...

2014-12-29 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3769#issuecomment-68332339 This looks good to me, so I'll merge it. Thanks for the reminder. Before I merge this, though, I'm going to hotfix the package-level SPARK_VERSION into the bac

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3732#issuecomment-68331919 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3732#issuecomment-68331913 [Test build #24882 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24882/consoleFull) for PR 3732 at commit [`d66b01c`](https://gith

[GitHub] spark pull request: [SPARK-4813][Streaming] Fix the issue that Con...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3661#issuecomment-68331877 [Test build #24881 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24881/consoleFull) for PR 3661 at commit [`52247f5`](https://gith

[GitHub] spark pull request: [SPARK-4813][Streaming] Fix the issue that Con...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3661#issuecomment-68331881 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-2304] tera sort example program for shu...

2014-12-29 Thread liuqiyun
Github user liuqiyun commented on the pull request: https://github.com/apache/spark/pull/1242#issuecomment-68331374 So how to save as the uncompressed binary representation in the GenSort.scala program? I want to compare it with Hadoop MR which also use the uncompressed binary represe

[GitHub] spark pull request: SPARK-2686 Add Length and OctetLen support to ...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1586#issuecomment-68331226 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: SPARK-2686 Add Length and OctetLen support to ...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1586#issuecomment-68331223 QA results for PR 1586:- This patch FAILED unit tests.For more information see test ouptut:https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24880/consol

[GitHub] spark pull request: [SPARK-4908][SQL] Prevent multiple concurrent ...

2014-12-29 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/3834#issuecomment-68330655 According to my earlier investigation, this issue seems to be related to the asynchronous execution feature enabled by default in Hive 0.13.1 JDBC driver. I'm not prett

[GitHub] spark pull request: [MLlib]delete the "train" function

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3836#issuecomment-68329970 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [MLlib]delete the "train" function

2014-12-29 Thread ljzzju
GitHub user ljzzju opened a pull request: https://github.com/apache/spark/pull/3836 [MLlib]delete the "train" function To make the functions with the same in "object" effective, specially when using java reflection. As the "train" function defined in "class DecisionTree" will hi

[GitHub] spark pull request: SPARK-4963 [SQL] HiveTableScan return mutable ...

2014-12-29 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/3827#issuecomment-68329848 @yanbohappy Actually, we can move the `copy` call to [`execution.Sample.execute`] [1]. In this way, queries without sampling are not negatively effected. [1]:

[GitHub] spark pull request: SPARK-4963 [SQL] HiveTableScan return mutable ...

2014-12-29 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/3827#issuecomment-68329556 Hey @yanbohappy, as I've commented in the JIRA, would you mind to do a micro benchmark using code in #758 to see whether this fix introduces noticeable performance regr

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3732#issuecomment-68329500 [Test build #24882 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24882/consoleFull) for PR 3732 at commit [`d66b01c`](https://githu

[GitHub] spark pull request: [SPARK-4920][UI] add version on master and wor...

2014-12-29 Thread liyezhang556520
Github user liyezhang556520 commented on the pull request: https://github.com/apache/spark/pull/3769#issuecomment-68329234 @JoshRosen , is this PR ready to merge? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-4908][SQL] Prevent multiple concurrent ...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3834#issuecomment-68329208 [Test build #24879 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24879/consoleFull) for PR 3834 at commit [`bf25300`](https://gith

[GitHub] spark pull request: [SPARK-4908][SQL] Prevent multiple concurrent ...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3834#issuecomment-68329213 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4813][Streaming] Fix the issue that Con...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3661#issuecomment-68328870 [Test build #24881 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24881/consoleFull) for PR 3661 at commit [`52247f5`](https://githu

[GitHub] spark pull request: [SPARK-4813][Streaming] Fix the issue that Con...

2014-12-29 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/3661#issuecomment-68328777 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-2686 Add Length and OctetLen support to ...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1586#issuecomment-68328503 QA tests have started for PR 1586. This patch DID NOT merge cleanly! View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24880/consoleFull

[GitHub] spark pull request: Changes to illustrate the principles of functi...

2014-12-29 Thread yujunliang
Github user yujunliang closed the pull request at: https://github.com/apache/spark/pull/3835 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Changes to illustrate the principles of functi...

2014-12-29 Thread yujunliang
Github user yujunliang commented on the pull request: https://github.com/apache/spark/pull/3835#issuecomment-68328295 Let me create another one instead. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-4990][Deploy]to find default properties...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3823#issuecomment-68327501 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4990][Deploy]to find default properties...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3823#issuecomment-68327498 [Test build #24877 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24877/consoleFull) for PR 3823 at commit [`d8d3cb7`](https://gith

[GitHub] spark pull request: Changes to illustrate the principles of functi...

2014-12-29 Thread yujunliang
Github user yujunliang commented on the pull request: https://github.com/apache/spark/pull/3835#issuecomment-68327317 Please don't merge, it is just for illustration purpose. Thanks. ! --- If your project is set up for it, you can reply to this email and h

[GitHub] spark pull request: Changes to illustrate the principles of functi...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3835#issuecomment-68327211 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: Changes to illustrate the principles of functi...

2014-12-29 Thread yujunliang
GitHub user yujunliang opened a pull request: https://github.com/apache/spark/pull/3835 Changes to illustrate the principles of functional programming. You can merge this pull request into a Git repository by running: $ git pull https://github.com/yujunliang/spark functional-p

[GitHub] spark pull request: [SPARK-4908][SQL] Prevent multiple concurrent ...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3834#issuecomment-68326513 [Test build #24879 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24879/consoleFull) for PR 3834 at commit [`bf25300`](https://githu

[GitHub] spark pull request: [SPARK-4908][SQL] Prevent multiple concurrent ...

2014-12-29 Thread marmbrus
GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/3834 [SPARK-4908][SQL] Prevent multiple concurrent hive native commands This is just a quick fix that locks when calling `runHive`. If we can find a way to avoid the error without a global lock that wo

[GitHub] spark pull request: [SPARK-4813][Streaming] Fix the issue that Con...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3661#issuecomment-68326338 [Test build #24876 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24876/consoleFull) for PR 3661 at commit [`52247f5`](https://gith

[GitHub] spark pull request: [SPARK-4813][Streaming] Fix the issue that Con...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3661#issuecomment-68326339 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4835] [WIP] Disable validateOutputSpecs...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3832#issuecomment-68326012 [Test build #24874 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24874/consoleFull) for PR 3832 at commit [`762e473`](https://gith

[GitHub] spark pull request: SPARK-4921. TaskSetManager.dequeueTask returns...

2014-12-29 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/3816#issuecomment-68326024 yes, @mateiz was right, I would like to give more clues to facilitate your debugging 1, NO_PREF will not be adjusted by getAllowedLocalityLevel() method of Ta

[GitHub] spark pull request: [SPARK-4835] [WIP] Disable validateOutputSpecs...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3832#issuecomment-68326015 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4990][Deploy]to find default properties...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3823#issuecomment-68325790 [Test build #24875 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24875/consoleFull) for PR 3823 at commit [`07b9ebf`](https://gith

[GitHub] spark pull request: [SPARK-4990][Deploy]to find default properties...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3823#issuecomment-68325792 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4990][Deploy]to find default properties...

2014-12-29 Thread OopsOutOfMemory
Github user OopsOutOfMemory commented on a diff in the pull request: https://github.com/apache/spark/pull/3823#discussion_r22337458 --- Diff: bin/spark-submit --- @@ -42,7 +42,10 @@ while (($#)); do shift done -DEFAULT_PROPERTIES_FILE="$SPARK_HOME/conf/spark-de

[GitHub] spark pull request: [SPARK-2309][MLlib] Multinomial Logistic Regre...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3833#issuecomment-68325568 [Test build #24878 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24878/consoleFull) for PR 3833 at commit [`a97b03a`](https://gith

[GitHub] spark pull request: [SPARK-2309][MLlib] Multinomial Logistic Regre...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3833#issuecomment-68325569 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-2309][MLlib] Multinomial Logistic Regre...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3833#issuecomment-68325298 [Test build #24878 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24878/consoleFull) for PR 3833 at commit [`a97b03a`](https://githu

[GitHub] spark pull request: [SPARK-2309][MLlib] Multinomial Logistic Regre...

2014-12-29 Thread dbtsai
GitHub user dbtsai opened a pull request: https://github.com/apache/spark/pull/3833 [SPARK-2309][MLlib] Multinomial Logistic Regression #1379 is automatically closed by asfgit, and github can not reopen it once it's closed, so this will be the new PR. Binary Logistic Regres

[GitHub] spark pull request: [SPARK-4501][Core] - Create build/mvn to autom...

2014-12-29 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/3707#issuecomment-68324363 @brennonyork Sorry, I tried many times, could not reproduce the issue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request: [SPARK-4990][Deploy]to find default properties...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3823#issuecomment-68324325 [Test build #24877 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24877/consoleFull) for PR 3823 at commit [`d8d3cb7`](https://githu

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-68324255 [Test build #556 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/556/consoleFull) for PR 3779 at commit [`32d363f`](https://githu

[GitHub] spark pull request: [SPARK-4813][Streaming] Fix the issue that Con...

2014-12-29 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/3661#issuecomment-68323743 I deleted the commit about `isTerminated`. It will be sent in a different PR. --- If your project is set up for it, you can reply to this email and have your reply appea

[GitHub] spark pull request: [SPARK-4813][Streaming] Fix the issue that Con...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3661#issuecomment-68323687 [Test build #24876 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24876/consoleFull) for PR 3661 at commit [`52247f5`](https://githu

[GitHub] spark pull request: [SPARK-4417] New API: sample RDD to fixed numb...

2014-12-29 Thread ilganeli
Github user ilganeli commented on the pull request: https://github.com/apache/spark/pull/3723#issuecomment-68322948 Mark and Matei - I hear you guys and understand what you're saying. Does it make sense to create new Jira to refactor the RDD interface to move the advanced sampling me

[GitHub] spark pull request: [SPARK-4990][Deploy]to find default properties...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3823#issuecomment-68322885 [Test build #24875 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24875/consoleFull) for PR 3823 at commit [`07b9ebf`](https://githu

[GitHub] spark pull request: [SPARK-4990][Deploy]to find default properties...

2014-12-29 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on the pull request: https://github.com/apache/spark/pull/3823#issuecomment-68322557 @OopsOutOfMemory Ok I got what you mean. After checking the logic in `SparkSubmitArguments.scala` I do think that your solution is more reasonable. Thanks.

[GitHub] spark pull request: spark-core - [SPARK-4787] - Stop sparkcontext ...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3809#issuecomment-68322408 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: spark-core - [SPARK-4787] - Stop sparkcontext ...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3809#issuecomment-68322406 [Test build #24873 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24873/consoleFull) for PR 3809 at commit [`5661e01`](https://gith

[GitHub] spark pull request: [SPARK-4989][CORE] avoid wrong eventlog conf c...

2014-12-29 Thread liyezhang556520
Github user liyezhang556520 commented on a diff in the pull request: https://github.com/apache/spark/pull/3824#discussion_r22336254 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -719,26 +719,28 @@ private[spark] class Master( def rebuildSpa

[GitHub] spark pull request: [SPARK-4961] [CORE] Put HadoopRDD.getPartition...

2014-12-29 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/3794#discussion_r22336168 --- Diff: core/src/main/scala/org/apache/spark/rdd/HadoopRDD.scala --- @@ -203,9 +204,27 @@ class HadoopRDD[K, V]( for (i <- 0 until inputSplits.s

[GitHub] spark pull request: [SPARK-4835] [WIP] Disable validateOutputSpecs...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3832#issuecomment-68322195 [Test build #24874 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24874/consoleFull) for PR 3832 at commit [`762e473`](https://githu

[GitHub] spark pull request: [SPARK-4835] [WIP] Disable validateOutputSpecs...

2014-12-29 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3832#issuecomment-68322201 The `[WIP]` tag in the title is because I just realized that we may be able to improve this based on some discussion at the JIRA ticket. --- If your project is set up

[GitHub] spark pull request: [SPARK-3982] [Streaming] [PySpark] Python API:...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2833#issuecomment-68322155 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-3982] [Streaming] [PySpark] Python API:...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2833#issuecomment-68322153 [Test build #24872 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24872/consoleFull) for PR 2833 at commit [`38c6342`](https://gith

[GitHub] spark pull request: [SPARK-4835] Disable validateOutputSpecs for S...

2014-12-29 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/3832 [SPARK-4835] Disable validateOutputSpecs for Spark Streaming jobs This patch disables output spec. validation for jobs launched through Spark Streaming, since this interferes with checkpoint recov

[GitHub] spark pull request: [YARN][SPARK-4929] Bug fix: fix the yarn-clien...

2014-12-29 Thread SaintBacchus
Github user SaintBacchus commented on the pull request: https://github.com/apache/spark/pull/3771#issuecomment-68321575 what @tgravescs says is close to the scenario, but it happens during the RM recover after broke down. ```scala if (finalStatus == FinalApplicati

[GitHub] spark pull request: [SPARK-4972][MLlib] Updated the scala doc for ...

2014-12-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3808 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-4972][MLlib] Updated the scala doc for ...

2014-12-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3808#issuecomment-68321431 LGTM. Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-3982] [Streaming] [PySpark] Python API:...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2833#issuecomment-68321410 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-3982] [Streaming] [PySpark] Python API:...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2833#issuecomment-68321406 [Test build #24871 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24871/consoleFull) for PR 2833 at commit [`3eb0d9f`](https://gith

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-68319961 [Test build #556 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/556/consoleFull) for PR 3779 at commit [`32d363f`](https://github

[GitHub] spark pull request: [SPARK-4790][STREAMING] Fix ReceivedBlockTrack...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3726#issuecomment-68319258 [Test build #24869 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24869/consoleFull) for PR 3726 at commit [`bbbacd1`](https://gith

[GitHub] spark pull request: [SPARK-4790][STREAMING] Fix ReceivedBlockTrack...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3726#issuecomment-68319259 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2014-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-68318551 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-68318545 [Test build #24870 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24870/consoleFull) for PR 3779 at commit [`32d363f`](https://gith

[GitHub] spark pull request: spark-core - [SPARK-4787] - Stop sparkcontext ...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3809#issuecomment-68317909 [Test build #24873 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24873/consoleFull) for PR 3809 at commit [`5661e01`](https://githu

[GitHub] spark pull request: [SPARK-3982] [Streaming] [PySpark] Python API:...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2833#issuecomment-68317573 [Test build #24872 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24872/consoleFull) for PR 2833 at commit [`38c6342`](https://githu

[GitHub] spark pull request: spark-core - [SPARK-4787] - Stop sparkcontext ...

2014-12-29 Thread tigerquoll
Github user tigerquoll commented on a diff in the pull request: https://github.com/apache/spark/pull/3809#discussion_r22334486 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -329,8 +329,11 @@ class SparkContext(config: SparkConf) extends Logging with Execu

[GitHub] spark pull request: [SPARK-4925][SQL] Publish Spark SQL hive-thrif...

2014-12-29 Thread alexliu68
Github user alexliu68 commented on the pull request: https://github.com/apache/spark/pull/3766#issuecomment-68317258 I removed it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-3982] [Streaming] [PySpark] Python API:...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2833#issuecomment-68316677 [Test build #24871 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24871/consoleFull) for PR 2833 at commit [`3eb0d9f`](https://githu

[GitHub] spark pull request: [SPARK-4882] Register PythonBroadcast with Kry...

2014-12-29 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/3831#issuecomment-68315787 LGTM, thanks for fixing it! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-4417] New API: sample RDD to fixed numb...

2014-12-29 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/3723#issuecomment-68315776 I agree with Mark about this. This method doesn't seem worth adding an API for by default, especially if it will be tricky to implement. For extracting small samples, take

[GitHub] spark pull request: SPARK-3955 part 2 [CORE] [HOTFIX] Different ve...

2014-12-29 Thread jongyoul
Github user jongyoul commented on the pull request: https://github.com/apache/spark/pull/3829#issuecomment-68315395 @srowen Oops... that's my mistake that I didn't change artifact id correctly when I make a pull request again. Thanks for fixing it. --- If your project is set up for i

[GitHub] spark pull request: Added setMinCount to Word2Vec.scala

2014-12-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3693 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: Added setMinCount to Word2Vec.scala

2014-12-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3693#issuecomment-68315410 LGTM (including the change to `norm`). Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub a

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/3022#issuecomment-68315285 @tgaloppo I've merged this into master. Thanks for contributing GMM! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: SPARK-4156 [MLLIB] EM algorithm for GMMs

2014-12-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3022 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-68314408 [Test build #24870 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24870/consoleFull) for PR 3779 at commit [`32d363f`](https://githu

[GitHub] spark pull request: [SPARK-4790][STREAMING] Fix ReceivedBlockTrack...

2014-12-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3726#issuecomment-68314063 [Test build #24869 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24869/consoleFull) for PR 3726 at commit [`bbbacd1`](https://githu

  1   2   3   >