[GitHub] spark pull request: [HOTFIX][BUILD][TEST-MAVEN]Remove duplicate de...

2016-01-21 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/10868 [HOTFIX][BUILD][TEST-MAVEN]Remove duplicate dependency You can merge this pull request into a Git repository by running: $ git pull https://github.com/zsxwing/spark hotfix-akka-pom

[GitHub] spark pull request: [SPARK-12760] [DOCS] invalid lambda expression...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10867#issuecomment-173635852 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12760] [DOCS] invalid lambda expression...

2016-01-21 Thread mortada
Github user mortada commented on the pull request: https://github.com/apache/spark/pull/10867#issuecomment-173639832 @srowen it compiles for local, let me test that on a cluster I noticed that the next line is actually also invalid python ``` In [7]:

[GitHub] spark pull request: [HOTFIX][BUILD][TEST-MAVEN]Remove duplicate de...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10868#issuecomment-173642639 **[Test build #49879 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49879/consoleFull)** for PR 10868 at commit

[GitHub] spark pull request: [SPARK-12760] [DOCS] invalid lambda expression...

2016-01-21 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10867#issuecomment-173636353 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11922][PYSPARK][ML] Python api for ml.f...

2016-01-21 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/10085#issuecomment-173644319 Think I addressed all of @jkbradley's comments --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173644365 so I haven't seen any use cases this would break. I would argue is they are relying on this behavior its a bug in the user code. They should be using shut

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173645684 I don't think this is quite addressing my point, but at best I'm asserting there's a choice between which "bad" behavior you want to deal with, not that either behavior

[GitHub] spark pull request: [HOTFIX][BUILD][TEST-MAVEN]Remove duplicate de...

2016-01-21 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10868#issuecomment-173645944 I think test-maven might have to be in lowercase? Let's wait and see --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-1680] [Docs] Explain environment variab...

2016-01-21 Thread weineran
GitHub user weineran opened a pull request: https://github.com/apache/spark/pull/10869 [SPARK-1680] [Docs] Explain environment variables for running on YARN in cluster mode JIRA 1680 added a property called spark.yarn.appMasterEnv. This PR draws users' attention to this special

[GitHub] spark pull request: [SPARK-1680] [Docs] Explain environment variab...

2016-01-21 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/10869#issuecomment-173664361 you should file a separate jira for this. The original went in and is closed. I'm fine with the text, it might be nice to add something about preferring

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173664570 Sure, but it becomes much more likely to bite if you always kill the threads immediately, if they're still running, rather than have them killed a little bit later by

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173666801 > Are you saying YARN immediately kills the container here? I'm saying that it's the user's fault if his application depends on that non-predictable behavior.

[GitHub] spark pull request: [SPARK-10873] Support column sort and search f...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10648#issuecomment-173669338 **[Test build #49878 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49878/consoleFull)** for PR 10648 at commit

[GitHub] spark pull request: [SPARK-10873] Support column sort and search f...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10648#issuecomment-173669838 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10873] Support column sort and search f...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10648#issuecomment-173669837 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-1680] [Docs] Explain environment variab...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10869#issuecomment-173651250 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [HOTFIX][BUILD][test-maven]Remove duplicate de...

2016-01-21 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10868#issuecomment-173656764 right... just updated it. retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173660845 Sorry Sean, I don't see how we're not addressing your comment. Without the change, the behavior you're concerned about *already exists*, because YARN kills containers

[GitHub] spark pull request: [SPARK-12933][SQL] Initial implementation of C...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10851#issuecomment-173662267 **[Test build #49882 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49882/consoleFull)** for PR 10851 at commit

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173671561 @zhuoliu please re-open this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-9656] [MLlib] [Python] Add missing meth...

2016-01-21 Thread dusenberrymw
Github user dusenberrymw commented on the pull request: https://github.com/apache/spark/pull/9441#issuecomment-173673834 ping @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-1680] [Docs] Explain environment variab...

2016-01-21 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10869#issuecomment-173654598 CC @sryza @vanzin @tgravescs for a check --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12933][SQL] Initial implementation of C...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10851#issuecomment-173662666 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [HOTFIX][BUILD][test-maven]Remove duplicate de...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10868#issuecomment-173662345 **[Test build #49881 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49881/consoleFull)** for PR 10868 at commit

[GitHub] spark pull request: [SPARK-12933][SQL] Initial implementation of C...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10851#issuecomment-173662658 **[Test build #49882 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49882/consoleFull)** for PR 10851 at commit

[GitHub] spark pull request: [SPARK-12933][SQL] Initial implementation of C...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10851#issuecomment-173662670 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6166] Limit number of concurrent outbou...

2016-01-21 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/10838#issuecomment-173682258 @wzhfy from looking at the linked original PR this is based on the large number of requests happens with a very large # of nodes and smaller amounts of data per node.

[GitHub] spark pull request: [HOTFIX][BUILD][test-maven]Remove duplicate de...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10868#issuecomment-173688751 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [HOTFIX][BUILD][test-maven]Remove duplicate de...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10868#issuecomment-173688747 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [HOTFIX][BUILD][test-maven]Remove duplicate de...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10868#issuecomment-173688606 **[Test build #49881 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49881/consoleFull)** for PR 10868 at commit

[GitHub] spark pull request: [SPARK-12629] [SparkR] Fixes for DataFrame sav...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10580#issuecomment-173690120 **[Test build #49884 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49884/consoleFull)** for PR 10580 at commit

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173691624 I'm on board with this if it's true that YARN virtually immediately kills a JVM like this if it's not done by the time the NM thinks it's done. Then indeed regardless of

[GitHub] spark pull request: [SPARK-12629] [SparkR] Fixes for DataFrame sav...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10580#issuecomment-173694688 **[Test build #49884 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49884/consoleFull)** for PR 10580 at commit

[GitHub] spark pull request: [SPARK-12629] [SparkR] Fixes for DataFrame sav...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10580#issuecomment-173694818 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12629] [SparkR] Fixes for DataFrame sav...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10580#issuecomment-173694816 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12848][SQL] Change parsed decimal liter...

2016-01-21 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/10796#discussion_r50426540 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/BucketedWriteSuite.scala --- @@ -65,6 +66,11 @@ class BucketedWriteSuite extends

[GitHub] spark pull request: [HOTFIX][BUILD][test-maven]Remove duplicate de...

2016-01-21 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10868#issuecomment-173698699 retest this please On Thu, Jan 21, 2016 at 11:50 AM UCB AMPLab wrote: > Merged build finished. Test FAILed. > >

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173702746 +1. I'll give this a bit for others to look at and make sure we are done discussing. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173703463 I still would like to see a better commit message (the link to JIRA is implied by the title so is redundant in a commit message). --- If your project is set up for it,

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread zhuoliu
Github user zhuoliu commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173706813 Hi @vanzin , do we want to amend the commit message to something like this? "Call system.exit explicitly to make sure non-daemon user threads terminate. Without

[GitHub] spark pull request: [Spark-12732][ML] bug fix in linear regression...

2016-01-21 Thread iyounus
Github user iyounus commented on the pull request: https://github.com/apache/spark/pull/10702#issuecomment-173738254 I've added an exception for the case when label is constant and `standardization == true` and `regParam != 0.0`. Also added test for this case. I cannot test

[GitHub] spark pull request: [SPARK-12959] [SQL] Issue Warning Messages whe...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10870#issuecomment-173750830 **[Test build #49888 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49888/consoleFull)** for PR 10870 at commit

[GitHub] spark pull request: [SPARK-12960] [Python] Some examples are missi...

2016-01-21 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/10872#issuecomment-173756474 LGTM - maybe @davies or @yanboliang can take a quick look --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: Some examples are missing support for python2

2016-01-21 Thread markgrover
GitHub user markgrover opened a pull request: https://github.com/apache/spark/pull/10872 Some examples are missing support for python2 Without importing the print_function, the lines later on like ```print("Usage: direct_kafka_wordcount.py ", file=sys.stderr)``` fail when using

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-01-21 Thread drcrallen
Github user drcrallen commented on the pull request: https://github.com/apache/spark/pull/10319#issuecomment-173748543 @tnachen / @andrewor14 ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-173724103 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-173724108 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-173723820 **[Test build #49886 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49886/consoleFull)** for PR 9207 at commit

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173733049 Huh, no. You have to edit the very first comment on *this page*, not fix the commit message on your github branch. --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173737599 Great, thanks! LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10498][TOOLS] Add requirements.txt file...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10871#issuecomment-173741633 **[Test build #49892 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49892/consoleFull)** for PR 10871 at commit

[GitHub] spark pull request: [SPARK-12959] [SQL] Issue Warning Messages whe...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10870#issuecomment-173750990 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12959] [SQL] Issue Warning Messages whe...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10870#issuecomment-173750991 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11826][MLlib] Refactor add() and subtra...

2016-01-21 Thread ehsanmok
Github user ehsanmok commented on a diff in the pull request: https://github.com/apache/spark/pull/9916#discussion_r50469740 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/BlockMatrix.scala --- @@ -317,40 +317,69 @@ class BlockMatrix @Since("1.3.0") (

[GitHub] spark pull request: [SPARK-10873] Support column sort and search f...

2016-01-21 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/10648#discussion_r50470952 --- Diff: core/src/main/resources/org/apache/spark/ui/static/historypage.js --- @@ -0,0 +1,151 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-11826][MLlib] Refactor add() and subtra...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9916#issuecomment-173742851 **[Test build #49893 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49893/consoleFull)** for PR 9916 at commit

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173737937 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173737934 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-12920. [SQL]. Spark thrift server can ru...

2016-01-21 Thread rajeshbalamohan
Github user rajeshbalamohan commented on the pull request: https://github.com/apache/spark/pull/10846#issuecomment-173741417 Thanks @JoshRosen . The current patch is based on flagging approach (in case of retaining caching) which would be safe for 1.6.x. --- If your project is set

[GitHub] spark pull request: [Spark-12732][ML] bug fix in linear regression...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10702#issuecomment-173744471 **[Test build #49889 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49889/consoleFull)** for PR 10702 at commit

[GitHub] spark pull request: [Spark-12732][ML] bug fix in linear regression...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10702#issuecomment-173744642 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Some examples are missing support for python2

2016-01-21 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/10872#issuecomment-173746559 This looks like a good change (thanks for catching the issue) and its probably small enough/straight forward enough it doesn't need a JIRA but it might be nice to have

[GitHub] spark pull request: [SPARK-11826][MLlib] Refactor add() and subtra...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9916#issuecomment-173751310 **[Test build #49893 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49893/consoleFull)** for PR 9916 at commit

[GitHub] spark pull request: [SPARK-11826][MLlib] Refactor add() and subtra...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9916#issuecomment-173751428 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11826][MLlib] Refactor add() and subtra...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9916#issuecomment-173751432 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12959] [SQL] Issue Warning Messages whe...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10870#issuecomment-173729545 **[Test build #49888 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49888/consoleFull)** for PR 10870 at commit

[GitHub] spark pull request: [SPARK-10498][TOOLS] Add requirements.txt file...

2016-01-21 Thread holdenk
GitHub user holdenk opened a pull request: https://github.com/apache/spark/pull/10871 [SPARK-10498][TOOLS] Add requirements.txt file for dev python tools Minor since so few people use them, but it would probably be good to have a requirements file for our python release tools for

[GitHub] spark pull request: [HOTFIX][BUILD][test-maven]Remove duplicate de...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10868#issuecomment-173742747 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [HOTFIX][BUILD][test-maven]Remove duplicate de...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10868#issuecomment-173742631 **[Test build #49887 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49887/consoleFull)** for PR 10868 at commit

[GitHub] spark pull request: [HOTFIX][BUILD][test-maven]Remove duplicate de...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10868#issuecomment-173742744 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Spark-12732][ML] bug fix in linear regression...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10702#issuecomment-173744640 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12960] [Python] Some examples are missi...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10872#issuecomment-173752595 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12960] [Python] Some examples are missi...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10872#issuecomment-173752594 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12960] [Python] Some examples are missi...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10872#issuecomment-173752512 **[Test build #49894 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49894/consoleFull)** for PR 10872 at commit

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread zhuoliu
Github user zhuoliu commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173732459 Thanks @vanzin , commit message updated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread zhuoliu
Github user zhuoliu commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173737073 Sorry for that. Just updated the first comment and changed the commit message back to original. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-10387][ML] Add code gen for gbt

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-173745598 **[Test build #49885 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49885/consoleFull)** for PR 9524 at commit

[GitHub] spark pull request: [SPARK-10387][ML] Add code gen for gbt

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-173745779 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Some examples are missing support for python2

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10872#issuecomment-173745963 **[Test build #49894 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49894/consoleFull)** for PR 10872 at commit

[GitHub] spark pull request: [SPARK-10387][ML] Add code gen for gbt

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-173745781 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-12200 Add __contains__ implementation to...

2016-01-21 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/10194#issuecomment-173746504 maybe @jkbradley could take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12067] [SQL] Add isNan, isnull, notnull...

2016-01-21 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/10097#discussion_r50481258 --- Diff: python/pyspark/sql/column.py --- @@ -316,6 +316,10 @@ def isin(self, *cols): isNull = _unary_op("isNull", "True if the current

[GitHub] spark pull request: [SPARK-12960] [Python] Some examples are missi...

2016-01-21 Thread markgrover
Github user markgrover commented on the pull request: https://github.com/apache/spark/pull/10872#issuecomment-173752124 Thanks @holdenk Created SPARK-12960. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12859] [Streaming] [Web UI] Names of in...

2016-01-21 Thread ajbozarth
GitHub user ajbozarth opened a pull request: https://github.com/apache/spark/pull/10873 [SPARK-12859] [Streaming] [Web UI] Names of input streams with receivers don't fit in Streaming page Added CSS style to force names of input streams with receivers to wrap You can merge this

[GitHub] spark pull request: [SPARK-10498][TOOLS] Add requirements.txt file...

2016-01-21 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/10871#issuecomment-173738633 Created a vagrant trusty image, tried to run the tools and installed missing packages until they would run. Picked the current head versions for pinning the version

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173740609 **[Test build #49891 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49891/consoleFull)** for PR 9946 at commit

[GitHub] spark pull request: [SPARK-10387][ML] Add code gen for gbt

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-173707053 **[Test build #49885 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49885/consoleFull)** for PR 9524 at commit

[GitHub] spark pull request: [SPARK-10911] Executors should System.exit on ...

2016-01-21 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9946#issuecomment-173707549 @zhuoliu that sounds great. Just edit your very first comment (that's the commit message). --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [HOTFIX][BUILD][test-maven]Remove duplicate de...

2016-01-21 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10868#issuecomment-173709227 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-173710797 **[Test build #49886 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49886/consoleFull)** for PR 9207 at commit

[GitHub] spark pull request: [SPARK-12629] [SparkR] Fixes for DataFrame sav...

2016-01-21 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/10580#issuecomment-173711547 added ! Let me know what do you think! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [HOTFIX][BUILD][test-maven]Remove duplicate de...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10868#issuecomment-173713102 **[Test build #49887 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49887/consoleFull)** for PR 10868 at commit

[GitHub] spark pull request: [Spark-12732][ML] bug fix in linear regression...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10702#issuecomment-173733630 **[Test build #49889 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49889/consoleFull)** for PR 10702 at commit

[GitHub] spark pull request: [SPARK-12959] [SQL] Issue Warning Messages whe...

2016-01-21 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/10870 [SPARK-12959] [SQL] Issue Warning Messages when Writing Bucketed Data with Bucketing Disabled When users turn off bucketing in SQLConf, we should issue some messages to tell users these

[GitHub] spark pull request: [SPARK-12859] [Streaming] [Web UI] Names of in...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10873#issuecomment-173759880 **[Test build #49895 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49895/consoleFull)** for PR 10873 at commit

[GitHub] spark pull request: [SPARK-10498][TOOLS] Add requirements.txt file...

2016-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10871#issuecomment-173762359 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10498][TOOLS] Add requirements.txt file...

2016-01-21 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10871#issuecomment-173762216 **[Test build #49892 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49892/consoleFull)** for PR 10871 at commit

[GitHub] spark pull request: [SPARK-12828][SQL]add natural join support

2016-01-21 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/10762#discussion_r50497473 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/AnalysisSuite.scala --- @@ -248,4 +249,20 @@ class AnalysisSuite extends

[GitHub] spark pull request: [SPARK-12932] [Java API] improved error messag...

2016-01-21 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/10865#discussion_r50498058 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/JavaTypeInference.scala --- @@ -406,7 +406,7 @@ object JavaTypeInference {

<    1   2   3   4   >