[GitHub] spark pull request: [SPARK-8661][ML] for LinearRegressionSuite.sca...

2015-06-29 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7098#issuecomment-116876134 Thanks - merged in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8407][SQL]complex type constructors: st...

2015-06-29 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6874#issuecomment-116877713 Do we also need to add this to `functions.py`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8715] ArrayOutOfBoundsException fixed f...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7100#issuecomment-116877668 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8538][SPARK-8539][ML] Linear Regression...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7099#issuecomment-116877667 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-8715] ArrayOutOfBoundsException fixed f...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7100#issuecomment-116877652 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8588] [SQL] Regression test

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7103#issuecomment-116878312 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [WIP] Binary processing sort for Spark SQL

2015-06-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6444#discussion_r33526988 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowSorter.java --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-8715] ArrayOutOfBoundsException fixed f...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7100#issuecomment-116879983 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8715] ArrayOutOfBoundsException fixed f...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7100#issuecomment-116879930 [Test build #36049 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36049/console) for PR 7100 at commit

[GitHub] spark pull request: [SPARK-8715] ArrayOutOfBoundsException fixed f...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7100#issuecomment-116880315 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8199][SPARK-8184][SPARK-8183][SPARK-818...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6981#issuecomment-116880347 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8715] ArrayOutOfBoundsException fixed f...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7100#issuecomment-116880343 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8199][SPARK-8184][SPARK-8183][SPARK-818...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6981#issuecomment-116880325 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Spark-8703] [ML] Add CountVectorizer as a ml ...

2015-06-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/7084#discussion_r33527772 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/CountVectorizer.scala --- @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-6707] [CORE][MESOS]: Mesos Scheduler sh...

2015-06-29 Thread ankurcha
Github user ankurcha commented on the pull request: https://github.com/apache/spark/pull/5563#issuecomment-116881510 * Looking at the way this feature is being used (as per marathon) and the age of the commits to the concerned attributes.cpp and values.cpp files, the feature is

[GitHub] spark pull request: [SPARK-4069] [YARN] When AppMaster finishes, t...

2015-06-29 Thread PraveenSeluka
Github user PraveenSeluka commented on the pull request: https://github.com/apache/spark/pull/5233#issuecomment-116881567 @sryza - After the fix on YARN side, I have not seen this issue - We can close this (and also the JIRA). --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-8199][SPARK-8184][SPARK-8183][SPARK-818...

2015-06-29 Thread tarekauel
Github user tarekauel commented on a diff in the pull request: https://github.com/apache/spark/pull/6981#discussion_r33527804 --- Diff: python/pyspark/sql/functions.py --- @@ -487,6 +487,114 @@ def ntile(n): return Column(sc._jvm.functions.ntile(int(n)))

[GitHub] spark pull request: [SPARK-8669] [SQL] Fix crash with BINARY (ENUM...

2015-06-29 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/7048#issuecomment-116881471 This LGTM, pending Jenkins build result. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Spark-8703] [ML] Add CountVectorizer as a ml ...

2015-06-29 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/7084#discussion_r33528713 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/CountVectorizer.scala --- @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-8679] [PySpark] [MLlib] Default values ...

2015-06-29 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7058#issuecomment-116884823 A slightly related concern is mutation of non-default arguments. There might be cases where we need to defensively copy the input arguments, but I'm not familiar

[GitHub] spark pull request: [SPARK-7871][SQL]Improve the outputPartitionin...

2015-06-29 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/6413#issuecomment-116884814 @yhuai sorry it's a big change. :) can you review this for me? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-8437] [DOCS] Using directory path witho...

2015-06-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7036 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8718] [GRAPHX] Improve EdgePartition2D ...

2015-06-29 Thread aray
Github user aray commented on a diff in the pull request: https://github.com/apache/spark/pull/7104#discussion_r33529689 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/PartitionStrategy.scala --- @@ -32,7 +32,7 @@ trait PartitionStrategy extends Serializable { object

[GitHub] spark pull request: [SPARK-7287] [SPARK-8567] [TEST] Add sc.stop t...

2015-06-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7027 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8713] Make codegen thread safe

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7101#issuecomment-116885992 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8718] [GRAPHX] Improve EdgePartition2D ...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7104#issuecomment-116885979 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8588] [SQL] Regression test

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7103#issuecomment-116893870 [Test build #36059 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36059/console) for PR 7103 at commit

[GitHub] spark pull request: [SPARK-8588] [SQL] Regression test

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7103#issuecomment-116893875 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-29 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-116893862 cc @andrewor14 who probably knows some thing about the YARN tests --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-8713] Make codegen thread safe

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7101#issuecomment-116895578 [Test build #36061 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36061/console) for PR 7101 at commit

[GitHub] spark pull request: [SPARK-8700][ML] Disable feature scaling in Lo...

2015-06-29 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/7080#discussion_r33532011 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -534,27 +554,39 @@ private class LogisticCostFun(

[GitHub] spark pull request: [SPARK-8226][SQL][WIP] Add function shiftright...

2015-06-29 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/7035#issuecomment-116896114 Can you wait a little bit for #7034? Hopefully it will be simpler once #7034 merged. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-8119][Scheduler]Do not let Spark set to...

2015-06-29 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6662#issuecomment-116896184 I have updated the description on the JIRA. However, this patch is definitely not the correct fix. The user should be able to call `sc.requestExecutors` (a public

[GitHub] spark pull request: [SPARK-8456][ML]Ngram featurizer python

2015-06-29 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6960#issuecomment-116908089 LGTM merging into master Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8669] [SQL] Fix crash with BINARY (ENUM...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7048#issuecomment-116909872 [Test build #36052 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36052/console) for PR 7048 at commit

[GitHub] spark pull request: [SPARK-2645] [Core] Allow SparkEnv.stop() to b...

2015-06-29 Thread rekhajoshm
Github user rekhajoshm commented on the pull request: https://github.com/apache/spark/pull/6973#issuecomment-116913875 thanks @andrewor14 for your quick input.the last commit 2ce5760 was updated for the comment from @srowen kindly check.thanks --- If your project is set up for it,

[GitHub] spark pull request: [SPARK-4352][YARN][WIP] Incorporate locality p...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6394#issuecomment-116913961 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4352][YARN][WIP] Incorporate locality p...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6394#issuecomment-116913976 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8119] HeartbeatReceiver should replace ...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7107#issuecomment-116915401 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8119] HeartbeatReceiver should replace ...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7107#issuecomment-116915343 [Test build #36067 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36067/console) for PR 7107 at commit

[GitHub] spark pull request: [SPARK-8471][ML] Discrete Cosine Transform Fea...

2015-06-29 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6894#issuecomment-116914837 Would you mind making that small update (also to trigger tests again)? Thanks! --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-11694 [Test build #36073 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36073/consoleFull) for PR 6982 at commit

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116921630 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8236][SQL] misc functions: crc32

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7108#issuecomment-116921620 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8713] Make codegen thread safe

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7101#issuecomment-116922432 [Test build #980 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/980/consoleFull) for PR 7101 at commit

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116921687 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SQL][SPARK-7088] Fix analysis for 3rd party l...

2015-06-29 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6853#discussion_r33536357 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -121,6 +122,17 @@ trait CheckAnalysis {

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-29 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6743#discussion_r33536903 --- Diff: core/src/main/scala/org/apache/spark/api/r/RUtils.scala --- @@ -0,0 +1,44 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-8721][SQL] Rename ExpectsInputTypes = ...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7109#issuecomment-116930002 [Test build #36076 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36076/consoleFull) for PR 7109 at commit

[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-116935000 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4069] [YARN] When AppMaster finishes, t...

2015-06-29 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/5233#issuecomment-116877465 There's no bug on the Spark side. @PraveenSeluka is this still something you're running into? If this is causing pain to a lot of users it could be worth the

[GitHub] spark pull request: [SPARK-8538][SPARK-8539][ML] Linear Regression...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7099#issuecomment-116877654 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8407][SQL]complex type constructors: st...

2015-06-29 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/6874#discussion_r33525785 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -747,9 +747,7 @@ object functions { */ @scala.annotation.varargs

[GitHub] spark pull request: [SPARK-8710] [SQL] Change ScalaReflection.mirr...

2015-06-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7094 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8588] [SQL] Regression test

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7103#issuecomment-116878335 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6980] [CORE] Akka timeout exceptions in...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6205#issuecomment-116878577 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8199][SPARK-8184][SPARK-8183][SPARK-818...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6981#issuecomment-116880728 [Test build #36054 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36054/consoleFull) for PR 6981 at commit

[GitHub] spark pull request: [SPARK-8715] ArrayOutOfBoundsException fixed f...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7100#issuecomment-116880727 [Test build #36053 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36053/consoleFull) for PR 7100 at commit

[GitHub] spark pull request: [SPARK-8130] - Made spark.files.useFetchCache ...

2015-06-29 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/7051#issuecomment-116883795 Update: I don't think we should change the default behavior without better understanding of how this feature works. The first step would be to write tests and update

[GitHub] spark pull request: [SPARK-8410][SPARK-8475] remove previous ivy r...

2015-06-29 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/7089#issuecomment-116886558 OK, merging into master 1.4, thanks @brkyvz. Do we need a fix for 1.3 as well? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-5161] Parallelize Python test execution

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116888365 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8657] [YARN] Fail to upload conf archiv...

2015-06-29 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/7055#issuecomment-116888345 Hm, I'm pretty confused. @litao-buptsse Which is your proposed fix, this one or #7053? Did you intend to have different fixes merged into different branches? ---

[GitHub] spark pull request: [SPARK-5161] Parallelize Python test execution

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116888348 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8372] Do not show applications that hav...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7097#issuecomment-116892032 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8372] Do not show applications that hav...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7097#issuecomment-116892028 [Test build #36058 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36058/console) for PR 7097 at commit

[GitHub] spark pull request: [SPARK-5962] [MLlib] Python support for Power ...

2015-06-29 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6992#issuecomment-116908613 @yanboliang Could you please make a JIRA and PR for updating the user guide with the Python API? Thanks! --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-8456][ML]Ngram featurizer python

2015-06-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6960 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8357] [SQL] Memory leakage on unsafe ag...

2015-06-29 Thread navis
Github user navis commented on a diff in the pull request: https://github.com/apache/spark/pull/6810#discussion_r33533643 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/AggregateSuite.scala --- @@ -0,0 +1,59 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-6785][SQL] fix DateTimeUtils for dates ...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6983#issuecomment-116910464 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6785][SQL] fix DateTimeUtils for dates ...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6983#issuecomment-116910475 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6785][SQL] fix DateTimeUtils for dates ...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6983#issuecomment-116910563 [Test build #36064 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36064/consoleFull) for PR 6983 at commit

[GitHub] spark pull request: [SPARK-8425][Core][WIP] Add blacklist mechanis...

2015-06-29 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/6870#issuecomment-116917074 I think the original blacklist mechanism and what @davies did is to avoid the resubmitted tasks running on the same executors/hosts, which means tasks should be

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-29 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r33536321 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,166 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-8688][YARN]Bug fix: disable the cache f...

2015-06-29 Thread SaintBacchus
Github user SaintBacchus commented on a diff in the pull request: https://github.com/apache/spark/pull/7069#discussion_r33536245 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -334,6 +334,17 @@ class SparkHadoopUtil extends Logging { *

[GitHub] spark pull request: [SPARK-8688][YARN]Bug fix: disable the cache f...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7069#issuecomment-116924975 [Test build #36074 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36074/consoleFull) for PR 7069 at commit

[GitHub] spark pull request: [SPARK-8366] When tasks failed and append new ...

2015-06-29 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6817#issuecomment-116924889 Also, echoing @squito's comments, I also don't really see why a new `TaskResubmit` event is necessary. If a task is resubmitted, a new `SparkListenerTaskStart` event

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-29 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6039#issuecomment-116927872 @hhbyyh Thanks for the updates. It looks fine, except for 1 to-do: Can you please add a note in the Scala doc, saying that this transformer does not yet set the

[GitHub] spark pull request: [SPARK-8186] [SPARK-8187] [SQL] datetime funct...

2015-06-29 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/6782#discussion_r33526888 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -946,6 +947,38 @@ object functions { def cosh(columnName: String): Column

[GitHub] spark pull request: [SPARK-8199][SPARK-8184][SPARK-8183][SPARK-818...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6981#issuecomment-116882775 [Test build #36054 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36054/console) for PR 6981 at commit

[GitHub] spark pull request: [SPARK-8199][SPARK-8184][SPARK-8183][SPARK-818...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6981#issuecomment-116882815 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8199][SPARK-8184][SPARK-8183][SPARK-818...

2015-06-29 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/6981#issuecomment-116884298 In order to having this fast path, you should check it first, for example: ``` year = days / 365.24 day_in_year = days - year.toInt * 365.24 if

[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116885235 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...

2015-06-29 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116885208 retest this please. SparkSubmitSuite --jars is really flaky... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116885225 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116886922 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5161] [WIP] Parallelize Python test exe...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116886948 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8410][SPARK-8475] remove previous ivy r...

2015-06-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7089 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8713] Make codegen thread safe

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7101#issuecomment-116894134 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8713] Make codegen thread safe

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7101#issuecomment-116894125 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-29 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-116894129 @sun-rui Yes --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-8713] Make codegen thread safe

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7101#issuecomment-116895188 [Test build #36061 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36061/consoleFull) for PR 7101 at commit

[GitHub] spark pull request: [SPARK-8713] Make codegen thread safe

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7101#issuecomment-116895581 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8713] Make codegen thread safe

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7101#issuecomment-116896777 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8720] [CORE] [HOTFIX] Escapes `/*' in t...

2015-06-29 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/7105 [SPARK-8720] [CORE] [HOTFIX] Escapes `/*' in the comment The `/*` in the comment starts another unclosed comment block. You can merge this pull request into a Git repository by running: $

[GitHub] spark pull request: [SPARK-5161] Parallelize Python test execution

2015-06-29 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7031#issuecomment-116909354 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8119][Scheduler]Do not let Spark set to...

2015-06-29 Thread SaintBacchus
Github user SaintBacchus closed the pull request at: https://github.com/apache/spark/pull/6662 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-8619][Streaming]Don't recover keytab an...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7008#issuecomment-116910937 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6785][SQL] fix DateTimeUtils for dates ...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6983#issuecomment-116912757 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8119] HeartbeatReceiver should replace ...

2015-06-29 Thread andrewor14
GitHub user andrewor14 opened a pull request: https://github.com/apache/spark/pull/7107 [SPARK-8119] HeartbeatReceiver should replace executors, not kill **Symptom.** If an executor in an application times out, `HeartbeatReceiver` attempts to kill it. After this happens, however,

[GitHub] spark pull request: [SPARK-6785][SQL] fix DateTimeUtils for dates ...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6983#issuecomment-116912751 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

<    5   6   7   8   9   10   11   12   13   14   >