[GitHub] spark pull request: [SPARK-8333] [SQL] Spark failed to delete temp...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6858#issuecomment-11295 [Test build #35061 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35061/console) for PR 6858 at commit

[GitHub] spark pull request: [SPARK-7017][HOTFIX][Project Infra]: Refactor ...

2015-06-17 Thread brennonyork
GitHub user brennonyork opened a pull request: https://github.com/apache/spark/pull/6865 [SPARK-7017][HOTFIX][Project Infra]: Refactor dev/run-tests into Python Fixed minor nits from the [previous PR](https://github.com/apache/spark/pull/5694) and removed unnecessary doc build

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689854 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689867 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689872 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689874 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/MinMaxScalerSuite.scala --- @@ -0,0 +1,64 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689869 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689862 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689859 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6039#issuecomment-112986615 A bunch of mostly small cleanups. That's all for now! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-8301][SQL] Improve UTF8String substring...

2015-06-17 Thread tarekauel
Github user tarekauel commented on a diff in the pull request: https://github.com/apache/spark/pull/6804#discussion_r32690041 --- Diff: unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java --- @@ -125,30 +129,37 @@ public UTF8String substring(final int start, final

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/6864#discussion_r32690469 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/hadoopFsRelationSuites.scala --- @@ -470,6 +470,33 @@ abstract class HadoopFsRelationTest

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/6864#issuecomment-112973573 Background and alternative solutions for this issue can be a little bit complex. Will give a summary of offline discussion with @yhuai here later. --- If your

[GitHub] spark pull request: [SPARK-7605] [MLlib] [PySpark] Python API for ...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6346#issuecomment-112975573 [Test build #35059 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35059/console) for PR 6346 at commit

[GitHub] spark pull request: [SPARK-7605] [MLlib] [PySpark] Python API for ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6346#issuecomment-112975673 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7017][HOTFIX][Project Infra]: Refactor ...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6865#issuecomment-112978374 [Test build #35067 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35067/consoleFull) for PR 6865 at commit

[GitHub] spark pull request: [SPARK-7546][ml][WIP] An example of a complex ...

2015-06-17 Thread harsha2010
Github user harsha2010 commented on the pull request: https://github.com/apache/spark/pull/6654#issuecomment-112978405 @jkbradley , yes I agree... the pipeline needs to be more complex. The Hive / HDFS component is not covered much in SQL examples as far as I can see... but you are

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8390] fix docs relate...

2015-06-17 Thread koeninger
Github user koeninger commented on the pull request: https://github.com/apache/spark/pull/6863#issuecomment-112978856 I don't think a doc change caused a python test failure. On Jun 17, 2015 5:27 PM, UCB AMPLab notificati...@github.com wrote: Merged build finished. Test

[GitHub] spark pull request: [SQL][SPARK-7088] Fix analysis for 3rd party l...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6853#issuecomment-112979975 [Test build #35063 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35063/console) for PR 6853 at commit

[GitHub] spark pull request: [SQL][SPARK-7088] Fix analysis for 3rd party l...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6853#issuecomment-112979996 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6864#issuecomment-112981099 [Test build #35066 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35066/console) for PR 6864 at commit

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6864#issuecomment-112981114 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-4352][YARN][WIP] Incorporate locality p...

2015-06-17 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/6394#issuecomment-112981135 Hi @jerryshao is this ready for review? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7862][SQL]Fix the deadlock in script tr...

2015-06-17 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/6404#issuecomment-112994338 Oh, sorry @JoshRosen the meaningless output is caused by #5671, I will fix it with a followup PR. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-8301][SQL] Improve UTF8String substring...

2015-06-17 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6804#discussion_r32690530 --- Diff: unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java --- @@ -69,8 +73,8 @@ public UTF8String set(final String str) { /**

[GitHub] spark pull request: [SPARK-8397][SQL] Allow custom configuration f...

2015-06-17 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6844#issuecomment-112969894 Thanks, merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6864#issuecomment-112973514 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6864#issuecomment-112973535 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7017][Build][Project Infra]: Refactor d...

2015-06-17 Thread brennonyork
Github user brennonyork commented on the pull request: https://github.com/apache/spark/pull/5694#issuecomment-112976517 Thanks for the PR merge @JoshRosen. I'll go ahead and make a hotfix branch to capture the last few nits you have above! --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-7017][HOTFIX][Project Infra]: Refactor ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6865#issuecomment-112978022 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7017][HOTFIX][Project Infra]: Refactor ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6865#issuecomment-112978032 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6039#issuecomment-112980823 @hhbyyh Sorry for the long delay around the release! I'll review this now. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689870 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689875 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/MinMaxScalerSuite.scala --- @@ -0,0 +1,64 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689865 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689873 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689849 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689852 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689861 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689868 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689880 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/MinMaxScalerSuite.scala --- @@ -0,0 +1,64 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689850 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689857 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-8301][SQL] Improve UTF8String substring...

2015-06-17 Thread tarekauel
Github user tarekauel commented on a diff in the pull request: https://github.com/apache/spark/pull/6804#discussion_r32690391 --- Diff: unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java --- @@ -69,8 +73,8 @@ public UTF8String set(final String str) { /**

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6864#issuecomment-112973920 [Test build #35066 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35066/consoleFull) for PR 6864 at commit

[GitHub] spark pull request: [SPARK-7712] [SQL] Move Window Functions from ...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6278#issuecomment-112974768 [Test build #35064 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35064/console) for PR 6278 at commit

[GitHub] spark pull request: [SPARK-7712] [SQL] Move Window Functions from ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6278#issuecomment-112974785 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7546][ml][WIP] An example of a complex ...

2015-06-17 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6654#issuecomment-112980561 OK, that sounds good. Also, sorry about the long delay in commenting! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-8335] [MLLIB] DecisionTreeModel.predict...

2015-06-17 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6854#issuecomment-112987424 @srowen Just commented on the JIRA. Let me know what you think. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-8301][SQL] Improve UTF8String substring...

2015-06-17 Thread tarekauel
Github user tarekauel commented on a diff in the pull request: https://github.com/apache/spark/pull/6804#discussion_r32690308 --- Diff: unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java --- @@ -55,13 +55,17 @@ public static UTF8String fromString(String str) {

[GitHub] spark pull request: [MLlib] [SPARK-7667] MLlib Python API consiste...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6856#discussion_r32673596 --- Diff: python/pyspark/mllib/feature.py --- @@ -110,6 +110,15 @@ class JavaVectorTransformer(JavaModelWrapper, VectorTransformer):

[GitHub] spark pull request: [SPARK-8306] [SQL] AddJar command needs to set...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6758#issuecomment-112946929 [Test build #35055 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35055/console) for PR 6758 at commit

[GitHub] spark pull request: [MLlib] [SPARK-7667] MLlib Python API consiste...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6856#discussion_r32673603 --- Diff: python/pyspark/mllib/feature.py --- @@ -185,7 +180,7 @@ def __init__(self, withMean=False, withStd=True): self.withMean = withMean

[GitHub] spark pull request: [SPARK-8373][PySpark]Add emptyRDD to pyspark a...

2015-06-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6826 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-7067][SQL] fix bug when use complex nes...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5659#issuecomment-112952257 [Test build #35056 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35056/console) for PR 5659 at commit

[GitHub] spark pull request: [SPARK-7626][SQL] Consider the columns in Hive...

2015-06-17 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6146#issuecomment-112956949 Please explain your change. Neither the JIRA nor the PR description describe why you the original code is incorrect. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-6740][SQL] Fix NOT operator precedence.

2015-06-17 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6326#issuecomment-112961301 Sorry for the delay here. Mind bringing this up to date? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-8404][Streaming][Tests] Use thread-safe...

2015-06-17 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/6852#issuecomment-112962475 Merging this in Spark 1.4 and master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-7712] [SQL] Move Window Functions from ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6278#issuecomment-112963368 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7712] [SQL] Move Window Functions from ...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6278#issuecomment-112963546 [Test build #35064 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35064/consoleFull) for PR 6278 at commit

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8390] fix docs relate...

2015-06-17 Thread koeninger
GitHub user koeninger opened a pull request: https://github.com/apache/spark/pull/6863 [Streaming][Kafka][SPARK-8390] fix docs related to HasOffsetRanges You can merge this pull request into a Git repository by running: $ git pull https://github.com/koeninger/spark-1

[GitHub] spark pull request: [SPARK-8095] Resolve dependencies of --package...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6788#issuecomment-112890118 [Test build #35048 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35048/consoleFull) for PR 6788 at commit

[GitHub] spark pull request: [SPARK-8392] Improve the efficiency

2015-06-17 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6839#issuecomment-112895403 Hi @XuTingjun can you update the title to something more specific: RDDOperationGraph: getting cached nodes is slow or something? --- If your project is set up

[GitHub] spark pull request: [SPARK-8392] Improve the efficiency

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6839#issuecomment-112895667 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8392] Improve the efficiency

2015-06-17 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6839#issuecomment-112895459 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-8392] Improve the efficiency

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6839#issuecomment-112895599 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8371][SQL] improve unit test for MaxOf ...

2015-06-17 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6825#discussion_r32656257 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala --- @@ -109,7 +109,7 @@ trait ExpressionEvalHelper

[GitHub] spark pull request: [SPARK-8392] Improve the efficiency

2015-06-17 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6839#discussion_r32656406 --- Diff: core/src/main/scala/org/apache/spark/ui/scope/RDDOperationGraph.scala --- @@ -70,6 +70,13 @@ private[ui] class RDDOperationCluster(val id:

[GitHub] spark pull request: [SPARK-8161] Set externalBlockStoreInitialized...

2015-06-17 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6702#issuecomment-112904541 LGTM. I agree we should have a regression test, but we shouldn't block the fix on it. The code before was clearly wrong since we never set the flag to true. --- If

[GitHub] spark pull request: [SPARK-8391][Core] More efficient usage of mem...

2015-06-17 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/6859#issuecomment-112907290 That is going to be slower and use a lot more memory in allocating (big) temp strings. Why would this be helpful? --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-8283][SQL] Resolve udf_struct test fail...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6828#issuecomment-112911047 [Test build #35051 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35051/consoleFull) for PR 6828 at commit

[GitHub] spark pull request: [SPARK-7017][Build][Project Infra]: Refactor d...

2015-06-17 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/5694#issuecomment-112914050 Some minor nits aside, this looks good enough to me, so I'm going to merge it into master and will submit a series of followup PRs to perform more modularization /

[GitHub] spark pull request: [SPARK-8379][SQL]avoid speculative tasks write...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6833#issuecomment-112914955 [Test build #35053 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35053/consoleFull) for PR 6833 at commit

[GitHub] spark pull request: [SPARK-7067][SQL] fix bug when use complex nes...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5659#issuecomment-112920697 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7067][SQL] fix bug when use complex nes...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5659#issuecomment-112920675 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8306] [SQL] AddJar command needs to set...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6758#issuecomment-112930242 [Test build #35057 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35057/consoleFull) for PR 6758 at commit

[GitHub] spark pull request: [SPARK-8306] [SQL] AddJar command needs to set...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6758#issuecomment-112929882 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8366] When tasks failed and append new ...

2015-06-17 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6817#issuecomment-112935099 Hi @XuTingjun I'll look at this today if not tomorrow thanks for the ping. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-7605] [MLlib] [PySpark] Python API for ...

2015-06-17 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6346#discussion_r32669748 --- Diff: python/pyspark/mllib/feature.py --- @@ -525,6 +526,41 @@ def fit(self, data): return Word2VecModel(jmodel) +class

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8390] fix docs relate...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6863#issuecomment-112969443 [Test build #35065 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35065/console) for PR 6863 at commit

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8390] fix docs relate...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6863#issuecomment-112969458 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7605] [MLlib] [PySpark] Python API for ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6346#issuecomment-112942027 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7605] [MLlib] [PySpark] Python API for ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6346#issuecomment-112942125 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8010][SQL]Promote types to StringType a...

2015-06-17 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6551#issuecomment-112942333 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7605] [MLlib] [PySpark] Python API for ...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6346#issuecomment-112942612 [Test build #35059 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35059/consoleFull) for PR 6346 at commit

[GitHub] spark pull request: [SPARK-8095] Resolve dependencies of --package...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6788#issuecomment-112947509 [Test build #35060 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35060/consoleFull) for PR 6788 at commit

[GitHub] spark pull request: [SPARK-8366] When tasks failed and append new ...

2015-06-17 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6817#discussion_r32675734 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -553,12 +562,13 @@ private[spark] class ExecutorAllocationManager(

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6796#issuecomment-112955333 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8306] [SQL] AddJar command needs to set...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6758#issuecomment-112961128 [Test build #35057 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35057/console) for PR 6758 at commit

[GitHub] spark pull request: [SPARK-8306] [SQL] AddJar command needs to set...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6758#issuecomment-112961170 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8306] [SQL] AddJar command needs to set...

2015-06-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6758 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-7026] [SQL] fix left semi join with equ...

2015-06-17 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/5643#issuecomment-112967276 Mind bringing this up to date? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8390] fix docs relate...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6863#issuecomment-112967694 [Test build #35065 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35065/consoleFull) for PR 6863 at commit

[GitHub] spark pull request: [SPARK-7605] [MLlib] [PySpark] Python API for ...

2015-06-17 Thread MechCoder
Github user MechCoder commented on a diff in the pull request: https://github.com/apache/spark/pull/6346#discussion_r32670198 --- Diff: python/pyspark/mllib/feature.py --- @@ -525,6 +526,41 @@ def fit(self, data): return Word2VecModel(jmodel) +class

[GitHub] spark pull request: [SPARK-3376] Add experimental (non-production)...

2015-06-17 Thread mikeringenburg
Github user mikeringenburg commented on the pull request: https://github.com/apache/spark/pull/5403#issuecomment-112938589 We have one of the configurations to which @kayousterhout refers - a good deal of local memory, but no local file system, only a global parallel file system

[GitHub] spark pull request: [SPARK-8283][SQL] Resolve udf_struct test fail...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6828#issuecomment-112940276 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8283][SQL] Resolve udf_struct test fail...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6828#issuecomment-112940239 [Test build #35051 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35051/console) for PR 6828 at commit

[GitHub] spark pull request: [SPARK-7605] [MLlib] [PySpark] Python API for ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6346#issuecomment-112940805 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7605] [MLlib] [PySpark] Python API for ...

2015-06-17 Thread MechCoder
Github user MechCoder commented on the pull request: https://github.com/apache/spark/pull/6346#issuecomment-112940733 @davies I fixed your comments and replaced vector with scalingVector for consistency --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-7605] [MLlib] [PySpark] Python API for ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6346#issuecomment-112940829 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

<    1   2   3   4   5   6   7   8   >