[GitHub] spark pull request: [SPARK-8301][SQL] Improve UTF8String substring...

2015-06-17 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6804#discussion_r32690229 --- Diff: unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java --- @@ -125,30 +129,37 @@ public UTF8String substring(final int start, final int un

[GitHub] spark pull request: [SPARK-8335] [MLLIB] DecisionTreeModel.predict...

2015-06-17 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6854#issuecomment-112987424 @srowen Just commented on the JIRA. Let me know what you think. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-8301][SQL] Improve UTF8String substring...

2015-06-17 Thread tarekauel
Github user tarekauel commented on a diff in the pull request: https://github.com/apache/spark/pull/6804#discussion_r32690041 --- Diff: unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java --- @@ -125,30 +129,37 @@ public UTF8String substring(final int start, final i

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6039#issuecomment-112986615 A bunch of mostly small cleanups. That's all for now! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689874 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/MinMaxScalerSuite.scala --- @@ -0,0 +1,64 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689869 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689854 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689867 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689872 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689862 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689859 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689880 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/MinMaxScalerSuite.scala --- @@ -0,0 +1,64 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689870 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689875 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/MinMaxScalerSuite.scala --- @@ -0,0 +1,64 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689865 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689873 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689857 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689849 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689852 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689861 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689868 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6039#discussion_r32689850 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinMaxScaler.scala --- @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [SPARK-4352][YARN][WIP] Incorporate locality p...

2015-06-17 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/6394#issuecomment-112981135 Hi @jerryshao is this ready for review? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6864#issuecomment-112981099 [Test build #35066 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35066/console) for PR 6864 at commit [`e5e92f3`](https://github.

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6864#issuecomment-112981114 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [Spark-7514][MLlib] Add MinMaxScaler to featur...

2015-06-17 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6039#issuecomment-112980823 @hhbyyh Sorry for the long delay around the release! I'll review this now. --- If your project is set up for it, you can reply to this email and have your reply appea

[GitHub] spark pull request: [SPARK-7546][ml][WIP] An example of a complex ...

2015-06-17 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6654#issuecomment-112980561 OK, that sounds good. Also, sorry about the long delay in commenting! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SQL][SPARK-7088] Fix analysis for 3rd party l...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6853#issuecomment-112979996 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SQL][SPARK-7088] Fix analysis for 3rd party l...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6853#issuecomment-112979975 [Test build #35063 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35063/console) for PR 6853 at commit [`c8c382a`](https://github.

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8390] fix docs relate...

2015-06-17 Thread koeninger
Github user koeninger commented on the pull request: https://github.com/apache/spark/pull/6863#issuecomment-112978856 I don't think a doc change caused a python test failure. On Jun 17, 2015 5:27 PM, "UCB AMPLab" wrote: > Merged build finished. Test FAILed. > > â€

[GitHub] spark pull request: [SPARK-7017][HOTFIX][Project Infra]: Refactor ...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6865#issuecomment-112978374 [Test build #35067 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35067/consoleFull) for PR 6865 at commit [`79845b1`](https://gith

[GitHub] spark pull request: [SPARK-7546][ml][WIP] An example of a complex ...

2015-06-17 Thread harsha2010
Github user harsha2010 commented on the pull request: https://github.com/apache/spark/pull/6654#issuecomment-112978405 @jkbradley , yes I agree... the pipeline needs to be more complex. The Hive / HDFS component is not covered much in SQL examples as far as I can see... but you are ri

[GitHub] spark pull request: [SPARK-7017][HOTFIX][Project Infra]: Refactor ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6865#issuecomment-112978032 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7017][HOTFIX][Project Infra]: Refactor ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6865#issuecomment-112978022 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8333] [SQL] Spark failed to delete temp...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6858#issuecomment-112977799 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7017][HOTFIX][Project Infra]: Refactor ...

2015-06-17 Thread brennonyork
GitHub user brennonyork opened a pull request: https://github.com/apache/spark/pull/6865 [SPARK-7017][HOTFIX][Project Infra]: Refactor dev/run-tests into Python Fixed minor nits from the [previous PR](https://github.com/apache/spark/pull/5694) and removed unnecessary doc build code

[GitHub] spark pull request: [SPARK-8333] [SQL] Spark failed to delete temp...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6858#issuecomment-11295 [Test build #35061 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35061/console) for PR 6858 at commit [`d65744d`](https://github.

[GitHub] spark pull request: [SPARK-7017][Build][Project Infra]: Refactor d...

2015-06-17 Thread brennonyork
Github user brennonyork commented on the pull request: https://github.com/apache/spark/pull/5694#issuecomment-112976517 Thanks for the PR merge @JoshRosen. I'll go ahead and make a hotfix branch to capture the last few nits you have above! --- If your project is set up for it, you ca

[GitHub] spark pull request: [SPARK-7605] [MLlib] [PySpark] Python API for ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6346#issuecomment-112975673 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7605] [MLlib] [PySpark] Python API for ...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6346#issuecomment-112975573 [Test build #35059 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35059/console) for PR 6346 at commit [`79d1ef5`](https://github.

[GitHub] spark pull request: [SPARK-7712] [SQL] Move Window Functions from ...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6278#issuecomment-112974768 [Test build #35064 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35064/console) for PR 6278 at commit [`7033c90`](https://github.

[GitHub] spark pull request: [SPARK-7712] [SQL] Move Window Functions from ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6278#issuecomment-112974785 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7546][ml][WIP] An example of a complex ...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6654#discussion_r32684148 --- Diff: examples/src/main/scala/org/apache/spark/examples/ml/ComplexPipelineExample.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request: [SPARK-7546][ml][WIP] An example of a complex ...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6654#discussion_r32684165 --- Diff: examples/src/main/scala/org/apache/spark/examples/ml/ComplexPipelineExample.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request: [SPARK-7546][ml][WIP] An example of a complex ...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6654#discussion_r32684157 --- Diff: examples/src/main/scala/org/apache/spark/examples/ml/ComplexPipelineExample.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request: [SPARK-7546][ml][WIP] An example of a complex ...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6654#discussion_r32684152 --- Diff: examples/src/main/scala/org/apache/spark/examples/ml/ComplexPipelineExample.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request: [SPARK-7546][ml][WIP] An example of a complex ...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6654#discussion_r32684146 --- Diff: examples/src/main/scala/org/apache/spark/examples/ml/ComplexPipelineExample.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request: [SPARK-7546][ml][WIP] An example of a complex ...

2015-06-17 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6654#issuecomment-112974372 @harsha2010 I added a few comments, but for this example, my intention was to have a complex chain of feature encoders (maybe using 6+ since the SimpleTextClassificat

[GitHub] spark pull request: [SPARK-7546][ml][WIP] An example of a complex ...

2015-06-17 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/6654#discussion_r32684159 --- Diff: examples/src/main/scala/org/apache/spark/examples/ml/ComplexPipelineExample.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6864#issuecomment-112973920 [Test build #35066 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35066/consoleFull) for PR 6864 at commit [`e5e92f3`](https://gith

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6864#issuecomment-112973514 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6864#issuecomment-112973535 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/6864#issuecomment-112973573 Background and alternative solutions for this issue can be a little bit complex. Will give a summary of offline discussion with @yhuai here later. --- If your project

[GitHub] spark pull request: [SPARK-8406] [SQL] Adding UUID to output file ...

2015-06-17 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/6864 [SPARK-8406] [SQL] Adding UUID to output file name to avoid accidental overwriting You can merge this pull request into a Git repository by running: $ git pull https://github.com/liancheng/

[GitHub] spark pull request: [SPARK-8095] Resolve dependencies of --package...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6788#issuecomment-112971247 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8095] Resolve dependencies of --package...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6788#issuecomment-112971221 [Test build #35060 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35060/console) for PR 6788 at commit [`2875bf4`](https://github.

[GitHub] spark pull request: [SPARK-8397][SQL] Allow custom configuration f...

2015-06-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6844 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-8397][SQL] Allow custom configuration f...

2015-06-17 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6844#issuecomment-112969894 Thanks, merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8390] fix docs relate...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6863#issuecomment-112969443 [Test build #35065 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35065/console) for PR 6863 at commit [`bb4336b`](https://github.

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8390] fix docs relate...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6863#issuecomment-112969458 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8376][Docs]Add common lang3 to the Spar...

2015-06-17 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/6829#issuecomment-112969135 I think the assembly is a good idea. Though for that we will have to 1. publish the assembly JAR instead of package JAR. It will be cumbersome to add additional flume-s

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8390] fix docs relate...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6863#issuecomment-112967694 [Test build #35065 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35065/consoleFull) for PR 6863 at commit [`bb4336b`](https://gith

[GitHub] spark pull request: [SPARK-7026] [SQL] fix left semi join with equ...

2015-06-17 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/5643#issuecomment-112967276 Mind bringing this up to date? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8390] fix docs relate...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6863#issuecomment-112966905 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8390] fix docs relate...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6863#issuecomment-112966838 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [Streaming][Kafka][SPARK-8390] fix docs relate...

2015-06-17 Thread koeninger
GitHub user koeninger opened a pull request: https://github.com/apache/spark/pull/6863 [Streaming][Kafka][SPARK-8390] fix docs related to HasOffsetRanges You can merge this pull request into a Git repository by running: $ git pull https://github.com/koeninger/spark-1 SPARK-839

[GitHub] spark pull request: [SPARK-7712] [SQL] Move Window Functions from ...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6278#issuecomment-112963546 [Test build #35064 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35064/consoleFull) for PR 6278 at commit [`7033c90`](https://gith

[GitHub] spark pull request: [SPARK-7712] [SQL] Move Window Functions from ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6278#issuecomment-112963368 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7712] [SQL] Move Window Functions from ...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6278#issuecomment-112963381 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8404][Streaming][Tests] Use thread-safe...

2015-06-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6852 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-8404][Streaming][Tests] Use thread-safe...

2015-06-17 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/6852#issuecomment-112962475 Merging this in Spark 1.4 and master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [SPARK-8404][Streaming][Tests] Use thread-safe...

2015-06-17 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/6852#issuecomment-112962440 @srowen We have been seeing some flakiness in this test in our daily master builds in Jenkins. So these fixes LGTM. --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-8306] [SQL] AddJar command needs to set...

2015-06-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6758 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-6740][SQL] Fix NOT operator precedence.

2015-06-17 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6326#issuecomment-112961301 Sorry for the delay here. Mind bringing this up to date? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark pull request: [SPARK-8306] [SQL] AddJar command needs to set...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6758#issuecomment-112961170 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8306] [SQL] AddJar command needs to set...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6758#issuecomment-112961128 [Test build #35057 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35057/console) for PR 6758 at commit [`1292346`](https://github.

[GitHub] spark pull request: [SPARK-7067][SQL] fix bug when use complex nes...

2015-06-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5659 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7067][SQL] fix bug when use complex nes...

2015-06-17 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/5659#issuecomment-112960569 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SQL][SPARK-7088] Fix analysis for 3rd party l...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6853#issuecomment-112960343 [Test build #35063 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35063/consoleFull) for PR 6853 at commit [`c8c382a`](https://gith

[GitHub] spark pull request: [SQL][SPARK-7088] Fix analysis for 3rd party l...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6853#issuecomment-112959823 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SQL][SPARK-7088] Fix analysis for 3rd party l...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6853#issuecomment-112959854 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SQL][SPARK-7088] Fix analysis for 3rd party l...

2015-06-17 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6853#issuecomment-112958839 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request: [SQL][SPARK-7088] Fix analysis for 3rd party l...

2015-06-17 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6853#issuecomment-112958798 If I understand correctly, you are just delaying the failure until `checkAnalysis`. A few followup questions: does that mean you don't check analysis in your code pat

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6796#issuecomment-112957441 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6796#issuecomment-112957431 [Test build #35062 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35062/console) for PR 6796 at commit [`8f6445c`](https://github.

[GitHub] spark pull request: [SPARK-7626][SQL] Consider the columns in Hive...

2015-06-17 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6146#issuecomment-112956949 Please explain your change. Neither the JIRA nor the PR description describe why you the original code is incorrect. --- If your project is set up for it, you can rep

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6796#issuecomment-112956321 [Test build #35062 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35062/consoleFull) for PR 6796 at commit [`8f6445c`](https://gith

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6796#issuecomment-112955352 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6796#issuecomment-112955333 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-4176][WIP] Support decimal types with p...

2015-06-17 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6796#issuecomment-112954757 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request: [SPARK-7067][SQL] fix bug when use complex nes...

2015-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5659#issuecomment-112952353 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7067][SQL] fix bug when use complex nes...

2015-06-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5659#issuecomment-112952257 [Test build #35056 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35056/console) for PR 5659 at commit [`cfa79f8`](https://github.

[GitHub] spark pull request: [SPARK-8366] When tasks failed and append new ...

2015-06-17 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6817#discussion_r32675734 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -553,12 +562,13 @@ private[spark] class ExecutorAllocationManager(

[GitHub] spark pull request: [SPARK-7913][Core]Increase the maximum capacit...

2015-06-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6456 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-8373][PySpark]Add emptyRDD to pyspark a...

2015-06-17 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/6826#discussion_r32674770 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala --- @@ -425,6 +425,11 @@ private[spark] object PythonRDD extends Logging { i

[GitHub] spark pull request: [SPARK-7913][Core]Increase the maximum capacit...

2015-06-17 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6456#issuecomment-112948921 Sorry slipped on this a little. I'm merging it into master now thanks Ryan! --- If your project is set up for it, you can reply to this email and have your reply appe

[GitHub] spark pull request: [SPARK-4362] [MLLIB] Make prediction probabili...

2015-06-17 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6761#issuecomment-11294 @acidghost Thanks for the updated PR! I'll try to make a closer pass soon. In the meantime, unit tests do sound great. I think one of the best ways to test correctn

[GitHub] spark pull request: [MLLIB] [spark-2352] Implementation of an Arti...

2015-06-17 Thread hntd187
Github user hntd187 commented on the pull request: https://github.com/apache/spark/pull/1290#issuecomment-112948835 @avulanov How about I take the read and you take the write? In an ideal world we should be able to take the implementation from here https://github.com/h5py/h5p

[GitHub] spark pull request: [SPARK-8373][PySpark]Add emptyRDD to pyspark a...

2015-06-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6826 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-8373][PySpark]Add emptyRDD to pyspark a...

2015-06-17 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6826#discussion_r32674187 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala --- @@ -425,6 +425,11 @@ private[spark] object PythonRDD extends Logging {

<    1   2   3   4   5   6   7   8   >