[GitHub] spark pull request #14175: [SPARK-16522][MESOS] Spark application throws exc...

2016-07-25 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/14175#discussion_r72176972 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala --- @@ -552,7 +552,12 @@ private[spark] clas

[GitHub] spark pull request #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r72176938 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1774,6 +1775,49 @@ class Analyzer( }

[GitHub] spark pull request #14340: [SPARK-16534][Streaming][Kafka] Add Python API su...

2016-07-25 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14340#discussion_r72176261 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/KafkaUtils.scala --- @@ -177,3 +182,172 @@ object KafkaUtils extends Logg

[GitHub] spark issue #14327: [SPARK-16686][SQL] Remove PushProjectThroughSample since...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14327 **[Test build #62856 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62856/consoleFull)** for PR 14327 at commit [`3e134f1`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #14357: [SPARK-16727][SparkR] Fix expected test output of descri...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14357 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14357: [SPARK-16727][SparkR] Fix expected test output of descri...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14357 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62852/ Test PASSed. ---

[GitHub] spark issue #14357: [SPARK-16727][SparkR] Fix expected test output of descri...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14357 **[Test build #62852 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62852/consoleFull)** for PR 14357 at commit [`f7d02ce`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14327: [SPARK-16686][SQL] Remove PushProjectThroughSampl...

2016-07-25 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14327#discussion_r72175886 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/ColumnPruningSuite.scala --- @@ -346,5 +346,33 @@ class ColumnPruningSuite exte

[GitHub] spark issue #14357: [SPARK-16727][SparkR] Fix expected test output of descri...

2016-07-25 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14357 I think this is related to https://github.com/apache/spark/commit/142df4834bc33dc7b84b626c6ee3508ab1abe015 cc @dongjoon-hyun --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #14296: [SPARK-16639][SQL] The query with having conditio...

2016-07-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14296#discussion_r72175501 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1207,6 +1207,17 @@ class Analyzer(

[GitHub] spark pull request #14314: [SPARK-16678] [SPARK-16677] [SQL] Fix two View-re...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14314 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #14340: [SPARK-16534][Streaming][Kafka] Add Python API su...

2016-07-25 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14340#discussion_r72175444 --- Diff: examples/src/main/python/streaming/direct_kafka010_wordcount.py --- @@ -0,0 +1,59 @@ +# +# Licensed to the Apache Software Foundation (AS

[GitHub] spark issue #14356: [SPARK-16724] Expose DefinedByConstructorParams

2016-07-25 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14356 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #14314: [SPARK-16678] [SPARK-16677] [SQL] Fix two View-related b...

2016-07-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14314 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #14357: [SPARK-16727][SparkR] Fix expected test output of descri...

2016-07-25 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14357 @junyangq Any idea how the tests were passing on Jenkins before this fix ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark issue #13824: [SPARK-16110][YARN][PYSPARK] Fix allowing python version...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13824 **[Test build #62855 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62855/consoleFull)** for PR 13824 at commit [`cb41e9e`](https://github.com/apache/spark/commit/c

[GitHub] spark pull request #14354: [SPARK-16722][Tests]Fix a StreamingContext leak i...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14354 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #14327: [SPARK-16686][SQL] Remove PushProjectThroughSampl...

2016-07-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14327#discussion_r72174917 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/ColumnPruningSuite.scala --- @@ -346,5 +346,33 @@ class ColumnPruningSuite e

[GitHub] spark issue #14354: [SPARK-16722][Tests]Fix a StreamingContext leak in Strea...

2016-07-25 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/14354 Merging to master and 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes s

[GitHub] spark issue #14284: [SPARK-16633] [SPARK-16642] [SPARK-16721] [SQL] Fixes th...

2016-07-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14284 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fea

[GitHub] spark issue #14335: [SPARK-16697][ML][MLLib] improve LDA submitMiniBatch met...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14335 **[Test build #62853 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62853/consoleFull)** for PR 14335 at commit [`3d8c60d`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #14284: [SPARK-16633] [SPARK-16642] [SPARK-16721] [SQL] Fixes th...

2016-07-25 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14284 yea. that's a good point. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14284: [SPARK-16633] [SPARK-16642] [SPARK-16721] [SQL] Fixes th...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14284 **[Test build #62854 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62854/consoleFull)** for PR 14284 at commit [`ff3029e`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #14335: [SPARK-16697][ML][MLLib] improve LDA submitMiniBatch met...

2016-07-25 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/14335 @srowen `stats.unpersist(false)` ==> `stats.unpersist()` updated. is there anything else need to update ? --- If your project is set up for it, you can reply to this email and have you

[GitHub] spark issue #14357: [SPARK-16727][SparkR] Fix expected test output of descri...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14357 **[Test build #62852 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62852/consoleFull)** for PR 14357 at commit [`f7d02ce`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #14284: [SPARK-16633] [SPARK-16642] [SPARK-16721] [SQL] Fixes th...

2016-07-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14284 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14284: [SPARK-16633] [SPARK-16642] [SPARK-16721] [SQL] Fixes th...

2016-07-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14284 should we also update the doc for `OffsetWindowFunction.default`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark pull request #14357: [SPARK-16727][SparkR] Fix expected test output of...

2016-07-25 Thread junyangq
GitHub user junyangq opened a pull request: https://github.com/apache/spark/pull/14357 [SPARK-16727][SparkR] Fix expected test output of describe and summary functions ## What changes were proposed in this pull request? Fix expected test output of describe and summary funct

[GitHub] spark issue #14356: [SPARK-16724] Expose DefinedByConstructorParams

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14356 **[Test build #62851 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62851/consoleFull)** for PR 14356 at commit [`e5dad1b`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #14356: [SPARK-16724] Expose DefinedByConstructorParams

2016-07-25 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/14356 /cc @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if th

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread nblintao
Github user nblintao commented on the issue: https://github.com/apache/spark/pull/13620 Great! Thanks, @andrewor14 @ajbozarth @yhuai @zsxwing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #14356: [SPARK-16724] Expose DefinedByConstructorParams

2016-07-25 Thread marmbrus
GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/14356 [SPARK-16724] Expose DefinedByConstructorParams We don't generally make things in catalyst/execution private. Instead they are just undocumented due to their lack of stability guarantees. You ca

[GitHub] spark issue #14353: [SPARK-16714][SQL] `array` should create a decimal array...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14353 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62848/ Test PASSed. ---

[GitHub] spark issue #14353: [SPARK-16714][SQL] `array` should create a decimal array...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14353 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14353: [SPARK-16714][SQL] `array` should create a decimal array...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14353 **[Test build #62848 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62848/consoleFull)** for PR 14353 at commit [`d3dd7fb`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14343: [SPARK-16705] Kafka Direct Stream is not experimental an...

2016-07-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/14343 Several annotations is `kafka.py` are still `Experimental`, we should also remove them. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark issue #14355: [SPARK-16726][SQL] Improve error message for `Union` que...

2016-07-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14355 @dongjoon-hyun Do you mind if I ask a question please? It seems it works in MySQL supports `UNION ALL` for the compatible types, for example, numeric compatible types. If my understandin

[GitHub] spark issue #14354: [SPARK-16722][Tests]Fix a StreamingContext leak in Strea...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14354 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62849/ Test PASSed. ---

[GitHub] spark issue #14354: [SPARK-16722][Tests]Fix a StreamingContext leak in Strea...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14354 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14354: [SPARK-16722][Tests]Fix a StreamingContext leak in Strea...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14354 **[Test build #62849 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62849/consoleFull)** for PR 14354 at commit [`5226a5e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14284: [SPARK-16633] [SPARK-16642] [SPARK-16721] [SQL] Fixes th...

2016-07-25 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14284 this this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs ...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13620 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14241 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14241 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62847/ Test PASSed. ---

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14241 **[Test build #62847 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62847/consoleFull)** for PR 14241 at commit [`ddb202e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/13620 Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13620 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62846/ Test PASSed. ---

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13620 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13620 **[Test build #62846 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62846/consoleFull)** for PR 13620 at commit [`649bb19`](https://github.com/apache/spark/commit/

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-25 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #66 has finished](https://jenkins.test.databricks.com/job/spark-pull-request-builder/66/consoleFull)** for PR 36 at commit [`8b764f3`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-25 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #66 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/66/consoleFull)** for PR 36 at commit [`8b764f3`](https://github.com/apache/spark/commit/8b

[GitHub] spark issue #14355: [SPARK-16726][SQL] Improve error message for `Union` que...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14355 **[Test build #62850 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62850/consoleFull)** for PR 14355 at commit [`98682a5`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/13571 Now that 2.0 is in the final RC would maybe @davies have a chance to take a look and see if this is something that would be interesting? --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #14355: [SPARK-16726][SQL] Improve error message for `Uni...

2016-07-25 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/14355 [SPARK-16726][SQL] Improve error message for `Union` queries for incompatible types ## What changes were proposed in this pull request? Currently, `UNION` queries on incompatible typ

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13571 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13571 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62843/ Test PASSed. ---

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13571 **[Test build #62843 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62843/consoleFull)** for PR 13571 at commit [`06f753e`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14231: [SPARK-16586] Change the way the exit code of lau...

2016-07-25 Thread zasdfgbnm
Github user zasdfgbnm commented on a diff in the pull request: https://github.com/apache/spark/pull/14231#discussion_r72167441 --- Diff: bin/spark-class --- @@ -65,24 +65,25 @@ fi # characters that would be otherwise interpreted by the shell. Read that in a while loop, populat

[GitHub] spark pull request #14231: [SPARK-16586] Change the way the exit code of lau...

2016-07-25 Thread zasdfgbnm
Github user zasdfgbnm commented on a diff in the pull request: https://github.com/apache/spark/pull/14231#discussion_r72167136 --- Diff: bin/spark-class --- @@ -65,24 +65,25 @@ fi # characters that would be otherwise interpreted by the shell. Read that in a while loop, populat

[GitHub] spark issue #13920: [SPARK-16166][Core] Also take off-heap memory usage into...

2016-07-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/13920 Thanks a lot @JoshRosen . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] spark issue #14354: [SPARK-16722][Tests]Fix a StreamingContext leak in Strea...

2016-07-25 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/14354 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #14354: [SPARK-16722][Tests]Fix a StreamingContext leak in Strea...

2016-07-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14354 This is an example of this leak: http://spark-tests.appspot.com/builds/spark-master-test-sbt-hadoop-2.2/1429 --- If your project is set up for it, you can reply to this email and have your reply ap

[GitHub] spark issue #14354: [SPARK-16722][Tests]Fix a StreamingContext leak in Strea...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14354 **[Test build #62849 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62849/consoleFull)** for PR 14354 at commit [`5226a5e`](https://github.com/apache/spark/commit/5

[GitHub] spark pull request #14354: [SPARK-16722][Tests]Fix a StreamingContext leak i...

2016-07-25 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/14354#discussion_r72163631 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/StreamingContextSuite.scala --- @@ -819,10 +819,13 @@ class StreamingContextSuite extends Spar

[GitHub] spark pull request #14354: [SPARK-16722][Tests]Fix a StreamingContext leak i...

2016-07-25 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/14354 [SPARK-16722][Tests]Fix a StreamingContext leak in StreamingContextSuite when eventually fails ## What changes were proposed in this pull request? This PR moves `ssc.stop()` into `finally`

[GitHub] spark issue #14349: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/14349 LGTM (from https://github.com/apache/spark/pull/14174) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14269 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62842/ Test PASSed. ---

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14269 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14269 **[Test build #62842 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62842/consoleFull)** for PR 14269 at commit [`82feec4`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avo...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14292 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #14350: [SPARK-16715][Tests]Fix a potential ExprId confli...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14350 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avoiding p...

2016-07-25 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/14292 Tests have passed. Merging this to master and 2.0. Thanks for reviewing @zsxwing @jaceklaskowski --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #14350: [SPARK-16715][Tests]Fix a potential ExprId conflict for ...

2016-07-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14350 Merging to master and 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark issue #14350: [SPARK-16715][Tests]Fix a potential ExprId conflict for ...

2016-07-25 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14350 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-25 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r72160752 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,216 @@ +/* + * Licensed to the Apache Software F

[GitHub] spark issue #14353: [SPARK-16714][SQL] `array` should create a decimal array...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14353 **[Test build #62848 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62848/consoleFull)** for PR 14353 at commit [`d3dd7fb`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #14350: [SPARK-16715][Tests]Fix a potential ExprId conflict for ...

2016-07-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14350 /cc @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if th

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-25 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r72160650 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -97,6 +97,49 @@ package object config { .toSequence

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-25 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r72160497 --- Diff: core/src/main/scala/org/apache/spark/TaskEndReason.scala --- @@ -204,6 +213,7 @@ case object TaskResultLost extends TaskFailedReason { @D

[GitHub] spark pull request #14353: [SPARK-16714][SQL] `array` should create a decima...

2016-07-25 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/14353 [SPARK-16714][SQL] `array` should create a decimal array from decimals with different precisions and scales ## What changes were proposed in this pull request? In Spark 2.0, we will

[GitHub] spark issue #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avoiding p...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14292 **[Test build #3190 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3190/consoleFull)** for PR 14292 at commit [`26138b2`](https://github.com/apache/spark/commit

[GitHub] spark issue #14350: [SPARK-16715][Tests]Fix a potential ExprId conflict for ...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14350 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62838/ Test PASSed. ---

[GitHub] spark issue #14350: [SPARK-16715][Tests]Fix a potential ExprId conflict for ...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14350 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14350: [SPARK-16715][Tests]Fix a potential ExprId conflict for ...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14350 **[Test build #62838 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62838/consoleFull)** for PR 14350 at commit [`4c6dfbc`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14241 **[Test build #62847 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62847/consoleFull)** for PR 14241 at commit [`ddb202e`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #14349: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14349 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62839/ Test PASSed. ---

[GitHub] spark issue #14349: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14349 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14349: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14349 **[Test build #62839 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62839/consoleFull)** for PR 14349 at commit [`33978cb`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14333: [SPARK-16696][ML][MLLib] destroy KMeans bcNewCenters whe...

2016-07-25 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/14333 @srowen The sparkContext, by default, will running a cleaner to release not referenced RDD/broadcasts on background. But, I think, we'd better to release them by ourselves because the Spar

[GitHub] spark issue #13585: [SPARK-15859][SQL] Optimize the partition pruning within...

2016-07-25 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/13585 @chenghao-intel Will you have time to update this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14352: Fix description of spark.speculation.quantile

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14352 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #14352: Fix description of spark.speculation.quantile

2016-07-25 Thread nwbvt
GitHub user nwbvt opened a pull request: https://github.com/apache/spark/pull/14352 Fix description of spark.speculation.quantile ## What changes were proposed in this pull request? Minor doc fix regarding the spark.speculation.quantile configuration parameter. It incorrec

[GitHub] spark issue #14351: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14351 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14351: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14351 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62844/ Test PASSed. ---

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14241 **[Test build #62845 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62845/consoleFull)** for PR 14241 at commit [`780fec5`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14241 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62845/ Test FAILed. ---

[GitHub] spark issue #14351: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14351 **[Test build #62844 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62844/consoleFull)** for PR 14351 at commit [`4bff124`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14241 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #13920: [SPARK-16166][Core] Also take off-heap memory usa...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13920 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13620 **[Test build #62846 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62846/consoleFull)** for PR 13620 at commit [`649bb19`](https://github.com/apache/spark/commit/6

<    1   2   3   4   5   6   7   >