[GitHub] spark issue #13494: [SPARK-15752] [SQL] Optimize metadata only query that ha...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61853 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61853/consoleFull)** for PR 13494 at commit

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to rem...

2016-07-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13876 Hi, @rxin . Could you review this PR again? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14070: [SPARK-15979][SQL] Renames CatalystWriteSupport to Parqu...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14070 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14070: [SPARK-15979][SQL] Renames CatalystWriteSupport to Parqu...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14070 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61856/ Test PASSed. ---

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r69775428 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -441,10 +452,15 @@ case class

[GitHub] spark pull request #14070: [SPARK-15979][SQL] Renames CatalystWriteSupport t...

2016-07-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14070 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer...

2016-07-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13876#discussion_r69775645 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -820,16 +820,26 @@ object ConstantFolding extends

[GitHub] spark pull request #14072: [SPARK-16398][CORE] Make cancelJob and cancelStag...

2016-07-06 Thread MasterDDT
GitHub user MasterDDT opened a pull request: https://github.com/apache/spark/pull/14072 [SPARK-16398][CORE] Make cancelJob and cancelStage APIs public ## What changes were proposed in this pull request? Make cancelJob and cancelStage APIs public ## How was this

[GitHub] spark pull request #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer...

2016-07-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13876#discussion_r69777982 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -820,16 +820,26 @@ object ConstantFolding

[GitHub] spark pull request #14080: [SPARK-16405] [ShuffleService] [Metrics] Add metr...

2016-07-06 Thread lovexi
GitHub user lovexi opened a pull request: https://github.com/apache/spark/pull/14080 [SPARK-16405] [ShuffleService] [Metrics] Add metrics and source for external shuffle service ## What changes were proposed in this pull request? ExternalShuffleService is essential for

[GitHub] spark pull request #12374: [SPARK-14610][ML] Remove superfluous split for co...

2016-07-06 Thread MechCoder
Github user MechCoder commented on a diff in the pull request: https://github.com/apache/spark/pull/12374#discussion_r69824592 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -137,14 +137,47 @@ class RandomForestSuite extends

[GitHub] spark issue #14078: [SPARK-11857] [Mesos] [WIP] Deprecate fine grained

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14078 **[Test build #61874 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61874/consoleFull)** for PR 14078 at commit

[GitHub] spark issue #14078: [SPARK-11857] [Mesos] [WIP] Deprecate fine grained

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14078 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #12374: [SPARK-14610][ML] Remove superfluous split for co...

2016-07-06 Thread MechCoder
Github user MechCoder commented on a diff in the pull request: https://github.com/apache/spark/pull/12374#discussion_r69826097 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala --- @@ -137,14 +137,47 @@ class RandomForestSuite extends

[GitHub] spark issue #14078: [SPARK-11857] [Mesos] [WIP] Deprecate fine grained

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14078 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61874/ Test PASSed. ---

[GitHub] spark pull request #14064: [SPARK-15968][SQL] Nonempty partitioned metastore...

2016-07-06 Thread yhuai
Github user yhuai closed the pull request at: https://github.com/apache/spark/pull/14064 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13701: [SPARK-15639][SQL] Try to push down filter at RowGroups ...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13701 **[Test build #61879 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61879/consoleFull)** for PR 13701 at commit

[GitHub] spark pull request #14026: [SPARK-13569][STREAMING][KAFKA] pattern based top...

2016-07-06 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/14026#discussion_r69830774 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/ConsumerStrategy.scala --- @@ -79,8 +81,71 @@ private case class

[GitHub] spark issue #14083: [SPARK-16406][SQL] Improve performance of LogicalPlan.re...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14083 **[Test build #61884 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61884/consoleFull)** for PR 14083 at commit

[GitHub] spark pull request #14074: [SPARK-16371][SQL] Two follow-up tasks

2016-07-06 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/14074#discussion_r69834626 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilterSuite.scala --- @@ -544,7 +544,7 @@ class

[GitHub] spark pull request #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer...

2016-07-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13876#discussion_r69834664 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -132,6 +132,7 @@ case class In(value: Expression,

[GitHub] spark pull request #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer...

2016-07-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13876#discussion_r69835417 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -132,6 +132,7 @@ case class In(value: Expression,

[GitHub] spark issue #14081: [SPARK-16403][Examples] Cleanup to remove unused imports...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14081 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61883/ Test PASSed. ---

[GitHub] spark issue #14081: [SPARK-16403][Examples] Cleanup to remove unused imports...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14081 **[Test build #61883 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61883/consoleFull)** for PR 14081 at commit

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to rem...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13876 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61875/ Test PASSed. ---

[GitHub] spark issue #14081: [SPARK-16403][Examples] Cleanup to remove unused imports...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14081 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to rem...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13876 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to rem...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13876 **[Test build #61875 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61875/consoleFull)** for PR 13876 at commit

[GitHub] spark issue #14083: [SPARK-16406][SQL] Improve performance of LogicalPlan.re...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14083 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61886/ Test FAILed. ---

[GitHub] spark issue #14083: [SPARK-16406][SQL] Improve performance of LogicalPlan.re...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14083 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14030: [SPARK-16350][SQL] Fix support for incremental planning ...

2016-07-06 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14030 @lw-lin thanks for fixing it. Just some minor comments. Once you fix it and tests pass, I will merge it. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #9940: [SPARK-11955][SQL] Mark optional fields in merging schema...

2016-07-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/9940 OK thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #14030: [SPARK-16350][SQL] Fix support for incremental pl...

2016-07-06 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/14030#discussion_r69824404 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/ForeachSinkSuite.scala --- @@ -35,35 +35,109 @@ class ForeachSinkSuite extends

[GitHub] spark pull request #13890: [SPARK-16189][SQL] Add ExistingRDD logical plan f...

2016-07-06 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/13890#discussion_r69825251 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala --- @@ -74,13 +74,71 @@ object RDDConversions { } }

[GitHub] spark issue #14078: [SPARK-11857] [Mesos] [WIP] Deprecate fine grained

2016-07-06 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/14078 cc @skonto --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #13993: [SPARK-16144][SPARKR] update R API doc for mllib

2016-07-06 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/13993#discussion_r69826669 --- Diff: R/pkg/R/mllib.R --- @@ -53,26 +53,27 @@ setClass("AFTSurvivalRegressionModel", representation(jobj = "jobj")) #' @note KMeansModel since

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to rem...

2016-07-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13876 Hmm. I will rename it according to the advice. Sorry for the delay! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #14026: [SPARK-13569][STREAMING][KAFKA] pattern based top...

2016-07-06 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14026#discussion_r69827687 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/ConsumerStrategy.scala --- @@ -79,8 +81,71 @@ private case class Subscribe[K,

[GitHub] spark pull request #14073: [SPARK-16212][STREAMING][KAFKA] apply test tweaks...

2016-07-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14073 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14081: [SPARK-16403][Examples] Cleanup to remove unused imports...

2016-07-06 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/14081 cc @MLnick @yanboliang - either of you mind taking a look? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13951: [WIP][SPARK-8425]

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13951 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61866/ Test PASSed. ---

[GitHub] spark issue #14082: [SPARK-16381][SQL][SparkR] Update SQL examples and progr...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14082 **[Test build #61881 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61881/consoleFull)** for PR 14082 at commit

[GitHub] spark issue #14083: [SPARK-16406][SQL] Improve performance of LogicalPlan.re...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14083 **[Test build #61882 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61882/consoleFull)** for PR 14083 at commit

[GitHub] spark issue #14083: [SPARK-16406][SQL] Improve performance of LogicalPlan.re...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14083 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14083: [SPARK-16406][SQL] Improve performance of LogicalPlan.re...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14083 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61882/ Test FAILed. ---

[GitHub] spark issue #14081: [SPARK-16403][Examples] Cleanup to remove unused imports...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14081 **[Test build #61883 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61883/consoleFull)** for PR 14081 at commit

[GitHub] spark pull request #14074: [SPARK-16371][SQL] Two follow-up tasks

2016-07-06 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/14074#discussion_r69834182 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilterSuite.scala --- @@ -544,7 +544,7 @@ class

[GitHub] spark pull request #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer...

2016-07-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13876#discussion_r69834801 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -820,16 +820,25 @@ object ConstantFolding extends

[GitHub] spark issue #14043: [Minor][Core][1.6-backport] Fix display wrong free memor...

2016-07-06 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/14043 Thanks @srowen and @rxin for your review, I will close it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #14043: [Minor][Core][1.6-backport] Fix display wrong fre...

2016-07-06 Thread jerryshao
Github user jerryshao closed the pull request at: https://github.com/apache/spark/pull/14043 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #61873 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61873/consoleFull)** for PR 14079 at commit

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14079 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61873/ Test PASSed. ---

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14079 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to rem...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13876 **[Test build #61888 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61888/consoleFull)** for PR 13876 at commit

[GitHub] spark pull request #14071: [SPARK-16397][SQL][WIP] make CatalogTable more ge...

2016-07-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14071#discussion_r69837833 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -45,35 +45,28 @@ case class CatalogFunction( */

[GitHub] spark issue #14072: [SPARK-16398][CORE] Make cancelJob and cancelStage APIs ...

2016-07-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14072 Looks fine to me. Do we expose stage ID anywhere else? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to rem...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13876 **[Test build #61878 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61878/consoleFull)** for PR 13876 at commit

[GitHub] spark issue #14077: [SPARK-16402] [SQL] JDBC Source: Implement save API of D...

2016-07-06 Thread JustinPihony
Github user JustinPihony commented on the issue: https://github.com/apache/spark/pull/14077 This may seem simpler, but that's because it seems to be taking some shortcuts to avoid having to refactor. This currently creates a cycle along the lines of `df.save.df.jdbc`. Wouldn't it be

[GitHub] spark issue #14028: [SPARK-16351][SQL] Avoid per-record type dispatch in JSO...

2016-07-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14028 Sure! Thank toy for your review! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14026: [SPARK-13569][STREAMING][KAFKA] pattern based top...

2016-07-06 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14026#discussion_r69827004 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/ConsumerStrategy.scala --- @@ -79,8 +81,71 @@ private case class Subscribe[K,

[GitHub] spark issue #12374: [SPARK-14610][ML] Remove superfluous split for continuou...

2016-07-06 Thread MechCoder
Github user MechCoder commented on the issue: https://github.com/apache/spark/pull/12374 @sethah Nice catch! This superfluous split seems to be only for continuous features in which the number of unique values - 1 is lesser than or equal to the number of splits. Can you update the PR

[GitHub] spark pull request #14026: [SPARK-13569][STREAMING][KAFKA] pattern based top...

2016-07-06 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14026#discussion_r69828515 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/ConsumerStrategy.scala --- @@ -79,8 +81,71 @@ private case class Subscribe[K,

[GitHub] spark pull request #14026: [SPARK-13569][STREAMING][KAFKA] pattern based top...

2016-07-06 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14026#discussion_r69828476 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/ConsumerStrategy.scala --- @@ -79,8 +81,71 @@ private case class Subscribe[K,

[GitHub] spark pull request #14026: [SPARK-13569][STREAMING][KAFKA] pattern based top...

2016-07-06 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/14026#discussion_r69828549 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/ConsumerStrategy.scala --- @@ -79,8 +81,71 @@ private case class

[GitHub] spark pull request #14026: [SPARK-13569][STREAMING][KAFKA] pattern based top...

2016-07-06 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/14026#discussion_r69828832 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/ConsumerStrategy.scala --- @@ -79,8 +81,71 @@ private case class

[GitHub] spark pull request #14073: [SPARK-16212][STREAMING][KAFKA] apply test tweaks...

2016-07-06 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14073#discussion_r69828953 --- Diff: external/kafka-0-8/src/test/scala/org/apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala --- @@ -244,12 +244,9 @@ class

[GitHub] spark pull request #13494: [SPARK-15752] [SQL] Optimize metadata only query ...

2016-07-06 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/13494#discussion_r69830577 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -1689,4 +1689,86 @@ class SQLQuerySuite extends QueryTest

[GitHub] spark pull request #14083: [SPARK-16406][SQL] Improve performance of Logical...

2016-07-06 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/14083 [SPARK-16406][SQL] Improve performance of LogicalPlan.resolve [WIP] ## What changes were proposed in this pull request? `LogicalPlan.resolve(...)` uses linear searches to find an attribute

[GitHub] spark issue #14083: [SPARK-16406][SQL] Improve performance of LogicalPlan.re...

2016-07-06 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14083 cc @dongjoon-hyun --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14081: [SPARK-16403][Examples] Cleanup to remove unused imports...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14081 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61880/ Test PASSed. ---

[GitHub] spark issue #14081: [SPARK-16403][Examples] Cleanup to remove unused imports...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14081 **[Test build #61880 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61880/consoleFull)** for PR 14081 at commit

[GitHub] spark issue #14081: [SPARK-16403][Examples] Cleanup to remove unused imports...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14081 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to rem...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13876 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61871/ Test PASSed. ---

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to rem...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13876 **[Test build #61871 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61871/consoleFull)** for PR 13876 at commit

[GitHub] spark issue #14083: [SPARK-16406][SQL] Improve performance of LogicalPlan.re...

2016-07-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14083 Oh, it's strange. It still fails at compiling in my local laptop. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #14074: [SPARK-16371][SQL] Two follow-up tasks

2016-07-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14074#discussion_r69834553 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilterSuite.scala --- @@ -544,7 +544,7 @@ class ParquetFilterSuite

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to rem...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13876 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer...

2016-07-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13876#discussion_r69835350 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -132,6 +132,7 @@ case class In(value:

[GitHub] spark pull request #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer...

2016-07-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13876#discussion_r69835277 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -132,6 +132,7 @@ case class In(value:

[GitHub] spark issue #14076: [SPARK-16400][SQL] Remove InSet filter pushdown from Par...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14076 **[Test build #61876 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61876/consoleFull)** for PR 14076 at commit

[GitHub] spark issue #8066: [SPARK-9778][SQL] remove unnecessary evaluation from Sort...

2016-07-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/8066 Close this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to rem...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13876 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14076: [SPARK-16400][SQL] Remove InSet filter pushdown from Par...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14076 **[Test build #61877 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61877/consoleFull)** for PR 14076 at commit

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to rem...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13876 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61878/ Test PASSed. ---

[GitHub] spark issue #14072: [SPARK-16398][CORE] Make cancelJob and cancelStage APIs ...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14072 **[Test build #3167 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3167/consoleFull)** for PR 14072 at commit

[GitHub] spark issue #14076: [SPARK-16400][SQL] Remove InSet filter pushdown from Par...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14076 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61877/ Test PASSed. ---

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #61873 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61873/consoleFull)** for PR 14079 at commit

[GitHub] spark issue #14078: [SPARK-11857] [Mesos] [WIP] Deprecate fine grained

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14078 **[Test build #61874 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61874/consoleFull)** for PR 14078 at commit

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-06 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/14079 @kayousterhout @markhamstra @tgravescs @mwws I finally this is ready for review. I have some minor updates left but I wanted to get this in your hands now. The main thing is testing on a cluster

[GitHub] spark issue #14080: [SPARK-16405] [ShuffleService] [Metrics] Add metrics and...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14080 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14076: [SPARK-16400][SQL] Remove InSet filter pushdown from Par...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14076 **[Test build #61876 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61876/consoleFull)** for PR 14076 at commit

[GitHub] spark issue #14078: [SPARK-11857] [Mesos] [WIP] Deprecate fine grained

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14078 **[Test build #61872 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61872/consoleFull)** for PR 14078 at commit

[GitHub] spark issue #14078: [SPARK-11857] [Mesos] [WIP] Deprecate fine grained

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14078 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61872/ Test PASSed. ---

[GitHub] spark issue #14078: [SPARK-11857] [Mesos] [WIP] Deprecate fine grained

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14078 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14026: [SPARK-13569][STREAMING][KAFKA] pattern based top...

2016-07-06 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/14026#discussion_r69829009 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/ConsumerStrategy.scala --- @@ -79,8 +81,71 @@ private case class

[GitHub] spark issue #14073: [SPARK-16212][STREAMING][KAFKA] apply test tweaks from 0...

2016-07-06 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/14073 LGTM. Merging this to master and 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14077: [SPARK-16402] [SQL] JDBC Source: Implement save API

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14077 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61867/ Test PASSed. ---

[GitHub] spark pull request #14026: [SPARK-13569][STREAMING][KAFKA] pattern based top...

2016-07-06 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14026#discussion_r69829829 --- Diff: external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/ConsumerStrategy.scala --- @@ -79,8 +81,71 @@ private case class Subscribe[K,

[GitHub] spark issue #13983: [SPARK-16021] Fill freed memory in test to help catch co...

2016-07-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13983 Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #13951: [WIP][SPARK-8425]

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13951 **[Test build #61866 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61866/consoleFull)** for PR 13951 at commit

<    1   2   3   4   5   6   7   8   >