[GitHub] spark pull request #15190: [SPARK-17620][SQL] Use the storage format specifi...

2016-09-21 Thread dilipbiswal
Github user dilipbiswal commented on a diff in the pull request: https://github.com/apache/spark/pull/15190#discussion_r79979332 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -988,9 +988,7 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark issue #15190: [SPARK-17620][SQL] Use the storage format specified by h...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15190 PR title should be ```Determine Serde by hive.default.fileformat when Creating Hive Serde Tables``` --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #15190: [SPARK-17620][SQL] Use the storage format specifi...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15190#discussion_r79978495 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -988,9 +988,7 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-21 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/15102 > I'd want to see some test cases though that show why the current implementation is wrong from an end-user perspective if it needs to block merging initial kafka support. PR with

[GitHub] spark pull request #15190: [SPARK-17620][SQL] Use the storage format specifi...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15190#discussion_r79978157 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -988,9 +988,7 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark pull request #15190: [SPARK-17620][SQL] Use the storage format specifi...

2016-09-21 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15190#discussion_r79977535 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -988,9 +988,7 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark pull request #15046: [SPARK-17492] [SQL] Fix Reading Cataloged Data So...

2016-09-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15046 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15046: [SPARK-17492] [SQL] Fix Reading Cataloged Data Sources w...

2016-09-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15046 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15174: [SPARK-17502] [SQL] [Backport] [2.0] Fix Multiple Bugs i...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15174 Sure, will do it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #15190: [SPARK-17620][SQL] Use the storage format specifi...

2016-09-21 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15190#discussion_r79976580 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -988,9 +988,7 @@ class SparkSqlAstBuilder(conf: SQLConf) extends

[GitHub] spark pull request #14988: [SPARK-17425][SQL] Override sameResult in HiveTab...

2016-09-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14988 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14988: [SPARK-17425][SQL] Override sameResult in HiveTableScanE...

2016-09-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14988 LGTM, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14537: [SPARK-16948][SQL] Use metastore schema instead of infer...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14537 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65755/ Test FAILed. ---

[GitHub] spark issue #14537: [SPARK-16948][SQL] Use metastore schema instead of infer...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14537 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14537: [SPARK-16948][SQL] Use metastore schema instead of infer...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14537 **[Test build #65755 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65755/consoleFull)** for PR 14537 at commit

[GitHub] spark issue #15174: [SPARK-17502] [SQL] [Backport] [2.0] Fix Multiple Bugs i...

2016-09-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15174 LGTM, if you have time, can you also include https://github.com/apache/spark/pull/15160? they are kind of related. thanks! --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request #15160: [SPARK-17609][SQL] SessionCatalog.tableExists sho...

2016-09-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15160 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15160: [SPARK-17609][SQL] SessionCatalog.tableExists should not...

2016-09-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15160 thanks for the review, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14537: [SPARK-16948][SQL] Use metastore schema instead of infer...

2016-09-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14537 LGTM, pending jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15090 The test suite `StatisticsColumnSuite` misses the negative cases. For example, so far, we do not allow users to analyze the temporary tables. Ideally, all the exceptions the code could

[GitHub] spark issue #15194: New feature for structured streaming: add http stream si...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15194 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15182: [SPARK-17625] [SQL] set expectedOutputAttributes when co...

2016-09-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15182 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #15194: New feature for structured streaming: add http st...

2016-09-21 Thread zhangxinyu1
GitHub user zhangxinyu1 opened a pull request: https://github.com/apache/spark/pull/15194 New feature for structured streaming: add http stream sink ## What changes were proposed in this pull request? Add http stream sink for structured streaming. Streaming query

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79975372 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeColumnCommand.scala --- @@ -0,0 +1,189 @@ +/* + * Licensed to

[GitHub] spark issue #14035: [SPARK-16356][ML] Add testImplicits for ML unit tests an...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14035 **[Test build #65758 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65758/consoleFull)** for PR 14035 at commit

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79975005 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/StatisticsTest.scala --- @@ -0,0 +1,93 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #14035: [SPARK-16356][ML] Add testImplicits for ML unit tests an...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14035 **[Test build #65757 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65757/consoleFull)** for PR 14035 at commit

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79974658 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -473,15 +476,20 @@ private[spark] class

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79974623 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeColumnCommand.scala --- @@ -0,0 +1,189 @@ +/* + * Licensed to

[GitHub] spark issue #15182: [SPARK-17625] [SQL] set expectedOutputAttributes when co...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15182 LGTM pending Jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13512: [SPARK-15769][SQL] Add Encoder for input type to Aggrega...

2016-09-21 Thread koertkuipers
Github user koertkuipers commented on the issue: https://github.com/apache/spark/pull/13512 @cloud-fan i thought about this a little more, and my suggested changes to the Aggregator api does not allow one to use a different encoder when applying a typed operation on Dataset. so i do

[GitHub] spark issue #15182: [SPARK-17625] [SQL] set expectedOutputAttributes when co...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15182 **[Test build #65756 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65756/consoleFull)** for PR 15182 at commit

[GitHub] spark pull request #15154: [SPARK-17494] [SQL] changePrecision() on compact ...

2016-09-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15154 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15182: [SPARK-17625] [SQL] set expectedOutputAttributes when co...

2016-09-21 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15182 @cloud-fan Ok. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #15188: [SPARK-17627] Mark Streaming Providers Experiment...

2016-09-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15188 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15154: [SPARK-17494] [SQL] changePrecision() on compact decimal...

2016-09-21 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15154 Merging in master/2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15188: [SPARK-17627] Mark Streaming Providers Experimental

2016-09-21 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15188 Merging in master/2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14537: [SPARK-16948][SQL] Use metastore schema instead of infer...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14537 **[Test build #65755 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65755/consoleFull)** for PR 14537 at commit

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15090 **[Test build #65754 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65754/consoleFull)** for PR 15090 at commit

[GitHub] spark issue #15005: [SPARK-17421] [DOCS] Documenting the current treatment o...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15005 **[Test build #3286 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3286/consoleFull)** for PR 15005 at commit

[GitHub] spark pull request #14537: [SPARK-16948][SQL] Use metastore schema instead o...

2016-09-21 Thread rajeshbalamohan
Github user rajeshbalamohan commented on a diff in the pull request: https://github.com/apache/spark/pull/14537#discussion_r79972251 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -237,21 +237,27 @@ private[hive] class

[GitHub] spark issue #15005: [SPARK-17421] [DOCS] Documenting the current treatment o...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15005 **[Test build #3286 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3286/consoleFull)** for PR 15005 at commit

[GitHub] spark issue #15191: [SPARK-17628][Streaming][Examples] change name "Streamin...

2016-09-21 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/15191 oh I see...sorry...I'll close this one --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15191: [SPARK-17628][Streaming][Examples] change name "S...

2016-09-21 Thread keypointt
Github user keypointt closed the pull request at: https://github.com/apache/spark/pull/15191 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15190: [SPARK-17620][SQL] hive.default.fileformat=orc does not ...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15190 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65752/ Test PASSed. ---

[GitHub] spark issue #15190: [SPARK-17620][SQL] hive.default.fileformat=orc does not ...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15190 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15193: [SQL]RowBasedKeyValueBatch reuse valueRow too

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15193 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15190: [SPARK-17620][SQL] hive.default.fileformat=orc does not ...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15190 **[Test build #65752 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65752/consoleFull)** for PR 15190 at commit

[GitHub] spark pull request #15139: [SPARK-17315][Follow-up][SparkR][ML] Fix print of...

2016-09-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15139 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15193: [SQL]RowBasedKeyValueBatch reuse valueRow too

2016-09-21 Thread yaooqinn
Github user yaooqinn commented on the issue: https://github.com/apache/spark/pull/15193 cc @ooq @sameeragarwal @davies is it right and necessary? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #15192: [SPARK-14536] [SQL] fix to handle null value in array ty...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15192 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65751/ Test PASSed. ---

[GitHub] spark issue #15139: [SPARK-17315][Follow-up][SparkR][ML] Fix print of Kolmog...

2016-09-21 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15139 I will merge this into master. If anyone has more comments, I can address them at follow-up work. Thanks for your review. @felixcheung --- If your project is set up for it, you can reply to

[GitHub] spark issue #15192: [SPARK-14536] [SQL] fix to handle null value in array ty...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15192 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15193: [SQL]RowBasedKeyValueBatch reuse valueRow too

2016-09-21 Thread yaooqinn
GitHub user yaooqinn opened a pull request: https://github.com/apache/spark/pull/15193 [SQL]RowBasedKeyValueBatch reuse valueRow too ## What changes were proposed in this pull request? reuse the cached valueRow in RowBasedKeyValueBatch ## How was this patch

[GitHub] spark issue #15191: [SPARK-17628][Streaming][Examples] change name "Streamin...

2016-09-21 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15191 "Foobars" is a common name in Java / Scala for "static methods related to Foobar objects". I think the current name is fine. It's not really an API anyway, just a component of an example. --- If

[GitHub] spark issue #15192: [SPARK-14536] [SQL] fix to handle null value in array ty...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15192 **[Test build #65751 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65751/consoleFull)** for PR 15192 at commit

[GitHub] spark pull request #14988: [SPARK-17425][SQL] Override sameResult in HiveTab...

2016-09-21 Thread watermen
Github user watermen commented on a diff in the pull request: https://github.com/apache/spark/pull/14988#discussion_r79970830 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveTableScanExec.scala --- @@ -164,4 +164,19 @@ case class HiveTableScanExec(

[GitHub] spark pull request #15131: [SPARK-17577][SparkR][Core] SparkR support add fi...

2016-09-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15131 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work for jdb...

2016-09-21 Thread JustinPihony
Github user JustinPihony commented on the issue: https://github.com/apache/spark/pull/12601 @srowen Ping. I don't think there is anything on my plate. This should be mergeable --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-21 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15131 I will merge this into master. If anyone has more comments, I can address them at follow up work. Thanks for your review. @felixcheung @HyukjinKwon @shivaram --- If your project is set up

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15090 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65749/ Test PASSed. ---

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15090 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15090 **[Test build #65749 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65749/consoleFull)** for PR 15090 at commit

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15090 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65746/ Test PASSed. ---

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15090 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14851: [SPARK-17281][ML][MLLib] Add treeAggregateDepth paramete...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14851 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65753/ Test PASSed. ---

[GitHub] spark issue #14851: [SPARK-17281][ML][MLLib] Add treeAggregateDepth paramete...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14851 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14851: [SPARK-17281][ML][MLLib] Add treeAggregateDepth paramete...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14851 **[Test build #65753 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65753/consoleFull)** for PR 14851 at commit

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15090 **[Test build #65746 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65746/consoleFull)** for PR 15090 at commit

[GitHub] spark issue #14124: [SPARK-16472][SQL] Inconsistent nullability in schema af...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14124 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65747/ Test PASSed. ---

[GitHub] spark issue #14124: [SPARK-16472][SQL] Inconsistent nullability in schema af...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14124 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14124: [SPARK-16472][SQL] Inconsistent nullability in schema af...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14124 **[Test build #65747 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65747/consoleFull)** for PR 14124 at commit

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-21 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79968621 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/StatisticsColumnSuite.scala --- @@ -0,0 +1,352 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #15185: [SPARK-17618] Fix invalid comparisons between UnsafeRow ...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15185 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65750/ Test PASSed. ---

[GitHub] spark issue #15185: [SPARK-17618] Fix invalid comparisons between UnsafeRow ...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15185 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15185: [SPARK-17618] Fix invalid comparisons between UnsafeRow ...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15185 **[Test build #65750 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65750/consoleFull)** for PR 15185 at commit

[GitHub] spark issue #14912: [SPARK-17357][SQL] Fix current predicate pushdown

2016-09-21 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14912 ping @cloud-fan @hvanhovell Can you review this if you have time? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #14780: [SPARK-17206][SQL] Support ANALYZE TABLE on analyzable t...

2016-09-21 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14780 @hvanhovell ok. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15046: [SPARK-17492] [SQL] Fix Reading Cataloged Data Sources w...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15046 This is a new issue of Spark 2.1, after we physically store the inferred schema in the metastore. BTW, I also ran the test cases in Spark 2.0. It works well. --- If your project is

[GitHub] spark issue #14851: [SPARK-17281][ML][MLLib] Add treeAggregateDepth paramete...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14851 **[Test build #65753 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65753/consoleFull)** for PR 14851 at commit

[GitHub] spark issue #15190: [SPARK-17620][SQL] hive.default.fileformat=orc does not ...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15190 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65744/ Test PASSed. ---

[GitHub] spark issue #15190: [SPARK-17620][SQL] hive.default.fileformat=orc does not ...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15190 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15190: [SPARK-17620][SQL] hive.default.fileformat=orc does not ...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15190 **[Test build #65744 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65744/consoleFull)** for PR 15190 at commit

[GitHub] spark issue #15071: [SPARK-17517][SQL]Improve generated Code for BroadcastHa...

2016-09-21 Thread yaooqinn
Github user yaooqinn commented on the issue: https://github.com/apache/spark/pull/15071 @hvanhovell I think unfixed length fields may lead to memory overlapping when ```BuildLeft```, since we are reusing the ```BufferHolder``` to avoid writing the stream side repeatedly. In this

[GitHub] spark issue #15146: [SPARK-17590][SQL] Analyze CTE definitions at once and a...

2016-09-21 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15146 @hvanhovell @cloud-fan Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15190: [SPARK-17620][SQL] hive.default.fileformat=orc does not ...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15190 Please update the PR description. This is not for `orc` only --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79965497 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/StatisticsTest.scala --- @@ -0,0 +1,88 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79965425 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/StatisticsColumnSuite.scala --- @@ -0,0 +1,352 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79965370 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SessionState.scala --- @@ -186,13 +187,27 @@ private[sql] class

[GitHub] spark issue #15152: [SPARK-17365][Core] Remove/Kill multiple executors toget...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15152 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15152: [SPARK-17365][Core] Remove/Kill multiple executors toget...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15152 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65740/ Test PASSed. ---

[GitHub] spark issue #15190: [SPARK-17620][SQL] hive.default.fileformat=orc does not ...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15190 **[Test build #65752 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65752/consoleFull)** for PR 15190 at commit

[GitHub] spark issue #15152: [SPARK-17365][Core] Remove/Kill multiple executors toget...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15152 **[Test build #65740 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65740/consoleFull)** for PR 15152 at commit

[GitHub] spark issue #15189: [SPARK-17549][sql] Coalesce cached relation stats in dri...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15189 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15189: [SPARK-17549][sql] Coalesce cached relation stats in dri...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15189 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65743/ Test PASSed. ---

[GitHub] spark pull request #15190: [SPARK-17620][SQL] hive.default.fileformat=orc do...

2016-09-21 Thread dilipbiswal
Github user dilipbiswal commented on a diff in the pull request: https://github.com/apache/spark/pull/15190#discussion_r79964807 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveDDLCommandSuite.scala --- @@ -556,4 +558,32 @@ class HiveDDLCommandSuite extends

[GitHub] spark issue #15189: [SPARK-17549][sql] Coalesce cached relation stats in dri...

2016-09-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15189 **[Test build #65743 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65743/consoleFull)** for PR 15189 at commit

[GitHub] spark pull request #15190: [SPARK-17620][SQL] hive.default.fileformat=orc do...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15190#discussion_r79964525 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveDDLCommandSuite.scala --- @@ -556,4 +558,32 @@ class HiveDDLCommandSuite extends PlanTest

[GitHub] spark pull request #15190: [SPARK-17620][SQL] hive.default.fileformat=orc do...

2016-09-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15190#discussion_r79964497 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveDDLCommandSuite.scala --- @@ -556,4 +558,32 @@ class HiveDDLCommandSuite extends PlanTest

[GitHub] spark issue #15154: [SPARK-17494] [SQL] changePrecision() on compact decimal...

2016-09-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15154 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

  1   2   3   4   5   6   >