[GitHub] [spark] AmplabJenkins commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#issuecomment-523555148 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] huaxingao commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

2019-08-21 Thread GitBox
huaxingao commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#issuecomment-523554706 [](url)

[GitHub] [spark] rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316296769 ## File path: sql/core/src/test/scala/org/apache/spark/sql/sources/v2/DataFrameWriterV2Suite.scala ##

[GitHub] [spark] rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316296208 ## File path: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ## @@ -3942,6 +3943,61 @@

[GitHub] [spark] SparkQA commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
SparkQA commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#issuecomment-523552484 **[Test build #109505 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109505/testReport)** for PR 25354 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523550426 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523549943 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523550433 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523549957 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
SparkQA removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523439382 **[Test build #109495 has

[GitHub] [spark] SparkQA removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
SparkQA removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523451346 **[Test build #109496 has

[GitHub] [spark] keypointt commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
keypointt commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316294998 ## File path:

[GitHub] [spark] keypointt commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
keypointt commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316294655 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/PartitionTransforms.scala

[GitHub] [spark] AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523550433 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523550426 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523549943 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523549957 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
SparkQA commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523549456 **[Test build #109495 has

[GitHub] [spark] SparkQA commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
SparkQA commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523549153 **[Test build #109496 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523546832 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523546840 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523546832 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523546840 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-21 Thread GitBox
SparkQA removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523426163 **[Test build #109494 has

[GitHub] [spark] SparkQA commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-21 Thread GitBox
SparkQA commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523546289 **[Test build #109494 has

[GitHub] [spark] brkyvz commented on issue #25521: [SPARK-28635][SQL][followup] CatalogManager should reflect the changes of default catalog

2019-08-21 Thread GitBox
brkyvz commented on issue #25521: [SPARK-28635][SQL][followup] CatalogManager should reflect the changes of default catalog URL: https://github.com/apache/spark/pull/25521#issuecomment-523545954 LGTM as well This is an

[GitHub] [spark] rdblue commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-21 Thread GitBox
rdblue commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523542819 > I have asked for your opinions one week ago in comment #25453 (comment) before I start the actual code

[GitHub] [spark] dongjoon-hyun commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-21 Thread GitBox
dongjoon-hyun commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523541624 @xuanyuanking and @cloud-fan . This PR doesn't include the original test case. Is it okay? It would

[GitHub] [spark] rdblue commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-21 Thread GitBox
rdblue commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523541789 If we want to have just one property, I think what we can do is use different defaults for v1 and v2, but use

[GitHub] [spark] rdblue commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-21 Thread GitBox
rdblue commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523540307 > For Spark users, I think it makes more sense to choose the table insertion policy with one flag. I

[GitHub] [spark] SparkQA commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
SparkQA commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523538354 **[Test build #109504 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523537124 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523537137 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523537137 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523537124 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
SparkQA commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523534335 **[Test build #109503 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523533292 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523533302 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] rdblue commented on issue #25521: [SPARK-28635][SQL][followup] CatalogManager should reflect the changes of default catalog

2019-08-21 Thread GitBox
rdblue commented on issue #25521: [SPARK-28635][SQL][followup] CatalogManager should reflect the changes of default catalog URL: https://github.com/apache/spark/pull/25521#issuecomment-523533389 +1 This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523533302 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-523533292 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-21 Thread GitBox
SparkQA commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25517#issuecomment-523530336 **[Test build #109502 has

[GitHub] [spark] rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316274492 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@ -3178,6 +3178,34 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on issue #25543: [SPARK-28795][DOC] Document CREATE VIEW statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25543: [SPARK-28795][DOC] Document CREATE VIEW statement in SQL Reference URL: https://github.com/apache/spark/pull/25543#issuecomment-523529137 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25543: [SPARK-28795][DOC] Document CREATE VIEW statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25543: [SPARK-28795][DOC] Document CREATE VIEW statement in SQL Reference URL: https://github.com/apache/spark/pull/25543#issuecomment-523530123 Can one of the admins verify this patch? This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25517#issuecomment-523529324 Merged build finished. Test PASSed.

[GitHub] [spark] rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316273986 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25517#issuecomment-523529332 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins removed a comment on issue #25543: [SPARK-28795][DOC] Document CREATE VIEW statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25543: [SPARK-28795][DOC] Document CREATE VIEW statement in SQL Reference URL: https://github.com/apache/spark/pull/25543#issuecomment-523528873 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25517#issuecomment-523529332 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25517#issuecomment-523529324 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25543: [SPARK-28795][DOC] Document CREATE VIEW statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25543: [SPARK-28795][DOC] Document CREATE VIEW statement in SQL Reference URL: https://github.com/apache/spark/pull/25543#issuecomment-523529137 Can one of the admins verify this patch? This

[GitHub] [spark] AmplabJenkins commented on issue #25543: [SPARK-28795][DOC] Document CREATE VIEW statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25543: [SPARK-28795][DOC] Document CREATE VIEW statement in SQL Reference URL: https://github.com/apache/spark/pull/25543#issuecomment-523528873 Can one of the admins verify this patch? This

[GitHub] [spark] amanomer opened a new pull request #25543: [SPARK-28795][DOC] Document CREATE VIEW statement in SQL Reference

2019-08-21 Thread GitBox
amanomer opened a new pull request #25543: [SPARK-28795][DOC] Document CREATE VIEW statement in SQL Reference URL: https://github.com/apache/spark/pull/25543 ### What changes were proposed in this pull request? Added document for CREATE VIEW command. ### Why are the changes

[GitHub] [spark] wangyum commented on issue #25542: [SPARK-28840][SQL] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive

2019-08-21 Thread GitBox
wangyum commented on issue #25542: [SPARK-28840][SQL] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-523528243 Our example always uses `--jars

[GitHub] [spark] rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316271719 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/PartitionTransforms.scala

[GitHub] [spark] hvanhovell commented on issue #25433: [SPARK-28715][SQL] Introduce collectInPlanAndSubqueries and subqueriesAll in QueryPlan

2019-08-21 Thread GitBox
hvanhovell commented on issue #25433: [SPARK-28715][SQL] Introduce collectInPlanAndSubqueries and subqueriesAll in QueryPlan URL: https://github.com/apache/spark/pull/25433#issuecomment-523527207 Merging to master. Thanks!

[GitHub] [spark] hvanhovell closed pull request #25433: [SPARK-28715][SQL] Introduce collectInPlanAndSubqueries and subqueriesAll in QueryPlan

2019-08-21 Thread GitBox
hvanhovell closed pull request #25433: [SPARK-28715][SQL] Introduce collectInPlanAndSubqueries and subqueriesAll in QueryPlan URL: https://github.com/apache/spark/pull/25433 This is an automated message from the Apache Git

[GitHub] [spark] rdblue commented on a change in pull request #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs

2019-08-21 Thread GitBox
rdblue commented on a change in pull request #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs URL: https://github.com/apache/spark/pull/25368#discussion_r316270790 ## File path:

[GitHub] [spark] vanzin commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-21 Thread GitBox
vanzin commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25517#issuecomment-523526847 retest this please

[GitHub] [spark] gaborgsomogyi commented on issue #24970: [SPARK-23977][SQL] Support High Performance S3A committers [test-hadoop3.2]

2019-08-21 Thread GitBox
gaborgsomogyi commented on issue #24970: [SPARK-23977][SQL] Support High Performance S3A committers [test-hadoop3.2] URL: https://github.com/apache/spark/pull/24970#issuecomment-523526431 This allows us to test streaming queries with S3 checkpoint location. @steveloughran presume S3

[GitHub] [spark] tgravescs commented on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case

2019-08-21 Thread GitBox
tgravescs commented on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case URL: https://github.com/apache/spark/pull/25491#issuecomment-523525070 +1, as discussed above I think performance impact is better then changing entire behavior to

[GitHub] [spark] sandeep-katta commented on issue #25542: [SPARK-28840][SQL] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive

2019-08-21 Thread GitBox
sandeep-katta commented on issue #25542: [SPARK-28840][SQL] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-523524306 > Is it a standard usage? We support

[GitHub] [spark] srowen commented on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case

2019-08-21 Thread GitBox
srowen commented on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case URL: https://github.com/apache/spark/pull/25491#issuecomment-523523225 If it's a correctness issue, I think we have to for now.

[GitHub] [spark] rdblue commented on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema

2019-08-21 Thread GitBox
rdblue commented on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema URL: https://github.com/apache/spark/pull/25536#issuecomment-523522950 +1 This is an automated message from the Apache Git Service. To

[GitHub] [spark] srowen commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page

2019-08-21 Thread GitBox
srowen commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-523520013 Merged to master This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-21 Thread GitBox
SparkQA commented on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#issuecomment-523519956 **[Test build #109501 has

[GitHub] [spark] srowen closed pull request #25430: [SPARK-28540][WEBUI] Document Environment page

2019-08-21 Thread GitBox
srowen closed pull request #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#issuecomment-523518783 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#issuecomment-523518771 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#issuecomment-523518771 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#issuecomment-523518783 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] maryannxue commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-21 Thread GitBox
maryannxue commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#discussion_r316257936 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25534: [SPARK-28835][SQL] Improve canonicalize API

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25534: [SPARK-28835][SQL] Improve canonicalize API URL: https://github.com/apache/spark/pull/25534#issuecomment-523514342 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25534: [SPARK-28835][SQL] Improve canonicalize API

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25534: [SPARK-28835][SQL] Improve canonicalize API URL: https://github.com/apache/spark/pull/25534#issuecomment-523514335 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25534: [SPARK-28835][SQL] Improve canonicalize API

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25534: [SPARK-28835][SQL] Improve canonicalize API URL: https://github.com/apache/spark/pull/25534#issuecomment-523514342 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-21 Thread GitBox
cloud-fan commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#discussion_r316256712 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25534: [SPARK-28835][SQL] Improve canonicalize API

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25534: [SPARK-28835][SQL] Improve canonicalize API URL: https://github.com/apache/spark/pull/25534#issuecomment-523514335 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] SparkQA removed a comment on issue #25534: [SPARK-28835][SQL] Improve canonicalize API

2019-08-21 Thread GitBox
SparkQA removed a comment on issue #25534: [SPARK-28835][SQL] Improve canonicalize API URL: https://github.com/apache/spark/pull/25534#issuecomment-523421277 **[Test build #109493 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109493/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #25534: [SPARK-28835][SQL] Improve canonicalize API

2019-08-21 Thread GitBox
SparkQA commented on issue #25534: [SPARK-28835][SQL] Improve canonicalize API URL: https://github.com/apache/spark/pull/25534#issuecomment-523513313 **[Test build #109493 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109493/testReport)** for PR 25534 at

[GitHub] [spark] mgaido91 commented on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum

2019-08-21 Thread GitBox
mgaido91 commented on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum URL: https://github.com/apache/spark/pull/25347#issuecomment-523508395 > Spark needs to follow SQL standard but not Postgres, so making Spark behave the same with Postgres is not a strong

[GitHub] [spark] dongjoon-hyun commented on issue #25508: [SPARK-28699][CORE][2.3] Fix a corner case for aborting indeterminate stage

2019-08-21 Thread GitBox
dongjoon-hyun commented on issue #25508: [SPARK-28699][CORE][2.3] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25508#issuecomment-523507222 cc @cloud-fan This is an automated

[GitHub] [spark] dongjoon-hyun closed pull request #25516: [SPARK-26895][CORE][2.4] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-21 Thread GitBox
dongjoon-hyun closed pull request #25516: [SPARK-26895][CORE][2.4] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25516 This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema URL: https://github.com/apache/spark/pull/25536#issuecomment-523504702 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema URL: https://github.com/apache/spark/pull/25536#issuecomment-523504696 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema

2019-08-21 Thread GitBox
SparkQA removed a comment on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema URL: https://github.com/apache/spark/pull/25536#issuecomment-523421278 **[Test build #109492 has

[GitHub] [spark] AmplabJenkins commented on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema URL: https://github.com/apache/spark/pull/25536#issuecomment-523504702 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema URL: https://github.com/apache/spark/pull/25536#issuecomment-523504696 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema

2019-08-21 Thread GitBox
SparkQA commented on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema URL: https://github.com/apache/spark/pull/25536#issuecomment-523503949 **[Test build #109492 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109492/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #25541: [SPARK-28831][DOC][SQL]Document CLEAR CACHE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25541: [SPARK-28831][DOC][SQL]Document CLEAR CACHE statement in SQL Reference URL: https://github.com/apache/spark/pull/25541#issuecomment-523501293 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25541: [SPARK-28831][DOC][SQL]Document CLEAR CACHE statement in SQL Reference

2019-08-21 Thread GitBox
SparkQA removed a comment on issue #25541: [SPARK-28831][DOC][SQL]Document CLEAR CACHE statement in SQL Reference URL: https://github.com/apache/spark/pull/25541#issuecomment-523496585 **[Test build #109500 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25541: [SPARK-28831][DOC][SQL]Document CLEAR CACHE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25541: [SPARK-28831][DOC][SQL]Document CLEAR CACHE statement in SQL Reference URL: https://github.com/apache/spark/pull/25541#issuecomment-523501284 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25535: [SPARK-28835][SQL] Introduce TPCDSSchema

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25535: [SPARK-28835][SQL] Introduce TPCDSSchema URL: https://github.com/apache/spark/pull/25535#issuecomment-523500699 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25541: [SPARK-28831][DOC][SQL]Document CLEAR CACHE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25541: [SPARK-28831][DOC][SQL]Document CLEAR CACHE statement in SQL Reference URL: https://github.com/apache/spark/pull/25541#issuecomment-523501293 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25535: [SPARK-28835][SQL] Introduce TPCDSSchema

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25535: [SPARK-28835][SQL] Introduce TPCDSSchema URL: https://github.com/apache/spark/pull/25535#issuecomment-523500709 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25541: [SPARK-28831][DOC][SQL]Document CLEAR CACHE statement in SQL Reference

2019-08-21 Thread GitBox
SparkQA commented on issue #25541: [SPARK-28831][DOC][SQL]Document CLEAR CACHE statement in SQL Reference URL: https://github.com/apache/spark/pull/25541#issuecomment-523501074 **[Test build #109500 has

[GitHub] [spark] AmplabJenkins commented on issue #25541: [SPARK-28831][DOC][SQL]Document CLEAR CACHE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25541: [SPARK-28831][DOC][SQL]Document CLEAR CACHE statement in SQL Reference URL: https://github.com/apache/spark/pull/25541#issuecomment-523501284 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #25535: [SPARK-28835][SQL] Introduce TPCDSSchema

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25535: [SPARK-28835][SQL] Introduce TPCDSSchema URL: https://github.com/apache/spark/pull/25535#issuecomment-523500709 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25535: [SPARK-28835][SQL] Introduce TPCDSSchema

2019-08-21 Thread GitBox
SparkQA removed a comment on issue #25535: [SPARK-28835][SQL] Introduce TPCDSSchema URL: https://github.com/apache/spark/pull/25535#issuecomment-523418999 **[Test build #109490 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109490/testReport)** for PR

[GitHub] [spark] AmplabJenkins commented on issue #25535: [SPARK-28835][SQL] Introduce TPCDSSchema

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25535: [SPARK-28835][SQL] Introduce TPCDSSchema URL: https://github.com/apache/spark/pull/25535#issuecomment-523500699 Merged build finished. Test PASSed. This is an automated message from

<    4   5   6   7   8   9   10   11   12   13   >