[GitHub] SparkQA commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

SparkQA commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457976229 **[Test build #101740 has

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r251266625 ## File path:

[GitHub] maropu commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

maropu commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457975717 yea, that's known flaky tests in branch-2.3..

[GitHub] HeartSaVioR commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

HeartSaVioR commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457975617 Test failure looks not relevant. Retest this, please.

[GitHub] HeartSaVioR commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

HeartSaVioR commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457975573 @dongjoon-hyun Sorry for the late. Just updated the title and content of

[GitHub] AmplabJenkins removed a comment on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

AmplabJenkins removed a comment on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#issuecomment-457973310 Test PASSed. Refer to this link for build results (access rights

[GitHub] AmplabJenkins commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

AmplabJenkins commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#issuecomment-457973310 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins removed a comment on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

AmplabJenkins removed a comment on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#issuecomment-457973308 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

AmplabJenkins commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#issuecomment-457973308 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

SparkQA commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#issuecomment-457973075 **[Test build #101739 has

[GitHub] AmplabJenkins removed a comment on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

AmplabJenkins removed a comment on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#issuecomment-457970518 Can one of the admins verify this patch?

[GitHub] maropu commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

maropu commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#issuecomment-457972528 ok to test This

[GitHub] maropu commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

maropu commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#issuecomment-457972516 cc: @HyukjinKwon @MaxGekk

[GitHub] AmplabJenkins removed a comment on issue #22193: [SPARK-25186][SQL] Remove v2 save mode.

AmplabJenkins removed a comment on issue #22193: [SPARK-25186][SQL] Remove v2 save mode. URL: https://github.com/apache/spark/pull/22193#issuecomment-457971995 Build finished. Test PASSed. This is an automated message from

[GitHub] AmplabJenkins commented on issue #22193: [SPARK-25186][SQL] Remove v2 save mode.

AmplabJenkins commented on issue #22193: [SPARK-25186][SQL] Remove v2 save mode. URL: https://github.com/apache/spark/pull/22193#issuecomment-457971995 Build finished. Test PASSed. This is an automated message from the Apache

[GitHub] AmplabJenkins removed a comment on issue #22193: [SPARK-25186][SQL] Remove v2 save mode.

AmplabJenkins removed a comment on issue #22193: [SPARK-25186][SQL] Remove v2 save mode. URL: https://github.com/apache/spark/pull/22193#issuecomment-457971997 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #22193: [SPARK-25186][SQL] Remove v2 save mode.

SparkQA commented on issue #22193: [SPARK-25186][SQL] Remove v2 save mode. URL: https://github.com/apache/spark/pull/22193#issuecomment-457971875 **[Test build #101733 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101733/testReport)** for PR 22193 at

[GitHub] AmplabJenkins commented on issue #22193: [SPARK-25186][SQL] Remove v2 save mode.

AmplabJenkins commented on issue #22193: [SPARK-25186][SQL] Remove v2 save mode. URL: https://github.com/apache/spark/pull/22193#issuecomment-457971997 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] maropu commented on issue #23639: [SPARK-26716][SQL] FileFormat: the supported types of read/write should be consistent

maropu commented on issue #23639: [SPARK-26716][SQL] FileFormat: the supported types of read/write should be consistent URL: https://github.com/apache/spark/pull/23639#issuecomment-457971941 We don't need to document this about the 2. behaviour change?

[GitHub] SparkQA removed a comment on issue #22193: [SPARK-25186][SQL] Remove v2 save mode.

SparkQA removed a comment on issue #22193: [SPARK-25186][SQL] Remove v2 save mode. URL: https://github.com/apache/spark/pull/22193#issuecomment-457948211 **[Test build #101733 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101733/testReport)** for PR

[GitHub] AmplabJenkins removed a comment on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

AmplabJenkins removed a comment on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#issuecomment-457970422 Can one of the admins verify this patch?

[GitHub] AmplabJenkins commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

AmplabJenkins commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#issuecomment-457970518 Can one of the admins verify this patch?

[GitHub] AmplabJenkins commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

AmplabJenkins commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#issuecomment-457970422 Can one of the admins verify this patch?

[GitHub] AmplabJenkins commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

AmplabJenkins commented on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#issuecomment-457970391 Can one of the admins verify this patch?

[GitHub] AmplabJenkins removed a comment on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

AmplabJenkins removed a comment on issue #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#issuecomment-457970391 Can one of the admins verify this patch?

[GitHub] sumitsu opened a new pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

sumitsu opened a new pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665 ## What changes were proposed in this pull request? This PR updates

[GitHub] AmplabJenkins removed a comment on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query

AmplabJenkins removed a comment on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23656#issuecomment-457969845 Test FAILed. Refer to this link for build results (access rights

[GitHub] AmplabJenkins commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query

AmplabJenkins commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23656#issuecomment-457969845 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins removed a comment on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query

AmplabJenkins removed a comment on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23656#issuecomment-457969844 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query

AmplabJenkins commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23656#issuecomment-457969844 Merged build finished. Test FAILed.

[GitHub] SparkQA removed a comment on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query

SparkQA removed a comment on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23656#issuecomment-457959590 **[Test build #101734 has

[GitHub] SparkQA commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query

SparkQA commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23656#issuecomment-457969756 **[Test build #101734 has

[GitHub] AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-457968644 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-457968645 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-457968644 Merged build finished. Test PASSed. This is

[GitHub] SparkQA commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

SparkQA commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-457968557 **[Test build #101738 has

[GitHub] AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-457968645 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] maropu commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

maropu commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-457968377 retest this please This is an automated message from

[GitHub] maropu commented on issue #20433: [SPARK-23264][SQL] Make INTERVAL keyword optional in INTERVAL clauses

maropu commented on issue #20433: [SPARK-23264][SQL] Make INTERVAL keyword optional in INTERVAL clauses URL: https://github.com/apache/spark/pull/20433#issuecomment-457968357 kindly ping This is an automated message from the

[GitHub] AmplabJenkins removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457965042 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457965046 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

SparkQA commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457964462 **[Test build #101736 has

[GitHub] AmplabJenkins commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457965046 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457965042 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

SparkQA commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457964890 **[Test build #101737 has

[GitHub] AmplabJenkins removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457964471 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

SparkQA removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457964153 **[Test build #101736 has

[GitHub] AmplabJenkins commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457964466 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457964471 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457964466 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457964230 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457964233 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457964233 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457964230 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

SparkQA commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457964153 **[Test build #101736 has

[GitHub] rdblue commented on a change in pull request #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

rdblue commented on a change in pull request #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#discussion_r251259964 ## File path:

[GitHub] rdblue commented on a change in pull request #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

rdblue commented on a change in pull request #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#discussion_r251259893 ## File path:

[GitHub] rdblue commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

rdblue commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457963640 @cloud-fan, I've added analysis tests for the new logical plans. Existing tests also validate that the new

[GitHub] rdblue commented on a change in pull request #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

rdblue commented on a change in pull request #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#discussion_r251259625 ## File path:

[GitHub] rdblue commented on a change in pull request #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

rdblue commented on a change in pull request #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#discussion_r251259610 ## File path:

[GitHub] rdblue commented on a change in pull request #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

rdblue commented on a change in pull request #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#discussion_r251259542 ## File path:

[GitHub] rdblue commented on a change in pull request #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

rdblue commented on a change in pull request #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#discussion_r251259498 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala

[GitHub] AmplabJenkins commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457962856 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] rdblue commented on a change in pull request #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

rdblue commented on a change in pull request #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#discussion_r251259437 ## File path:

[GitHub] rdblue commented on a change in pull request #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

rdblue commented on a change in pull request #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#discussion_r251259412 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457962856 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457962853 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457962853 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

SparkQA commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457962767 **[Test build #101735 has

[GitHub] dongjoon-hyun commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query

dongjoon-hyun commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23656#issuecomment-457960866 @HeartSaVioR . Could you update the PR title and description, too?

[GitHub] dongjoon-hyun commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query

dongjoon-hyun commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23656#issuecomment-457960770 Thank you, @HeartSaVioR . It's enough since this will be merged as a single

[GitHub] SparkQA commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query

SparkQA commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23656#issuecomment-457959590 **[Test build #101734 has

[GitHub] MaxGekk commented on issue #23662: [SPARK-26740][SQL] Make statistics of timestamp/date columns independent from system time zones

MaxGekk commented on issue #23662: [SPARK-26740][SQL] Make statistics of timestamp/date columns independent from system time zones URL: https://github.com/apache/spark/pull/23662#issuecomment-457959496 The ticket (https://issues.apache.org/jira/browse/SPARK-26654) can be closed if this

[GitHub] HeartSaVioR commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query

HeartSaVioR commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23656#issuecomment-457959229 @dongjoon-hyun Yes, I've just cherry-picked the FOLLOW-UP commit into PR

[GitHub] AmplabJenkins removed a comment on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

AmplabJenkins removed a comment on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-457948607 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

AmplabJenkins commented on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-457948607 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

AmplabJenkins removed a comment on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-457948606 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

AmplabJenkins commented on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-457948606 Merged build finished. Test PASSed.

[GitHub] SparkQA removed a comment on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

SparkQA removed a comment on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-457928532 **[Test build #101732 has

[GitHub] SparkQA commented on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

SparkQA commented on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-457948451 **[Test build #101732 has

[GitHub] SparkQA commented on issue #22193: [SPARK-25186][SQL] Remove v2 save mode.

SparkQA commented on issue #22193: [SPARK-25186][SQL] Remove v2 save mode. URL: https://github.com/apache/spark/pull/22193#issuecomment-457948211 **[Test build #101733 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101733/testReport)** for PR 22193 at

[GitHub] asfgit closed pull request #23644: [SPARK-26708][SQL] Incorrect result caused by inconsistency between a SQL cache's cached RDD and its physical plan

asfgit closed pull request #23644: [SPARK-26708][SQL] Incorrect result caused by inconsistency between a SQL cache's cached RDD and its physical plan URL: https://github.com/apache/spark/pull/23644 This is an automated

[GitHub] gatorsmile commented on issue #23644: [SPARK-26708][SQL] Incorrect result caused by inconsistency between a SQL cache's cached RDD and its physical plan

gatorsmile commented on issue #23644: [SPARK-26708][SQL] Incorrect result caused by inconsistency between a SQL cache's cached RDD and its physical plan URL: https://github.com/apache/spark/pull/23644#issuecomment-457947551 Thanks! Merged to master. Could you submit a PR to 2.4?

[GitHub] rdblue commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

rdblue commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#discussion_r251249608 ## File path: docs/configuration.md ## @@ -190,8 +190,10 @@

[GitHub] rdblue commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

rdblue commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#discussion_r251249560 ## File path: docs/configuration.md ## @@ -223,7 +225,8 @@

[GitHub] rdblue commented on a change in pull request #21977: [SPARK-25004][CORE] Add spark.executor.pyspark.memory limit.

rdblue commented on a change in pull request #21977: [SPARK-25004][CORE] Add spark.executor.pyspark.memory limit. URL: https://github.com/apache/spark/pull/21977#discussion_r251249517 ## File path: docs/configuration.md ## @@ -179,6 +179,18 @@ of the most common options

[GitHub] SparkQA removed a comment on issue #23638: [SPARK-26713][CORE] Interrupt pipe IO threads in PipedRDD when task is finished

SparkQA removed a comment on issue #23638: [SPARK-26713][CORE] Interrupt pipe IO threads in PipedRDD when task is finished URL: https://github.com/apache/spark/pull/23638#issuecomment-457919922 **[Test build #4533 has

[GitHub] SparkQA commented on issue #23638: [SPARK-26713][CORE] Interrupt pipe IO threads in PipedRDD when task is finished

SparkQA commented on issue #23638: [SPARK-26713][CORE] Interrupt pipe IO threads in PipedRDD when task is finished URL: https://github.com/apache/spark/pull/23638#issuecomment-457942250 **[Test build #4533 has

[GitHub] rdblue commented on a change in pull request #23622: [SPARK-26677][SQL] Disable dictionary filtering by default at Parquet

rdblue commented on a change in pull request #23622: [SPARK-26677][SQL] Disable dictionary filtering by default at Parquet URL: https://github.com/apache/spark/pull/23622#discussion_r251248759 ## File path:

[GitHub] rdblue commented on a change in pull request #23622: [SPARK-26677][SQL] Disable dictionary filtering by default at Parquet

rdblue commented on a change in pull request #23622: [SPARK-26677][SQL] Disable dictionary filtering by default at Parquet URL: https://github.com/apache/spark/pull/23622#discussion_r251248759 ## File path:

[GitHub] dongjoon-hyun commented on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

dongjoon-hyun commented on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-457940829 Ur, #23639 seems to make conflicts. Could you resolve the conflicts?

[GitHub] dongjoon-hyun closed pull request #23639: [SPARK-26716][SQL] FileFormat: the supported types of read/write should be consistent

dongjoon-hyun closed pull request #23639: [SPARK-26716][SQL] FileFormat: the supported types of read/write should be consistent URL: https://github.com/apache/spark/pull/23639 This is an automated message from the Apache

[GitHub] dongjoon-hyun closed pull request #23660: [SPARK-26379][SS][FOLLOWUP] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

dongjoon-hyun closed pull request #23660: [SPARK-26379][SS][FOLLOWUP] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23660 This is an automated message

[GitHub] dongjoon-hyun commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query

dongjoon-hyun commented on issue #23656: [SPARK-26379][SS][BACKPORT-2.3] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23656#issuecomment-457940145 Hi, @HeartSaVioR . Could you update this PR with the final content?

[GitHub] dongjoon-hyun commented on issue #23660: [SPARK-26379][SS][FOLLOWUP] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

dongjoon-hyun commented on issue #23660: [SPARK-26379][SS][FOLLOWUP] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23660#issuecomment-457939991 Thank you for approval, @srowen . Merged to master/branch-2.4.

[GitHub] srowen commented on a change in pull request #23637: [SPARK-26714][CORE][WEBUI] Show 0 partition job in WebUI

srowen commented on a change in pull request #23637: [SPARK-26714][CORE][WEBUI] Show 0 partition job in WebUI URL: https://github.com/apache/spark/pull/23637#discussion_r251248080 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -693,6

[GitHub] AmplabJenkins removed a comment on issue #23438: [SPARK-26525]Fast release ShuffleBlockFetcherIterator on completion of the iteration

AmplabJenkins removed a comment on issue #23438: [SPARK-26525]Fast release ShuffleBlockFetcherIterator on completion of the iteration URL: https://github.com/apache/spark/pull/23438#issuecomment-457936158 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23438: [SPARK-26525]Fast release ShuffleBlockFetcherIterator on completion of the iteration

AmplabJenkins commented on issue #23438: [SPARK-26525]Fast release ShuffleBlockFetcherIterator on completion of the iteration URL: https://github.com/apache/spark/pull/23438#issuecomment-457936158 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23438: [SPARK-26525]Fast release ShuffleBlockFetcherIterator on completion of the iteration

AmplabJenkins removed a comment on issue #23438: [SPARK-26525]Fast release ShuffleBlockFetcherIterator on completion of the iteration URL: https://github.com/apache/spark/pull/23438#issuecomment-457936160 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] AmplabJenkins commented on issue #23438: [SPARK-26525]Fast release ShuffleBlockFetcherIterator on completion of the iteration

AmplabJenkins commented on issue #23438: [SPARK-26525]Fast release ShuffleBlockFetcherIterator on completion of the iteration URL: https://github.com/apache/spark/pull/23438#issuecomment-457936160 Test PASSed. Refer to this link for build results (access rights to CI server needed):

<    1   2   3   4   >