[GitHub] [spark] yaooqinn commented on a change in pull request #26557: [SPARK-29873][SQL][Test][FOLLOWUP] set operations should not escape when regen golde file with --SET --import both specified

yaooqinn commented on a change in pull request #26557: [SPARK-29873][SQL][Test][FOLLOWUP] set operations should not escape when regen golde file with --SET --import both specified URL: https://github.com/apache/spark/pull/26557#discussion_r347238447 ## File path: sql/core/src/test/

[GitHub] [spark] MaxGekk commented on a change in pull request #26563: [SPARK-29758][SQL][2.4] Fix truncation of requested string fields in `json_tuple`

MaxGekk commented on a change in pull request #26563: [SPARK-29758][SQL][2.4] Fix truncation of requested string fields in `json_tuple` URL: https://github.com/apache/spark/pull/26563#discussion_r347236196 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expr

[GitHub] [spark] cloud-fan commented on issue #26491: [SPARK-29870][SQL] Unify the logic of multi-units interval string to CalendarInterval

cloud-fan commented on issue #26491: [SPARK-29870][SQL] Unify the logic of multi-units interval string to CalendarInterval URL: https://github.com/apache/spark/pull/26491#issuecomment-554895291 thanks, merging to master! This

[GitHub] [spark] cloud-fan commented on a change in pull request #26557: [SPARK-29873][SQL][Test][FOLLOWUP] set operations should not escape when regen golde file with --SET --import both specified

cloud-fan commented on a change in pull request #26557: [SPARK-29873][SQL][Test][FOLLOWUP] set operations should not escape when regen golde file with --SET --import both specified URL: https://github.com/apache/spark/pull/26557#discussion_r347235814 ## File path: sql/core/src/test

[GitHub] [spark] cloud-fan closed pull request #26491: [SPARK-29870][SQL] Unify the logic of multi-units interval string to CalendarInterval

cloud-fan closed pull request #26491: [SPARK-29870][SQL] Unify the logic of multi-units interval string to CalendarInterval URL: https://github.com/apache/spark/pull/26491 This is an automated message from the Apache Git Ser

[GitHub] [spark] AmplabJenkins removed a comment on issue #26104: [SPARK-29450][SS] Measure the number of output rows for streaming aggregation with append mode

AmplabJenkins removed a comment on issue #26104: [SPARK-29450][SS] Measure the number of output rows for streaming aggregation with append mode URL: https://github.com/apache/spark/pull/26104#issuecomment-554894255 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #26104: [SPARK-29450][SS] Measure the number of output rows for streaming aggregation with append mode

AmplabJenkins removed a comment on issue #26104: [SPARK-29450][SS] Measure the number of output rows for streaming aggregation with append mode URL: https://github.com/apache/spark/pull/26104#issuecomment-554894260 Test PASSed. Refer to this link for build results (access rights to CI se

[GitHub] [spark] cloud-fan commented on a change in pull request #26557: [SPARK-29873][SQL][Test][FOLLOWUP] set operations should not escape when regen golde file with --SET --import both specified

cloud-fan commented on a change in pull request #26557: [SPARK-29873][SQL][Test][FOLLOWUP] set operations should not escape when regen golde file with --SET --import both specified URL: https://github.com/apache/spark/pull/26557#discussion_r347235548 ## File path: sql/core/src/test

[GitHub] [spark] cloud-fan commented on a change in pull request #26557: [SPARK-29873][SQL][Test][FOLLOWUP] set operations should not escape when regen golde file with --SET --import both specified

cloud-fan commented on a change in pull request #26557: [SPARK-29873][SQL][Test][FOLLOWUP] set operations should not escape when regen golde file with --SET --import both specified URL: https://github.com/apache/spark/pull/26557#discussion_r347235334 ## File path: sql/core/src/test

[GitHub] [spark] AmplabJenkins commented on issue #26104: [SPARK-29450][SS] Measure the number of output rows for streaming aggregation with append mode

AmplabJenkins commented on issue #26104: [SPARK-29450][SS] Measure the number of output rows for streaming aggregation with append mode URL: https://github.com/apache/spark/pull/26104#issuecomment-554894260 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] AmplabJenkins commented on issue #26104: [SPARK-29450][SS] Measure the number of output rows for streaming aggregation with append mode

AmplabJenkins commented on issue #26104: [SPARK-29450][SS] Measure the number of output rows for streaming aggregation with append mode URL: https://github.com/apache/spark/pull/26104#issuecomment-554894255 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA removed a comment on issue #26104: [SPARK-29450][SS] Measure the number of output rows for streaming aggregation with append mode

SparkQA removed a comment on issue #26104: [SPARK-29450][SS] Measure the number of output rows for streaming aggregation with append mode URL: https://github.com/apache/spark/pull/26104#issuecomment-554840053 **[Test build #113983 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spa

[GitHub] [spark] SparkQA commented on issue #26104: [SPARK-29450][SS] Measure the number of output rows for streaming aggregation with append mode

SparkQA commented on issue #26104: [SPARK-29450][SS] Measure the number of output rows for streaming aggregation with append mode URL: https://github.com/apache/spark/pull/26104#issuecomment-554893550 **[Test build #113983 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullR

[GitHub] [spark] dongjoon-hyun commented on issue #26568: [SPARK-29936][R][2.4] Fix SparkR lint errors and add lint-r GitHub Action

dongjoon-hyun commented on issue #26568: [SPARK-29936][R][2.4] Fix SparkR lint errors and add lint-r GitHub Action URL: https://github.com/apache/spark/pull/26568#issuecomment-554893249 Thank you for merging, @HyukjinKwon . :) ---

[GitHub] [spark] cloud-fan closed pull request #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type

cloud-fan closed pull request #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type URL: https://github.com/apache/spark/pull/26418 This is an automated message from the Apache Git Service.

[GitHub] [spark] cloud-fan commented on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type

cloud-fan commented on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type URL: https://github.com/apache/spark/pull/26418#issuecomment-554892769 thanks, merging to master! This is an

[GitHub] [spark] dongjoon-hyun commented on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory`

dongjoon-hyun commented on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory` URL: https://github.com/apache/spark/pull/26530#issuecomment-554891702 Thank you for merging, @dbtsai . Thanks for the follow-up, @HyukjinKwon . @jiangzho . You are added to

[GitHub] [spark] cloud-fan commented on a change in pull request #26563: [SPARK-29758][SQL][2.4] Fix truncation of requested string fields in `json_tuple`

cloud-fan commented on a change in pull request #26563: [SPARK-29758][SQL][2.4] Fix truncation of requested string fields in `json_tuple` URL: https://github.com/apache/spark/pull/26563#discussion_r347229794 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ex

[GitHub] [spark] cloud-fan commented on a change in pull request #26557: [SPARK-29873][SQL][Test][FOLLOWUP] set operations should not escape when regen golde file with --SET --import both specified

cloud-fan commented on a change in pull request #26557: [SPARK-29873][SQL][Test][FOLLOWUP] set operations should not escape when regen golde file with --SET --import both specified URL: https://github.com/apache/spark/pull/26557#discussion_r347228176 ## File path: sql/core/src/test

[GitHub] [spark] AmplabJenkins removed a comment on issue #26279: [SPARK-28382][SQL] Add array function - unnest

AmplabJenkins removed a comment on issue #26279: [SPARK-28382][SQL] Add array function - unnest URL: https://github.com/apache/spark/pull/26279#issuecomment-554885971 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] AmplabJenkins removed a comment on issue #26279: [SPARK-28382][SQL] Add array function - unnest

AmplabJenkins removed a comment on issue #26279: [SPARK-28382][SQL] Add array function - unnest URL: https://github.com/apache/spark/pull/26279#issuecomment-554885968 Merged build finished. Test PASSed. This is an automated m

[GitHub] [spark] AmplabJenkins commented on issue #26279: [SPARK-28382][SQL] Add array function - unnest

AmplabJenkins commented on issue #26279: [SPARK-28382][SQL] Add array function - unnest URL: https://github.com/apache/spark/pull/26279#issuecomment-554885971 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkin

[GitHub] [spark] AmplabJenkins commented on issue #26279: [SPARK-28382][SQL] Add array function - unnest

AmplabJenkins commented on issue #26279: [SPARK-28382][SQL] Add array function - unnest URL: https://github.com/apache/spark/pull/26279#issuecomment-554885968 Merged build finished. Test PASSed. This is an automated message f

[GitHub] [spark] AmplabJenkins removed a comment on issue #26564: [SPARK-29936][R] Fix SparkR lint errors and add lint-r GitHub Action

AmplabJenkins removed a comment on issue #26564: [SPARK-29936][R] Fix SparkR lint errors and add lint-r GitHub Action URL: https://github.com/apache/spark/pull/26564#issuecomment-554885424 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run

SparkQA commented on issue #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run URL: https://github.com/apache/spark/pull/25987#issuecomment-554885552 **[Test build #113997 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkP

[GitHub] [spark] cloud-fan commented on a change in pull request #26557: [SPARK-29873][SQL][Test][FOLLOWUP] set operations should not escape when regen golde file with --SET --import both specified

cloud-fan commented on a change in pull request #26557: [SPARK-29873][SQL][Test][FOLLOWUP] set operations should not escape when regen golde file with --SET --import both specified URL: https://github.com/apache/spark/pull/26557#discussion_r347228176 ## File path: sql/core/src/test

[GitHub] [spark] AmplabJenkins removed a comment on issue #26564: [SPARK-29936][R] Fix SparkR lint errors and add lint-r GitHub Action

AmplabJenkins removed a comment on issue #26564: [SPARK-29936][R] Fix SparkR lint errors and add lint-r GitHub Action URL: https://github.com/apache/spark/pull/26564#issuecomment-554885434 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins commented on issue #26564: [SPARK-29936][R] Fix SparkR lint errors and add lint-r GitHub Action

AmplabJenkins commented on issue #26564: [SPARK-29936][R] Fix SparkR lint errors and add lint-r GitHub Action URL: https://github.com/apache/spark/pull/26564#issuecomment-554885434 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins commented on issue #26564: [SPARK-29936][R] Fix SparkR lint errors and add lint-r GitHub Action

AmplabJenkins commented on issue #26564: [SPARK-29936][R] Fix SparkR lint errors and add lint-r GitHub Action URL: https://github.com/apache/spark/pull/26564#issuecomment-554885424 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA commented on issue #26279: [SPARK-28382][SQL] Add array function - unnest

SparkQA commented on issue #26279: [SPARK-28382][SQL] Add array function - unnest URL: https://github.com/apache/spark/pull/26279#issuecomment-554885527 **[Test build #113996 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113996/testReport)** for PR 26279

[GitHub] [spark] SparkQA commented on issue #26564: [SPARK-29936][R] Fix SparkR lint errors and add lint-r GitHub Action

SparkQA commented on issue #26564: [SPARK-29936][R] Fix SparkR lint errors and add lint-r GitHub Action URL: https://github.com/apache/spark/pull/26564#issuecomment-554884837 **[Test build #113987 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113987/testR

[GitHub] [spark] SparkQA removed a comment on issue #26564: [SPARK-29936][R] Fix SparkR lint errors and add lint-r GitHub Action

SparkQA removed a comment on issue #26564: [SPARK-29936][R] Fix SparkR lint errors and add lint-r GitHub Action URL: https://github.com/apache/spark/pull/26564#issuecomment-554847906 **[Test build #113987 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/11398

[GitHub] [spark] yucai closed pull request #21391: [SPARK-24343][SQL] In AE, avoid shuffle for the bucketed table when shuffle.partition > bucket number

yucai closed pull request #21391: [SPARK-24343][SQL] In AE, avoid shuffle for the bucketed table when shuffle.partition > bucket number URL: https://github.com/apache/spark/pull/21391 This is an automated message from the Ap

[GitHub] [spark] gatorsmile commented on a change in pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

gatorsmile commented on a change in pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#discussion_r347227108 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala

[GitHub] [spark] HeartSaVioR commented on issue #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run

HeartSaVioR commented on issue #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run URL: https://github.com/apache/spark/pull/25987#issuecomment-554884210 retest this, please

[GitHub] [spark] HeartSaVioR commented on issue #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run

HeartSaVioR commented on issue #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run URL: https://github.com/apache/spark/pull/25987#issuecomment-554884174 I've added the query and changed outputs to show which issue this PR fixes.

[GitHub] [spark] HeartSaVioR commented on a change in pull request #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run

HeartSaVioR commented on a change in pull request #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run URL: https://github.com/apache/spark/pull/25987#discussion_r329984407 ## File path: sql/core/src/test/scala/org/apache/spar

[GitHub] [spark] AmplabJenkins commented on issue #21391: [SPARK-24343][SQL] In AE, avoid shuffle for the bucketed table when shuffle.partition > bucket number

AmplabJenkins commented on issue #21391: [SPARK-24343][SQL] In AE, avoid shuffle for the bucketed table when shuffle.partition > bucket number URL: https://github.com/apache/spark/pull/21391#issuecomment-554883382 Can one of the admins verify this patch? ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #21391: [SPARK-24343][SQL] In AE, avoid shuffle for the bucketed table when shuffle.partition > bucket number

AmplabJenkins removed a comment on issue #21391: [SPARK-24343][SQL] In AE, avoid shuffle for the bucketed table when shuffle.partition > bucket number URL: https://github.com/apache/spark/pull/21391#issuecomment-531896947 Can one of the admins verify this patch? ---

[GitHub] [spark] MaxGekk commented on a change in pull request #26563: [SPARK-29758][SQL][2.4] Fix truncation of requested string fields in `json_tuple`

MaxGekk commented on a change in pull request #26563: [SPARK-29758][SQL][2.4] Fix truncation of requested string fields in `json_tuple` URL: https://github.com/apache/spark/pull/26563#discussion_r347226053 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLC

[GitHub] [spark] HyukjinKwon commented on issue #26279: [SPARK-28382][SQL] Add array function - unnest

HyukjinKwon commented on issue #26279: [SPARK-28382][SQL] Add array function - unnest URL: https://github.com/apache/spark/pull/26279#issuecomment-554882309 Thanks @yaooqinn. Will take a closer look soon within few days. This

[GitHub] [spark] cloud-fan commented on a change in pull request #26539: [SPARK-29728][SQL] Datasource V2: Support ALTER TABLE RENAME TO

cloud-fan commented on a change in pull request #26539: [SPARK-29728][SQL] Datasource V2: Support ALTER TABLE RENAME TO URL: https://github.com/apache/spark/pull/26539#discussion_r347225441 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveCata

[GitHub] [spark] HyukjinKwon closed pull request #25728: [SPARK-29020][SQL] Improving array_sort behaviour

HyukjinKwon closed pull request #25728: [SPARK-29020][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728 This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [spark] AmplabJenkins removed a comment on issue #26570: [SPARK-25694][SQL] Move 'spark.sql.defaultUrlStreamHandlerFactory.enabled' into StaticSQLConf.scala

AmplabJenkins removed a comment on issue #26570: [SPARK-25694][SQL] Move 'spark.sql.defaultUrlStreamHandlerFactory.enabled' into StaticSQLConf.scala URL: https://github.com/apache/spark/pull/26570#issuecomment-554881166 Merged build finished. Test PASSed. --

[GitHub] [spark] HyukjinKwon commented on issue #26568: [SPARK-29936][R][2.4] Fix SparkR lint errors and add lint-r GitHub Action

HyukjinKwon commented on issue #26568: [SPARK-29936][R][2.4] Fix SparkR lint errors and add lint-r GitHub Action URL: https://github.com/apache/spark/pull/26568#issuecomment-554881240 Ah, technically I had to wait for the build results. I will keep my eyes on that. ---

[GitHub] [spark] HyukjinKwon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour

HyukjinKwon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-554881395 Merged to master. This is an automated message from the Apache Gi

[GitHub] [spark] AmplabJenkins removed a comment on issue #26570: [SPARK-25694][SQL] Move 'spark.sql.defaultUrlStreamHandlerFactory.enabled' into StaticSQLConf.scala

AmplabJenkins removed a comment on issue #26570: [SPARK-25694][SQL] Move 'spark.sql.defaultUrlStreamHandlerFactory.enabled' into StaticSQLConf.scala URL: https://github.com/apache/spark/pull/26570#issuecomment-554881171 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #26570: [SPARK-25694][SQL] Move 'spark.sql.defaultUrlStreamHandlerFactory.enabled' into StaticSQLConf.scala

AmplabJenkins commented on issue #26570: [SPARK-25694][SQL] Move 'spark.sql.defaultUrlStreamHandlerFactory.enabled' into StaticSQLConf.scala URL: https://github.com/apache/spark/pull/26570#issuecomment-554881166 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #26570: [SPARK-25694][SQL] Move 'spark.sql.defaultUrlStreamHandlerFactory.enabled' into StaticSQLConf.scala

AmplabJenkins commented on issue #26570: [SPARK-25694][SQL] Move 'spark.sql.defaultUrlStreamHandlerFactory.enabled' into StaticSQLConf.scala URL: https://github.com/apache/spark/pull/26570#issuecomment-554881171 Test PASSed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] cloud-fan commented on issue #22163: [SPARK-25166][CORE]Reduce the number of write operations for shuffle write.

cloud-fan commented on issue #22163: [SPARK-25166][CORE]Reduce the number of write operations for shuffle write. URL: https://github.com/apache/spark/pull/22163#issuecomment-554881072 Any updates here? @Ngone51 can you take it over if it's inactive?

[GitHub] [spark] HyukjinKwon commented on issue #26568: [SPARK-29936][R][2.4] Fix SparkR lint errors and add lint-r GitHub Action

HyukjinKwon commented on issue #26568: [SPARK-29936][R][2.4] Fix SparkR lint errors and add lint-r GitHub Action URL: https://github.com/apache/spark/pull/26568#issuecomment-554881014 Merged to branch-2.4. This is an automate

[GitHub] [spark] HyukjinKwon closed pull request #26568: [SPARK-29936][R][2.4] Fix SparkR lint errors and add lint-r GitHub Action

HyukjinKwon closed pull request #26568: [SPARK-29936][R][2.4] Fix SparkR lint errors and add lint-r GitHub Action URL: https://github.com/apache/spark/pull/26568 This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on issue #26570: [SPARK-25694][SQL] Move 'spark.sql.defaultUrlStreamHandlerFactory.enabled' into StaticSQLConf.scala

SparkQA commented on issue #26570: [SPARK-25694][SQL] Move 'spark.sql.defaultUrlStreamHandlerFactory.enabled' into StaticSQLConf.scala URL: https://github.com/apache/spark/pull/26570#issuecomment-554880837 **[Test build #113995 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkP

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory`

HyukjinKwon commented on a change in pull request #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory` URL: https://github.com/apache/spark/pull/26530#discussion_r347224056 ## File path: sql/core/src/main/scala/org/apache/spark/sql/internal/config/package.sc

[GitHub] [spark] HyukjinKwon opened a new pull request #26570: [SPARK-25694][SQL] Move 'spark.sql.defaultUrlStreamHandlerFactory.enabled' into StaticSQLConf.scala

HyukjinKwon opened a new pull request #26570: [SPARK-25694][SQL] Move 'spark.sql.defaultUrlStreamHandlerFactory.enabled' into StaticSQLConf.scala URL: https://github.com/apache/spark/pull/26570 ### What changes were proposed in this pull request? This PR is a followup of https://gith

[GitHub] [spark] cloud-fan commented on a change in pull request #26563: [SPARK-29758][SQL][2.4] Fix truncation of requested string fields in `json_tuple`

cloud-fan commented on a change in pull request #26563: [SPARK-29758][SQL][2.4] Fix truncation of requested string fields in `json_tuple` URL: https://github.com/apache/spark/pull/26563#discussion_r347223791 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQ

[GitHub] [spark] yaooqinn commented on a change in pull request #26279: [SPARK-28382][SQL] Add array function - unnest

yaooqinn commented on a change in pull request #26279: [SPARK-28382][SQL] Add array function - unnest URL: https://github.com/apache/spark/pull/26279#discussion_r347223386 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/generators.scala

[GitHub] [spark] cloud-fan commented on a change in pull request #26102: [SPARK-29448][SQL] Support the `INTERVAL` type by Parquet datasource

cloud-fan commented on a change in pull request #26102: [SPARK-29448][SQL] Support the `INTERVAL` type by Parquet datasource URL: https://github.com/apache/spark/pull/26102#discussion_r347223313 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parque

[GitHub] [spark] yaooqinn commented on a change in pull request #26279: [SPARK-28382][SQL] Add array function - unnest

yaooqinn commented on a change in pull request #26279: [SPARK-28382][SQL] Add array function - unnest URL: https://github.com/apache/spark/pull/26279#discussion_r347223065 ## File path: sql/core/src/test/resources/sql-tests/inputs/postgreSQL/join.sql ## @@ -1089,10 +1089,9

[GitHub] [spark] yaooqinn commented on a change in pull request #26279: [SPARK-28382][SQL] Add array function - unnest

yaooqinn commented on a change in pull request #26279: [SPARK-28382][SQL] Add array function - unnest URL: https://github.com/apache/spark/pull/26279#discussion_r347222983 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/generators.scala

[GitHub] [spark] cloud-fan commented on issue #25990: [SPARK-29248][SQL] Pass in number of partitions to WriteBuilder

cloud-fan commented on issue #25990: [SPARK-29248][SQL] Pass in number of partitions to WriteBuilder URL: https://github.com/apache/spark/pull/25990#issuecomment-554879404 LGTM. @rdblue @brkyvz do you have more comments? This

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26279: [SPARK-28382][SQL] Add array function - unnest

HyukjinKwon commented on a change in pull request #26279: [SPARK-28382][SQL] Add array function - unnest URL: https://github.com/apache/spark/pull/26279#discussion_r347222054 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/generators.scala #

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26279: [SPARK-28382][SQL] Add array function - unnest

HyukjinKwon commented on a change in pull request #26279: [SPARK-28382][SQL] Add array function - unnest URL: https://github.com/apache/spark/pull/26279#discussion_r347221212 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/generators.scala #

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26279: [SPARK-28382][SQL] Add array function - unnest

HyukjinKwon commented on a change in pull request #26279: [SPARK-28382][SQL] Add array function - unnest URL: https://github.com/apache/spark/pull/26279#discussion_r347221064 ## File path: sql/core/src/test/resources/sql-tests/inputs/postgreSQL/join.sql ## @@ -1089,10 +108

[GitHub] [spark] AmplabJenkins removed a comment on issue #26547: [SPARK-29914][ML] ML models append metadata in `transform`/`transformSchema`

AmplabJenkins removed a comment on issue #26547: [SPARK-29914][ML] ML models append metadata in `transform`/`transformSchema` URL: https://github.com/apache/spark/pull/26547#issuecomment-554875741 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #26547: [SPARK-29914][ML] ML models append metadata in `transform`/`transformSchema`

AmplabJenkins removed a comment on issue #26547: [SPARK-29914][ML] ML models append metadata in `transform`/`transformSchema` URL: https://github.com/apache/spark/pull/26547#issuecomment-554875746 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #26547: [SPARK-29914][ML] ML models append metadata in `transform`/`transformSchema`

SparkQA removed a comment on issue #26547: [SPARK-29914][ML] ML models append metadata in `transform`/`transformSchema` URL: https://github.com/apache/spark/pull/26547#issuecomment-554859820 **[Test build #113994 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuild

[GitHub] [spark] AmplabJenkins commented on issue #26547: [SPARK-29914][ML] ML models append metadata in `transform`/`transformSchema`

AmplabJenkins commented on issue #26547: [SPARK-29914][ML] ML models append metadata in `transform`/`transformSchema` URL: https://github.com/apache/spark/pull/26547#issuecomment-554875741 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26547: [SPARK-29914][ML] ML models append metadata in `transform`/`transformSchema`

AmplabJenkins commented on issue #26547: [SPARK-29914][ML] ML models append metadata in `transform`/`transformSchema` URL: https://github.com/apache/spark/pull/26547#issuecomment-554875746 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] SparkQA commented on issue #26547: [SPARK-29914][ML] ML models append metadata in `transform`/`transformSchema`

SparkQA commented on issue #26547: [SPARK-29914][ML] ML models append metadata in `transform`/`transformSchema` URL: https://github.com/apache/spark/pull/26547#issuecomment-554875474 **[Test build #113994 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1139

[GitHub] [spark] AmplabJenkins removed a comment on issue #26566: [SPARK-29378][R][FOLLOW-UP] Remove manual installation of Arrow dependencies in AppVeyor build

AmplabJenkins removed a comment on issue #26566: [SPARK-29378][R][FOLLOW-UP] Remove manual installation of Arrow dependencies in AppVeyor build URL: https://github.com/apache/spark/pull/26566#issuecomment-554873376 Test PASSed. Refer to this link for build results (access rights to CI se

[GitHub] [spark] AmplabJenkins removed a comment on issue #26566: [SPARK-29378][R][FOLLOW-UP] Remove manual installation of Arrow dependencies in AppVeyor build

AmplabJenkins removed a comment on issue #26566: [SPARK-29378][R][FOLLOW-UP] Remove manual installation of Arrow dependencies in AppVeyor build URL: https://github.com/apache/spark/pull/26566#issuecomment-554873366 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #26569: [SPARK-29938] [SQL] Add batching support in Alter table add partition flow

AmplabJenkins removed a comment on issue #26569: [SPARK-29938] [SQL] Add batching support in Alter table add partition flow URL: https://github.com/apache/spark/pull/26569#issuecomment-554872927 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins commented on issue #26566: [SPARK-29378][R][FOLLOW-UP] Remove manual installation of Arrow dependencies in AppVeyor build

AmplabJenkins commented on issue #26566: [SPARK-29378][R][FOLLOW-UP] Remove manual installation of Arrow dependencies in AppVeyor build URL: https://github.com/apache/spark/pull/26566#issuecomment-554873366 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #26566: [SPARK-29378][R][FOLLOW-UP] Remove manual installation of Arrow dependencies in AppVeyor build

AmplabJenkins commented on issue #26566: [SPARK-29378][R][FOLLOW-UP] Remove manual installation of Arrow dependencies in AppVeyor build URL: https://github.com/apache/spark/pull/26566#issuecomment-554873376 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] AmplabJenkins commented on issue #26569: [SPARK-29938] [SQL] Add batching support in Alter table add partition flow

AmplabJenkins commented on issue #26569: [SPARK-29938] [SQL] Add batching support in Alter table add partition flow URL: https://github.com/apache/spark/pull/26569#issuecomment-554873195 Can one of the admins verify this patch? --

[GitHub] [spark] SparkQA removed a comment on issue #26566: [SPARK-29378][R][FOLLOW-UP] Remove manual installation of Arrow dependencies in AppVeyor build

SparkQA removed a comment on issue #26566: [SPARK-29378][R][FOLLOW-UP] Remove manual installation of Arrow dependencies in AppVeyor build URL: https://github.com/apache/spark/pull/26566#issuecomment-554840031 **[Test build #113981 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spa

[GitHub] [spark] AmplabJenkins commented on issue #26569: [SPARK-29938] [SQL] Add batching support in Alter table add partition flow

AmplabJenkins commented on issue #26569: [SPARK-29938] [SQL] Add batching support in Alter table add partition flow URL: https://github.com/apache/spark/pull/26569#issuecomment-554872927 Can one of the admins verify this patch? --

[GitHub] [spark] SparkQA commented on issue #26566: [SPARK-29378][R][FOLLOW-UP] Remove manual installation of Arrow dependencies in AppVeyor build

SparkQA commented on issue #26566: [SPARK-29378][R][FOLLOW-UP] Remove manual installation of Arrow dependencies in AppVeyor build URL: https://github.com/apache/spark/pull/26566#issuecomment-554872961 **[Test build #113981 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullR

[GitHub] [spark] prakharjain09 opened a new pull request #26569: [SPARK-29938] [SQL] Add batching support in Alter table add partition flow

prakharjain09 opened a new pull request #26569: [SPARK-29938] [SQL] Add batching support in Alter table add partition flow URL: https://github.com/apache/spark/pull/26569 ### What changes were proposed in this pull request? This PR split the the single createPartitions() call AlterTableA

[GitHub] [spark] cloud-fan commented on a change in pull request #26516: [SPARK-29893] improve the local shuffle reader performance by changing the reading task number from 1 to multi.

cloud-fan commented on a change in pull request #26516: [SPARK-29893] improve the local shuffle reader performance by changing the reading task number from 1 to multi. URL: https://github.com/apache/spark/pull/26516#discussion_r347215819 ## File path: sql/core/src/main/scala/org/a

[GitHub] [spark] cloud-fan commented on a change in pull request #26516: [SPARK-29893] improve the local shuffle reader performance by changing the reading task number from 1 to multi.

cloud-fan commented on a change in pull request #26516: [SPARK-29893] improve the local shuffle reader performance by changing the reading task number from 1 to multi. URL: https://github.com/apache/spark/pull/26516#discussion_r347215506 ## File path: sql/core/src/main/scala/org/a

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory`

HyukjinKwon commented on a change in pull request #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory` URL: https://github.com/apache/spark/pull/26530#discussion_r347214965 ## File path: sql/core/src/main/scala/org/apache/spark/sql/internal/config/package.sc

[GitHub] [spark] cloud-fan commented on a change in pull request #26516: [SPARK-29893] improve the local shuffle reader performance by changing the reading task number from 1 to multi.

cloud-fan commented on a change in pull request #26516: [SPARK-29893] improve the local shuffle reader performance by changing the reading task number from 1 to multi. URL: https://github.com/apache/spark/pull/26516#discussion_r347215040 ## File path: sql/core/src/main/scala/org/a

[GitHub] [spark] cloud-fan commented on a change in pull request #26516: [SPARK-29893] improve the local shuffle reader performance by changing the reading task number from 1 to multi.

cloud-fan commented on a change in pull request #26516: [SPARK-29893] improve the local shuffle reader performance by changing the reading task number from 1 to multi. URL: https://github.com/apache/spark/pull/26516#discussion_r347214423 ## File path: sql/core/src/main/scala/org/a

[GitHub] [spark] amanomer commented on a change in pull request #26472: [SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp

amanomer commented on a change in pull request #26472: [SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp URL: https://github.com/apache/spark/pull/26472#discussion_r347214178 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/postgreSQL/Postg

[GitHub] [spark] AmplabJenkins removed a comment on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory`

AmplabJenkins removed a comment on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory` URL: https://github.com/apache/spark/pull/26530#issuecomment-554868511 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26549: [SPARK-29644][SQL][2.4] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

HyukjinKwon commented on a change in pull request #26549: [SPARK-29644][SQL][2.4] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils URL: https://github.com/apache/spark/pull/26549#discussion_r347213679 ## File path: external/docker-integration-tests/src

[GitHub] [spark] AmplabJenkins commented on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory`

AmplabJenkins commented on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory` URL: https://github.com/apache/spark/pull/26530#issuecomment-554868511 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] cloud-fan commented on a change in pull request #26516: [SPARK-29893] improve the local shuffle reader performance by changing the reading task number from 1 to multi.

cloud-fan commented on a change in pull request #26516: [SPARK-29893] improve the local shuffle reader performance by changing the reading task number from 1 to multi. URL: https://github.com/apache/spark/pull/26516#discussion_r347213557 ## File path: sql/core/src/main/scala/org/a

[GitHub] [spark] AmplabJenkins commented on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory`

AmplabJenkins commented on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory` URL: https://github.com/apache/spark/pull/26530#issuecomment-554868506 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory`

AmplabJenkins removed a comment on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory` URL: https://github.com/apache/spark/pull/26530#issuecomment-554868506 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory`

SparkQA removed a comment on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory` URL: https://github.com/apache/spark/pull/26530#issuecomment-554827686 **[Test build #113979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/11397

[GitHub] [spark] SparkQA commented on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory`

SparkQA commented on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory` URL: https://github.com/apache/spark/pull/26530#issuecomment-554868179 **[Test build #113979 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113979/testR

[GitHub] [spark] amanomer removed a comment on issue #26472: [SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp

amanomer removed a comment on issue #26472: [SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp URL: https://github.com/apache/spark/pull/26472#issuecomment-554816305 cc @maropu This is an automated message from the Apac

[GitHub] [spark] amanomer commented on a change in pull request #26472: [SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp

amanomer commented on a change in pull request #26472: [SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp URL: https://github.com/apache/spark/pull/26472#discussion_r347211361 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/postgreSQL/Postg

[GitHub] [spark] AmplabJenkins removed a comment on issue #22093: [SPARK-25100][CORE] Fix no registering TaskCommitMessage bug

AmplabJenkins removed a comment on issue #22093: [SPARK-25100][CORE] Fix no registering TaskCommitMessage bug URL: https://github.com/apache/spark/pull/22093#issuecomment-531896338 Can one of the admins verify this patch? Thi

[GitHub] [spark] AmplabJenkins commented on issue #22093: [SPARK-25100][CORE] Fix no registering TaskCommitMessage bug

AmplabJenkins commented on issue #22093: [SPARK-25100][CORE] Fix no registering TaskCommitMessage bug URL: https://github.com/apache/spark/pull/22093#issuecomment-554863566 Can one of the admins verify this patch? This is an

[GitHub] [spark] shivsood commented on a change in pull request #26549: [SPARK-29644][SQL][2.4] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

shivsood commented on a change in pull request #26549: [SPARK-29644][SQL][2.4] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils URL: https://github.com/apache/spark/pull/26549#discussion_r347209517 ## File path: external/docker-integration-tests/src/tes

[GitHub] [spark] dbtsai commented on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory`

dbtsai commented on issue #26530: [SPARK-25694][SQL] Add a config for `URL.setURLStreamHandlerFactory` URL: https://github.com/apache/spark/pull/26530#issuecomment-554861895 Merged into master. Thanks all! This is an automate

  1   2   3   4   5   6   7   >