[GitHub] [spark] HyukjinKwon commented on issue #27962: [SPARK-31195][SQL] Correct and reuse days rebase functions of `DateTimeUtils` in `DaysWritable`

HyukjinKwon commented on issue #27962: [SPARK-31195][SQL] Correct and reuse days rebase functions of `DateTimeUtils` in `DaysWritable` URL: https://github.com/apache/spark/pull/27962#issuecomment-601560212 Merged to master and branch-3.0. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

AmplabJenkins removed a comment on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601559965 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

AmplabJenkins removed a comment on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601559959 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon closed pull request #27962: [SPARK-31195][SQL] Correct and reuse days rebase functions of `DateTimeUtils` in `DaysWritable`

HyukjinKwon closed pull request #27962: [SPARK-31195][SQL] Correct and reuse days rebase functions of `DateTimeUtils` in `DaysWritable` URL: https://github.com/apache/spark/pull/27962 This is an automated message from the Ap

[GitHub] [spark] AmplabJenkins commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

AmplabJenkins commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601559965 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

AmplabJenkins commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601559959 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

SparkQA commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601559722 **[Test build #120082 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] Deegue commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

Deegue commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601559551 retest this please This is an automate

[GitHub] [spark] cloud-fan commented on a change in pull request #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable`

cloud-fan commented on a change in pull request #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable` URL: https://github.com/apache/spark/pull/27962#discussion_r395460700 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/DaysWrita

[GitHub] [spark] cloud-fan commented on a change in pull request #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable`

cloud-fan commented on a change in pull request #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable` URL: https://github.com/apache/spark/pull/27962#discussion_r395460338 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/DaysWrita

[GitHub] [spark] cloud-fan commented on a change in pull request #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable`

cloud-fan commented on a change in pull request #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable` URL: https://github.com/apache/spark/pull/27962#discussion_r395460534 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/DaysWrita

[GitHub] [spark] AmplabJenkins removed a comment on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document

AmplabJenkins removed a comment on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document URL: https://github.com/apache/spark/pull/27956#issuecomment-601555352 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document

AmplabJenkins removed a comment on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document URL: https://github.com/apache/spark/pull/27956#issuecomment-601555357 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] AmplabJenkins commented on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document

AmplabJenkins commented on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document URL: https://github.com/apache/spark/pull/27956#issuecomment-601555352 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document

AmplabJenkins commented on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document URL: https://github.com/apache/spark/pull/27956#issuecomment-601555357 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document

SparkQA commented on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document URL: https://github.com/apache/spark/pull/27956#issuecomment-601555067 **[Test build #120081 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] prakharjain09 edited a comment on issue #27864: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

prakharjain09 edited a comment on issue #27864: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned URL: https://github.com/apache/spark/pull/27864#issuecomment-601554366 @Dooyoung-Hwang Thanks for the review! I have addressed most of the revi

[GitHub] [spark] prakharjain09 commented on issue #27864: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

prakharjain09 commented on issue #27864: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned URL: https://github.com/apache/spark/pull/27864#issuecomment-601554366 @Dooyoung-Hwang Thanks for the review! I have addressed most of the review com

[GitHub] [spark] AmplabJenkins commented on issue #27952: [SPARK-31184][SQL][test-hive1.2] Support getTablesByType API of Hive Client

AmplabJenkins commented on issue #27952: [SPARK-31184][SQL][test-hive1.2] Support getTablesByType API of Hive Client URL: https://github.com/apache/spark/pull/27952#issuecomment-601552405 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins removed a comment on issue #27952: [SPARK-31184][SQL][test-hive1.2] Support getTablesByType API of Hive Client

AmplabJenkins removed a comment on issue #27952: [SPARK-31184][SQL][test-hive1.2] Support getTablesByType API of Hive Client URL: https://github.com/apache/spark/pull/27952#issuecomment-601552405 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27952: [SPARK-31184][SQL][test-hive1.2] Support getTablesByType API of Hive Client

AmplabJenkins commented on issue #27952: [SPARK-31184][SQL][test-hive1.2] Support getTablesByType API of Hive Client URL: https://github.com/apache/spark/pull/27952#issuecomment-601552399 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins removed a comment on issue #27952: [SPARK-31184][SQL][test-hive1.2] Support getTablesByType API of Hive Client

AmplabJenkins removed a comment on issue #27952: [SPARK-31184][SQL][test-hive1.2] Support getTablesByType API of Hive Client URL: https://github.com/apache/spark/pull/27952#issuecomment-601552399 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA commented on issue #27952: [SPARK-31184][SQL][test-hive1.2] Support getTablesByType API of Hive Client

SparkQA commented on issue #27952: [SPARK-31184][SQL][test-hive1.2] Support getTablesByType API of Hive Client URL: https://github.com/apache/spark/pull/27952#issuecomment-601552196 **[Test build #120080 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120080

[GitHub] [spark] cloud-fan commented on a change in pull request #27953: [SPARK-31183][SQL] Rebase date/timestamp from/to Julian calendar in Avro

cloud-fan commented on a change in pull request #27953: [SPARK-31183][SQL] Rebase date/timestamp from/to Julian calendar in Avro URL: https://github.com/apache/spark/pull/27953#discussion_r395453034 ## File path: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroLogicalTyp

[GitHub] [spark] dongjoon-hyun commented on issue #27952: [SPARK-31184][SQL][test-hive1.2] Support getTablesByType API of Hive Client

dongjoon-hyun commented on issue #27952: [SPARK-31184][SQL][test-hive1.2] Support getTablesByType API of Hive Client URL: https://github.com/apache/spark/pull/27952#issuecomment-601551296 Retest this please. This is an automa

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27952: [SPARK-31184][SQL] Support getTablesByType API of Hive Client

dongjoon-hyun commented on a change in pull request #27952: [SPARK-31184][SQL] Support getTablesByType API of Hive Client URL: https://github.com/apache/spark/pull/27952#discussion_r395451362 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scal

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27952: [SPARK-31184][SQL] Support getTablesByType API of Hive Client

dongjoon-hyun commented on a change in pull request #27952: [SPARK-31184][SQL] Support getTablesByType API of Hive Client URL: https://github.com/apache/spark/pull/27952#discussion_r395451175 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClient.scala #

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27952: [SPARK-31184][SQL] Support getTablesByType API of Hive Client

dongjoon-hyun commented on a change in pull request #27952: [SPARK-31184][SQL] Support getTablesByType API of Hive Client URL: https://github.com/apache/spark/pull/27952#discussion_r395450798 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala ###

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27952: [SPARK-31184][SQL] Support getTablesByType API of Hive Client

dongjoon-hyun commented on a change in pull request #27952: [SPARK-31184][SQL] Support getTablesByType API of Hive Client URL: https://github.com/apache/spark/pull/27952#discussion_r395450798 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala ###

[GitHub] [spark] cloud-fan closed pull request #27953: [SPARK-31183][SQL] Rebase date/timestamp from/to Julian calendar in Avro

cloud-fan closed pull request #27953: [SPARK-31183][SQL] Rebase date/timestamp from/to Julian calendar in Avro URL: https://github.com/apache/spark/pull/27953 This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] cloud-fan commented on issue #27953: [SPARK-31183][SQL] Rebase date/timestamp from/to Julian calendar in Avro

cloud-fan commented on issue #27953: [SPARK-31183][SQL] Rebase date/timestamp from/to Julian calendar in Avro URL: https://github.com/apache/spark/pull/27953#issuecomment-601548659 thanks, merging to master/3.0! This is an au

[GitHub] [spark] dongjoon-hyun commented on issue #27961: [SPARK-31193][CORE] set spark.master and spark.app.name conf default value

dongjoon-hyun commented on issue #27961: [SPARK-31193][CORE] set spark.master and spark.app.name conf default value URL: https://github.com/apache/spark/pull/27961#issuecomment-601547225 Thank you! This is an automated messag

[GitHub] [spark] running2 commented on issue #27963: [SPARK-31199]separate shuffle io connect timeout and idle timeout

running2 commented on issue #27963: [SPARK-31199]separate shuffle io connect timeout and idle timeout URL: https://github.com/apache/spark/pull/27963#issuecomment-601546502 > Please take a look at https://spark.apache.org/contributing.html. For example, file a JIRA, fix the PR title, etc.

[GitHub] [spark] MrDLontheway closed pull request #27961: [SPARK-31193][CORE] set spark.master and spark.app.name conf default value

MrDLontheway closed pull request #27961: [SPARK-31193][CORE] set spark.master and spark.app.name conf default value URL: https://github.com/apache/spark/pull/27961 This is an automated message from the Apache Git Service. To

[GitHub] [spark] MrDLontheway commented on issue #27961: [SPARK-31193][CORE] set spark.master and spark.app.name conf default value

MrDLontheway commented on issue #27961: [SPARK-31193][CORE] set spark.master and spark.app.name conf default value URL: https://github.com/apache/spark/pull/27961#issuecomment-601545628 ok thanks This is an automated message

[GitHub] [spark] MaxGekk commented on issue #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable`

MaxGekk commented on issue #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable` URL: https://github.com/apache/spark/pull/27962#issuecomment-601545487 @cloud-fan This should be considered as a bug fix. I will update the PR description. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document

AmplabJenkins removed a comment on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document URL: https://github.com/apache/spark/pull/27956#issuecomment-601545416 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] AmplabJenkins commented on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document

AmplabJenkins commented on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document URL: https://github.com/apache/spark/pull/27956#issuecomment-601545412 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

AmplabJenkins removed a comment on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601545281 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document

AmplabJenkins commented on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document URL: https://github.com/apache/spark/pull/27956#issuecomment-601545416 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document

AmplabJenkins removed a comment on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document URL: https://github.com/apache/spark/pull/27956#issuecomment-601545412 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

AmplabJenkins removed a comment on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601545279 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

AmplabJenkins commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601545279 Merged build finished. Test FAILed.

[GitHub] [spark] dongjoon-hyun commented on issue #27961: [SPARK-31193][CORE] set spark.master and spark.app.name conf default value

dongjoon-hyun commented on issue #27961: [SPARK-31193][CORE] set spark.master and spark.app.name conf default value URL: https://github.com/apache/spark/pull/27961#issuecomment-601545192 Thank you for making a PR, @MrDLontheway . However, could you close this PR? --

[GitHub] [spark] SparkQA commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

SparkQA commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601545195 **[Test build #120076 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] SparkQA commented on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document

SparkQA commented on issue #27956: [SPARK-31189][SQL][DOCS] Fix errors and missing parts for datetime pattern document URL: https://github.com/apache/spark/pull/27956#issuecomment-601545184 **[Test build #120079 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] AmplabJenkins commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

AmplabJenkins commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601545281 Test FAILed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] SparkQA removed a comment on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

SparkQA removed a comment on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601512577 **[Test build #120076 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] AmplabJenkins removed a comment on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11

AmplabJenkins removed a comment on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11 URL: https://github.com/apache/spark/pull/27929#issuecomment-601543783 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins commented on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11

AmplabJenkins commented on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11 URL: https://github.com/apache/spark/pull/27929#issuecomment-601543774 Merged build finished. Test FAILed. This is an aut

[GitHub] [spark] AmplabJenkins commented on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11

AmplabJenkins commented on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11 URL: https://github.com/apache/spark/pull/27929#issuecomment-601543783 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins removed a comment on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11

AmplabJenkins removed a comment on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11 URL: https://github.com/apache/spark/pull/27929#issuecomment-601543774 Merged build finished. Test FAILed. This i

[GitHub] [spark] SparkQA removed a comment on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11

SparkQA removed a comment on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11 URL: https://github.com/apache/spark/pull/27929#issuecomment-601451711 **[Test build #120073 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120073/test

[GitHub] [spark] SparkQA commented on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11

SparkQA commented on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11 URL: https://github.com/apache/spark/pull/27929#issuecomment-601543517 **[Test build #120073 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120073/testReport)

[GitHub] [spark] cloud-fan commented on issue #27958: [SPARK-31192][SQL] Introduce PushProjectThroughLimit

cloud-fan commented on issue #27958: [SPARK-31192][SQL] Introduce PushProjectThroughLimit URL: https://github.com/apache/spark/pull/27958#issuecomment-601543386 Can you put an example in the PR description that a query can avoid a shuffle by keeping the limit node at top via this patch? -

[GitHub] [spark] maropu commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution

maropu commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-601543355 Thanks for the reviews, @dongjoon-hyun @cloud-fan !

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27902: [SPARK-31147][SQL] forbid CHAR/VARCHAR type in non-Hive tables

dongjoon-hyun commented on a change in pull request #27902: [SPARK-31147][SQL] forbid CHAR/VARCHAR type in non-Hive tables URL: https://github.com/apache/spark/pull/27902#discussion_r395443616 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV

[GitHub] [spark] Ngone51 commented on a change in pull request #27959: [SPARK-31190][SQL] ScalaReflection should erasure non user defined AnyVal type

Ngone51 commented on a change in pull request #27959: [SPARK-31190][SQL] ScalaReflection should erasure non user defined AnyVal type URL: https://github.com/apache/spark/pull/27959#discussion_r395443562 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaRe

[GitHub] [spark] cloud-fan commented on a change in pull request #27958: [SPARK-31192][SQL] Introduce PushProjectThroughLimit

cloud-fan commented on a change in pull request #27958: [SPARK-31192][SQL] Introduce PushProjectThroughLimit URL: https://github.com/apache/spark/pull/27958#discussion_r395443468 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala

[GitHub] [spark] Ngone51 commented on a change in pull request #27959: [SPARK-31190][SQL] ScalaReflection should erasure non user defined AnyVal type

Ngone51 commented on a change in pull request #27959: [SPARK-31190][SQL] ScalaReflection should erasure non user defined AnyVal type URL: https://github.com/apache/spark/pull/27959#discussion_r395443471 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaRe

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable`

HyukjinKwon commented on a change in pull request #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable` URL: https://github.com/apache/spark/pull/27962#discussion_r395442753 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/DaysWri

[GitHub] [spark] HyukjinKwon commented on issue #27963: separate shuffle io connect timeout and idle timeout

HyukjinKwon commented on issue #27963: separate shuffle io connect timeout and idle timeout URL: https://github.com/apache/spark/pull/27963#issuecomment-601541348 Please take a look at https://spark.apache.org/contributing.html. For example, file a JIRA, fix the PR title, etc. ---

[GitHub] [spark] cloud-fan commented on a change in pull request #27959: [SPARK-31190][SQL] ScalaReflection should erasure non user defined AnyVal type

cloud-fan commented on a change in pull request #27959: [SPARK-31190][SQL] ScalaReflection should erasure non user defined AnyVal type URL: https://github.com/apache/spark/pull/27959#discussion_r395441468 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/Scala

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable`

HyukjinKwon commented on a change in pull request #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable` URL: https://github.com/apache/spark/pull/27962#discussion_r395441060 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/DaysWri

[GitHub] [spark] running2 commented on issue #27963: separate shuffle io connect timeout and idle timeout

running2 commented on issue #27963: separate shuffle io connect timeout and idle timeout URL: https://github.com/apache/spark/pull/27963#issuecomment-601540803 cc @cloud-fan , would you please help check also? This is an auto

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable`

HyukjinKwon commented on a change in pull request #27962: [SPARK-31195][SQL] Reuse days rebase functions of `DateTimeUtils` in `DaysWritable` URL: https://github.com/apache/spark/pull/27962#discussion_r395441060 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/DaysWri

[GitHub] [spark] cloud-fan commented on a change in pull request #27959: [SPARK-31190][SQL] ScalaReflection should erasure non user defined AnyVal type

cloud-fan commented on a change in pull request #27959: [SPARK-31190][SQL] ScalaReflection should erasure non user defined AnyVal type URL: https://github.com/apache/spark/pull/27959#discussion_r395441245 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/Scala

[GitHub] [spark] cloud-fan commented on a change in pull request #27902: [SPARK-31147][SQL] forbid CHAR/VARCHAR type in non-Hive tables

cloud-fan commented on a change in pull request #27902: [SPARK-31147][SQL] forbid CHAR/VARCHAR type in non-Hive tables URL: https://github.com/apache/spark/pull/27902#discussion_r395439533 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Uti

[GitHub] [spark] AmplabJenkins commented on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable

AmplabJenkins commented on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable URL: https://github.com/apache/spark/pull/27815#issuecomment-601538183 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable

AmplabJenkins commented on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable URL: https://github.com/apache/spark/pull/27815#issuecomment-601538189 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable

AmplabJenkins removed a comment on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable URL: https://github.com/apache/spark/pull/27815#issuecomment-601538183 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable

AmplabJenkins removed a comment on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable URL: https://github.com/apache/spark/pull/27815#issuecomment-601538189 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] SparkQA commented on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable

SparkQA commented on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable URL: https://github.com/apache/spark/pull/27815#issuecomment-601537944 **[Test build #120078 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120078/testReport)

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27902: [SPARK-31147][SQL] forbid CHAR/VARCHAR type in non-Hive tables

dongjoon-hyun commented on a change in pull request #27902: [SPARK-31147][SQL] forbid CHAR/VARCHAR type in non-Hive tables URL: https://github.com/apache/spark/pull/27902#discussion_r395437790 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV

[GitHub] [spark] AmplabJenkins commented on issue #27821: [SPARK-31087][SQL][API] Add Back Multiple Removed APIs

AmplabJenkins commented on issue #27821: [SPARK-31087][SQL][API] Add Back Multiple Removed APIs URL: https://github.com/apache/spark/pull/27821#issuecomment-601536261 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] AmplabJenkins commented on issue #27821: [SPARK-31087][SQL][API] Add Back Multiple Removed APIs

AmplabJenkins commented on issue #27821: [SPARK-31087][SQL][API] Add Back Multiple Removed APIs URL: https://github.com/apache/spark/pull/27821#issuecomment-601536257 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #27821: [SPARK-31087][SQL][API] Add Back Multiple Removed APIs

AmplabJenkins removed a comment on issue #27821: [SPARK-31087][SQL][API] Add Back Multiple Removed APIs URL: https://github.com/apache/spark/pull/27821#issuecomment-601536261 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #27821: [SPARK-31087][SQL][API] Add Back Multiple Removed APIs

AmplabJenkins removed a comment on issue #27821: [SPARK-31087][SQL][API] Add Back Multiple Removed APIs URL: https://github.com/apache/spark/pull/27821#issuecomment-601536257 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] SparkQA commented on issue #27821: [SPARK-31087][SQL][API] Add Back Multiple Removed APIs

SparkQA commented on issue #27821: [SPARK-31087][SQL][API] Add Back Multiple Removed APIs URL: https://github.com/apache/spark/pull/27821#issuecomment-601536059 **[Test build #120077 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120077/testReport)** for

[GitHub] [spark] gatorsmile commented on issue #27821: [SPARK-31087][SQL] Add Back Multiple Removed APIs

gatorsmile commented on issue #27821: [SPARK-31087][SQL] Add Back Multiple Removed APIs URL: https://github.com/apache/spark/pull/27821#issuecomment-601535924 retest this please This is an automated message from the Apache G

[GitHub] [spark] dongjoon-hyun commented on issue #27946: [SPARK-31181][SQL][TESTS] Remove the default value assumption on CREATE TABLE test cases

dongjoon-hyun commented on issue #27946: [SPARK-31181][SQL][TESTS] Remove the default value assumption on CREATE TABLE test cases URL: https://github.com/apache/spark/pull/27946#issuecomment-601535210 Thank you, @cloud-fan ! Also, I closed #27894. --

[GitHub] [spark] dongjoon-hyun closed pull request #27894: [SPARK-31136] Revert SPARK-30098 Use default datasource as provider for CREATE TABLE syntax

dongjoon-hyun closed pull request #27894: [SPARK-31136] Revert SPARK-30098 Use default datasource as provider for CREATE TABLE syntax URL: https://github.com/apache/spark/pull/27894 This is an automated message from the Apac

[GitHub] [spark] dongjoon-hyun commented on issue #27894: [SPARK-31136] Revert SPARK-30098 Use default datasource as provider for CREATE TABLE syntax

dongjoon-hyun commented on issue #27894: [SPARK-31136] Revert SPARK-30098 Use default datasource as provider for CREATE TABLE syntax URL: https://github.com/apache/spark/pull/27894#issuecomment-601535039 Thank you all! I'm going to close this PR because this is discussed explicitly. -

[GitHub] [spark] gatorsmile commented on a change in pull request #27839: [SPARK-31086][SQL] Add Back the Deprecated SQLContext methods

gatorsmile commented on a change in pull request #27839: [SPARK-31086][SQL] Add Back the Deprecated SQLContext methods URL: https://github.com/apache/spark/pull/27839#discussion_r395435576 ## File path: sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala ## @@ -6

[GitHub] [spark] dongjoon-hyun commented on issue #27952: [SPARK-31184][SQL] Support getTablesByType API of Hive Client

dongjoon-hyun commented on issue #27952: [SPARK-31184][SQL] Support getTablesByType API of Hive Client URL: https://github.com/apache/spark/pull/27952#issuecomment-601533788 Thank you for making a dedicated one, @Eric5553 . T

[GitHub] [spark] cloud-fan closed pull request #27946: [SPARK-31181][SQL][TESTS] Remove the default value assumption on CREATE TABLE test cases

cloud-fan closed pull request #27946: [SPARK-31181][SQL][TESTS] Remove the default value assumption on CREATE TABLE test cases URL: https://github.com/apache/spark/pull/27946 This is an automated message from the Apache Git

[GitHub] [spark] cloud-fan commented on issue #27946: [SPARK-31181][SQL][TESTS] Remove the default value assumption on CREATE TABLE test cases

cloud-fan commented on issue #27946: [SPARK-31181][SQL][TESTS] Remove the default value assumption on CREATE TABLE test cases URL: https://github.com/apache/spark/pull/27946#issuecomment-601533737 thanks, merging to master/3.0! --

[GitHub] [spark] HeartSaVioR edited a comment on issue #27860: [SPARK-31101][SQL][BUILD] Upgrade Janino to 3.1.2

HeartSaVioR edited a comment on issue #27860: [SPARK-31101][SQL][BUILD] Upgrade Janino to 3.1.2 URL: https://github.com/apache/spark/pull/27860#issuecomment-601520170 > https://issues.apache.org/jira/browse/SPARK-25987 has been addressed in SPARK 3.0? Looks like, though it might be

[GitHub] [spark] HeartSaVioR edited a comment on issue #27860: [SPARK-31101][SQL][BUILD] Upgrade Janino to 3.1.2

HeartSaVioR edited a comment on issue #27860: [SPARK-31101][SQL][BUILD] Upgrade Janino to 3.1.2 URL: https://github.com/apache/spark/pull/27860#issuecomment-601520170 > https://issues.apache.org/jira/browse/SPARK-25987 has been addressed in SPARK 3.0? Looks like, though it might be

[GitHub] [spark] running2 commented on issue #27963: separate shuffle io connect timeout and idle timeout

running2 commented on issue #27963: separate shuffle io connect timeout and idle timeout URL: https://github.com/apache/spark/pull/27963#issuecomment-601526546 cc @rxin @aarondav who worked on #5584 before This is an automat

[GitHub] [spark] HeartSaVioR edited a comment on issue #27860: [SPARK-31101][SQL][BUILD] Upgrade Janino to 3.1.2

HeartSaVioR edited a comment on issue #27860: [SPARK-31101][SQL][BUILD] Upgrade Janino to 3.1.2 URL: https://github.com/apache/spark/pull/27860#issuecomment-601520170 > https://issues.apache.org/jira/browse/SPARK-25987 has been addressed in SPARK 3.0? Looks like. We don't seem to fi

[GitHub] [spark] HeartSaVioR edited a comment on issue #27860: [SPARK-31101][SQL][BUILD] Upgrade Janino to 3.1.2

HeartSaVioR edited a comment on issue #27860: [SPARK-31101][SQL][BUILD] Upgrade Janino to 3.1.2 URL: https://github.com/apache/spark/pull/27860#issuecomment-601520170 > https://issues.apache.org/jira/browse/SPARK-25987 has been addressed in SPARK 3.0? Looks like. We don't seem to fi

[GitHub] [spark] HeartSaVioR commented on issue #27860: [SPARK-31101][SQL][BUILD] Upgrade Janino to 3.1.2

HeartSaVioR commented on issue #27860: [SPARK-31101][SQL][BUILD] Upgrade Janino to 3.1.2 URL: https://github.com/apache/spark/pull/27860#issuecomment-601520170 The code Spark generates are far from hand-written code which only few of users would have gone through the same path - the bugs w

[GitHub] [spark] AmplabJenkins removed a comment on issue #27963: separate shuffle io connect timeout and idle timeout

AmplabJenkins removed a comment on issue #27963: separate shuffle io connect timeout and idle timeout URL: https://github.com/apache/spark/pull/27963#issuecomment-601515059 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins commented on issue #27963: separate shuffle io connect timeout and idle timeout

AmplabJenkins commented on issue #27963: separate shuffle io connect timeout and idle timeout URL: https://github.com/apache/spark/pull/27963#issuecomment-601515310 Can one of the admins verify this patch? This is an automate

[GitHub] [spark] AmplabJenkins commented on issue #27963: separate shuffle io connect timeout and idle timeout

AmplabJenkins commented on issue #27963: separate shuffle io connect timeout and idle timeout URL: https://github.com/apache/spark/pull/27963#issuecomment-601515059 Can one of the admins verify this patch? This is an automate

[GitHub] [spark] running2 opened a new pull request #27963: separate shuffle io connect timeout and idle timeout

running2 opened a new pull request #27963: separate shuffle io connect timeout and idle timeout URL: https://github.com/apache/spark/pull/27963 ### What changes were proposed in this pull request? When reading shuffle data, some fetch request may go to some shuffle server th

[GitHub] [spark] gatorsmile commented on issue #27860: [SPARK-31101][SQL][BUILD] Upgrade Janino to 3.1.2

gatorsmile commented on issue #27860: [SPARK-31101][SQL][BUILD] Upgrade Janino to 3.1.2 URL: https://github.com/apache/spark/pull/27860#issuecomment-601513445 https://issues.apache.org/jira/browse/SPARK-25987 has been addressed in SPARK 3.0? Upgrading to Janino 3.0.16 looks much sa

[GitHub] [spark] AmplabJenkins removed a comment on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

AmplabJenkins removed a comment on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601512811 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

AmplabJenkins commented on issue #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS URL: https://github.com/apache/spark/pull/26422#issuecomment-601512811 Merged build finished. Test PASSed.

  1   2   3   4   5   6   7   8   9   10   >