[GitHub] [spark] AmplabJenkins commented on issue #27442: [SPARK-30708][SQL] Fix parse exception for first_value and last_value

AmplabJenkins commented on issue #27442: [SPARK-30708][SQL] Fix parse exception for first_value and last_value URL: https://github.com/apache/spark/pull/27442#issuecomment-581395033 Merged build finished. Test PASSed. This

[GitHub] [spark] beliefer opened a new pull request #27442: [SPARK-30708][SQL] Fix parse exception for first_value and last_value

beliefer opened a new pull request #27442: [SPARK-30708][SQL] Fix parse exception for first_value and last_value URL: https://github.com/apache/spark/pull/27442 ### What changes were proposed in this pull request? When I running first_value and last_value window function occur a

[GitHub] [spark] zero323 commented on a change in pull request #27406: [SPARK-30681][PYSPARK][SQL] Add higher order functions API to PySpark

zero323 commented on a change in pull request #27406: [SPARK-30681][PYSPARK][SQL] Add higher order functions API to PySpark URL: https://github.com/apache/spark/pull/27406#discussion_r374074657 ## File path: python/pyspark/sql/column.py ## @@ -129,6 +129,103 @@ def

[GitHub] [spark] AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581389218 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581389209 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581389209 Merged build finished. Test FAILed.

[GitHub] [spark] cloud-fan commented on issue #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

cloud-fan commented on issue #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource URL: https://github.com/apache/spark/pull/27366#issuecomment-581389021 This misses 3.0 already and I'll take a look later. Need to focus on 3.0 bug fixes first.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581386442 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581386450 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581386442 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581386450 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581367453 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] zero323 commented on a change in pull request #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

zero323 commented on a change in pull request #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#discussion_r374069388 ## File path: R/pkg/R/functions.R ## @@ -3281,6 +3322,126 @@

[GitHub] [spark] zero323 commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

zero323 commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581385857 Jenkins, retest this please. This is an

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27406: [SPARK-30681][PYSPARK][SQL] Add higher order functions API to PySpark

HyukjinKwon commented on a change in pull request #27406: [SPARK-30681][PYSPARK][SQL] Add higher order functions API to PySpark URL: https://github.com/apache/spark/pull/27406#discussion_r374068808 ## File path: python/pyspark/sql/column.py ## @@ -129,6 +129,103 @@ def

[GitHub] [spark] AmplabJenkins removed a comment on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false

AmplabJenkins removed a comment on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false URL: https://github.com/apache/spark/pull/27306#issuecomment-581383575 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false

AmplabJenkins removed a comment on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false URL: https://github.com/apache/spark/pull/27306#issuecomment-581383571 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false

AmplabJenkins commented on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false URL: https://github.com/apache/spark/pull/27306#issuecomment-581383571 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false

AmplabJenkins commented on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false URL: https://github.com/apache/spark/pull/27306#issuecomment-581383575 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false

SparkQA commented on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false URL: https://github.com/apache/spark/pull/27306#issuecomment-581382968 **[Test build #117773 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false

AmplabJenkins removed a comment on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false URL: https://github.com/apache/spark/pull/27306#issuecomment-581277885 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] cloud-fan commented on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false

cloud-fan commented on issue #27306: [SPARK-30594][CORE] Do not post SparkListenerBlockUpdated when updateBlockInfo returns false URL: https://github.com/apache/spark/pull/27306#issuecomment-581381580 retest this please This

[GitHub] [spark] cloud-fan commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

cloud-fan commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581381291 This patch LGTM as it is (pending migration guide updates). Another concern is: since we

[GitHub] [spark] cloud-fan commented on a change in pull request #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

cloud-fan commented on a change in pull request #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#discussion_r374062911 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

cloud-fan commented on a change in pull request #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#discussion_r374062911 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp`

cloud-fan commented on a change in pull request #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp` URL: https://github.com/apache/spark/pull/27438#discussion_r374061420 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning

AmplabJenkins removed a comment on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning URL: https://github.com/apache/spark/pull/27232#issuecomment-581377862 Test PASSed. Refer to this link

[GitHub] [spark] AmplabJenkins removed a comment on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning

AmplabJenkins removed a comment on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning URL: https://github.com/apache/spark/pull/27232#issuecomment-581377856 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning

AmplabJenkins commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning URL: https://github.com/apache/spark/pull/27232#issuecomment-581377862 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning

AmplabJenkins commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning URL: https://github.com/apache/spark/pull/27232#issuecomment-581377856 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning

SparkQA commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning URL: https://github.com/apache/spark/pull/27232#issuecomment-581377344 **[Test build #117772 has

[GitHub] [spark] zero323 commented on a change in pull request #27406: [SPARK-30681][PYSPARK][SQL] Add higher order functions API to PySpark

zero323 commented on a change in pull request #27406: [SPARK-30681][PYSPARK][SQL] Add higher order functions API to PySpark URL: https://github.com/apache/spark/pull/27406#discussion_r374059996 ## File path: python/pyspark/sql/functions.py ## @@ -2840,6 +2841,495 @@ def

[GitHub] [spark] AmplabJenkins removed a comment on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning

AmplabJenkins removed a comment on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning URL: https://github.com/apache/spark/pull/27232#issuecomment-581287881 Test FAILed. Refer to this link

[GitHub] [spark] cloud-fan commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning

cloud-fan commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning URL: https://github.com/apache/spark/pull/27232#issuecomment-581376509 retest this please

[GitHub] [spark] cloud-fan commented on issue #27185: [SPARK-30494][SQL] Avoid duplicated cached RDD when replace an existing view

cloud-fan commented on issue #27185: [SPARK-30494][SQL] Avoid duplicated cached RDD when replace an existing view URL: https://github.com/apache/spark/pull/27185#issuecomment-581376313 ah I see. `CacheManager` is in sql/core not catalyst. Then can we create a util function to make sure we

[GitHub] [spark] SparkQA removed a comment on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp`

SparkQA removed a comment on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp` URL: https://github.com/apache/spark/pull/27438#issuecomment-581293414 **[Test build #117767 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp`

AmplabJenkins removed a comment on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp` URL: https://github.com/apache/spark/pull/27438#issuecomment-581369057 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp`

AmplabJenkins removed a comment on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp` URL: https://github.com/apache/spark/pull/27438#issuecomment-581369045 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp`

AmplabJenkins commented on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp` URL: https://github.com/apache/spark/pull/27438#issuecomment-581369057 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp`

AmplabJenkins commented on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp` URL: https://github.com/apache/spark/pull/27438#issuecomment-581369045 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp`

SparkQA commented on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp` URL: https://github.com/apache/spark/pull/27438#issuecomment-581368586 **[Test build #117767 has

[GitHub] [spark] zero323 commented on a change in pull request #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

zero323 commented on a change in pull request #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#discussion_r374051458 ## File path: R/pkg/R/functions.R ## @@ -3281,6 +3322,126 @@

[GitHub] [spark] AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581367963 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581367963 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581367970 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581367970 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581367453 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins commented on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581367437 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions

AmplabJenkins removed a comment on issue #27433: [SPARK-30682][SPARKR][SQL] Add SparkR interface for higher order functions URL: https://github.com/apache/spark/pull/27433#issuecomment-581367437 Merged build finished. Test FAILed.

[GitHub] [spark] cloud-fan commented on issue #27429: [SPARK-28330][SQL] Support ANSI SQL: result offset clause in query expression

cloud-fan commented on issue #27429: [SPARK-28330][SQL] Support ANSI SQL: result offset clause in query expression URL: https://github.com/apache/spark/pull/27429#issuecomment-581362656 > LocalLimitExec (limit = 10, offset = 10) // Take the first 20(limit + offset) rows locally

[GitHub] [spark] AmplabJenkins removed a comment on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

AmplabJenkins removed a comment on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581361258 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

AmplabJenkins removed a comment on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581361263 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

AmplabJenkins commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581361258 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

AmplabJenkins commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581361263 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

AmplabJenkins removed a comment on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581357753 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

SparkQA commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581360845 **[Test build #117770 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

AmplabJenkins removed a comment on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581358363 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

AmplabJenkins removed a comment on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581358376 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

AmplabJenkins commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581358376 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

AmplabJenkins commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581358363 Merged build finished. Test PASSed.

[GitHub] [spark] MaxGekk commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

MaxGekk commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581358262 jenkins, retest this, please

[GitHub] [spark] MaxGekk commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

MaxGekk commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581358188 I will update the SQL migration guide soon.

[GitHub] [spark] AmplabJenkins commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

AmplabJenkins commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581357747 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

AmplabJenkins removed a comment on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581357747 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

AmplabJenkins commented on issue #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441#issuecomment-581357753 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] MaxGekk opened a new pull request #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings

MaxGekk opened a new pull request #27441: [SPARK-30668][SQL] Support `SimpleDateFormat` patterns in parsing timestamps/dates strings URL: https://github.com/apache/spark/pull/27441 ### What changes were proposed in this pull request? In the PR, I propose to partially revert the commit

[GitHub] [spark] AmplabJenkins removed a comment on issue #27440: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

AmplabJenkins removed a comment on issue #27440: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function URL: https://github.com/apache/spark/pull/27440#issuecomment-581345453 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27440: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

AmplabJenkins removed a comment on issue #27440: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function URL: https://github.com/apache/spark/pull/27440#issuecomment-581345439 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #27440: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

AmplabJenkins commented on issue #27440: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function URL: https://github.com/apache/spark/pull/27440#issuecomment-581345439 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27440: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

AmplabJenkins commented on issue #27440: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function URL: https://github.com/apache/spark/pull/27440#issuecomment-581345453 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27440: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

SparkQA commented on issue #27440: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function URL: https://github.com/apache/spark/pull/27440#issuecomment-581344791 **[Test build #117768 has

[GitHub] [spark] beliefer opened a new pull request #27440: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

beliefer opened a new pull request #27440: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function URL: https://github.com/apache/spark/pull/27440 ### What changes were proposed in this pull request? The `NTH_VALUE` function is an ANSI SQL. There are some mainstream

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md

gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md URL: https://github.com/apache/spark/pull/27398#discussion_r373984374 ## File path: docs/monitoring.md ## @@ -95,6

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md

gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md URL: https://github.com/apache/spark/pull/27398#discussion_r373984061 ## File path: docs/monitoring.md ## @@ -95,6

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md

gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md URL: https://github.com/apache/spark/pull/27398#discussion_r373985499 ## File path: docs/monitoring.md ## @@ -95,6

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md

gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md URL: https://github.com/apache/spark/pull/27398#discussion_r373978109 ## File path: docs/monitoring.md ## @@ -95,6

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md

gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md URL: https://github.com/apache/spark/pull/27398#discussion_r373983359 ## File path: docs/monitoring.md ## @@ -95,6

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md

gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md URL: https://github.com/apache/spark/pull/27398#discussion_r373982455 ## File path: docs/monitoring.md ## @@ -95,6

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md

gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md URL: https://github.com/apache/spark/pull/27398#discussion_r373980333 ## File path: docs/monitoring.md ## @@ -95,6

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md

gaborgsomogyi commented on a change in pull request #27398: [SPARK-30481][DOCS][FOLLOWUP] Document event log compaction into new section of monitoring.md URL: https://github.com/apache/spark/pull/27398#discussion_r373979073 ## File path: docs/monitoring.md ## @@ -95,6

[GitHub] [spark] MaxGekk edited a comment on issue #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

MaxGekk edited a comment on issue #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource URL: https://github.com/apache/spark/pull/27366#issuecomment-581303143 @cloud-fan @HyukjinKwon @dongjoon-hyun I have re-ran CSV/JSON benchmarks on r3.xlarge, and got slightly better

[GitHub] [spark] MaxGekk commented on issue #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

MaxGekk commented on issue #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource URL: https://github.com/apache/spark/pull/27366#issuecomment-581303143 @cloud-fan @HyukjinKwon @dongjoon-hyun I have re-run CSV/JSON benchmarks on r3.xlarge, and got slightly better results

[GitHub] [spark] LantaoJin edited a comment on issue #27185: [SPARK-30494][SQL] Avoid duplicated cached RDD when replace an existing view

LantaoJin edited a comment on issue #27185: [SPARK-30494][SQL] Avoid duplicated cached RDD when replace an existing view URL: https://github.com/apache/spark/pull/27185#issuecomment-581294858 > To do that, `SessionCatalog` needs a reference of `SparkSession`. We need pass `SparkSession`

[GitHub] [spark] AmplabJenkins removed a comment on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp`

AmplabJenkins removed a comment on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp` URL: https://github.com/apache/spark/pull/27438#issuecomment-581294021 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp`

AmplabJenkins removed a comment on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp` URL: https://github.com/apache/spark/pull/27438#issuecomment-581294016 Merged build finished. Test PASSed.

[GitHub] [spark] LantaoJin commented on issue #27185: [SPARK-30494][SQL] Avoid duplicated cached RDD when replace an existing view

LantaoJin commented on issue #27185: [SPARK-30494][SQL] Avoid duplicated cached RDD when replace an existing view URL: https://github.com/apache/spark/pull/27185#issuecomment-581294858 > To do that, `SessionCatalog` needs a reference of `SparkSession`. We need pass `SparkSession` to the

[GitHub] [spark] AmplabJenkins commented on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp`

AmplabJenkins commented on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp` URL: https://github.com/apache/spark/pull/27438#issuecomment-581294021 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp`

AmplabJenkins commented on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp` URL: https://github.com/apache/spark/pull/27438#issuecomment-581294016 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp`

SparkQA commented on issue #27438: [MINOR][SQL][DOCS][2.4] Fix the timestamp pattern in the example for `to_timestamp` URL: https://github.com/apache/spark/pull/27438#issuecomment-581293414 **[Test build #117767 has

[GitHub] [spark] LantaoJin edited a comment on issue #27185: [SPARK-30494][SQL] Avoid duplicated cached RDD when replace an existing view

LantaoJin edited a comment on issue #27185: [SPARK-30494][SQL] Avoid duplicated cached RDD when replace an existing view URL: https://github.com/apache/spark/pull/27185#issuecomment-581290732 To do that, `SessionCatalog` needs a reference of `SparkSession`. We need pass `SparkSession` to

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27438: [MINOR][SQL][DOCS][2.4] Fix the descriptions of `to_timestamp` and `ParseToTimestamp`

HyukjinKwon commented on a change in pull request #27438: [MINOR][SQL][DOCS][2.4] Fix the descriptions of `to_timestamp` and `ParseToTimestamp` URL: https://github.com/apache/spark/pull/27438#discussion_r373965439 ## File path:

[GitHub] [spark] LantaoJin edited a comment on issue #27185: [SPARK-30494][SQL] Avoid duplicated cached RDD when replace an existing view

LantaoJin edited a comment on issue #27185: [SPARK-30494][SQL] Avoid duplicated cached RDD when replace an existing view URL: https://github.com/apache/spark/pull/27185#issuecomment-581290732 To do that, `SessionCatalog` needs a reference of `SparkSession`. We need pass `SparkSession` or

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27438: [MINOR][SQL][DOCS][2.4] Fix the descriptions of `to_timestamp` and `ParseToTimestamp`

HyukjinKwon commented on a change in pull request #27438: [MINOR][SQL][DOCS][2.4] Fix the descriptions of `to_timestamp` and `ParseToTimestamp` URL: https://github.com/apache/spark/pull/27438#discussion_r373968203 ## File path:

[GitHub] [spark] LantaoJin commented on issue #27185: [SPARK-30494][SQL] Avoid duplicated cached RDD when replace an existing view

LantaoJin commented on issue #27185: [SPARK-30494][SQL] Avoid duplicated cached RDD when replace an existing view URL: https://github.com/apache/spark/pull/27185#issuecomment-581290732 To do that, `SessionCatalog` needs a reference of `SparkSession`. We need pass it to the construct

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27438: [MINOR][SQL][DOCS][2.4] Fix the descriptions of `to_timestamp` and `ParseToTimestamp`

HyukjinKwon commented on a change in pull request #27438: [MINOR][SQL][DOCS][2.4] Fix the descriptions of `to_timestamp` and `ParseToTimestamp` URL: https://github.com/apache/spark/pull/27438#discussion_r373965439 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning

AmplabJenkins commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning URL: https://github.com/apache/spark/pull/27232#issuecomment-581287881 Test FAILed. Refer to this link for build

[GitHub] [spark] AmplabJenkins removed a comment on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning

AmplabJenkins removed a comment on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning URL: https://github.com/apache/spark/pull/27232#issuecomment-581287870 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning

AmplabJenkins commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to SessionCatalog for partition pruning URL: https://github.com/apache/spark/pull/27232#issuecomment-581287870 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27055: [SPARK-30394]Skip DetermineTableStats rule when hive table can be converted to datasource table

AmplabJenkins removed a comment on issue #27055: [SPARK-30394]Skip DetermineTableStats rule when hive table can be converted to datasource table URL: https://github.com/apache/spark/pull/27055#issuecomment-581285890 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA removed a comment on issue #27055: [SPARK-30394]Skip DetermineTableStats rule when hive table can be converted to datasource table

SparkQA removed a comment on issue #27055: [SPARK-30394]Skip DetermineTableStats rule when hive table can be converted to datasource table URL: https://github.com/apache/spark/pull/27055#issuecomment-581275585 **[Test build #117764 has

<    2   3   4   5   6   7   8   >