[jira] [Resolved] (SPARK-32120) Single GPU is allocated multiple times

2021-01-27 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack resolved SPARK-32120. --- Resolution: Not A Bug Its documented, so it is not a bug. Thanks! > Single GPU is allocated

[jira] [Reopened] (SPARK-33913) Upgrade Kafka to 2.7.0

2021-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-33913: -- Assignee: (was: Dongjoon Hyun) Reverted due to Scala bug (https://github.com/scala/bug/i

[jira] [Updated] (SPARK-33913) Upgrade Kafka to 2.7.0

2021-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33913: - Fix Version/s: (was: 3.2.0) > Upgrade Kafka to 2.7.0 > -- > >

[jira] [Commented] (SPARK-31168) Upgrade Scala to 2.12.13

2021-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272646#comment-17272646 ] Hyukjin Kwon commented on SPARK-31168: -- Reverted due to Scala bug (https://github.c

[jira] [Updated] (SPARK-31168) Upgrade Scala to 2.12.13

2021-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31168: - Fix Version/s: (was: 3.2.0) > Upgrade Scala to 2.12.13 > > >

[jira] [Reopened] (SPARK-31168) Upgrade Scala to 2.12.13

2021-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-31168: -- Assignee: (was: Dongjoon Hyun) > Upgrade Scala to 2.12.13 > > >

[jira] [Comment Edited] (SPARK-33913) Upgrade Kafka to 2.7.0

2021-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272644#comment-17272644 ] Hyukjin Kwon edited comment on SPARK-33913 at 1/27/21, 8:04 AM: --

[jira] [Updated] (SPARK-34258) scala.reflect.internal.Symbols$CyclicReference: illegal cyclic reference involving type BuilderType

2021-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34258: - Description: There is a regression in Scala 2.13. We should probably upgrade maintenance versio

[jira] [Updated] (SPARK-34258) Upgrade Scala to avoid Scala's bug about illegal cyclic reference

2021-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34258: - Summary: Upgrade Scala to avoid Scala's bug about illegal cyclic reference (was: scala.reflect.

[jira] [Updated] (SPARK-34258) Upgrade Scala to avoid Scala's bug about illegal cyclic reference

2021-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34258: - Description: There is a regression in Scala 2.13. We should probably upgrade maintenance versio

[jira] [Assigned] (SPARK-33913) Upgrade Kafka to 2.7.0

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33913: Assignee: (was: Apache Spark) > Upgrade Kafka to 2.7.0 > -- > >

[jira] [Assigned] (SPARK-33913) Upgrade Kafka to 2.7.0

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33913: Assignee: Apache Spark > Upgrade Kafka to 2.7.0 > -- > >

[jira] [Assigned] (SPARK-31168) Upgrade Scala to 2.12.13

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31168: Assignee: Apache Spark > Upgrade Scala to 2.12.13 > > >

[jira] [Assigned] (SPARK-31168) Upgrade Scala to 2.12.13

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31168: Assignee: (was: Apache Spark) > Upgrade Scala to 2.12.13 > >

[jira] [Updated] (SPARK-34257) Improve performance for last_value over unbounded window frame

2021-01-27 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-34257: --- Summary: Improve performance for last_value over unbounded window frame (was: Improve performance f

[jira] [Commented] (SPARK-34257) Improve performance for last_value over unbounded window frame

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272660#comment-17272660 ] Apache Spark commented on SPARK-34257: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-34257) Improve performance for last_value over unbounded window frame

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34257: Assignee: (was: Apache Spark) > Improve performance for last_value over unbounded win

[jira] [Assigned] (SPARK-34257) Improve performance for last_value over unbounded window frame

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34257: Assignee: Apache Spark > Improve performance for last_value over unbounded window frame >

[jira] [Commented] (SPARK-34257) Improve performance for last_value over unbounded window frame

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272664#comment-17272664 ] Apache Spark commented on SPARK-34257: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272675#comment-17272675 ] Apache Spark commented on SPARK-34212: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272676#comment-17272676 ] Apache Spark commented on SPARK-34212: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-34259) Reading a partitioned dataset with a partition value of NOW causes the value to be parsed as a timestamp.

2021-01-27 Thread Chris Martin (Jira)
Chris Martin created SPARK-34259: Summary: Reading a partitioned dataset with a partition value of NOW causes the value to be parsed as a timestamp. Key: SPARK-34259 URL: https://issues.apache.org/jira/browse/SPAR

[jira] [Created] (SPARK-34260) UnresolvedException when creating temp view twice

2021-01-27 Thread Linhong Liu (Jira)
Linhong Liu created SPARK-34260: --- Summary: UnresolvedException when creating temp view twice Key: SPARK-34260 URL: https://issues.apache.org/jira/browse/SPARK-34260 Project: Spark Issue Type: B

[jira] [Created] (SPARK-34261) Avoid side effect if create exists temporary function

2021-01-27 Thread ulysses you (Jira)
ulysses you created SPARK-34261: --- Summary: Avoid side effect if create exists temporary function Key: SPARK-34261 URL: https://issues.apache.org/jira/browse/SPARK-34261 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-34261) Avoid side effect if create exists temporary function

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34261: Assignee: Apache Spark > Avoid side effect if create exists temporary function >

[jira] [Assigned] (SPARK-34261) Avoid side effect if create exists temporary function

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34261: Assignee: (was: Apache Spark) > Avoid side effect if create exists temporary function

[jira] [Commented] (SPARK-34261) Avoid side effect if create exists temporary function

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272738#comment-17272738 ] Apache Spark commented on SPARK-34261: -- User 'ulysses-you' has created a pull reque

[jira] [Created] (SPARK-34262) ALTER TABLE .. SET LOCATION doesn't refresh v1 table cache

2021-01-27 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34262: -- Summary: ALTER TABLE .. SET LOCATION doesn't refresh v1 table cache Key: SPARK-34262 URL: https://issues.apache.org/jira/browse/SPARK-34262 Project: Spark Issue

[jira] [Commented] (SPARK-34083) Using TPCDS original definitions for char/varchar columns

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272755#comment-17272755 ] Apache Spark commented on SPARK-34083: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-34083) Using TPCDS original definitions for char/varchar columns

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272756#comment-17272756 ] Apache Spark commented on SPARK-34083: -- User 'yaooqinn' has created a pull request

[jira] [Updated] (SPARK-34262) ALTER TABLE .. SET LOCATION doesn't refresh v1 table cache

2021-01-27 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34262: --- Description: The example below portraits the issue: 1. Create a source table: {code:sql} spark-sql>

[jira] [Commented] (SPARK-34260) UnresolvedException when creating temp view twice

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272775#comment-17272775 ] Apache Spark commented on SPARK-34260: -- User 'linhongliu-db' has created a pull req

[jira] [Assigned] (SPARK-34260) UnresolvedException when creating temp view twice

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34260: Assignee: Apache Spark > UnresolvedException when creating temp view twice >

[jira] [Assigned] (SPARK-34260) UnresolvedException when creating temp view twice

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34260: Assignee: (was: Apache Spark) > UnresolvedException when creating temp view twice > -

[jira] [Commented] (SPARK-34260) UnresolvedException when creating temp view twice

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272776#comment-17272776 ] Apache Spark commented on SPARK-34260: -- User 'linhongliu-db' has created a pull req

[jira] [Assigned] (SPARK-34262) ALTER TABLE .. SET LOCATION doesn't refresh v1 table cache

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34262: Assignee: Maxim Gekk (was: Apache Spark) > ALTER TABLE .. SET LOCATION doesn't refresh v

[jira] [Commented] (SPARK-34262) ALTER TABLE .. SET LOCATION doesn't refresh v1 table cache

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272783#comment-17272783 ] Apache Spark commented on SPARK-34262: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34262) ALTER TABLE .. SET LOCATION doesn't refresh v1 table cache

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34262: Assignee: Apache Spark (was: Maxim Gekk) > ALTER TABLE .. SET LOCATION doesn't refresh v

[jira] [Commented] (SPARK-34262) ALTER TABLE .. SET LOCATION doesn't refresh v1 table cache

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272784#comment-17272784 ] Apache Spark commented on SPARK-34262: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-34263) Simplify the code for treating unicode/octal/escaped characters in string literals

2021-01-27 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34263: -- Summary: Simplify the code for treating unicode/octal/escaped characters in string literals Key: SPARK-34263 URL: https://issues.apache.org/jira/browse/SPARK-34263

[jira] [Assigned] (SPARK-34263) Simplify the code for treating unicode/octal/escaped characters in string literals

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34263: Assignee: Apache Spark (was: Kousuke Saruta) > Simplify the code for treating unicode/oc

[jira] [Commented] (SPARK-34263) Simplify the code for treating unicode/octal/escaped characters in string literals

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272808#comment-17272808 ] Apache Spark commented on SPARK-34263: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-34263) Simplify the code for treating unicode/octal/escaped characters in string literals

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34263: Assignee: Kousuke Saruta (was: Apache Spark) > Simplify the code for treating unicode/oc

[jira] [Created] (SPARK-34264) Prevent incomplete master URLs for Spark on Kubernetes early

2021-01-27 Thread Jacek Laskowski (Jira)
Jacek Laskowski created SPARK-34264: --- Summary: Prevent incomplete master URLs for Spark on Kubernetes early Key: SPARK-34264 URL: https://issues.apache.org/jira/browse/SPARK-34264 Project: Spark

[jira] [Assigned] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34154: Assignee: (was: Apache Spark) > Flaky Test: LocalityPlacementStrategySuite.handle lar

[jira] [Commented] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272865#comment-17272865 ] Apache Spark commented on SPARK-34154: -- User 'attilapiros' has created a pull reque

[jira] [Assigned] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34154: Assignee: Apache Spark > Flaky Test: LocalityPlacementStrategySuite.handle large number o

[jira] [Commented] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272866#comment-17272866 ] Apache Spark commented on SPARK-34154: -- User 'attilapiros' has created a pull reque

[jira] [Commented] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2021-01-27 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272867#comment-17272867 ] Attila Zsolt Piros commented on SPARK-34154: I tried to reproduce this issue

[jira] [Created] (SPARK-34265) Add SQLMetrics instrumentation to Python UDF

2021-01-27 Thread Luca Canali (Jira)
Luca Canali created SPARK-34265: --- Summary: Add SQLMetrics instrumentation to Python UDF Key: SPARK-34265 URL: https://issues.apache.org/jira/browse/SPARK-34265 Project: Spark Issue Type: Improv

[jira] [Created] (SPARK-34266) Update comments for `SessionCatalog.refreshTable()` and `CatalogImpl.refreshTable()`

2021-01-27 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34266: -- Summary: Update comments for `SessionCatalog.refreshTable()` and `CatalogImpl.refreshTable()` Key: SPARK-34266 URL: https://issues.apache.org/jira/browse/SPARK-34266 Proj

[jira] [Assigned] (SPARK-34266) Update comments for `SessionCatalog.refreshTable()` and `CatalogImpl.refreshTable()`

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34266: Assignee: Apache Spark > Update comments for `SessionCatalog.refreshTable()` and > `Cata

[jira] [Commented] (SPARK-34266) Update comments for `SessionCatalog.refreshTable()` and `CatalogImpl.refreshTable()`

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272882#comment-17272882 ] Apache Spark commented on SPARK-34266: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34266) Update comments for `SessionCatalog.refreshTable()` and `CatalogImpl.refreshTable()`

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34266: Assignee: (was: Apache Spark) > Update comments for `SessionCatalog.refreshTable()` a

[jira] [Commented] (SPARK-34260) UnresolvedException when creating temp view twice

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272894#comment-17272894 ] Apache Spark commented on SPARK-34260: -- User 'linhongliu-db' has created a pull req

[jira] [Commented] (SPARK-34260) UnresolvedException when creating temp view twice

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272896#comment-17272896 ] Apache Spark commented on SPARK-34260: -- User 'linhongliu-db' has created a pull req

[jira] [Updated] (SPARK-34265) Add SQLMetrics instrumentation to Python UDF

2021-01-27 Thread Luca Canali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-34265: Attachment: PythonSQLMetrics_Jira_Picture.png > Add SQLMetrics instrumentation to Python UDF > ---

[jira] [Created] (SPARK-34267) Remove `refreshTable()` from `SessionState`

2021-01-27 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34267: -- Summary: Remove `refreshTable()` from `SessionState` Key: SPARK-34267 URL: https://issues.apache.org/jira/browse/SPARK-34267 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34267) Remove `refreshTable()` from `SessionState`

2021-01-27 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34267: --- Description: Spark already has `SessionCatalog.refreshTable` and `CatalogImpl.refreshTable`. One mor

[jira] [Commented] (SPARK-34267) Remove `refreshTable()` from `SessionState`

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272925#comment-17272925 ] Apache Spark commented on SPARK-34267: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34267) Remove `refreshTable()` from `SessionState`

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34267: Assignee: (was: Apache Spark) > Remove `refreshTable()` from `SessionState` > ---

[jira] [Assigned] (SPARK-34267) Remove `refreshTable()` from `SessionState`

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34267: Assignee: Apache Spark > Remove `refreshTable()` from `SessionState` > --

[jira] [Commented] (SPARK-34267) Remove `refreshTable()` from `SessionState`

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272926#comment-17272926 ] Apache Spark commented on SPARK-34267: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34265) Add SQLMetrics instrumentation to Python UDF

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34265: Assignee: (was: Apache Spark) > Add SQLMetrics instrumentation to Python UDF > --

[jira] [Assigned] (SPARK-34265) Add SQLMetrics instrumentation to Python UDF

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34265: Assignee: Apache Spark > Add SQLMetrics instrumentation to Python UDF > -

[jira] [Commented] (SPARK-34265) Add SQLMetrics instrumentation to Python UDF

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272956#comment-17272956 ] Apache Spark commented on SPARK-34265: -- User 'LucaCanali' has created a pull reques

[jira] [Commented] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2021-01-27 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272990#comment-17272990 ] Attila Zsolt Piros commented on SPARK-34154: In my PR the bug does not surfa

[jira] [Updated] (SPARK-34209) Allow multiple namespaces with session catalog

2021-01-27 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-34209: - Description: SPARK-30885 removed the ability for tables in session catalogs being queried with S

[jira] [Resolved] (SPARK-34267) Remove `refreshTable()` from `SessionState`

2021-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34267. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31366 [https://

[jira] [Assigned] (SPARK-34267) Remove `refreshTable()` from `SessionState`

2021-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34267: - Assignee: Maxim Gekk > Remove `refreshTable()` from `SessionState` > --

[jira] [Updated] (SPARK-34221) In a special scenario, the error message of the stage in the UI page is blank

2021-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34221: -- Issue Type: Bug (was: Improvement) > In a special scenario, the error message of the stage in

[jira] [Assigned] (SPARK-34221) In a special scenario, the error message of the stage in the UI page is blank

2021-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34221: - Assignee: akiyamaneko > In a special scenario, the error message of the stage in the UI

[jira] [Resolved] (SPARK-34221) In a special scenario, the error message of the stage in the UI page is blank

2021-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34221. --- Fix Version/s: 3.0.2 3.1.1 Resolution: Fixed Issue resolved by pul

[jira] [Created] (SPARK-34268) The Signature for ConcatWs in Spark SQL Docs Is Inconsistent with the Actual Behavior

2021-01-27 Thread Yuning Zhang (Jira)
Yuning Zhang created SPARK-34268: Summary: The Signature for ConcatWs in Spark SQL Docs Is Inconsistent with the Actual Behavior Key: SPARK-34268 URL: https://issues.apache.org/jira/browse/SPARK-34268

[jira] [Updated] (SPARK-34268) The Signature for ConcatWs in Spark SQL Docs Is Inconsistent with the Actual Behavior

2021-01-27 Thread Yuning Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuning Zhang updated SPARK-34268: - Description: In [https://spark.apache.org/docs/latest/api/sql/index.html#concat_ws], the signat

[jira] [Created] (SPARK-34269) simplify view resolution

2021-01-27 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-34269: --- Summary: simplify view resolution Key: SPARK-34269 URL: https://issues.apache.org/jira/browse/SPARK-34269 Project: Spark Issue Type: Improvement Comp

[jira] [Commented] (SPARK-34269) simplify view resolution

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273093#comment-17273093 ] Apache Spark commented on SPARK-34269: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-34269) simplify view resolution

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34269: Assignee: Wenchen Fan (was: Apache Spark) > simplify view resolution > -

[jira] [Assigned] (SPARK-34269) simplify view resolution

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34269: Assignee: Apache Spark (was: Wenchen Fan) > simplify view resolution > -

[jira] [Commented] (SPARK-34269) simplify view resolution

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273094#comment-17273094 ] Apache Spark commented on SPARK-34269: -- User 'cloud-fan' has created a pull request

[jira] [Resolved] (SPARK-34252) View subqueries in aggregate's grouping expression fail during the analysis check

2021-01-27 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim resolved SPARK-34252. --- Resolution: Not A Problem > View subqueries in aggregate's grouping expression fail during the analy

[jira] [Assigned] (SPARK-34193) Potential race condition during decommissioning with TorrentBroadcast

2021-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34193: Assignee: Holden Karau > Potential race condition during decommissioning with TorrentBroa

[jira] [Resolved] (SPARK-34193) Potential race condition during decommissioning with TorrentBroadcast

2021-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34193. -- Fix Version/s: 3.1.2 Resolution: Fixed Issue resolved by pull request 31298 [https://gi

[jira] [Created] (SPARK-34270) Combine StateStoreMetrics should not override individual StateStoreCustomMetric

2021-01-27 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-34270: --- Summary: Combine StateStoreMetrics should not override individual StateStoreCustomMetric Key: SPARK-34270 URL: https://issues.apache.org/jira/browse/SPARK-34270 Project

[jira] [Updated] (SPARK-34270) Combine StateStoreMetrics should not override individual StateStoreCustomMetric

2021-01-27 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-34270: Affects Version/s: 3.1.2 2.3.4 2.4.7

[jira] [Commented] (SPARK-27589) Spark file source V2

2021-01-27 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273154#comment-17273154 ] Erik Krogen commented on SPARK-27589: - [~Gengliang.Wang] are you or anyone else plan

[jira] [Commented] (SPARK-34270) Combine StateStoreMetrics should not override individual StateStoreCustomMetric

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273155#comment-17273155 ] Apache Spark commented on SPARK-34270: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-34270) Combine StateStoreMetrics should not override individual StateStoreCustomMetric

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34270: Assignee: Apache Spark (was: L. C. Hsieh) > Combine StateStoreMetrics should not overrid

[jira] [Assigned] (SPARK-34270) Combine StateStoreMetrics should not override individual StateStoreCustomMetric

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34270: Assignee: L. C. Hsieh (was: Apache Spark) > Combine StateStoreMetrics should not overrid

[jira] [Updated] (SPARK-34270) Combine StateStoreMetrics should not override StateStoreCustomMetric

2021-01-27 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-34270: Summary: Combine StateStoreMetrics should not override StateStoreCustomMetric (was: Combine State

[jira] [Commented] (SPARK-27589) Spark file source V2

2021-01-27 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273161#comment-17273161 ] Chao Sun commented on SPARK-27589: -- [~xkrogen] FWIW I'm working on a POC for SPARK-3293

[jira] [Resolved] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2021-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34154. -- Fix Version/s: 3.1.2 3.2.0 3.0.2 Assignee: Attil

[jira] [Commented] (SPARK-27963) Allow dynamic allocation without an external shuffle service

2021-01-27 Thread Neelesh Srinivas Salian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273192#comment-17273192 ] Neelesh Srinivas Salian commented on SPARK-27963: - [~dongjoon] [~vanzin]

[jira] [Assigned] (SPARK-34268) The Signature for ConcatWs in Spark SQL Docs Is Inconsistent with the Actual Behavior

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34268: Assignee: Apache Spark > The Signature for ConcatWs in Spark SQL Docs Is Inconsistent wit

[jira] [Commented] (SPARK-34268) The Signature for ConcatWs in Spark SQL Docs Is Inconsistent with the Actual Behavior

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273228#comment-17273228 ] Apache Spark commented on SPARK-34268: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-34268) The Signature for ConcatWs in Spark SQL Docs Is Inconsistent with the Actual Behavior

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34268: Assignee: (was: Apache Spark) > The Signature for ConcatWs in Spark SQL Docs Is Incon

[jira] [Created] (SPARK-34271) Use majorMinorPatchVersion for Hive version parsing

2021-01-27 Thread Chao Sun (Jira)
Chao Sun created SPARK-34271: Summary: Use majorMinorPatchVersion for Hive version parsing Key: SPARK-34271 URL: https://issues.apache.org/jira/browse/SPARK-34271 Project: Spark Issue Type: Impro

[jira] [Assigned] (SPARK-34271) Use majorMinorPatchVersion for Hive version parsing

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34271: Assignee: Apache Spark > Use majorMinorPatchVersion for Hive version parsing > --

[jira] [Commented] (SPARK-34271) Use majorMinorPatchVersion for Hive version parsing

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273256#comment-17273256 ] Apache Spark commented on SPARK-34271: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-34271) Use majorMinorPatchVersion for Hive version parsing

2021-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34271: Assignee: (was: Apache Spark) > Use majorMinorPatchVersion for Hive version parsing >

  1   2   >