[jira] [Commented] (SPARK-33777) Sort output of V2 SHOW PARTITIONS

2020-12-14 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17249120#comment-17249120 ] Maxim Gekk commented on SPARK-33777: I am working on this. > Sort output of V2 SHOW

[jira] [Created] (SPARK-33787) Add `purge` to `dropPartition` in `SupportsPartitionManagement`

2020-12-14 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33787: -- Summary: Add `purge` to `dropPartition` in `SupportsPartitionManagement` Key: SPARK-33787 URL: https://issues.apache.org/jira/browse/SPARK-33787 Project: Spark

[jira] [Created] (SPARK-33788) Throw NoSuchPartitionsException from HiveExternalCatalog.dropPartitions()

2020-12-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33788: -- Summary: Throw NoSuchPartitionsException from HiveExternalCatalog.dropPartitions() Key: SPARK-33788 URL: https://issues.apache.org/jira/browse/SPARK-33788 Project: Spark

[jira] [Updated] (SPARK-33788) Throw NoSuchPartitionsException from HiveExternalCatalog.dropPartitions()

2020-12-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33788: --- Description: HiveExternalCatalog.dropPartitions and as a consequence of that V1 Hive catalog throws

[jira] [Created] (SPARK-33789) Refactor unified V1 and V2 datasource tests

2020-12-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33789: -- Summary: Refactor unified V1 and V2 datasource tests Key: SPARK-33789 URL: https://issues.apache.org/jira/browse/SPARK-33789 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-33830) Describe the PURGE option of ALTER TABLE .. DROP PATITION

2020-12-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33830: -- Summary: Describe the PURGE option of ALTER TABLE .. DROP PATITION Key: SPARK-33830 URL: https://issues.apache.org/jira/browse/SPARK-33830 Project: Spark Issue T

[jira] [Updated] (SPARK-33830) Describe the PURGE option of ALTER TABLE .. DROP PARTITION

2020-12-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33830: --- Summary: Describe the PURGE option of ALTER TABLE .. DROP PARTITION (was: Describe the PURGE option

[jira] [Created] (SPARK-33838) Add comment about `PURGE` in DropTable and in AlterTableDropPartition

2020-12-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33838: -- Summary: Add comment about `PURGE` in DropTable and in AlterTableDropPartition Key: SPARK-33838 URL: https://issues.apache.org/jira/browse/SPARK-33838 Project: Spark

[jira] [Updated] (SPARK-33838) Add comments about `PURGE` in DropTable and in AlterTableDropPartition

2020-12-18 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33838: --- Summary: Add comments about `PURGE` in DropTable and in AlterTableDropPartition (was: Add comment a

[jira] [Created] (SPARK-33849) Unify v1 and v2 DROP TABLE tests

2020-12-19 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33849: -- Summary: Unify v1 and v2 DROP TABLE tests Key: SPARK-33849 URL: https://issues.apache.org/jira/browse/SPARK-33849 Project: Spark Issue Type: Sub-task C

[jira] [Updated] (SPARK-33849) Unify v1 and v2 DROP TABLE tests

2020-12-19 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33849: --- Description: Extract DROP TABLE tests to the common place to run them for V1 and v2 datasources. Som

[jira] [Created] (SPARK-33858) Unify v1 and v2 ALTER TABLE .. RENAME PARTITION tests

2020-12-20 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33858: -- Summary: Unify v1 and v2 ALTER TABLE .. RENAME PARTITION tests Key: SPARK-33858 URL: https://issues.apache.org/jira/browse/SPARK-33858 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33858) Unify v1 and v2 ALTER TABLE .. RENAME PARTITION tests

2020-12-20 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33858: --- Description: Extract ALTER TABLE .. RENAME PARTITION tests to the common place to run them for V1 an

[jira] [Commented] (SPARK-33858) Unify v1 and v2 ALTER TABLE .. RENAME PARTITION tests

2020-12-20 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252373#comment-17252373 ] Maxim Gekk commented on SPARK-33858: I am working on this. > Unify v1 and v2 ALTER

[jira] [Created] (SPARK-33859) Support V2 ALTER TABLE .. RENAME PARTITION

2020-12-20 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33859: -- Summary: Support V2 ALTER TABLE .. RENAME PARTITION Key: SPARK-33859 URL: https://issues.apache.org/jira/browse/SPARK-33859 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-33862) Throw `PartitionAlreadyExistsException` if the target partition exists in Hive v1 Table Catalog

2020-12-20 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33862: -- Summary: Throw `PartitionAlreadyExistsException` if the target partition exists in Hive v1 Table Catalog Key: SPARK-33862 URL: https://issues.apache.org/jira/browse/SPARK-33862

[jira] [Commented] (SPARK-33875) Implement DESCRIBE COLUMN for v2 catalog

2020-12-21 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17253291#comment-17253291 ] Maxim Gekk commented on SPARK-33875: [~imback82] Could you convert this to a sub-tas

[jira] [Created] (SPARK-33878) The test "SPARK-33305: DROP TABLE should also invalidate cache" fails for v1 Hive catalog

2020-12-21 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33878: -- Summary: The test "SPARK-33305: DROP TABLE should also invalidate cache" fails for v1 Hive catalog Key: SPARK-33878 URL: https://issues.apache.org/jira/browse/SPARK-33878

[jira] [Updated] (SPARK-33787) Support partition purging by `SupportsPartitionManagement`

2020-12-22 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33787: --- Summary: Support partition purging by `SupportsPartitionManagement` (was: Add `purge` to `dropParti

[jira] [Updated] (SPARK-33787) Support partition purging by `SupportsPartitionManagement`

2020-12-22 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33787: --- Description: Add new method `purgePartition` in `SupportsPartitionManagement` and `purgePartitions`

[jira] [Created] (SPARK-33881) Check null and empty string as partition values in v1 and v2 tests

2020-12-22 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33881: -- Summary: Check null and empty string as partition values in v1 and v2 tests Key: SPARK-33881 URL: https://issues.apache.org/jira/browse/SPARK-33881 Project: Spark

[jira] [Updated] (SPARK-33889) NPE from SHOW PARTITIONS for null partition values

2020-12-23 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33889: --- Description: The following test fails with NPE on V2 table: {code:scala} test("null and empty stri

[jira] [Created] (SPARK-33889) NPE from SHOW PARTITIONS for null partition values

2020-12-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33889: -- Summary: NPE from SHOW PARTITIONS for null partition values Key: SPARK-33889 URL: https://issues.apache.org/jira/browse/SPARK-33889 Project: Spark Issue Type: Su

[jira] [Created] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

2020-12-24 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33899: -- Summary: v1 SHOW TABLES fails with assert on spark_catalog Key: SPARK-33899 URL: https://issues.apache.org/jira/browse/SPARK-33899 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-33904) Recognize `spark_catalog` in `saveAsTable()` and `insertInto()`

2020-12-24 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33904: -- Summary: Recognize `spark_catalog` in `saveAsTable()` and `insertInto()` Key: SPARK-33904 URL: https://issues.apache.org/jira/browse/SPARK-33904 Project: Spark

[jira] [Resolved] (SPARK-33830) Describe the PURGE option of ALTER TABLE .. DROP PARTITION

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-33830. Resolution: Won't Fix > Describe the PURGE option of ALTER TABLE .. DROP PARTITION > -

[jira] [Created] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33911: -- Summary: Update SQL migration guide about changes in HiveClientImpl Key: SPARK-33911 URL: https://issues.apache.org/jira/browse/SPARK-33911 Project: Spark Issue

[jira] [Updated] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33911: --- Affects Version/s: (was: 2.4.8) (was: 3.1.0) > Update SQL migration g

[jira] [Updated] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33911: --- Affects Version/s: 3.1.0 > Update SQL migration guide about changes in HiveClientImpl >

[jira] [Updated] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33911: --- Affects Version/s: 2.4.8 > Update SQL migration guide about changes in HiveClientImpl >

[jira] [Updated] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33911: --- Affects Version/s: 3.0.2 > Update SQL migration guide about changes in HiveClientImpl >

[jira] [Commented] (SPARK-33804) Cleanup "view bounds are deprecated" compilation warnings

2020-12-25 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17254767#comment-17254767 ] Maxim Gekk commented on SPARK-33804: [~LuciferYang] Could you convert this (and your

[jira] [Created] (SPARK-33914) Describe the structure of unified v1 and v2 tests

2020-12-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33914: -- Summary: Describe the structure of unified v1 and v2 tests Key: SPARK-33914 URL: https://issues.apache.org/jira/browse/SPARK-33914 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-33919) Unify v1 and v2 SHOW NAMESPACES tests

2020-12-26 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33919: -- Summary: Unify v1 and v2 SHOW NAMESPACES tests Key: SPARK-33919 URL: https://issues.apache.org/jira/browse/SPARK-33919 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

2020-12-28 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33924: -- Summary: v2 INSERT INTO .. PARTITION drops the partition location Key: SPARK-33924 URL: https://issues.apache.org/jira/browse/SPARK-33924 Project: Spark Issue Ty

[jira] [Created] (SPARK-33926) Improve the error message in resolving of DSv1 multi-part identifiers

2020-12-28 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33926: -- Summary: Improve the error message in resolving of DSv1 multi-part identifiers Key: SPARK-33926 URL: https://issues.apache.org/jira/browse/SPARK-33926 Project: Spark

[jira] [Created] (SPARK-33936) Add the version when connector methods and interfaces were added

2020-12-29 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33936: -- Summary: Add the version when connector methods and interfaces were added Key: SPARK-33936 URL: https://issues.apache.org/jira/browse/SPARK-33936 Project: Spark

[jira] [Created] (SPARK-33941) ALTER TABLE .. DROP PARTITION doesn't invalidate the cache

2020-12-30 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33941: -- Summary: ALTER TABLE .. DROP PARTITION doesn't invalidate the cache Key: SPARK-33941 URL: https://issues.apache.org/jira/browse/SPARK-33941 Project: Spark Issue

[jira] [Commented] (SPARK-33941) ALTER TABLE .. DROP PARTITION doesn't invalidate the cache

2020-12-30 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17256403#comment-17256403 ] Maxim Gekk commented on SPARK-33941: I am working on a bug fix. > ALTER TABLE .. DR

[jira] [Updated] (SPARK-33941) ALTER TABLE .. DROP PARTITION doesn't invalidate the cache

2020-12-30 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33941: --- Affects Version/s: 2.4.7 > ALTER TABLE .. DROP PARTITION doesn't invalidate the cache >

[jira] [Created] (SPARK-33950) ALTER TABLE .. DROP PARTITION doesn't refresh cache

2020-12-31 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33950: -- Summary: ALTER TABLE .. DROP PARTITION doesn't refresh cache Key: SPARK-33950 URL: https://issues.apache.org/jira/browse/SPARK-33950 Project: Spark Issue Type: B

[jira] [Created] (SPARK-33963) `isCached` return `false` for cached Hive table

2021-01-02 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33963: -- Summary: `isCached` return `false` for cached Hive table Key: SPARK-33963 URL: https://issues.apache.org/jira/browse/SPARK-33963 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-33963) `isCached` return `false` for cached Hive table

2021-01-02 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17257483#comment-17257483 ] Maxim Gekk commented on SPARK-33963: I am working on a bug fix. > `isCached` return

[jira] [Created] (SPARK-33965) CACHE TABLE does not support `spark_catalog` in Hive table names

2021-01-03 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33965: -- Summary: CACHE TABLE does not support `spark_catalog` in Hive table names Key: SPARK-33965 URL: https://issues.apache.org/jira/browse/SPARK-33965 Project: Spark

[jira] [Created] (SPARK-33987) v2 ALTER TABLE .. DROP PARTITION does not refresh cached table

2021-01-04 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33987: -- Summary: v2 ALTER TABLE .. DROP PARTITION does not refresh cached table Key: SPARK-33987 URL: https://issues.apache.org/jira/browse/SPARK-33987 Project: Spark I

[jira] [Commented] (SPARK-33987) v2 ALTER TABLE .. DROP PARTITION does not refresh cached table

2021-01-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258179#comment-17258179 ] Maxim Gekk commented on SPARK-33987: I am working on this > v2 ALTER TABLE .. DROP

[jira] [Commented] (SPARK-33990) v2 ALTER TABLE .. DROP PARTITION does not remove data from dropped partition

2021-01-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258183#comment-17258183 ] Maxim Gekk commented on SPARK-33990: I am working on the issue. > v2 ALTER TABLE ..

[jira] [Created] (SPARK-33990) v2 ALTER TABLE .. DROP PARTITION does not remove data from dropped partition

2021-01-04 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33990: -- Summary: v2 ALTER TABLE .. DROP PARTITION does not remove data from dropped partition Key: SPARK-33990 URL: https://issues.apache.org/jira/browse/SPARK-33990 Project: Spa

[jira] [Commented] (SPARK-33995) Make datetime addition easier for years, weeks, hours, minutes, and seconds

2021-01-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258718#comment-17258718 ] Maxim Gekk commented on SPARK-33995: > Option 1: Single make_interval function that

[jira] [Updated] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34011: --- Description: Here is the example to reproduce the issue: {code:sql} spark-sql> CREATE TABLE tbl1 (co

[jira] [Commented] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258818#comment-17258818 ] Maxim Gekk commented on SPARK-34011: I am working on the issue. > ALTER TABLE .. RE

[jira] [Created] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34011: -- Summary: ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache Key: SPARK-34011 URL: https://issues.apache.org/jira/browse/SPARK-34011 Project: Spark Issue Ty

[jira] [Issue Comment Deleted] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34011: --- Comment: was deleted (was: I am working on the issue.) > ALTER TABLE .. RENAME TO PARTITION doesn't

[jira] [Created] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-06 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34027: -- Summary: ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache Key: SPARK-34027 URL: https://issues.apache.org/jira/browse/SPARK-34027 Project: Spark Issue Typ

[jira] [Updated] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34027: --- Description: Here is the example to reproduce the issue: {code:sql} spark-sql> create table tbl (col

[jira] [Updated] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34027: --- Description: Here is the example to reproduce the issue: {code:sql} spark-sql> create table tbl (col

[jira] [Created] (SPARK-34048) Check the amount of calls to Hive external catalog

2021-01-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34048: -- Summary: Check the amount of calls to Hive external catalog Key: SPARK-34048 URL: https://issues.apache.org/jira/browse/SPARK-34048 Project: Spark Issue Type: Su

[jira] [Created] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34055: -- Summary: ALTER TABLE .. ADD PARTITION doesn't refresh cache Key: SPARK-34055 URL: https://issues.apache.org/jira/browse/SPARK-34055 Project: Spark Issue Type: Bu

[jira] [Updated] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34055: --- Description: Here is the example to reproduce the issue: {code:sql} spark-sql> create table tbl2 (co

[jira] [Created] (SPARK-34056) Unify v1 and v2 ALTER TABLE .. RECOVER PARTITIONS tests

2021-01-09 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34056: -- Summary: Unify v1 and v2 ALTER TABLE .. RECOVER PARTITIONS tests Key: SPARK-34056 URL: https://issues.apache.org/jira/browse/SPARK-34056 Project: Spark Issue Typ

[jira] [Updated] (SPARK-34056) Unify v1 and v2 ALTER TABLE .. RECOVER PARTITIONS tests

2021-01-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34056: --- Description: Extract ALTER TABLE .. RECOVER PARTITIONS tests to the common place to run them for V1

[jira] [Created] (SPARK-34060) ALTER TABLE .. DROP PARTITION uncaches Hive table while updating table stats

2021-01-10 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34060: -- Summary: ALTER TABLE .. DROP PARTITION uncaches Hive table while updating table stats Key: SPARK-34060 URL: https://issues.apache.org/jira/browse/SPARK-34060 Project: Spa

[jira] [Created] (SPARK-34062) Call updateTableStats() from AlterTableAddPartitionCommand

2021-01-10 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34062: -- Summary: Call updateTableStats() from AlterTableAddPartitionCommand Key: SPARK-34062 URL: https://issues.apache.org/jira/browse/SPARK-34062 Project: Spark Issue

[jira] [Updated] (SPARK-34062) Call updateTableStats() from AlterTableAddPartitionCommand

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34062: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Improvement) > Call updateTableStats() from

[jira] [Updated] (SPARK-34060) ALTER TABLE .. DROP PARTITION uncaches Hive table while updating table stats

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34060: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > ALTER TABLE .. DROP PARTITION uncache

[jira] [Updated] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34055: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > ALTER TABLE .. ADD PARTITION doesn't

[jira] [Updated] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34027: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > ALTER TABLE .. RECOVER PARTITIONS doe

[jira] [Updated] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34011: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > ALTER TABLE .. RENAME TO PARTITION do

[jira] [Updated] (SPARK-33963) `isCached` return `false` for cached Hive table

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33963: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > `isCached` return `false` for cached

[jira] [Updated] (SPARK-33950) ALTER TABLE .. DROP PARTITION doesn't refresh cache

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33950: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > ALTER TABLE .. DROP PARTITION doesn't

[jira] [Updated] (SPARK-33941) ALTER TABLE .. DROP PARTITION doesn't invalidate the cache

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33941: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > ALTER TABLE .. DROP PARTITION doesn't

[jira] [Created] (SPARK-34071) Check stats of cached table after altering

2021-01-11 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34071: -- Summary: Check stats of cached table after altering Key: SPARK-34071 URL: https://issues.apache.org/jira/browse/SPARK-34071 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34071) Check stats of cached table after altering

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34071: --- Description: 1. Port the test added by https://github.com/apache/spark/pull/31112 for `ALTER TABLE

[jira] [Created] (SPARK-34074) Update stats when table size changes

2021-01-11 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34074: -- Summary: Update stats when table size changes Key: SPARK-34074 URL: https://issues.apache.org/jira/browse/SPARK-34074 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-34084) ALTER TABLE .. ADD PARTITION does not update table stats

2021-01-12 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34084: -- Summary: ALTER TABLE .. ADD PARTITION does not update table stats Key: SPARK-34084 URL: https://issues.apache.org/jira/browse/SPARK-34084 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-34062) Call updateTableStats() from AlterTableAddPartitionCommand

2021-01-13 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-34062. Resolution: Won't Do > Call updateTableStats() from AlterTableAddPartitionCommand > --

[jira] [Created] (SPARK-34099) Refactor table caching in `DataSourceV2Strategy`

2021-01-13 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34099: -- Summary: Refactor table caching in `DataSourceV2Strategy` Key: SPARK-34099 URL: https://issues.apache.org/jira/browse/SPARK-34099 Project: Spark Issue Type: Impr

[jira] [Created] (SPARK-30416) Log a warning for deprecated SQL config in `set()` and `unset()`

2020-01-03 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30416: -- Summary: Log a warning for deprecated SQL config in `set()` and `unset()` Key: SPARK-30416 URL: https://issues.apache.org/jira/browse/SPARK-30416 Project: Spark

[jira] [Created] (SPARK-30429) WideSchemaBenchmark fails with OOM

2020-01-05 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30429: -- Summary: WideSchemaBenchmark fails with OOM Key: SPARK-30429 URL: https://issues.apache.org/jira/browse/SPARK-30429 Project: Spark Issue Type: Bug Comp

[jira] [Updated] (SPARK-30429) WideSchemaBenchmark fails with OOM

2020-01-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30429: --- Attachment: WideSchemaBenchmark_console.txt > WideSchemaBenchmark fails with OOM > -

[jira] [Commented] (SPARK-30429) WideSchemaBenchmark fails with OOM

2020-01-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009189#comment-17009189 ] Maxim Gekk commented on SPARK-30429: [~dongjoon] I ran git bisect. Let see what it w

[jira] [Commented] (SPARK-30429) WideSchemaBenchmark fails with OOM

2020-01-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009398#comment-17009398 ] Maxim Gekk commented on SPARK-30429: Bisect have found the first bad commit. I speci

[jira] [Commented] (SPARK-30442) Write mode ignored when using CodecStreams

2020-01-07 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009963#comment-17009963 ] Maxim Gekk commented on SPARK-30442: > This can cause issues, particularly with aws

[jira] [Created] (SPARK-30482) Add sub-class of AppenderSkeleton reusable in tests

2020-01-10 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30482: -- Summary: Add sub-class of AppenderSkeleton reusable in tests Key: SPARK-30482 URL: https://issues.apache.org/jira/browse/SPARK-30482 Project: Spark Issue Type: T

[jira] [Updated] (SPARK-30482) Add sub-class of AppenderSkeleton reusable in tests

2020-01-10 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30482: --- Component/s: (was: SQL) > Add sub-class of AppenderSkeleton reusable in tests >

[jira] [Created] (SPARK-30485) Remove SQL configs deprecated before v2.4

2020-01-10 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30485: -- Summary: Remove SQL configs deprecated before v2.4 Key: SPARK-30485 URL: https://issues.apache.org/jira/browse/SPARK-30485 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-30485) Remove SQL configs deprecated before v2.4

2020-01-10 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012678#comment-17012678 ] Maxim Gekk commented on SPARK-30485: [~dongjoon] [~srowen] [~cloud_fan] [~hyukjin.kw

[jira] [Updated] (SPARK-30485) Remove SQL configs deprecated before v2.4

2020-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30485: --- Description: Remove the following SQL configs: * spark.sql.variable.substitute.depth * spark.sql.e

[jira] [Created] (SPARK-30490) Eliminate deprecation warning in Avro datasource

2020-01-11 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30490: -- Summary: Eliminate deprecation warning in Avro datasource Key: SPARK-30490 URL: https://issues.apache.org/jira/browse/SPARK-30490 Project: Spark Issue Type: Sub-

[jira] [Updated] (SPARK-30490) Eliminate warnings in Avro datasource

2020-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30490: --- Summary: Eliminate warnings in Avro datasource (was: Eliminate deprecation warning in Avro datasour

[jira] [Created] (SPARK-30492) Eliminate deprecation warning in ORC datasource

2020-01-12 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30492: -- Summary: Eliminate deprecation warning in ORC datasource Key: SPARK-30492 URL: https://issues.apache.org/jira/browse/SPARK-30492 Project: Spark Issue Type: Sub-t

[jira] [Updated] (SPARK-30492) Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30492: --- Summary: Eliminate deprecation warnings in ORC datasource (was: Eliminate deprecation warning in OR

[jira] [Created] (SPARK-30499) Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone

2020-01-13 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30499: -- Summary: Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone Key: SPARK-30499 URL: https://issues.apache.org/jira/browse/SPARK-30499 Project: Spark

[jira] [Created] (SPARK-30500) Remove SQL config spark.sql.variable.substitute.depth

2020-01-13 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30500: -- Summary: Remove SQL config spark.sql.variable.substitute.depth Key: SPARK-30500 URL: https://issues.apache.org/jira/browse/SPARK-30500 Project: Spark Issue Type:

[jira] [Created] (SPARK-30501) Remove SQL config spark.sql.parquet.int64AsTimestampMillis

2020-01-13 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30501: -- Summary: Remove SQL config spark.sql.parquet.int64AsTimestampMillis Key: SPARK-30501 URL: https://issues.apache.org/jira/browse/SPARK-30501 Project: Spark Issue

[jira] [Created] (SPARK-30505) Deprecate Avro option `ignoreExtension` in a doc

2020-01-13 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30505: -- Summary: Deprecate Avro option `ignoreExtension` in a doc Key: SPARK-30505 URL: https://issues.apache.org/jira/browse/SPARK-30505 Project: Spark Issue Type: Docu

[jira] [Resolved] (SPARK-30492) Eliminate deprecation warnings in ORC datasource

2020-01-13 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-30492. Resolution: Won't Fix > Eliminate deprecation warnings in ORC datasource > ---

[jira] [Created] (SPARK-30509) Deprecation log warning is not printed in Avro schema inferring

2020-01-14 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30509: -- Summary: Deprecation log warning is not printed in Avro schema inferring Key: SPARK-30509 URL: https://issues.apache.org/jira/browse/SPARK-30509 Project: Spark

[jira] [Resolved] (SPARK-30490) Eliminate warnings in Avro datasource

2020-01-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-30490. Resolution: Won't Fix See [https://github.com/apache/spark/pull/27174#discussion_r365629991] > El

[jira] [Resolved] (SPARK-30171) Eliminate warnings: part2

2020-01-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-30171. Resolution: Won't Fix As per discussion in  [https://github.com/apache/spark/pull/27174#discussion

<    3   4   5   6   7   8   9   10   11   12   >