[jira] [Created] (SPARK-34727) Difference in results of casting float to timestamp

Maxim Gekk created SPARK-34727: -- Summary: Difference in results of casting float to timestamp Key: SPARK-34727 URL: https://issues.apache.org/jira/browse/SPARK-34727 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34727) Difference in results of casting float to timestamp

[ https://issues.apache.org/jira/browse/SPARK-34727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300263#comment-17300263 ] Maxim Gekk commented on SPARK-34727: I am working on a fix. > Difference in results of casting

[jira] [Commented] (SPARK-34721) Add an year-month interval to a date

[ https://issues.apache.org/jira/browse/SPARK-34721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299834#comment-17299834 ] Maxim Gekk commented on SPARK-34721: I am working on this. > Add an year-month interval to a date >

[jira] [Created] (SPARK-34721) Add an year-month interval to a date

Maxim Gekk created SPARK-34721: -- Summary: Add an year-month interval to a date Key: SPARK-34721 URL: https://issues.apache.org/jira/browse/SPARK-34721 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34718) Assign pretty names to YearMonthIntervalType and DayTimeIntervalType

Maxim Gekk created SPARK-34718: -- Summary: Assign pretty names to YearMonthIntervalType and DayTimeIntervalType Key: SPARK-34718 URL: https://issues.apache.org/jira/browse/SPARK-34718 Project: Spark

[jira] [Created] (SPARK-34716) Support ANSI SQL intervals by the aggregate function `sum`

Maxim Gekk created SPARK-34716: -- Summary: Support ANSI SQL intervals by the aggregate function `sum` Key: SPARK-34716 URL: https://issues.apache.org/jira/browse/SPARK-34716 Project: Spark Issue

[jira] [Updated] (SPARK-34715) Add round trip tests for period <-> month and duration <-> micros

[ https://issues.apache.org/jira/browse/SPARK-34715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34715: --- Description: Similarly to the test from the PR https://github.com/apache/spark/pull/31799,  add

[jira] [Created] (SPARK-34715) Add round trip tests for period <-> month and duration <-> micros

Maxim Gekk created SPARK-34715: -- Summary: Add round trip tests for period <-> month and duration <-> micros Key: SPARK-34715 URL: https://issues.apache.org/jira/browse/SPARK-34715 Project: Spark

[jira] [Commented] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299345#comment-17299345 ] Maxim Gekk commented on SPARK-34675: > Could you link the original related patch and close this

[jira] [Commented] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299086#comment-17299086 ] Maxim Gekk commented on SPARK-34675: Here is the output on the current master (the same result for

[jira] [Created] (SPARK-34695) Overflow in round trip conversion from micros to duration

Maxim Gekk created SPARK-34695: -- Summary: Overflow in round trip conversion from micros to duration Key: SPARK-34695 URL: https://issues.apache.org/jira/browse/SPARK-34695 Project: Spark Issue

[jira] [Created] (SPARK-34677) Support add and subtract of ANSI SQL intervals

Maxim Gekk created SPARK-34677: -- Summary: Support add and subtract of ANSI SQL intervals Key: SPARK-34677 URL: https://issues.apache.org/jira/browse/SPARK-34677 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298233#comment-17298233 ] Maxim Gekk commented on SPARK-34675: > Set session timezone to America/Los_Angeles > scala>

[jira] [Updated] (SPARK-34668) Support casting of day-time intervals to strings

[ https://issues.apache.org/jira/browse/SPARK-34668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34668: --- Description: Extend the Cast expression and support DayTimeIntervalType in casting to StringType.

[jira] [Created] (SPARK-34668) Support casting of day-time intervals to strings

Maxim Gekk created SPARK-34668: -- Summary: Support casting of day-time intervals to strings Key: SPARK-34668 URL: https://issues.apache.org/jira/browse/SPARK-34668 Project: Spark Issue Type:

[jira] [Created] (SPARK-34667) Support casting of year-month intervals to strings

Maxim Gekk created SPARK-34667: -- Summary: Support casting of year-month intervals to strings Key: SPARK-34667 URL: https://issues.apache.org/jira/browse/SPARK-34667 Project: Spark Issue Type:

[jira] [Created] (SPARK-34666) Test DayTimeIntervalType/YearMonthIntervalType as ordered and atomic types

Maxim Gekk created SPARK-34666: -- Summary: Test DayTimeIntervalType/YearMonthIntervalType as ordered and atomic types Key: SPARK-34666 URL: https://issues.apache.org/jira/browse/SPARK-34666 Project:

[jira] [Created] (SPARK-34663) Test year-month and day-time intervals in UDF

Maxim Gekk created SPARK-34663: -- Summary: Test year-month and day-time intervals in UDF Key: SPARK-34663 URL: https://issues.apache.org/jira/browse/SPARK-34663 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34615) Support java.time.Period as an external type of the year-month interval type

[ https://issues.apache.org/jira/browse/SPARK-34615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296540#comment-17296540 ] Maxim Gekk commented on SPARK-34615: I am working on this sub-task. > Support java.time.Period as

[jira] [Created] (SPARK-34619) Update the Spark SQL guide about day-time and year-month interval types

Maxim Gekk created SPARK-34619: -- Summary: Update the Spark SQL guide about day-time and year-month interval types Key: SPARK-34619 URL: https://issues.apache.org/jira/browse/SPARK-34619 Project: Spark

[jira] [Updated] (SPARK-34615) Support java.time.Period as an external type of the year-month interval type

[ https://issues.apache.org/jira/browse/SPARK-34615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34615: --- Description: Allow parallelization/collection of java.time.Period values, and convert the values to

[jira] [Created] (SPARK-34615) Support java.time.Period as an external type of the year-month interval type

Maxim Gekk created SPARK-34615: -- Summary: Support java.time.Period as an external type of the year-month interval type Key: SPARK-34615 URL: https://issues.apache.org/jira/browse/SPARK-34615 Project:

[jira] [Updated] (SPARK-34605) Support java.time.Duration as an external type of the day-time interval type

[ https://issues.apache.org/jira/browse/SPARK-34605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34605: --- Summary: Support java.time.Duration as an external type of the day-time interval type (was:

[jira] [Commented] (SPARK-34605) Support java.time.Duration as an external type for the day-time interval type

[ https://issues.apache.org/jira/browse/SPARK-34605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294395#comment-17294395 ] Maxim Gekk commented on SPARK-34605: I am working on the sub-task. > Support java.time.Duration as

[jira] [Created] (SPARK-34605) Support java.time.Duration as an external type for the day-time interval type

Maxim Gekk created SPARK-34605: -- Summary: Support java.time.Duration as an external type for the day-time interval type Key: SPARK-34605 URL: https://issues.apache.org/jira/browse/SPARK-34605 Project:

[jira] [Updated] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Description: Spark has an INTERVAL data type, but it is “broken”: # It cannot be persisted # It is

[jira] [Updated] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Description: Spark has an INTERVAL data type, but it is “broken”: # It cannot be persisted # It is

[jira] [Updated] (SPARK-27793) Add ANSI SQL day-time and year-month interval types

[ https://issues.apache.org/jira/browse/SPARK-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27793: --- Summary: Add ANSI SQL day-time and year-month interval types (was: Add day-time and year-month

[jira] [Updated] (SPARK-27791) Support SQL year-month INTERVAL type

[ https://issues.apache.org/jira/browse/SPARK-27791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27791: --- Parent: (was: SPARK-27790) Issue Type: Improvement (was: Sub-task) > Support SQL

[jira] [Resolved] (SPARK-27791) Support SQL year-month INTERVAL type

[ https://issues.apache.org/jira/browse/SPARK-27791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-27791. Resolution: Won't Fix > Support SQL year-month INTERVAL type >

[jira] [Updated] (SPARK-27793) Add day-time and year-month interval types

[ https://issues.apache.org/jira/browse/SPARK-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27793: --- Description: Extend Catalyst's type system by two new types that conform to the SQL standard (see

[jira] [Updated] (SPARK-27793) Add day-time and year-month interval types

[ https://issues.apache.org/jira/browse/SPARK-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27793: --- Summary: Add day-time and year-month interval types (was: Support SQL day-time INTERVAL type) >

[jira] [Updated] (SPARK-27793) Support SQL day-time INTERVAL type

[ https://issues.apache.org/jira/browse/SPARK-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27793: --- Affects Version/s: (was: 2.4.3) 3.2.0 > Support SQL day-time INTERVAL

[jira] [Updated] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Description: Spark has an INTERVAL data type, but it is “broken”: # It cannot be persisted # It is

[jira] [Updated] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Description: Spark has an INTERVAL data type, but it is “broken”: # It cannot be persisted # It is

[jira] [Issue Comment Deleted] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Comment: was deleted (was: I am working on it.) > Support ANSI SQL INTERVAL types >

[jira] [Updated] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Issue Type: Improvement (was: New Feature) > Support ANSI SQL INTERVAL types >

[jira] [Updated] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Summary: Support ANSI SQL INTERVAL types (was: Support SQL INTERVAL types) > Support ANSI SQL

[jira] [Commented] (SPARK-34564) DateTimeUtils.fromJavaDate fails for very late dates during casting to Int

[ https://issues.apache.org/jira/browse/SPARK-34564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292427#comment-17292427 ] Maxim Gekk commented on SPARK-34564: We changed the behavior intentionally because we do believe

[jira] [Created] (SPARK-34561) Cannot drop/add columns from/to a dataset of v2 `DESCRIBE TABLE`

Maxim Gekk created SPARK-34561: -- Summary: Cannot drop/add columns from/to a dataset of v2 `DESCRIBE TABLE` Key: SPARK-34561 URL: https://issues.apache.org/jira/browse/SPARK-34561 Project: Spark

[jira] [Created] (SPARK-34560) Cannot join datasets of SHOW TABLES

Maxim Gekk created SPARK-34560: -- Summary: Cannot join datasets of SHOW TABLES Key: SPARK-34560 URL: https://issues.apache.org/jira/browse/SPARK-34560 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-34447) Refactor the unified v1 and v2 command tests

[ https://issues.apache.org/jira/browse/SPARK-34447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34447: --- Description: The ticket aims to gather potential improvements for the unified tests. 1. Remove

[jira] [Created] (SPARK-34554) Implement the copy() method in ColumnarMap

Maxim Gekk created SPARK-34554: -- Summary: Implement the copy() method in ColumnarMap Key: SPARK-34554 URL: https://issues.apache.org/jira/browse/SPARK-34554 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

[ https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34543: --- Fix Version/s: (was: 3.0.2) (was: 2.4.8) (was:

[jira] [Updated] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

[ https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34543: --- Affects Version/s: (was: 3.0.1) (was: 3.1.0)

[jira] [Updated] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

[ https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34543: --- Description: SHOW PARTITIONS is case sensitive, and doesn't respect the SQL config

[jira] [Created] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

Maxim Gekk created SPARK-34543: -- Summary: Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION Key: SPARK-34543 URL: https://issues.apache.org/jira/browse/SPARK-34543 Project: Spark Issue

[jira] [Updated] (SPARK-34447) Refactor the unified v1 and v2 command tests

[ https://issues.apache.org/jira/browse/SPARK-34447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34447: --- Description: The ticket aims to gather potential improvements for the unified tests. 1. Remove

[jira] [Created] (SPARK-34518) Rename `AlterTableRecoverPartitionsCommand` to `RepairTableCommand`

Maxim Gekk created SPARK-34518: -- Summary: Rename `AlterTableRecoverPartitionsCommand` to `RepairTableCommand` Key: SPARK-34518 URL: https://issues.apache.org/jira/browse/SPARK-34518 Project: Spark

[jira] [Updated] (SPARK-27790) Support SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Affects Version/s: (was: 3.1.0) 3.2.0 > Support SQL INTERVAL types >

[jira] [Updated] (SPARK-34447) Refactor the unified v1 and v2 command tests

[ https://issues.apache.org/jira/browse/SPARK-34447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34447: --- Description: The ticket aims to gather potential improvements for the unified tests. 1. Remove

[jira] [Updated] (SPARK-34475) Rename v2 logical nodes

[ https://issues.apache.org/jira/browse/SPARK-34475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34475: --- Description: Rename v2 logical nodes for simplicity in the form: +   (was: To be consistent with

[jira] [Created] (SPARK-34475) Rename v2 logical nodes

Maxim Gekk created SPARK-34475: -- Summary: Rename v2 logical nodes Key: SPARK-34475 URL: https://issues.apache.org/jira/browse/SPARK-34475 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-34302) Migrate ALTER TABLE .. CHANGE COLUMN to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-34302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286842#comment-17286842 ] Maxim Gekk commented on SPARK-34302: [~imback82] I don't plan to work on this in the near future.

[jira] [Created] (SPARK-34468) Fix v2 ALTER TABLE .. RENAME TO

Maxim Gekk created SPARK-34468: -- Summary: Fix v2 ALTER TABLE .. RENAME TO Key: SPARK-34468 URL: https://issues.apache.org/jira/browse/SPARK-34468 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34466) Improve docs for ALTER TABLE .. RENAME TO

Maxim Gekk created SPARK-34466: -- Summary: Improve docs for ALTER TABLE .. RENAME TO Key: SPARK-34466 URL: https://issues.apache.org/jira/browse/SPARK-34466 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-34439) Recognize `spark_catalog` in new identifier while view/table renaming

[ https://issues.apache.org/jira/browse/SPARK-34439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-34439. Resolution: Won't Fix > Recognize `spark_catalog` in new identifier while view/table renaming >

[jira] [Updated] (SPARK-34465) Rename alter table exec nodes

[ https://issues.apache.org/jira/browse/SPARK-34465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34465: --- Description: To be consistent with other exec nodes, rename: * AlterTableAddPartitionExec ->

[jira] [Created] (SPARK-34465) Rename alter table exec nodes

Maxim Gekk created SPARK-34465: -- Summary: Rename alter table exec nodes Key: SPARK-34465 URL: https://issues.apache.org/jira/browse/SPARK-34465 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34455) Deprecate spark.sql.legacy.replaceDatabricksSparkAvro.enabled

Maxim Gekk created SPARK-34455: -- Summary: Deprecate spark.sql.legacy.replaceDatabricksSparkAvro.enabled Key: SPARK-34455 URL: https://issues.apache.org/jira/browse/SPARK-34455 Project: Spark

[jira] [Created] (SPARK-34454) SQL configs from the legacy namespace must be internal

Maxim Gekk created SPARK-34454: -- Summary: SQL configs from the legacy namespace must be internal Key: SPARK-34454 URL: https://issues.apache.org/jira/browse/SPARK-34454 Project: Spark Issue

[jira] [Updated] (SPARK-34454) SQL configs from the legacy namespace must be internal

[ https://issues.apache.org/jira/browse/SPARK-34454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34454: --- Fix Version/s: (was: 3.0.0) > SQL configs from the legacy namespace must be internal >

[jira] [Created] (SPARK-34451) Add alternatives for datetime rebasing SQL configs and deprecate legacy configs

Maxim Gekk created SPARK-34451: -- Summary: Add alternatives for datetime rebasing SQL configs and deprecate legacy configs Key: SPARK-34451 URL: https://issues.apache.org/jira/browse/SPARK-34451 Project:

[jira] [Updated] (SPARK-34450) Unify v1 and v2 ALTER TABLE .. RENAME tests

[ https://issues.apache.org/jira/browse/SPARK-34450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34450: --- Summary: Unify v1 and v2 ALTER TABLE .. RENAME tests (was: Unify v1 and v2 `ALTER TABLE .. RENAME`

[jira] [Updated] (SPARK-34450) Unify v1 and v2 `ALTER TABLE .. RENAME` tests

[ https://issues.apache.org/jira/browse/SPARK-34450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34450: --- Description: Extract ALTER TABLE .. RENAME tests to the common place to run them for V1 and v2

[jira] [Created] (SPARK-34450) Unify v1 and v2 `ALTER TABLE .. RENAME` tests

Maxim Gekk created SPARK-34450: -- Summary: Unify v1 and v2 `ALTER TABLE .. RENAME` tests Key: SPARK-34450 URL: https://issues.apache.org/jira/browse/SPARK-34450 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33381) Unify DSv1 and DSv2 command tests

[ https://issues.apache.org/jira/browse/SPARK-33381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33381: --- Affects Version/s: 3.2.0 > Unify DSv1 and DSv2 command tests > - >

[jira] [Created] (SPARK-34447) Refactor the unified v1 and v2 command tests

Maxim Gekk created SPARK-34447: -- Summary: Refactor the unified v1 and v2 command tests Key: SPARK-34447 URL: https://issues.apache.org/jira/browse/SPARK-34447 Project: Spark Issue Type:

[jira] [Created] (SPARK-34445) Make `spark.sql.legacy.replaceDatabricksSparkAvro.enabled` as non-internal

Maxim Gekk created SPARK-34445: -- Summary: Make `spark.sql.legacy.replaceDatabricksSparkAvro.enabled` as non-internal Key: SPARK-34445 URL: https://issues.apache.org/jira/browse/SPARK-34445 Project:

[jira] [Updated] (SPARK-34440) Allow saving/loading datetime in ORC w/o rebasing

[ https://issues.apache.org/jira/browse/SPARK-34440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34440: --- Affects Version/s: (was: 3.1.0) 3.2.0 > Allow saving/loading datetime in

[jira] [Updated] (SPARK-34440) Allow saving/loading datetime in ORC w/o rebasing

[ https://issues.apache.org/jira/browse/SPARK-34440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34440: --- Fix Version/s: (was: 3.2.0) > Allow saving/loading datetime in ORC w/o rebasing >

[jira] [Updated] (SPARK-34440) Allow saving/loading datetime in ORC w/o rebasing

[ https://issues.apache.org/jira/browse/SPARK-34440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34440: --- Fix Version/s: (was: 3.1.0) 3.2.0 > Allow saving/loading datetime in ORC w/o

[jira] [Updated] (SPARK-34440) Allow saving/loading datetime in ORC w/o rebasing

[ https://issues.apache.org/jira/browse/SPARK-34440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34440: --- Description: Currently, Spark always performs rebasing of date/timestamp columns in ORC datasource

[jira] [Created] (SPARK-34440) Allow saving/loading datetime in ORC w/o rebasing

Maxim Gekk created SPARK-34440: -- Summary: Allow saving/loading datetime in ORC w/o rebasing Key: SPARK-34440 URL: https://issues.apache.org/jira/browse/SPARK-34440 Project: Spark Issue Type:

[jira] [Created] (SPARK-34439) Recognize `spark_catalog` in new identifier while view/table renaming

Maxim Gekk created SPARK-34439: -- Summary: Recognize `spark_catalog` in new identifier while view/table renaming Key: SPARK-34439 URL: https://issues.apache.org/jira/browse/SPARK-34439 Project: Spark

[jira] [Created] (SPARK-34437) Update Spark SQL guide about rebase DS options and SQL configs

Maxim Gekk created SPARK-34437: -- Summary: Update Spark SQL guide about rebase DS options and SQL configs Key: SPARK-34437 URL: https://issues.apache.org/jira/browse/SPARK-34437 Project: Spark

[jira] [Created] (SPARK-34434) Mention DS rebase options in SparkUpgradeException

Maxim Gekk created SPARK-34434: -- Summary: Mention DS rebase options in SparkUpgradeException Key: SPARK-34434 URL: https://issues.apache.org/jira/browse/SPARK-34434 Project: Spark Issue Type:

[jira] [Created] (SPARK-34431) Only load hive-site.xml once

Maxim Gekk created SPARK-34431: -- Summary: Only load hive-site.xml once Key: SPARK-34431 URL: https://issues.apache.org/jira/browse/SPARK-34431 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-34424) HiveOrcHadoopFsRelationSuite fails with seed 610710213676

Maxim Gekk created SPARK-34424: -- Summary: HiveOrcHadoopFsRelationSuite fails with seed 610710213676 Key: SPARK-34424 URL: https://issues.apache.org/jira/browse/SPARK-34424 Project: Spark Issue

[jira] [Created] (SPARK-34418) Check v1 TRUNCATE TABLE preserves partitions

Maxim Gekk created SPARK-34418: -- Summary: Check v1 TRUNCATE TABLE preserves partitions Key: SPARK-34418 URL: https://issues.apache.org/jira/browse/SPARK-34418 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-34392) Invalid ID for offset-based ZoneId since Spark 3.0

[ https://issues.apache.org/jira/browse/SPARK-34392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281838#comment-17281838 ] Maxim Gekk edited comment on SPARK-34392 at 2/9/21, 3:26 PM: - The "GMT+8:00"

[jira] [Commented] (SPARK-34392) Invalid ID for offset-based ZoneId since Spark 3.0

[ https://issues.apache.org/jira/browse/SPARK-34392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281838#comment-17281838 ] Maxim Gekk commented on SPARK-34392: The "GMT+8:00" string is unsupported format in 3.0, see docs

[jira] [Updated] (SPARK-34404) Support Avro datasource options to control datetime rebasing in read

[ https://issues.apache.org/jira/browse/SPARK-34404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34404: --- Description: Add new Avro option similar to the SQL configs 

[jira] [Created] (SPARK-34404) Support Avro datasource options to control datetime rebasing in read

Maxim Gekk created SPARK-34404: -- Summary: Support Avro datasource options to control datetime rebasing in read Key: SPARK-34404 URL: https://issues.apache.org/jira/browse/SPARK-34404 Project: Spark

[jira] [Created] (SPARK-34401) Update public docs about altering cached tables/views

Maxim Gekk created SPARK-34401: -- Summary: Update public docs about altering cached tables/views Key: SPARK-34401 URL: https://issues.apache.org/jira/browse/SPARK-34401 Project: Spark Issue

[jira] [Created] (SPARK-34397) Support v2 `MSCK REPAIR TABLE`

Maxim Gekk created SPARK-34397: -- Summary: Support v2 `MSCK REPAIR TABLE` Key: SPARK-34397 URL: https://issues.apache.org/jira/browse/SPARK-34397 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-34386) "Proleptic" date off by 10 days when returned by .collectAsList

[ https://issues.apache.org/jira/browse/SPARK-34386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280269#comment-17280269 ] Maxim Gekk commented on SPARK-34386: [~bysza] You can find more details in the blog post: 

[jira] [Commented] (SPARK-34386) "Proleptic" date off by 10 days when returned by .collectAsList

[ https://issues.apache.org/jira/browse/SPARK-34386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280268#comment-17280268 ] Maxim Gekk commented on SPARK-34386: [~bysza] Thanks for the ping. This is expected behavior,

[jira] [Updated] (SPARK-34385) Unwrap SparkUpgradeException in v2 Parquet datasource

[ https://issues.apache.org/jira/browse/SPARK-34385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34385: --- Summary: Unwrap SparkUpgradeException in v2 Parquet datasource (was: Unwrap SparkUpgradeException

[jira] [Created] (SPARK-34385) Unwrap SparkUpgradeException in v1 Parquet datasource

Maxim Gekk created SPARK-34385: -- Summary: Unwrap SparkUpgradeException in v1 Parquet datasource Key: SPARK-34385 URL: https://issues.apache.org/jira/browse/SPARK-34385 Project: Spark Issue

[jira] [Created] (SPARK-34377) Support parquet datasource options to control datetime rebasing in read

Maxim Gekk created SPARK-34377: -- Summary: Support parquet datasource options to control datetime rebasing in read Key: SPARK-34377 URL: https://issues.apache.org/jira/browse/SPARK-34377 Project: Spark

[jira] [Created] (SPARK-34371) Run datetime rebasing tests for parquet DSv1 and DSv2

Maxim Gekk created SPARK-34371: -- Summary: Run datetime rebasing tests for parquet DSv1 and DSv2 Key: SPARK-34371 URL: https://issues.apache.org/jira/browse/SPARK-34371 Project: Spark Issue

[jira] [Updated] (SPARK-34360) Support table truncation by v2 Table Catalogs

[ https://issues.apache.org/jira/browse/SPARK-34360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34360: --- Description: Add new method `truncateTable` to the TableCatalog interface with default

[jira] [Created] (SPARK-34360) Support table truncation by v2 Table Catalogs

Maxim Gekk created SPARK-34360: -- Summary: Support table truncation by v2 Table Catalogs Key: SPARK-34360 URL: https://issues.apache.org/jira/browse/SPARK-34360 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34332) Unify v1 and v2 ALTER TABLE .. SET LOCATION tests

[ https://issues.apache.org/jira/browse/SPARK-34332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34332: --- Description: Extract ALTER TABLE .. SET LOCATION tests to the common place to run them for V1 and

[jira] [Created] (SPARK-34332) Unify v1 and v2 ALTER TABLE .. SET LOCATION tests

Maxim Gekk created SPARK-34332: -- Summary: Unify v1 and v2 ALTER TABLE .. SET LOCATION tests Key: SPARK-34332 URL: https://issues.apache.org/jira/browse/SPARK-34332 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34314) Wrong discovered partition value

[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34314: --- Affects Version/s: 3.1.0 3.0.2 2.4.8 > Wrong

[jira] [Created] (SPARK-34314) Wrong discovered partition value

Maxim Gekk created SPARK-34314: -- Summary: Wrong discovered partition value Key: SPARK-34314 URL: https://issues.apache.org/jira/browse/SPARK-34314 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-34312) Support partition truncation by `SupportsPartitionManagement`

[ https://issues.apache.org/jira/browse/SPARK-34312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34312: --- Description: Add new method `truncatePartition` in `SupportsPartitionManagement` and

[jira] [Created] (SPARK-34312) Support partition truncation by `SupportsPartitionManagement`

Maxim Gekk created SPARK-34312: -- Summary: Support partition truncation by `SupportsPartitionManagement` Key: SPARK-34312 URL: https://issues.apache.org/jira/browse/SPARK-34312 Project: Spark

  1   2   3   4   5   6   7   8   9   10   >