[jira] [Commented] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250880#comment-17250880 ] Apache Spark commented on SPARK-33822: -- User 'maropu' has created a pull request for this issue:

[jira] [Updated] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33822: -- Description: **PROBLEM STATEMENT** {code} >>> tables = ['call_center', 'catalog_page',

[jira] [Assigned] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33822: Assignee: (was: Apache Spark) > TPCDS Q5 fails if spark.sql.adaptive.enabled=true >

[jira] [Assigned] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33822: Assignee: Apache Spark > TPCDS Q5 fails if spark.sql.adaptive.enabled=true >

[jira] [Resolved] (SPARK-33823) Use the `CastSupport.cast` method in HashJoin

[ https://issues.apache.org/jira/browse/SPARK-33823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33823. --- Resolution: Duplicate > Use the `CastSupport.cast` method in HashJoin >

[jira] [Commented] (SPARK-33787) Add `purge` to `dropPartition` in `SupportsPartitionManagement`

[ https://issues.apache.org/jira/browse/SPARK-33787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250876#comment-17250876 ] Apache Spark commented on SPARK-33787: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33787) Add `purge` to `dropPartition` in `SupportsPartitionManagement`

[ https://issues.apache.org/jira/browse/SPARK-33787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250877#comment-17250877 ] Apache Spark commented on SPARK-33787: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33819) SingleFileEventLogFileReader/RollingEventLogFilesFileReader should be `package private`

[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250864#comment-17250864 ] Apache Spark commented on SPARK-33819: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Comment Edited] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250832#comment-17250832 ] Dongjoon Hyun edited comment on SPARK-33822 at 12/17/20, 7:25 AM: -- Hi,

[jira] [Comment Edited] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250832#comment-17250832 ] Dongjoon Hyun edited comment on SPARK-33822 at 12/17/20, 7:25 AM: -- Hi,

[jira] [Updated] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33822: -- Affects Version/s: 3.0.0 > TPCDS Q5 fails if spark.sql.adaptive.enabled=true >

[jira] [Updated] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33822: -- Target Version/s: 3.2.0 (was: 3.0.2, 3.2.0) > TPCDS Q5 fails if

[jira] [Updated] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33822: -- Target Version/s: 3.0.2, 3.2.0 (was: 3.2.0) > TPCDS Q5 fails if

[jira] [Commented] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250846#comment-17250846 ] Dongjoon Hyun commented on SPARK-33822: --- Thank you so much, [~maropu]! > TPCDS Q5 fails if

[jira] [Commented] (SPARK-33819) SingleFileEventLogFileReader/RollingEventLogFilesFileReader should be `package private`

[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250845#comment-17250845 ] Apache Spark commented on SPARK-33819: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250842#comment-17250842 ] Takeshi Yamamuro commented on SPARK-33822: -- Ah, I made a PR a minute ago in

[jira] [Updated] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33822: - Target Version/s: 3.2.0 > TPCDS Q5 fails if spark.sql.adaptive.enabled=true >

[jira] [Updated] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33822: - Priority: Blocker (was: Critical) > TPCDS Q5 fails if spark.sql.adaptive.enabled=true >

[jira] [Assigned] (SPARK-33823) Use the `CastSupport.cast` method in HashJoin

[ https://issues.apache.org/jira/browse/SPARK-33823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33823: Assignee: (was: Apache Spark) > Use the `CastSupport.cast` method in HashJoin >

[jira] [Issue Comment Deleted] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33822: - Comment: was deleted (was: I am making it as a blocker.) > TPCDS Q5 fails if

[jira] [Assigned] (SPARK-33823) Use the `CastSupport.cast` method in HashJoin

[ https://issues.apache.org/jira/browse/SPARK-33823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33823: Assignee: Apache Spark > Use the `CastSupport.cast` method in HashJoin >

[jira] [Updated] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33822: - Priority: Critical (was: Major) > TPCDS Q5 fails if spark.sql.adaptive.enabled=true >

[jira] [Commented] (SPARK-33823) Use the `CastSupport.cast` method in HashJoin

[ https://issues.apache.org/jira/browse/SPARK-33823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250839#comment-17250839 ] Apache Spark commented on SPARK-33823: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250838#comment-17250838 ] Hyukjin Kwon commented on SPARK-33822: -- I am making it as a blocker. > TPCDS Q5 fails if

[jira] [Created] (SPARK-33823) Use the `CastSupport.cast` method in HashJoin

Takeshi Yamamuro created SPARK-33823: Summary: Use the `CastSupport.cast` method in HashJoin Key: SPARK-33823 URL: https://issues.apache.org/jira/browse/SPARK-33823 Project: Spark Issue

[jira] [Resolved] (SPARK-33819) SingleFileEventLogFileReader/RollingEventLogFilesFileReader should be `package private`

[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33819. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30814

[jira] [Assigned] (SPARK-33819) SingleFileEventLogFileReader/RollingEventLogFilesFileReader should be `package private`

[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33819: Assignee: Dongjoon Hyun > SingleFileEventLogFileReader/RollingEventLogFilesFileReader

[jira] [Comment Edited] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250832#comment-17250832 ] Dongjoon Hyun edited comment on SPARK-33822 at 12/17/20, 6:52 AM: -- Hi,

[jira] [Comment Edited] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250832#comment-17250832 ] Dongjoon Hyun edited comment on SPARK-33822 at 12/17/20, 6:52 AM: -- Hi,

[jira] [Resolved] (SPARK-33821) Upgrade SBT to 1.4.5

[ https://issues.apache.org/jira/browse/SPARK-33821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33821. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30817

[jira] [Assigned] (SPARK-33821) Upgrade SBT to 1.4.5

[ https://issues.apache.org/jira/browse/SPARK-33821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33821: Assignee: Dongjoon Hyun > Upgrade SBT to 1.4.5 > > >

[jira] [Created] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

Dongjoon Hyun created SPARK-33822: - Summary: TPCDS Q5 fails if spark.sql.adaptive.enabled=true Key: SPARK-33822 URL: https://issues.apache.org/jira/browse/SPARK-33822 Project: Spark Issue

[jira] [Resolved] (SPARK-33697) UnionExec should require column ordering in RemoveRedundantProjects

[ https://issues.apache.org/jira/browse/SPARK-33697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33697. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30659

[jira] [Resolved] (SPARK-33815) Migrate ALTER TABLE SET [SERDE|SERDEPROPERTIES] command to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33815. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30813

[jira] [Assigned] (SPARK-33815) Migrate ALTER TABLE SET [SERDE|SERDEPROPERTIES] command to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33815: --- Assignee: Terry Kim > Migrate ALTER TABLE SET [SERDE|SERDEPROPERTIES] command to the new

[jira] [Commented] (SPARK-33821) Upgrade SBT to 1.4.5

[ https://issues.apache.org/jira/browse/SPARK-33821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250801#comment-17250801 ] Apache Spark commented on SPARK-33821: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33821) Upgrade SBT to 1.4.5

[ https://issues.apache.org/jira/browse/SPARK-33821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33821: Assignee: (was: Apache Spark) > Upgrade SBT to 1.4.5 > > >

[jira] [Assigned] (SPARK-33821) Upgrade SBT to 1.4.5

[ https://issues.apache.org/jira/browse/SPARK-33821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33821: Assignee: Apache Spark > Upgrade SBT to 1.4.5 > > >

[jira] [Commented] (SPARK-33821) Upgrade SBT to 1.4.5

[ https://issues.apache.org/jira/browse/SPARK-33821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250800#comment-17250800 ] Apache Spark commented on SPARK-33821: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-33821) Upgrade SBT to 1.4.5

Dongjoon Hyun created SPARK-33821: - Summary: Upgrade SBT to 1.4.5 Key: SPARK-33821 URL: https://issues.apache.org/jira/browse/SPARK-33821 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-33818) Doc `spark.sql.parser.quotedRegexColumnNames`

[ https://issues.apache.org/jira/browse/SPARK-33818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33818: Assignee: Apache Spark > Doc `spark.sql.parser.quotedRegexColumnNames` >

[jira] [Assigned] (SPARK-33818) Doc `spark.sql.parser.quotedRegexColumnNames`

[ https://issues.apache.org/jira/browse/SPARK-33818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33818: Assignee: (was: Apache Spark) > Doc `spark.sql.parser.quotedRegexColumnNames` >

[jira] [Commented] (SPARK-33818) Doc `spark.sql.parser.quotedRegexColumnNames`

[ https://issues.apache.org/jira/browse/SPARK-33818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250799#comment-17250799 ] Apache Spark commented on SPARK-33818: -- User 'AngersZh' has created a pull request for this

[jira] [Updated] (SPARK-33820) java.lang.ClassCastException: com.example.A cannot be cast to com.example.A when spark.executor.userClassPathFirst is true

[ https://issues.apache.org/jira/browse/SPARK-33820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Moschou updated SPARK-33820: -- Issue Type: Bug (was: Improvement) > java.lang.ClassCastException: com.example.A cannot be

[jira] [Created] (SPARK-33820) java.lang.ClassCastException: com.example.A cannot be cast to com.example.A when spark.executor.userClassPathFirst is true

Terry Moschou created SPARK-33820: - Summary: java.lang.ClassCastException: com.example.A cannot be cast to com.example.A when spark.executor.userClassPathFirst is true Key: SPARK-33820 URL:

[jira] [Updated] (SPARK-33819) SingleFileEventLogFileReader/RollingEventLogFilesFileReader should be `package private`

[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33819: -- Summary: SingleFileEventLogFileReader/RollingEventLogFilesFileReader should be `package

[jira] [Updated] (SPARK-33819) EventLogFileReader and its derived classes should be `package private`

[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33819: -- Labels: releasenotes (was: ) > EventLogFileReader and its derived classes should be `package

[jira] [Updated] (SPARK-33819) EventLogFileReader and its derived classes should be `package private`

[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33819: -- Affects Version/s: 3.0.2 > EventLogFileReader and its derived classes should be `package

[jira] [Commented] (SPARK-33819) EventLogFileReader and its derived classes should be `package private`

[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250793#comment-17250793 ] Apache Spark commented on SPARK-33819: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-33819) EventLogFileReader and its derived classes should be `package private`

[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250790#comment-17250790 ] Apache Spark commented on SPARK-33819: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33819) EventLogFileReader and its derived classes should be `package private`

[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33819: Assignee: (was: Apache Spark) > EventLogFileReader and its derived classes should be

[jira] [Assigned] (SPARK-33819) EventLogFileReader and its derived classes should be `package private`

[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33819: Assignee: Apache Spark > EventLogFileReader and its derived classes should be `package

[jira] [Updated] (SPARK-33819) EventLogFileReader and its derived classes should be `package private`

[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33819: -- Summary: EventLogFileReader and its derived classes should be `package private` (was: Mark

[jira] [Created] (SPARK-33819) Mark EventLogFileReader and its derived classes `package private`

Dongjoon Hyun created SPARK-33819: - Summary: Mark EventLogFileReader and its derived classes `package private` Key: SPARK-33819 URL: https://issues.apache.org/jira/browse/SPARK-33819 Project: Spark

[jira] [Created] (SPARK-33818) Doc `spark.sql.parser.quotedRegexColumnNames`

angerszhu created SPARK-33818: - Summary: Doc `spark.sql.parser.quotedRegexColumnNames` Key: SPARK-33818 URL: https://issues.apache.org/jira/browse/SPARK-33818 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-33811) Support `all_columns_without_dunplicated` complex column expressions

[ https://issues.apache.org/jira/browse/SPARK-33811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-33811. --- Resolution: Won't Fix > Support `all_columns_without_dunplicated` complex column expressions >

[jira] [Commented] (SPARK-33790) Reduce the rpc call of getFileStatus in SingleFileEventLogFileReader

[ https://issues.apache.org/jira/browse/SPARK-33790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250779#comment-17250779 ] Apache Spark commented on SPARK-33790: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33817) Use a logical plan to cache instead of dataframe

[ https://issues.apache.org/jira/browse/SPARK-33817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33817: Assignee: Apache Spark > Use a logical plan to cache instead of dataframe >

[jira] [Commented] (SPARK-33817) Use a logical plan to cache instead of dataframe

[ https://issues.apache.org/jira/browse/SPARK-33817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250780#comment-17250780 ] Apache Spark commented on SPARK-33817: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33817) Use a logical plan to cache instead of dataframe

[ https://issues.apache.org/jira/browse/SPARK-33817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33817: Assignee: (was: Apache Spark) > Use a logical plan to cache instead of dataframe >

[jira] [Created] (SPARK-33817) Use a logical plan to cache instead of dataframe

Terry Kim created SPARK-33817: - Summary: Use a logical plan to cache instead of dataframe Key: SPARK-33817 URL: https://issues.apache.org/jira/browse/SPARK-33817 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-33790) Reduce the rpc call of getFileStatus in SingleFileEventLogFileReader

[ https://issues.apache.org/jira/browse/SPARK-33790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-33790. -- Fix Version/s: 3.2.0 Assignee: dzcxzl Resolution: Fixed Issue resolved via

[jira] [Updated] (SPARK-33799) ExecutorMonitor should handle SparkListenerExecutorExcluded/SparkListenerNodeExcluded

[ https://issues.apache.org/jira/browse/SPARK-33799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33799: - Affects Version/s: (was: 3.1.0) 3.2.0 > ExecutorMonitor should

[jira] [Commented] (SPARK-33816) Make stateful operations reuse previous state store

[ https://issues.apache.org/jira/browse/SPARK-33816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250728#comment-17250728 ] L. C. Hsieh commented on SPARK-33816: - working on it. > Make stateful operations reuse previous

[jira] [Created] (SPARK-33816) Make stateful operations reuse previous state store

L. C. Hsieh created SPARK-33816: --- Summary: Make stateful operations reuse previous state store Key: SPARK-33816 URL: https://issues.apache.org/jira/browse/SPARK-33816 Project: Spark Issue

[jira] [Commented] (SPARK-33815) Migrate ALTER TABLE SET [SERDE|SERDEPROPERTIES] command to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250721#comment-17250721 ] Apache Spark commented on SPARK-33815: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33815) Migrate ALTER TABLE SET [SERDE|SERDEPROPERTIES] command to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33815: Assignee: Apache Spark > Migrate ALTER TABLE SET [SERDE|SERDEPROPERTIES] command to the

[jira] [Assigned] (SPARK-33815) Migrate ALTER TABLE SET [SERDE|SERDEPROPERTIES] command to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33815: Assignee: (was: Apache Spark) > Migrate ALTER TABLE SET [SERDE|SERDEPROPERTIES]

[jira] [Created] (SPARK-33815) Migrate ALTER TABLE SET [SERDE|SERDEPROPERTIES] command to the new resolution framework

Terry Kim created SPARK-33815: - Summary: Migrate ALTER TABLE SET [SERDE|SERDEPROPERTIES] command to the new resolution framework Key: SPARK-33815 URL: https://issues.apache.org/jira/browse/SPARK-33815

[jira] [Resolved] (SPARK-33775) Suppress unimportant compilation warnings in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33775. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30760

[jira] [Assigned] (SPARK-33775) Suppress unimportant compilation warnings in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33775: - Assignee: Yang Jie > Suppress unimportant compilation warnings in Scala 2.13 >

[jira] [Assigned] (SPARK-33806) limit partition num to 1 when distributing by foldable expressions

[ https://issues.apache.org/jira/browse/SPARK-33806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33806: - Assignee: Kent Yao > limit partition num to 1 when distributing by foldable

[jira] [Resolved] (SPARK-33806) limit partition num to 1 when distributing by foldable expressions

[ https://issues.apache.org/jira/browse/SPARK-33806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33806. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30800

[jira] [Commented] (SPARK-33814) Provide preferred locations for stateful operations without reported state store locations

[ https://issues.apache.org/jira/browse/SPARK-33814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250623#comment-17250623 ] Apache Spark commented on SPARK-33814: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33814) Provide preferred locations for stateful operations without reported state store locations

[ https://issues.apache.org/jira/browse/SPARK-33814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33814: Assignee: L. C. Hsieh (was: Apache Spark) > Provide preferred locations for stateful

[jira] [Assigned] (SPARK-33814) Provide preferred locations for stateful operations without reported state store locations

[ https://issues.apache.org/jira/browse/SPARK-33814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33814: Assignee: Apache Spark (was: L. C. Hsieh) > Provide preferred locations for stateful

[jira] [Created] (SPARK-33814) Provide preferred locations for stateful operations without reported state store locations

L. C. Hsieh created SPARK-33814: --- Summary: Provide preferred locations for stateful operations without reported state store locations Key: SPARK-33814 URL: https://issues.apache.org/jira/browse/SPARK-33814

[jira] [Commented] (SPARK-33514) Migrate TRUNCATE TABLE to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250615#comment-17250615 ] Apache Spark commented on SPARK-33514: -- User 'imback82' has created a pull request for this issue:

[jira] [Created] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

Michał Świtakowski created SPARK-33813: -- Summary: JDBC datasource fails when reading spatial datatypes with the MS SQL driver Key: SPARK-33813 URL: https://issues.apache.org/jira/browse/SPARK-33813

[jira] [Assigned] (SPARK-33812) splt the histogram column stats when saving to hive metastore as table property

[ https://issues.apache.org/jira/browse/SPARK-33812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33812: Assignee: Wenchen Fan (was: Apache Spark) > splt the histogram column stats when saving

[jira] [Assigned] (SPARK-33812) splt the histogram column stats when saving to hive metastore as table property

[ https://issues.apache.org/jira/browse/SPARK-33812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33812: Assignee: Apache Spark (was: Wenchen Fan) > splt the histogram column stats when saving

[jira] [Commented] (SPARK-33812) splt the histogram column stats when saving to hive metastore as table property

[ https://issues.apache.org/jira/browse/SPARK-33812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250489#comment-17250489 ] Apache Spark commented on SPARK-33812: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-33812) splt the histogram column stats when saving to hive metastore as table property

Wenchen Fan created SPARK-33812: --- Summary: splt the histogram column stats when saving to hive metastore as table property Key: SPARK-33812 URL: https://issues.apache.org/jira/browse/SPARK-33812

[jira] [Commented] (SPARK-33784) Rename dataSourceRewriteRules and customDataSourceRewriteRules in BaseSessionStateBuilder

[ https://issues.apache.org/jira/browse/SPARK-33784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250449#comment-17250449 ] Apache Spark commented on SPARK-33784: -- User 'aokolnychyi' has created a pull request for this

[jira] [Assigned] (SPARK-33784) Rename dataSourceRewriteRules and customDataSourceRewriteRules in BaseSessionStateBuilder

[ https://issues.apache.org/jira/browse/SPARK-33784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33784: Assignee: Apache Spark (was: Anton Okolnychyi) > Rename dataSourceRewriteRules and

[jira] [Assigned] (SPARK-33784) Rename dataSourceRewriteRules and customDataSourceRewriteRules in BaseSessionStateBuilder

[ https://issues.apache.org/jira/browse/SPARK-33784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33784: Assignee: Anton Okolnychyi (was: Apache Spark) > Rename dataSourceRewriteRules and

[jira] [Commented] (SPARK-33784) Rename dataSourceRewriteRules and customDataSourceRewriteRules in BaseSessionStateBuilder

[ https://issues.apache.org/jira/browse/SPARK-33784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250448#comment-17250448 ] Apache Spark commented on SPARK-33784: -- User 'aokolnychyi' has created a pull request for this

[jira] [Resolved] (SPARK-33810) Reenable test cases disabled in SPARK-31732

[ https://issues.apache.org/jira/browse/SPARK-33810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33810. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30798

[jira] [Assigned] (SPARK-33810) Reenable test cases disabled in SPARK-31732

[ https://issues.apache.org/jira/browse/SPARK-33810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33810: - Assignee: Hyukjin Kwon > Reenable test cases disabled in SPARK-31732 >

[jira] [Assigned] (SPARK-33800) Remove command name in AnalysisException message when a relation is not resolved

[ https://issues.apache.org/jira/browse/SPARK-33800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33800: --- Assignee: Terry Kim > Remove command name in AnalysisException message when a relation is

[jira] [Resolved] (SPARK-33800) Remove command name in AnalysisException message when a relation is not resolved

[ https://issues.apache.org/jira/browse/SPARK-33800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33800. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30794

[jira] [Commented] (SPARK-33794) [ANSI mode][SQL] next_day function should throw runtime exception when receiving invalid input under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-33794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250403#comment-17250403 ] Apache Spark commented on SPARK-33794: -- User 'chongguang' has created a pull request for this

[jira] [Assigned] (SPARK-33794) [ANSI mode][SQL] next_day function should throw runtime exception when receiving invalid input under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-33794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33794: Assignee: (was: Apache Spark) > [ANSI mode][SQL] next_day function should throw

[jira] [Assigned] (SPARK-33794) [ANSI mode][SQL] next_day function should throw runtime exception when receiving invalid input under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-33794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33794: Assignee: Apache Spark > [ANSI mode][SQL] next_day function should throw runtime

[jira] [Commented] (SPARK-33808) DataSource V2: Build logical writes in the optimizer

[ https://issues.apache.org/jira/browse/SPARK-33808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250398#comment-17250398 ] Apache Spark commented on SPARK-33808: -- User 'aokolnychyi' has created a pull request for this

[jira] [Assigned] (SPARK-33808) DataSource V2: Build logical writes in the optimizer

[ https://issues.apache.org/jira/browse/SPARK-33808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33808: Assignee: (was: Apache Spark) > DataSource V2: Build logical writes in the optimizer

[jira] [Assigned] (SPARK-33808) DataSource V2: Build logical writes in the optimizer

[ https://issues.apache.org/jira/browse/SPARK-33808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33808: Assignee: Apache Spark > DataSource V2: Build logical writes in the optimizer >

[jira] [Commented] (SPARK-33808) DataSource V2: Build logical writes in the optimizer

[ https://issues.apache.org/jira/browse/SPARK-33808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250396#comment-17250396 ] Apache Spark commented on SPARK-33808: -- User 'aokolnychyi' has created a pull request for this

[jira] [Assigned] (SPARK-33809) Support `all_columns_except` complex column expression function

[ https://issues.apache.org/jira/browse/SPARK-33809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33809: Assignee: Apache Spark > Support `all_columns_except` complex column expression function

[jira] [Updated] (SPARK-33811) Support `all_columns_without_dunplicated` complex column expressions

[ https://issues.apache.org/jira/browse/SPARK-33811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33811: -- Description: support column expression such as `dropDunplcated` Dataset API > Support

  1   2   >