[jira] [Resolved] (SPARK-40297) CTE outer reference nested in CTE main body cannot be resolved

2022-09-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40297. - Fix Version/s: 3.4.0 3.3.1 Assignee: Wei Xue Resolution:

[jira] [Updated] (SPARK-38404) Spark does not find CTE inside nested CTE

2022-09-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-38404: Fix Version/s: 3.3.1 > Spark does not find CTE inside nested CTE >

[jira] [Resolved] (SPARK-40285) Simplify the roundTo[Numeric] for Decimal

2022-08-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40285. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37736

[jira] [Assigned] (SPARK-40285) Simplify the roundTo[Numeric] for Decimal

2022-08-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40285: --- Assignee: jiaan.geng > Simplify the roundTo[Numeric] for Decimal >

[jira] [Resolved] (SPARK-40112) Improve the TO_BINARY() function

2022-08-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40112. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37483

[jira] [Assigned] (SPARK-40112) Improve the TO_BINARY() function

2022-08-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40112: --- Assignee: Vitalii Li > Improve the TO_BINARY() function >

[jira] [Assigned] (SPARK-40219) resolved view plan should hold the schema to avoid redundant lookup

2022-08-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40219: --- Assignee: Wenchen Fan > resolved view plan should hold the schema to avoid redundant

[jira] [Resolved] (SPARK-40219) resolved view plan should hold the schema to avoid redundant lookup

2022-08-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40219. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37658

[jira] [Resolved] (SPARK-40194) SPLIT function on empty regex should truncate trailing empty string.

2022-08-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40194. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37631

[jira] [Assigned] (SPARK-40194) SPLIT function on empty regex should truncate trailing empty string.

2022-08-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40194: --- Assignee: Vitalii Li > SPLIT function on empty regex should truncate trailing empty

[jira] [Assigned] (SPARK-39896) The structural integrity of the plan is broken after UnwrapCastInBinaryComparison

2022-08-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39896: --- Assignee: Fu Chen > The structural integrity of the plan is broken after >

[jira] [Resolved] (SPARK-39896) The structural integrity of the plan is broken after UnwrapCastInBinaryComparison

2022-08-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39896. - Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-38603) Qualified star selection produces duplicated common columns after join then alias

2022-08-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38603. - Resolution: Duplicate > Qualified star selection produces duplicated common columns after join

[jira] [Resolved] (SPARK-40245) Fix FileScan equality check when partition or data filter columns are not read

2022-08-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40245. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37693

[jira] [Assigned] (SPARK-40245) Fix FileScan equality check when partition or data filter columns are not read

2022-08-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40245: --- Assignee: Peter Toth > Fix FileScan equality check when partition or data filter columns

[jira] [Assigned] (SPARK-40247) Fix BitSet equality check

2022-08-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40247: --- Assignee: Peter Toth > Fix BitSet equality check > - > >

[jira] [Resolved] (SPARK-40247) Fix BitSet equality check

2022-08-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40247. - Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-40224) Make ObjectHashAggregateExec release memory eagerly when fallback to sort-based

2022-08-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40224: --- Assignee: XiDuo You > Make ObjectHashAggregateExec release memory eagerly when fallback to

[jira] [Resolved] (SPARK-40224) Make ObjectHashAggregateExec release memory eagerly when fallback to sort-based

2022-08-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40224. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37668

[jira] [Resolved] (SPARK-39607) DataSourceV2: Distribution and ordering support V2 function in writing

2022-08-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39607. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36995

[jira] [Assigned] (SPARK-39607) DataSourceV2: Distribution and ordering support V2 function in writing

2022-08-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39607: --- Assignee: Cheng Pan > DataSourceV2: Distribution and ordering support V2 function in

[jira] [Resolved] (SPARK-40218) GROUPING SETS should preserve the grouping columns

2022-08-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40218. - Fix Version/s: 3.3.1 3.2.3 3.4.0 Resolution: Fixed

[jira] [Assigned] (SPARK-40153) Unify the logic of resolve functions and table-valued functions

2022-08-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40153: --- Assignee: Allison Wang > Unify the logic of resolve functions and table-valued functions >

[jira] [Resolved] (SPARK-40153) Unify the logic of resolve functions and table-valued functions

2022-08-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40153. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37586

[jira] [Created] (SPARK-40219) resolved view plan should hold the schema to avoid redundant lookup

2022-08-25 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-40219: --- Summary: resolved view plan should hold the schema to avoid redundant lookup Key: SPARK-40219 URL: https://issues.apache.org/jira/browse/SPARK-40219 Project: Spark

[jira] [Created] (SPARK-40218) GROUPING SETS should preserve the grouping columns

2022-08-25 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-40218: --- Summary: GROUPING SETS should preserve the grouping columns Key: SPARK-40218 URL: https://issues.apache.org/jira/browse/SPARK-40218 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40055) listCatalogs should also return spark_catalog even spark_catalog implementation is defaultSessionCatalog

2022-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40055. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37488

[jira] [Assigned] (SPARK-40055) listCatalogs should also return spark_catalog even spark_catalog implementation is defaultSessionCatalog

2022-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40055: --- Assignee: Rui Wang > listCatalogs should also return spark_catalog even spark_catalog >

[jira] [Resolved] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

2022-08-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40089. - Fix Version/s: 3.3.1 3.1.4 3.2.3 3.4.0

[jira] [Assigned] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter

2022-08-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40107: --- Assignee: Allison Wang > Pull out empty2null conversion from FileFormatWriter >

[jira] [Resolved] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter

2022-08-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40107. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37539

[jira] [Assigned] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

2022-08-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40105: --- Assignee: XiDuo You > Improve repartition in ReplaceCTERefWithRepartition >

[jira] [Resolved] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

2022-08-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40105. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37537

[jira] [Assigned] (SPARK-37980) Extend METADATA column to support row indices for file based data sources

2022-08-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37980: --- Assignee: Ala Luszczak > Extend METADATA column to support row indices for file based data

[jira] [Resolved] (SPARK-37980) Extend METADATA column to support row indices for file based data sources

2022-08-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37980. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37228

[jira] [Resolved] (SPARK-40013) DS V2 expressions should have the default toString

2022-08-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40013. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37494

[jira] [Assigned] (SPARK-40067) Add table name to Spark plan node in SparkUI

2022-08-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40067: --- Assignee: Sumeet > Add table name to Spark plan node in SparkUI >

[jira] [Resolved] (SPARK-40067) Add table name to Spark plan node in SparkUI

2022-08-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40067. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37505

[jira] [Created] (SPARK-40085) use INTERNAL_ERROR error class instead of IllegalStateException to indicate bugs

2022-08-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-40085: --- Summary: use INTERNAL_ERROR error class instead of IllegalStateException to indicate bugs Key: SPARK-40085 URL: https://issues.apache.org/jira/browse/SPARK-40085

[jira] [Assigned] (SPARK-39887) Expression transform error

2022-08-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39887: --- Assignee: Peter Toth > Expression transform error > -- > >

[jira] [Updated] (SPARK-39887) Expression transform error

2022-08-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-39887: Fix Version/s: 3.4.0 3.3.1 3.2.3 > Expression transform

[jira] [Resolved] (SPARK-39887) Expression transform error

2022-08-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39887. - Fix Version/s: 3.1.4 Resolution: Fixed Issue resolved by pull request 37496

[jira] [Resolved] (SPARK-40019) Refactor comment of ArrayType

2022-08-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40019. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37453

[jira] [Assigned] (SPARK-40019) Refactor comment of ArrayType

2022-08-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40019: --- Assignee: angerszhu > Refactor comment of ArrayType > - > >

[jira] [Resolved] (SPARK-40073) Should Use `connector/${moduleName}` instead of `external/${moduleName}`

2022-08-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40073. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37512

[jira] [Assigned] (SPARK-40073) Should Use `connector/${moduleName}` instead of `external/${moduleName}`

2022-08-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40073: --- Assignee: Yang Jie > Should Use `connector/${moduleName}` instead of

[jira] [Resolved] (SPARK-39976) NULL check in ArrayIntersect adds extraneous null from first param

2022-08-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39976. - Fix Version/s: 3.4.0 3.3.1 Assignee: angerszhu Resolution:

[jira] [Assigned] (SPARK-40020) centralize the code of qualifying identifiers in SessionCatalog

2022-08-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40020: --- Assignee: Wenchen Fan > centralize the code of qualifying identifiers in SessionCatalog >

[jira] [Resolved] (SPARK-40020) centralize the code of qualifying identifiers in SessionCatalog

2022-08-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40020. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37415

[jira] [Resolved] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

2022-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39929. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37427

[jira] [Created] (SPARK-40020) centralize the code of qualifying identifiers in SessionCatalog

2022-08-09 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-40020: --- Summary: centralize the code of qualifying identifiers in SessionCatalog Key: SPARK-40020 URL: https://issues.apache.org/jira/browse/SPARK-40020 Project: Spark

[jira] [Resolved] (SPARK-39819) DS V2 aggregate push down can work with Top N or Paging (Sort with group expressions)

2022-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39819. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37320

[jira] [Assigned] (SPARK-39819) DS V2 aggregate push down can work with Top N or Paging (Sort with group expressions)

2022-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39819: --- Assignee: jiaan.geng > DS V2 aggregate push down can work with Top N or Paging (Sort with

[jira] [Assigned] (SPARK-39828) Catalog.listTables() should respect currentCatalog

2022-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39828: --- Assignee: Wenchen Fan > Catalog.listTables() should respect currentCatalog >

[jira] [Resolved] (SPARK-39912) Refine CatalogImpl

2022-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39912. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37287

[jira] [Resolved] (SPARK-39828) Catalog.listTables() should respect currentCatalog

2022-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39828. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37287

[jira] [Assigned] (SPARK-39912) Refine CatalogImpl

2022-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39912: --- Assignee: Wenchen Fan > Refine CatalogImpl > -- > > Key:

[jira] [Assigned] (SPARK-39764) Make PhysicalOperation the same as ScanOperation

2022-08-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39764: --- Assignee: Wenchen Fan > Make PhysicalOperation the same as ScanOperation >

[jira] [Resolved] (SPARK-39764) Make PhysicalOperation the same as ScanOperation

2022-08-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39764. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37176

[jira] [Resolved] (SPARK-38034) Optimize time complexity and extend applicable cases for TransposeWindow

2022-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38034. - Fix Version/s: 3.4.0 3.3.1 3.2.3 Assignee: zhou

[jira] [Assigned] (SPARK-39964) DS V2 pushdown should unify the translate path

2022-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39964: --- Assignee: jiaan.geng > DS V2 pushdown should unify the translate path >

[jira] [Resolved] (SPARK-39964) DS V2 pushdown should unify the translate path

2022-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39964. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37391

[jira] [Assigned] (SPARK-39963) Simplify the implementation of SimplifyCasts

2022-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39963: --- Assignee: jiaan.geng > Simplify the implementation of SimplifyCasts >

[jira] [Resolved] (SPARK-39963) Simplify the implementation of SimplifyCasts

2022-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39963. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37389

[jira] [Resolved] (SPARK-38901) DS V2 supports push down misc functions

2022-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38901. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37169

[jira] [Assigned] (SPARK-39867) Global limit should not inherit OrderPreservingUnaryNode

2022-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39867: --- Assignee: XiDuo You > Global limit should not inherit OrderPreservingUnaryNode >

[jira] [Assigned] (SPARK-38901) DS V2 supports push down misc functions

2022-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38901: --- Assignee: Zhixiong Chen > DS V2 supports push down misc functions >

[jira] [Updated] (SPARK-39867) Global limit should not inherit OrderPreservingUnaryNode

2022-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-39867: Fix Version/s: 3.1.4 3.2.3 > Global limit should not inherit

[jira] [Resolved] (SPARK-39775) Regression due to AVRO-2035

2022-08-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39775. - Fix Version/s: 3.3.1 3.2.3 3.4.0 Resolution: Fixed

[jira] [Assigned] (SPARK-39775) Regression due to AVRO-2035

2022-08-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39775: --- Assignee: Yuming Wang > Regression due to AVRO-2035 > --- > >

[jira] [Resolved] (SPARK-39936) Spark View creation with hyphens in column-type names fails

2022-08-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39936. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37364

[jira] [Assigned] (SPARK-39936) Spark View creation with hyphens in column-type names fails

2022-08-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39936: --- Assignee: Jeffrey Chen > Spark View creation with hyphens in column-type names fails >

[jira] [Assigned] (SPARK-39952) SaveIntoDataSourceCommand should recache result relation

2022-08-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39952: --- Assignee: XiDuo You > SaveIntoDataSourceCommand should recache result relation >

[jira] [Resolved] (SPARK-39952) SaveIntoDataSourceCommand should recache result relation

2022-08-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39952. - Fix Version/s: 3.3.1 3.1.4 3.2.3 3.4.0

[jira] [Resolved] (SPARK-39867) Global limit should not inherit OrderPreservingUnaryNode

2022-08-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39867. - Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-39835) Fix EliminateSorts remove global sort below the local sort

2022-08-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-39835: Fix Version/s: 3.1.4 3.2.3 > Fix EliminateSorts remove global sort below the

[jira] [Assigned] (SPARK-39873) Remove OptimizeLimitZero and merge it into EliminateLimits

2022-08-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39873: --- Assignee: jiaan.geng > Remove OptimizeLimitZero and merge it into EliminateLimits >

[jira] [Resolved] (SPARK-39873) Remove OptimizeLimitZero and merge it into EliminateLimits

2022-08-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39873. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37295

[jira] [Assigned] (SPARK-39911) Optimize global Sort to RepartitionByExpression

2022-08-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39911: --- Assignee: XiDuo You > Optimize global Sort to RepartitionByExpression >

[jira] [Resolved] (SPARK-39911) Optimize global Sort to RepartitionByExpression

2022-08-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39911. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37330

[jira] [Resolved] (SPARK-39849) Dataset.as(StructType) fills missing new columns with null value

2022-07-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39849. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37264

[jira] [Assigned] (SPARK-39849) Dataset.as(StructType) fills missing new columns with null value

2022-07-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39849: --- Assignee: Cheng Su > Dataset.as(StructType) fills missing new columns with null value >

[jira] [Assigned] (SPARK-37194) Avoid unnecessary sort in FileFormatWriter if it's not dynamic partition

2022-07-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37194: --- Assignee: XiDuo You > Avoid unnecessary sort in FileFormatWriter if it's not dynamic

[jira] [Resolved] (SPARK-37194) Avoid unnecessary sort in FileFormatWriter if it's not dynamic partition

2022-07-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37194. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37290

[jira] [Created] (SPARK-39912) Refine CatalogImpl

2022-07-28 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-39912: --- Summary: Refine CatalogImpl Key: SPARK-39912 URL: https://issues.apache.org/jira/browse/SPARK-39912 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-39528) Use V2 Filter in SupportsRuntimeFiltering

2022-07-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39528: --- Assignee: Huaxin Gao > Use V2 Filter in SupportsRuntimeFiltering >

[jira] [Resolved] (SPARK-39528) Use V2 Filter in SupportsRuntimeFiltering

2022-07-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39528. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36918

[jira] [Resolved] (SPARK-39890) Make TakeOrderedAndProjectExec inherit AliasAwareOutputOrdering

2022-07-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39890. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37318

[jira] [Assigned] (SPARK-39890) Make TakeOrderedAndProjectExec inherit AliasAwareOutputOrdering

2022-07-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39890: --- Assignee: XiDuo You > Make TakeOrderedAndProjectExec inherit AliasAwareOutputOrdering >

[jira] [Assigned] (SPARK-39731) Correctness issue when parsing dates with yyyyMMdd format in CSV and JSON

2022-07-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39731: --- Assignee: Ivan Sadikov > Correctness issue when parsing dates with MMdd format in CSV

[jira] [Resolved] (SPARK-39731) Correctness issue when parsing dates with yyyyMMdd format in CSV and JSON

2022-07-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39731. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37147

[jira] [Created] (SPARK-39880) V2 SHOW FUNCTIONS command should print qualified function name like v1

2022-07-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-39880: --- Summary: V2 SHOW FUNCTIONS command should print qualified function name like v1 Key: SPARK-39880 URL: https://issues.apache.org/jira/browse/SPARK-39880 Project: Spark

[jira] [Resolved] (SPARK-38864) Melt function for Dataset API

2022-07-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38864. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36150

[jira] [Assigned] (SPARK-38864) Melt function for Dataset API

2022-07-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38864: --- Assignee: Enrico Minack > Melt function for Dataset API > - >

[jira] [Resolved] (SPARK-39808) Support aggregate function MODE

2022-07-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39808. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37216

[jira] [Assigned] (SPARK-39808) Support aggregate function MODE

2022-07-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39808: --- Assignee: jiaan.geng > Support aggregate function MODE > --- >

[jira] [Resolved] (SPARK-39858) Remove unnecessary AliasHelper or PredicateHelper for some rules

2022-07-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39858. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37272

[jira] [Assigned] (SPARK-39858) Remove unnecessary AliasHelper or PredicateHelper for some rules

2022-07-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39858: --- Assignee: jiaan.geng > Remove unnecessary AliasHelper or PredicateHelper for some rules >

[jira] [Assigned] (SPARK-39835) Fix EliminateSorts remove global sort below the local sort

2022-07-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39835: --- Assignee: XiDuo You > Fix EliminateSorts remove global sort below the local sort >

[jira] [Resolved] (SPARK-39835) Fix EliminateSorts remove global sort below the local sort

2022-07-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39835. - Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

<    9   10   11   12   13   14   15   16   17   18   >