[jira] [Resolved] (SPARK-44967) Unit should be considered first before using Boolean for TreeNodeTag

[ https://issues.apache.org/jira/browse/SPARK-44967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44967. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42683 [https://gith

[jira] [Assigned] (SPARK-44967) Unit should be considered first before using Boolean for TreeNodeTag

[ https://issues.apache.org/jira/browse/SPARK-44967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44967: --- Assignee: jiaan.geng > Unit should be considered first before using Boolean for TreeNodeTag

[jira] [Resolved] (SPARK-44897) Local Property Propagation to Subquery Broadcast Exec

[ https://issues.apache.org/jira/browse/SPARK-44897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44897. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42587 [https://gith

[jira] [Assigned] (SPARK-44897) Local Property Propagation to Subquery Broadcast Exec

[ https://issues.apache.org/jira/browse/SPARK-44897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44897: --- Assignee: Michael Chen > Local Property Propagation to Subquery Broadcast Exec > --

[jira] [Assigned] (SPARK-44865) Make StreamingRelationV2 support metadata column

[ https://issues.apache.org/jira/browse/SPARK-44865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44865: --- Assignee: Zerui Bao > Make StreamingRelationV2 support metadata column > --

[jira] [Resolved] (SPARK-44865) Make StreamingRelationV2 support metadata column

[ https://issues.apache.org/jira/browse/SPARK-44865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44865. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42554 [https://gith

[jira] [Resolved] (SPARK-44930) Deterministic ApplyFunctionExpression should be foldable

[ https://issues.apache.org/jira/browse/SPARK-44930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44930. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42629 [https://gith

[jira] [Assigned] (SPARK-44930) Deterministic ApplyFunctionExpression should be foldable

[ https://issues.apache.org/jira/browse/SPARK-44930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44930: --- Assignee: Xianyang Liu > Deterministic ApplyFunctionExpression should be foldable > ---

[jira] [Resolved] (SPARK-44549) Support correlated references under window functions

[ https://issues.apache.org/jira/browse/SPARK-44549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44549. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42383 [https://gith

[jira] [Assigned] (SPARK-44549) Support correlated references under window functions

[ https://issues.apache.org/jira/browse/SPARK-44549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44549: --- Assignee: Andrey Gubichev > Support correlated references under window functions >

[jira] [Resolved] (SPARK-42768) Enable cached plan apply AQE by default

[ https://issues.apache.org/jira/browse/SPARK-42768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42768. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40390 [https://gith

[jira] [Assigned] (SPARK-42768) Enable cached plan apply AQE by default

[ https://issues.apache.org/jira/browse/SPARK-42768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42768: --- Assignee: XiDuo You > Enable cached plan apply AQE by default > ---

[jira] [Resolved] (SPARK-43327) Trigger `committer.setupJob` before plan execute in `FileFormatWriter`

[ https://issues.apache.org/jira/browse/SPARK-43327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43327. - Fix Version/s: 3.3.4 Resolution: Fixed Issue resolved by pull request 41154 [https://gith

[jira] [Assigned] (SPARK-43327) Trigger `committer.setupJob` before plan execute in `FileFormatWriter`

[ https://issues.apache.org/jira/browse/SPARK-43327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43327: --- Assignee: ming95 > Trigger `committer.setupJob` before plan execute in `FileFormatWrite

[jira] [Assigned] (SPARK-44822) Make Python UDTFs by default non-deterministic

[ https://issues.apache.org/jira/browse/SPARK-44822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44822: --- Assignee: Allison Wang > Make Python UDTFs by default non-deterministic > -

[jira] [Resolved] (SPARK-44822) Make Python UDTFs by default non-deterministic

[ https://issues.apache.org/jira/browse/SPARK-44822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44822. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42519 [https://gith

[jira] [Assigned] (SPARK-44718) High On-heap memory usage is detected while doing parquet-file reading with Off-Heap memory mode enabled on spark

[ https://issues.apache.org/jira/browse/SPARK-44718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44718: --- Assignee: Zamil Majdy > High On-heap memory usage is detected while doing parquet-file read

[jira] [Resolved] (SPARK-44718) High On-heap memory usage is detected while doing parquet-file reading with Off-Heap memory mode enabled on spark

[ https://issues.apache.org/jira/browse/SPARK-44718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44718. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42394 [https://gith

[jira] [Assigned] (SPARK-43780) Support correlated columns in join ON conditions

[ https://issues.apache.org/jira/browse/SPARK-43780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43780: --- Assignee: Andrey Gubichev > Support correlated columns in join ON conditions >

[jira] [Resolved] (SPARK-43780) Support correlated columns in join ON conditions

[ https://issues.apache.org/jira/browse/SPARK-43780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43780. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 41301 [https://gith

[jira] [Resolved] (SPARK-43781) IllegalStateException when cogrouping two datasets derived from the same source

[ https://issues.apache.org/jira/browse/SPARK-43781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43781. - Fix Version/s: 3.5.0 Assignee: Jia Fan Resolution: Fixed > IllegalStateException

[jira] [Assigned] (SPARK-44691) Move Subclasses of Analysis to sql/api

[ https://issues.apache.org/jira/browse/SPARK-44691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44691: --- Assignee: Yihong He > Move Subclasses of Analysis to sql/api >

[jira] [Resolved] (SPARK-44691) Move Subclasses of Analysis to sql/api

[ https://issues.apache.org/jira/browse/SPARK-44691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44691. - Fix Version/s: 3.5.0 Resolution: Fixed > Move Subclasses of Analysis to sql/api > ---

[jira] [Resolved] (SPARK-42849) Session variables

[ https://issues.apache.org/jira/browse/SPARK-42849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42849. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 40474 [https://gith

[jira] [Assigned] (SPARK-42849) Session variables

[ https://issues.apache.org/jira/browse/SPARK-42849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42849: --- Assignee: Serge Rielau > Session variables > - > > Key: SPA

[jira] [Resolved] (SPARK-44551) Wrong semantics for null IN (empty list) - IN expression execution

[ https://issues.apache.org/jira/browse/SPARK-44551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44551. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42163 [https://gith

[jira] [Assigned] (SPARK-44551) Wrong semantics for null IN (empty list) - IN expression execution

[ https://issues.apache.org/jira/browse/SPARK-44551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44551: --- Assignee: Jack Chen > Wrong semantics for null IN (empty list) - IN expression execution >

[jira] [Assigned] (SPARK-44236) Even `spark.sql.codegen.factoryMode` is NO_CODEGEN, the WholeStageCodegen also will be generated.

[ https://issues.apache.org/jira/browse/SPARK-44236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44236: --- Assignee: Jia Fan > Even `spark.sql.codegen.factoryMode` is NO_CODEGEN, the WholeStageCodeg

[jira] [Resolved] (SPARK-44236) Even `spark.sql.codegen.factoryMode` is NO_CODEGEN, the WholeStageCodegen also will be generated.

[ https://issues.apache.org/jira/browse/SPARK-44236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44236. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41779 [https://gith

[jira] [Resolved] (SPARK-44714) Ease restriction of LCA resolution regarding queries with having

[ https://issues.apache.org/jira/browse/SPARK-44714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44714. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42276 [https://gith

[jira] [Assigned] (SPARK-44714) Ease restriction of LCA resolution regarding queries with having

[ https://issues.apache.org/jira/browse/SPARK-44714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44714: --- Assignee: Xinyi Yu > Ease restriction of LCA resolution regarding queries with having > ---

[jira] [Resolved] (SPARK-44653) non-trivial DataFrame unions should not break caching

[ https://issues.apache.org/jira/browse/SPARK-44653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44653. - Fix Version/s: 3.3.3 3.5.0 3.4.2 Resolution: Fixed

[jira] [Assigned] (SPARK-44653) non-trivial DataFrame unions should not break caching

[ https://issues.apache.org/jira/browse/SPARK-44653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44653: --- Assignee: Wenchen Fan > non-trivial DataFrame unions should not break caching > ---

[jira] [Created] (SPARK-44655) make the code cleaner about static and dynamc data/partition filters

Wenchen Fan created SPARK-44655: --- Summary: make the code cleaner about static and dynamc data/partition filters Key: SPARK-44655 URL: https://issues.apache.org/jira/browse/SPARK-44655 Project: Spark

[jira] [Created] (SPARK-44653) non-trivial DataFrame unions should not break caching

Wenchen Fan created SPARK-44653: --- Summary: non-trivial DataFrame unions should not break caching Key: SPARK-44653 URL: https://issues.apache.org/jira/browse/SPARK-44653 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-40664) Union in query can remove cache from the plan

[ https://issues.apache.org/jira/browse/SPARK-40664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40664. - Resolution: Not A Problem > Union in query can remove cache from the plan >

[jira] [Assigned] (SPARK-44280) Add convertJavaTimestampToTimestamp in JDBCDialect API

[ https://issues.apache.org/jira/browse/SPARK-44280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44280: --- Assignee: Mingkang Li > Add convertJavaTimestampToTimestamp in JDBCDialect API > --

[jira] [Resolved] (SPARK-44280) Add convertJavaTimestampToTimestamp in JDBCDialect API

[ https://issues.apache.org/jira/browse/SPARK-44280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44280. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41843 [https://gith

[jira] [Created] (SPARK-44610) DeduplicateRelations should retain Alias metadata when creating a new instance

Wenchen Fan created SPARK-44610: --- Summary: DeduplicateRelations should retain Alias metadata when creating a new instance Key: SPARK-44610 URL: https://issues.apache.org/jira/browse/SPARK-44610 Project:

[jira] [Resolved] (SPARK-44605) refine internal ShuffleWriteProcessor API

[ https://issues.apache.org/jira/browse/SPARK-44605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44605. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42234 [https://gith

[jira] [Assigned] (SPARK-44605) refine internal ShuffleWriteProcessor API

[ https://issues.apache.org/jira/browse/SPARK-44605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44605: --- Assignee: Wenchen Fan > refine internal ShuffleWriteProcessor API > ---

[jira] [Created] (SPARK-44605) refine internal ShuffleWriteProcessor API

Wenchen Fan created SPARK-44605: --- Summary: refine internal ShuffleWriteProcessor API Key: SPARK-44605 URL: https://issues.apache.org/jira/browse/SPARK-44605 Project: Spark Issue Type: Improveme

[jira] [Assigned] (SPARK-42098) ResolveInlineTables should handle RuntimeReplaceable

[ https://issues.apache.org/jira/browse/SPARK-42098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42098: --- Assignee: Jia Fan > ResolveInlineTables should handle RuntimeReplaceable >

[jira] [Resolved] (SPARK-42098) ResolveInlineTables should handle RuntimeReplaceable

[ https://issues.apache.org/jira/browse/SPARK-42098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42098. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42110 [https://gith

[jira] [Assigned] (SPARK-44505) DataSource v2 Scans should not require planning the input partitions on explain

[ https://issues.apache.org/jira/browse/SPARK-44505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44505: --- Assignee: Martin Grund > DataSource v2 Scans should not require planning the input partitio

[jira] [Resolved] (SPARK-44505) DataSource v2 Scans should not require planning the input partitions on explain

[ https://issues.apache.org/jira/browse/SPARK-44505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44505. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42099 [https://gith

[jira] [Assigned] (SPARK-44355) Move commands to CTEDef code path and deprecate CTE inline path

[ https://issues.apache.org/jira/browse/SPARK-44355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44355: --- Assignee: Wenchen Fan > Move commands to CTEDef code path and deprecate CTE inline path > -

[jira] [Resolved] (SPARK-44355) Move commands to CTEDef code path and deprecate CTE inline path

[ https://issues.apache.org/jira/browse/SPARK-44355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44355. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42036 [https://gith

[jira] [Resolved] (SPARK-39634) Allow file splitting in combination with row index generation

[ https://issues.apache.org/jira/browse/SPARK-39634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39634. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40728 [https://gith

[jira] [Assigned] (SPARK-39634) Allow file splitting in combination with row index generation

[ https://issues.apache.org/jira/browse/SPARK-39634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39634: --- Assignee: Ala Luszczak > Allow file splitting in combination with row index generation > --

[jira] [Assigned] (SPARK-43966) Support non-deterministic Python UDTFs

[ https://issues.apache.org/jira/browse/SPARK-43966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43966: --- Assignee: Allison Wang > Support non-deterministic Python UDTFs > -

[jira] [Resolved] (SPARK-43966) Support non-deterministic Python UDTFs

[ https://issues.apache.org/jira/browse/SPARK-43966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43966. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42075 [https://gith

[jira] [Resolved] (SPARK-44475) Relocate DataType and Parser to sql/api

[ https://issues.apache.org/jira/browse/SPARK-44475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44475. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41928 [https://gith

[jira] [Assigned] (SPARK-44431) Wrong semantics for null IN (empty list)

[ https://issues.apache.org/jira/browse/SPARK-44431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44431: --- Assignee: Jack Chen > Wrong semantics for null IN (empty list) > --

[jira] [Resolved] (SPARK-44431) Wrong semantics for null IN (empty list)

[ https://issues.apache.org/jira/browse/SPARK-44431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44431. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42007 [https://gith

[jira] [Resolved] (SPARK-43838) Subquery on single table with having clause can't be optimized

[ https://issues.apache.org/jira/browse/SPARK-43838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43838. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 41347 [https://gith

[jira] [Assigned] (SPARK-43838) Subquery on single table with having clause can't be optimized

[ https://issues.apache.org/jira/browse/SPARK-43838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43838: --- Assignee: Jia Fan > Subquery on single table with having clause can't be optimized > --

[jira] [Assigned] (SPARK-44361) Use PartitionEvaluator API in MapInBatchExec

[ https://issues.apache.org/jira/browse/SPARK-44361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44361: --- Assignee: Vinod KC > Use PartitionEvaluator API in MapInBatchExec > --

[jira] [Resolved] (SPARK-44361) Use PartitionEvaluator API in MapInBatchExec

[ https://issues.apache.org/jira/browse/SPARK-44361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44361. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42024 [https://gith

[jira] [Resolved] (SPARK-44411) Use PartitionEvaluator API in ArrowEvalPythonExec, BatchEvalPythonExec

[ https://issues.apache.org/jira/browse/SPARK-44411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44411. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 41998 [https://gith

[jira] [Assigned] (SPARK-44411) Use PartitionEvaluator API in ArrowEvalPythonExec, BatchEvalPythonExec

[ https://issues.apache.org/jira/browse/SPARK-44411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44411: --- Assignee: Vinod KC > Use PartitionEvaluator API in ArrowEvalPythonExec, BatchEvalPythonExec

[jira] [Assigned] (SPARK-44375) Use PartitionEvaluator API in DebugExec

[ https://issues.apache.org/jira/browse/SPARK-44375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44375: --- Assignee: Jia Fan > Use PartitionEvaluator API in DebugExec > -

[jira] [Resolved] (SPARK-44375) Use PartitionEvaluator API in DebugExec

[ https://issues.apache.org/jira/browse/SPARK-44375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44375. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 41949 [https://gith

[jira] [Updated] (SPARK-44448) Wrong results for dense_rank() <= k from InferWindowGroupLimit and DenseRankLimitIterator

[ https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-8: Fix Version/s: (was: 4.0.0) > Wrong results for dense_rank() <= k from InferWindowGroupLimit a

[jira] [Resolved] (SPARK-44448) Wrong results for dense_rank() <= k from InferWindowGroupLimit and DenseRankLimitIterator

[ https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-8. - Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-44448) Wrong results for dense_rank() <= k from InferWindowGroupLimit and DenseRankLimitIterator

[ https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-8: --- Assignee: Jack Chen > Wrong results for dense_rank() <= k from InferWindowGroupLimit and >

[jira] [Resolved] (SPARK-44324) Move CaseInsensitiveMap to sql/api

[ https://issues.apache.org/jira/browse/SPARK-44324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44324. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41882 [https://gith

[jira] [Updated] (SPARK-44341) Define the computing logic through PartitionEvaluator API and use it in WindowExec and WindowInPandasExec

[ https://issues.apache.org/jira/browse/SPARK-44341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-44341: Fix Version/s: 4.0.0 (was: 3.5.0) > Define the computing logic through Part

[jira] [Assigned] (SPARK-44341) Define the computing logic through PartitionEvaluator API and use it in WindowExec and WindowInPandasExec

[ https://issues.apache.org/jira/browse/SPARK-44341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44341: --- Assignee: jiaan.geng > Define the computing logic through PartitionEvaluator API and use it

[jira] [Resolved] (SPARK-44341) Define the computing logic through PartitionEvaluator API and use it in WindowExec and WindowInPandasExec

[ https://issues.apache.org/jira/browse/SPARK-44341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44341. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41939 [https://gith

[jira] [Resolved] (SPARK-44059) Add named argument support for SQL functions

[ https://issues.apache.org/jira/browse/SPARK-44059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44059. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42020 [https://gith

[jira] [Assigned] (SPARK-44059) Add named argument support for SQL functions

[ https://issues.apache.org/jira/browse/SPARK-44059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44059: --- Assignee: Richard Yu > Add named argument support for SQL functions > -

[jira] [Assigned] (SPARK-44180) DistributionAndOrderingUtils should apply ResolveTimeZone

[ https://issues.apache.org/jira/browse/SPARK-44180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44180: --- Assignee: Cheng Pan > DistributionAndOrderingUtils should apply ResolveTimeZone > -

[jira] [Resolved] (SPARK-44180) DistributionAndOrderingUtils should apply ResolveTimeZone

[ https://issues.apache.org/jira/browse/SPARK-44180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44180. - Fix Version/s: 3.5.0 3.4.2 Resolution: Fixed Issue resolved by pull re

[jira] [Resolved] (SPARK-44340) Define the computing logic through PartitionEvaluator API and use it in WindowGroupLimitExec

[ https://issues.apache.org/jira/browse/SPARK-44340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44340. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41899 [https://gith

[jira] [Assigned] (SPARK-44340) Define the computing logic through PartitionEvaluator API and use it in WindowGroupLimitExec

[ https://issues.apache.org/jira/browse/SPARK-44340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44340: --- Assignee: jiaan.geng > Define the computing logic through PartitionEvaluator API and use it

[jira] [Created] (SPARK-44338) fix view schema mismatch error message

Wenchen Fan created SPARK-44338: --- Summary: fix view schema mismatch error message Key: SPARK-44338 URL: https://issues.apache.org/jira/browse/SPARK-44338 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-44287) Define the computing logic through PartitionEvaluator API and use it in RowToColumnarExec & ColumnarToRowExec SQL operators.

[ https://issues.apache.org/jira/browse/SPARK-44287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44287: --- Assignee: Vinod KC > Define the computing logic through PartitionEvaluator API and use

[jira] [Resolved] (SPARK-44287) Define the computing logic through PartitionEvaluator API and use it in RowToColumnarExec & ColumnarToRowExec SQL operators.

[ https://issues.apache.org/jira/browse/SPARK-44287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44287. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41839 [https://gith

[jira] [Created] (SPARK-44335) SQL parser should have a SQLConf parameter instead of relying on the active conf

Wenchen Fan created SPARK-44335: --- Summary: SQL parser should have a SQLConf parameter instead of relying on the active conf Key: SPARK-44335 URL: https://issues.apache.org/jira/browse/SPARK-44335 Projec

[jira] [Resolved] (SPARK-44315) Move DefinedByConstructorParams to sql/api

[ https://issues.apache.org/jira/browse/SPARK-44315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44315. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41873 [https://gith

[jira] [Resolved] (SPARK-44154) Bitmap functions

[ https://issues.apache.org/jira/browse/SPARK-44154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44154. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41623 [https://gith

[jira] [Resolved] (SPARK-44274) Move out util functions used by ArtifactManager to common/utils

[ https://issues.apache.org/jira/browse/SPARK-44274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44274. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41825 [https://gith

[jira] [Resolved] (SPARK-44266) Move Util.truncatedString to sql/api

[ https://issues.apache.org/jira/browse/SPARK-44266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44266. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41811 [https://gith

[jira] [Assigned] (SPARK-44199) CacheManager refreshes the fileIndex unnecessarily

[ https://issues.apache.org/jira/browse/SPARK-44199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44199: --- Assignee: Vihang Karajgaonkar > CacheManager refreshes the fileIndex unnecessarily > --

[jira] [Resolved] (SPARK-44199) CacheManager refreshes the fileIndex unnecessarily

[ https://issues.apache.org/jira/browse/SPARK-44199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44199. - Fix Version/s: 3.5.0 Resolution: Fixed > CacheManager refreshes the fileIndex unnecessari

[jira] [Resolved] (SPARK-30424) Change ExpressionEncoder toRow method to return UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-30424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30424. - Resolution: Won't Fix > Change ExpressionEncoder toRow method to return UnsafeRow >

[jira] [Created] (SPARK-44232) add a config for auto refresh query result cache

Wenchen Fan created SPARK-44232: --- Summary: add a config for auto refresh query result cache Key: SPARK-44232 URL: https://issues.apache.org/jira/browse/SPARK-44232 Project: Spark Issue Type: Im

[jira] [Resolved] (SPARK-44205) Extract catalyst code from DecimalType

[ https://issues.apache.org/jira/browse/SPARK-44205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44205. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41757 [https://gith

[jira] [Resolved] (SPARK-44026) Update helper methods to create SQLMetric with initial value

[ https://issues.apache.org/jira/browse/SPARK-44026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44026. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41555 [https://gith

[jira] [Assigned] (SPARK-44026) Update helper methods to create SQLMetric with initial value

[ https://issues.apache.org/jira/browse/SPARK-44026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44026: --- Assignee: Johan Lasperas > Update helper methods to create SQLMetric with initial value > -

[jira] [Resolved] (SPARK-43203) Fix DROP table behavior in session catalog

[ https://issues.apache.org/jira/browse/SPARK-43203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43203. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41348 [https://gith

[jira] [Assigned] (SPARK-43203) Fix DROP table behavior in session catalog

[ https://issues.apache.org/jira/browse/SPARK-43203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43203: --- Assignee: Jia Fan > Fix DROP table behavior in session catalog > --

[jira] [Resolved] (SPARK-44018) Improve the hashCode for Some DS V2 Expression

[ https://issues.apache.org/jira/browse/SPARK-44018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44018. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-44018) Improve the hashCode for Some DS V2 Expression

[ https://issues.apache.org/jira/browse/SPARK-44018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44018: --- Assignee: jiaan.geng > Improve the hashCode for Some DS V2 Expression > ---

[jira] [Resolved] (SPARK-43961) Add optional pattern for Catalog.listTables

[ https://issues.apache.org/jira/browse/SPARK-43961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43961. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41461 [https://gith

[jira] [Resolved] (SPARK-43979) CollectedMetrics should be treated as the same one for self-join

[ https://issues.apache.org/jira/browse/SPARK-43979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43979. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41475 [https://gith

[jira] [Resolved] (SPARK-42750) Support INSERT INTO by name

[ https://issues.apache.org/jira/browse/SPARK-42750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42750. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40908 [https://gith

[jira] [Updated] (SPARK-43760) Incorrect attribute nullability after RewriteCorrelatedScalarSubquery leads to incorrect query results

[ https://issues.apache.org/jira/browse/SPARK-43760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-43760: Fix Version/s: 3.4.1 > Incorrect attribute nullability after RewriteCorrelatedScalarSubquery leads

[jira] [Resolved] (SPARK-43792) Add optional pattern for Catalog.listCatalogs

[ https://issues.apache.org/jira/browse/SPARK-43792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43792. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41311 [https://gith

<    4   5   6   7   8   9   10   11   12   13   >