[jira] [Resolved] (SPARK-41637) ORDER BY ALL

2022-12-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41637. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39144

[jira] [Resolved] (SPARK-41513) Implement a Accumulator to collect per mapper row count metrics

2022-12-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41513. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39057

[jira] [Resolved] (SPARK-41635) GROUP BY ALL

2022-12-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41635. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39134

[jira] [Assigned] (SPARK-41639) Remove ScalaReflectionLock

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41639: --- Assignee: Sandish Kumar HN > Remove ScalaReflectionLock > --- > >

[jira] [Resolved] (SPARK-41639) Remove ScalaReflectionLock

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41639. - Resolution: Fixed Issue resolved by pull request 39147

[jira] [Resolved] (SPARK-41669) Speed up CollapseProject for wide tables

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41669. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39161

[jira] [Assigned] (SPARK-41669) Speed up CollapseProject for wide tables

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41669: --- Assignee: Allison Wang > Speed up CollapseProject for wide tables >

[jira] [Resolved] (SPARK-41509) Delay execution hash until after aggregation for semi-join runtime filter.

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41509. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39049

[jira] [Assigned] (SPARK-41509) Delay execution hash until after aggregation for semi-join runtime filter.

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41509: --- Assignee: jiaan.geng > Delay execution hash until after aggregation for semi-join runtime

[jira] [Assigned] (SPARK-41660) only propagate metadata columns if they are used

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41660: --- Assignee: Wenchen Fan > only propagate metadata columns if they are used >

[jira] [Resolved] (SPARK-41660) only propagate metadata columns if they are used

2022-12-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41660. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39152

[jira] [Created] (SPARK-41660) only propagate metadata columns if they are used

2022-12-20 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41660: --- Summary: only propagate metadata columns if they are used Key: SPARK-41660 URL: https://issues.apache.org/jira/browse/SPARK-41660 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-41631) Support lateral column alias in Aggregate code path

2022-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41631. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39040

[jira] [Assigned] (SPARK-41631) Support lateral column alias in Aggregate code path

2022-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41631: --- Assignee: Xinyi Yu > Support lateral column alias in Aggregate code path >

[jira] [Assigned] (SPARK-41396) Oneof field support and recursive fields

2022-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41396: --- Assignee: Sandish Kumar HN > Oneof field support and recursive fields >

[jira] [Resolved] (SPARK-41396) Oneof field support and recursive fields

2022-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41396. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38922

[jira] [Resolved] (SPARK-41441) Allow Generate with no required child output to host outer references

2022-12-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41441. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38968

[jira] [Assigned] (SPARK-41441) Allow Generate with no required child output to host outer references

2022-12-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41441: --- Assignee: Allison Wang > Allow Generate with no required child output to host outer

[jira] [Resolved] (SPARK-41511) LongToUnsafeRowMap support ignoresDuplicatedKey

2022-12-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41511. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39051

[jira] [Created] (SPARK-41530) extend MedianHeap to support percentile

2022-12-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41530: --- Summary: extend MedianHeap to support percentile Key: SPARK-41530 URL: https://issues.apache.org/jira/browse/SPARK-41530 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses

2022-12-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27561: --- Assignee: Xinyi Yu > Support "lateral column alias references" to allow column aliases to

[jira] [Resolved] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses

2022-12-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27561. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38776

[jira] [Assigned] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter

2022-12-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41448: --- Assignee: Hui An > Make consistent MR job IDs in FileBatchWriter and FileFormatWriter >

[jira] [Resolved] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter

2022-12-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41448. - Fix Version/s: 3.3.2 3.2.3 3.4.0 Resolution: Fixed

[jira] [Assigned] (SPARK-40775) V2 file scans have duplicative descriptions

2022-12-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40775: --- Assignee: Adam Binford > V2 file scans have duplicative descriptions >

[jira] [Resolved] (SPARK-40775) V2 file scans have duplicative descriptions

2022-12-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40775. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38229

[jira] [Resolved] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions

2022-12-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41468. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions

2022-12-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41468: --- Assignee: Peter Toth > Fix PlanExpression handling in EquivalentExpressions >

[jira] [Resolved] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

2022-12-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41437. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38942

[jira] [Assigned] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

2022-12-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41437: --- Assignee: Wenchen Fan > Do not optimize the input query twice for v1 write fallback >

[jira] [Resolved] (SPARK-41349) Implement `DataFrame.hint`

2022-12-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41349. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38899

[jira] [Assigned] (SPARK-41349) Implement `DataFrame.hint`

2022-12-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41349: --- Assignee: Deng Ziming > Implement `DataFrame.hint` > -- > >

[jira] [Created] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

2022-12-06 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41437: --- Summary: Do not optimize the input query twice for v1 write fallback Key: SPARK-41437 URL: https://issues.apache.org/jira/browse/SPARK-41437 Project: Spark

[jira] [Created] (SPARK-41405) centralize the column resolution logic

2022-12-06 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41405: --- Summary: centralize the column resolution logic Key: SPARK-41405 URL: https://issues.apache.org/jira/browse/SPARK-41405 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-41355) Workaround hive table name validation issue

2022-12-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41355: --- Assignee: Wan Kun > Workaround hive table name validation issue >

[jira] [Resolved] (SPARK-41355) Workaround hive table name validation issue

2022-12-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41355. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38765

[jira] [Resolved] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

2022-12-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41358. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38873

[jira] [Assigned] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

2022-12-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41358: --- Assignee: Yang Jie > Use `PhysicalDataType` instead of DataType in ColumnVectorUtils >

[jira] [Created] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias

2022-12-01 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41350: --- Summary: allow simple name access of using join hidden columns after subquery alias Key: SPARK-41350 URL: https://issues.apache.org/jira/browse/SPARK-41350 Project:

[jira] [Resolved] (SPARK-41347) Add Cast to Expression proto

2022-12-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41347. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38859

[jira] [Assigned] (SPARK-41338) resolve outer references and normal columns in the same analyzer batch

2022-11-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41338: --- Assignee: Wenchen Fan > resolve outer references and normal columns in the same analyzer

[jira] [Resolved] (SPARK-41338) resolve outer references and normal columns in the same analyzer batch

2022-11-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41338. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38851

[jira] [Resolved] (SPARK-41343) Move FunctionName parsing to server side

2022-11-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41343. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38854

[jira] [Resolved] (SPARK-41226) Refactor Spark types by introducing physical types

2022-11-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41226. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38750

[jira] [Assigned] (SPARK-41226) Refactor Spark types by introducing physical types

2022-11-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41226: --- Assignee: Gengliang Wang > Refactor Spark types by introducing physical types >

[jira] [Created] (SPARK-41338) resolve outer references and normal columns in the same analyzer batch

2022-11-30 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41338: --- Summary: resolve outer references and normal columns in the same analyzer batch Key: SPARK-41338 URL: https://issues.apache.org/jira/browse/SPARK-41338 Project: Spark

[jira] [Resolved] (SPARK-41323) Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE()

2022-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41323. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38840

[jira] [Assigned] (SPARK-41323) Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE()

2022-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41323: --- Assignee: Serge Rielau > Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE() >

[jira] [Resolved] (SPARK-41256) Implement DataFrame.withColumn(s)

2022-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41256. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38793

[jira] [Resolved] (SPARK-41306) Improve Connect Expression proto documentation

2022-11-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41306. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38825

[jira] [Resolved] (SPARK-41003) BHJ LeftAnti does not update numOutputRows when codegen is disabled

2022-11-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41003. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38489

[jira] [Assigned] (SPARK-41003) BHJ LeftAnti does not update numOutputRows when codegen is disabled

2022-11-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41003: --- Assignee: dzcxzl > BHJ LeftAnti does not update numOutputRows when codegen is disabled >

[jira] [Assigned] (SPARK-41154) Incorrect relation caching for queries with time travel spec

2022-11-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41154: --- Assignee: XiDuo You > Incorrect relation caching for queries with time travel spec >

[jira] [Resolved] (SPARK-41154) Incorrect relation caching for queries with time travel spec

2022-11-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41154. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-41183) Add an extension API to do plan normalization for caching

2022-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41183: --- Assignee: Wenchen Fan > Add an extension API to do plan normalization for caching >

[jira] [Resolved] (SPARK-41183) Add an extension API to do plan normalization for caching

2022-11-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41183. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38692

[jira] [Created] (SPARK-41195) Support PIVOT/UNPIVOT with join children

2022-11-18 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41195: --- Summary: Support PIVOT/UNPIVOT with join children Key: SPARK-41195 URL: https://issues.apache.org/jira/browse/SPARK-41195 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-40999) Hints on subqueries are not properly propagated

2022-11-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40999: --- Assignee: Fredrik Klauß > Hints on subqueries are not properly propagated >

[jira] [Resolved] (SPARK-40999) Hints on subqueries are not properly propagated

2022-11-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40999. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38497

[jira] [Resolved] (SPARK-41178) fix parser rule precedence between JOIN and comma

2022-11-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41178. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38691

[jira] [Assigned] (SPARK-41178) fix parser rule precedence between JOIN and comma

2022-11-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41178: --- Assignee: Wenchen Fan > fix parser rule precedence between JOIN and comma >

[jira] [Created] (SPARK-41183) Add an extension API to do plan normalization for caching

2022-11-17 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41183: --- Summary: Add an extension API to do plan normalization for caching Key: SPARK-41183 URL: https://issues.apache.org/jira/browse/SPARK-41183 Project: Spark

[jira] [Created] (SPARK-41178) fix parser rule precedence between JOIN and comma

2022-11-17 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41178: --- Summary: fix parser rule precedence between JOIN and comma Key: SPARK-41178 URL: https://issues.apache.org/jira/browse/SPARK-41178 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41048) Improve output partitioning and ordering with AQE cache

2022-11-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41048: --- Assignee: XiDuo You > Improve output partitioning and ordering with AQE cache >

[jira] [Resolved] (SPARK-41048) Improve output partitioning and ordering with AQE cache

2022-11-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41048. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38558

[jira] [Resolved] (SPARK-41090) Enhance Dataset.createTempView testing coverage for db_name.view_name

2022-11-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41090. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38595

[jira] [Assigned] (SPARK-41090) Enhance Dataset.createTempView testing coverage for db_name.view_name

2022-11-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41090: --- Assignee: Rui Wang > Enhance Dataset.createTempView testing coverage for db_name.view_name

[jira] [Resolved] (SPARK-41103) Document how to add a new proto field of messages

2022-11-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41103. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38605

[jira] [Assigned] (SPARK-41103) Document how to add a new proto field of messages

2022-11-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41103: --- Assignee: Rui Wang > Document how to add a new proto field of messages >

[jira] [Assigned] (SPARK-40956) SQL Equivalent for Dataframe overwrite command

2022-11-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40956: --- Assignee: chengyan fu > SQL Equivalent for Dataframe overwrite command >

[jira] [Resolved] (SPARK-40956) SQL Equivalent for Dataframe overwrite command

2022-11-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40956. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38404

[jira] [Assigned] (SPARK-41144) UnresolvedHint should not cause query failure

2022-11-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41144: --- Assignee: XiDuo You > UnresolvedHint should not cause query failure >

[jira] [Resolved] (SPARK-41144) UnresolvedHint should not cause query failure

2022-11-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41144. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-41112) RuntimeFilter should apply ColumnPruning eagerly with in-subquery filter

2022-11-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41112. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38619

[jira] [Assigned] (SPARK-41112) RuntimeFilter should apply ColumnPruning eagerly with in-subquery filter

2022-11-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41112: --- Assignee: XiDuo You > RuntimeFilter should apply ColumnPruning eagerly with in-subquery

[jira] [Assigned] (SPARK-41134) improve error message of internal errors

2022-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41134: --- Assignee: Wenchen Fan > improve error message of internal errors >

[jira] [Resolved] (SPARK-41134) improve error message of internal errors

2022-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41134. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38648

[jira] [Created] (SPARK-41134) improve error message of internal errors

2022-11-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41134: --- Summary: improve error message of internal errors Key: SPARK-41134 URL: https://issues.apache.org/jira/browse/SPARK-41134 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-41111) Implement `DataFrame.show`

2022-11-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-4. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38621

[jira] [Resolved] (SPARK-41116) Input relation can be optional for Project in Connect proto

2022-11-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41116. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38632

[jira] [Assigned] (SPARK-41116) Input relation can be optional for Project in Connect proto

2022-11-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41116: --- Assignee: Rui Wang > Input relation can be optional for Project in Connect proto >

[jira] [Assigned] (SPARK-41102) Merge SparkConnectPlanner and SparkConnectCommandPlanner

2022-11-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41102: --- Assignee: Rui Wang > Merge SparkConnectPlanner and SparkConnectCommandPlanner >

[jira] [Resolved] (SPARK-41102) Merge SparkConnectPlanner and SparkConnectCommandPlanner

2022-11-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41102. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38604

[jira] [Created] (SPARK-41092) Do not use identifier to match interval units

2022-11-09 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41092: --- Summary: Do not use identifier to match interval units Key: SPARK-41092 URL: https://issues.apache.org/jira/browse/SPARK-41092 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41078) DataFrame `withColumnsRenamed` can be implemented through `RenameColumns` proto

2022-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41078: --- Assignee: Rui Wang > DataFrame `withColumnsRenamed` can be implemented through

[jira] [Resolved] (SPARK-41078) DataFrame `withColumnsRenamed` can be implemented through `RenameColumns` proto

2022-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41078. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38587

[jira] [Resolved] (SPARK-41046) Support CreateView in Connect DSL

2022-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41046. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38566

[jira] [Assigned] (SPARK-41046) Support CreateView in Connect DSL

2022-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41046: --- Assignee: Rui Wang > Support CreateView in Connect DSL > -

[jira] [Resolved] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

2022-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41061. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38573

[jira] [Assigned] (SPARK-41061) Support SelectExpr which apply Projection by expressions in Strings in Connect DSL

2022-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41061: --- Assignee: Rui Wang > Support SelectExpr which apply Projection by expressions in Strings

[jira] [Assigned] (SPARK-40588) Sorting issue with partitioned-writing and AQE turned on

2022-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40588: --- Assignee: Enrico Minack > Sorting issue with partitioned-writing and AQE turned on >

[jira] [Resolved] (SPARK-40588) Sorting issue with partitioned-writing and AQE turned on

2022-11-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40588. - Fix Version/s: 3.3.2 3.2.3 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-40992) Support toDF(columnNames) in Connect DSL

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40992. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38475

[jira] [Assigned] (SPARK-40992) Support toDF(columnNames) in Connect DSL

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40992: --- Assignee: Rui Wang > Support toDF(columnNames) in Connect DSL >

[jira] [Assigned] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41058: --- Assignee: Deng Ziming > Removing unused code in connect > ---

[jira] [Resolved] (SPARK-41058) Removing unused code in connect

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41058. - Resolution: Fixed Issue resolved by pull request 38491

[jira] [Resolved] (SPARK-40852) Implement `DataFrame.summary`

2022-11-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40852. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38318

[jira] [Updated] (SPARK-41017) Support column pruning with multiple nondeterministic Filters

2022-11-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-41017: Summary: Support column pruning with multiple nondeterministic Filters (was: Do not push Filter

[jira] [Resolved] (SPARK-41026) Support Repartition in Connect DSL

2022-11-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41026. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38529

[jira] [Assigned] (SPARK-41026) Support Repartition in Connect DSL

2022-11-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41026: --- Assignee: Rui Wang > Support Repartition in Connect DSL >

<    5   6   7   8   9   10   11   12   13   14   >