[jira] [Commented] (SPARK-34296) AggregateWindowFunction#frame should not always use UnboundedPreceding

[ https://issues.apache.org/jira/browse/SPARK-34296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275826#comment-17275826 ] Apache Spark commented on SPARK-34296: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-34296) AggregateWindowFunction#frame should not always use UnboundedPreceding

[ https://issues.apache.org/jira/browse/SPARK-34296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34296: Assignee: (was: Apache Spark) > AggregateWindowFunction#frame should not always use U

[jira] [Commented] (SPARK-34296) AggregateWindowFunction#frame should not always use UnboundedPreceding

[ https://issues.apache.org/jira/browse/SPARK-34296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275825#comment-17275825 ] Apache Spark commented on SPARK-34296: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-34296) AggregateWindowFunction#frame should not always use UnboundedPreceding

[ https://issues.apache.org/jira/browse/SPARK-34296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34296: Assignee: Apache Spark > AggregateWindowFunction#frame should not always use UnboundedPre

[jira] [Commented] (SPARK-34296) AggregateWindowFunction#frame should not always use UnboundedPreceding

[ https://issues.apache.org/jira/browse/SPARK-34296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275827#comment-17275827 ] Apache Spark commented on SPARK-34296: -- User 'AngersZh' has created a pull requ

[jira] [Created] (SPARK-34301) Use logical plan of alter table in `CatalogImpl.recoverPartitions()`

Maxim Gekk created SPARK-34301: -- Summary: Use logical plan of alter table in `CatalogImpl.recoverPartitions()` Key: SPARK-34301 URL: https://issues.apache.org/jira/browse/SPARK-34301 Project: Spark

[jira] [Commented] (SPARK-34301) Use logical plan of alter table in `CatalogImpl.recoverPartitions()`

[ https://issues.apache.org/jira/browse/SPARK-34301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275837#comment-17275837 ] Apache Spark commented on SPARK-34301: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34301) Use logical plan of alter table in `CatalogImpl.recoverPartitions()`

[ https://issues.apache.org/jira/browse/SPARK-34301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34301: Assignee: Apache Spark > Use logical plan of alter table in `CatalogImpl.recoverPartition

[jira] [Assigned] (SPARK-34301) Use logical plan of alter table in `CatalogImpl.recoverPartitions()`

[ https://issues.apache.org/jira/browse/SPARK-34301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34301: Assignee: (was: Apache Spark) > Use logical plan of alter table in `CatalogImpl.recov

[jira] [Commented] (SPARK-34301) Use logical plan of alter table in `CatalogImpl.recoverPartitions()`

[ https://issues.apache.org/jira/browse/SPARK-34301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275838#comment-17275838 ] Apache Spark commented on SPARK-34301: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275913#comment-17275913 ] Apache Spark commented on SPARK-34283: -- User 'zzcclp' has created a pull request fo

[jira] [Assigned] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34283: Assignee: Apache Spark > Combines all adjacent 'Union' operators into a single 'Union' wh

[jira] [Assigned] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34283: Assignee: (was: Apache Spark) > Combines all adjacent 'Union' operators into a single

[jira] [Commented] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct'

[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275914#comment-17275914 ] Apache Spark commented on SPARK-34283: -- User 'zzcclp' has created a pull request fo

[jira] [Created] (SPARK-34302) Migrate ALTER TABLE .. CHANGE COLUMN to new resolution framework

Maxim Gekk created SPARK-34302: -- Summary: Migrate ALTER TABLE .. CHANGE COLUMN to new resolution framework Key: SPARK-34302 URL: https://issues.apache.org/jira/browse/SPARK-34302 Project: Spark

[jira] [Updated] (SPARK-34302) Migrate ALTER TABLE .. CHANGE COLUMN to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-34302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34302: --- Description: # Create the Command logical node for ALTER TABLE .. CHANGE COLUMN # Remove AlterTableA

[jira] [Created] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

Maxim Gekk created SPARK-34303: -- Summary: Migrate ALTER TABLE ... SET LOCATION to new resolution framework Key: SPARK-34303 URL: https://issues.apache.org/jira/browse/SPARK-34303 Project: Spark

[jira] [Updated] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-34303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34303: --- Description: # Create the Command logical node for ALTER TABLE ... SET LOCATION # Remove AlterTableS

[jira] [Updated] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.distinct'

[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Summary: Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.u

[jira] [Updated] (SPARK-34283) Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.distinct'

[ https://issues.apache.org/jira/browse/SPARK-34283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-34283: --- Description: Problem: Currently when using 'Dataset.union.distinct.union.distinct' to union

[jira] [Created] (SPARK-34304) Remove view checks in v1 alter table commands

Maxim Gekk created SPARK-34304: -- Summary: Remove view checks in v1 alter table commands Key: SPARK-34304 URL: https://issues.apache.org/jira/browse/SPARK-34304 Project: Spark Issue Type: Sub-tas

[jira] [Commented] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275926#comment-17275926 ] Attila Zsolt Piros commented on SPARK-29391: I am working on this and within

[jira] [Created] (SPARK-34305) Unify v1 and v2 ALTER TABLE .. SET SERDE tests

Maxim Gekk created SPARK-34305: -- Summary: Unify v1 and v2 ALTER TABLE .. SET SERDE tests Key: SPARK-34305 URL: https://issues.apache.org/jira/browse/SPARK-34305 Project: Spark Issue Type: Sub-ta

[jira] [Updated] (SPARK-34305) Unify v1 and v2 ALTER TABLE .. SET SERDE tests

[ https://issues.apache.org/jira/browse/SPARK-34305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34305: --- Description: Extract ALTER TABLE .. SET SERDE tests to the common place to run them for V1 and v2 da

[jira] [Updated] (SPARK-34302) Migrate ALTER TABLE .. CHANGE COLUMN to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-34302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34302: --- Description: # Create the Command logical node for ALTER TABLE .. CHANGE COLUMN # Remove AlterTableA

[jira] [Updated] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-34303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34303: --- Description: # Create the Command logical node for ALTER TABLE ... SET LOCATION # Remove AlterTableS

[jira] [Commented] (SPARK-34304) Remove view checks in v1 alter table commands

[ https://issues.apache.org/jira/browse/SPARK-34304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275930#comment-17275930 ] Apache Spark commented on SPARK-34304: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34304) Remove view checks in v1 alter table commands

[ https://issues.apache.org/jira/browse/SPARK-34304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34304: Assignee: (was: Apache Spark) > Remove view checks in v1 alter table commands > -

[jira] [Assigned] (SPARK-34304) Remove view checks in v1 alter table commands

[ https://issues.apache.org/jira/browse/SPARK-34304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34304: Assignee: Apache Spark > Remove view checks in v1 alter table commands >

[jira] [Assigned] (SPARK-34304) Remove view checks in v1 alter table commands

[ https://issues.apache.org/jira/browse/SPARK-34304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34304: Assignee: Apache Spark > Remove view checks in v1 alter table commands >

[jira] [Commented] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275933#comment-17275933 ] Maxim Gekk commented on SPARK-29391: For now, I am not sure that we are still going

[jira] [Commented] (SPARK-29391) Default year-month units

[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275952#comment-17275952 ] Attila Zsolt Piros commented on SPARK-29391: If this helps in decision: the

[jira] [Commented] (SPARK-34161) Check re-caching of v2 table dependents after table altering

[ https://issues.apache.org/jira/browse/SPARK-34161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275958#comment-17275958 ] Maxim Gekk commented on SPARK-34161: This was resolved by https://github.com/apache/

[jira] [Assigned] (SPARK-34161) Check re-caching of v2 table dependents after table altering

[ https://issues.apache.org/jira/browse/SPARK-34161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34161: Assignee: (was: Apache Spark) > Check re-caching of v2 table dependents after table a

[jira] [Commented] (SPARK-34161) Check re-caching of v2 table dependents after table altering

[ https://issues.apache.org/jira/browse/SPARK-34161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275959#comment-17275959 ] Apache Spark commented on SPARK-34161: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34161) Check re-caching of v2 table dependents after table altering

[ https://issues.apache.org/jira/browse/SPARK-34161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34161: Assignee: Apache Spark > Check re-caching of v2 table dependents after table altering > -

[jira] [Commented] (SPARK-34194) Queries that only touch partition columns shouldn't scan through all files

[ https://issues.apache.org/jira/browse/SPARK-34194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275965#comment-17275965 ] Attila Zsolt Piros commented on SPARK-34194: [~nchammas] I suggest to check

[jira] [Resolved] (SPARK-12890) Spark SQL query related to only partition fields should not scan the whole data.

[ https://issues.apache.org/jira/browse/SPARK-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-12890. -- Resolution: Duplicate > Spark SQL query related to only partition fields should not scan the w

[jira] [Assigned] (SPARK-34256) VectorSlicer refine numFeatures checking and toString method

[ https://issues.apache.org/jira/browse/SPARK-34256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-34256: Assignee: zhengruifeng > VectorSlicer refine numFeatures checking and toString method > -

[jira] [Resolved] (SPARK-34256) VectorSlicer refine numFeatures checking and toString method

[ https://issues.apache.org/jira/browse/SPARK-34256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-34256. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31354 [https://gi

[jira] [Created] (SPARK-34306) Use Snake naming rule across the function APIs

Hyukjin Kwon created SPARK-34306: Summary: Use Snake naming rule across the function APIs Key: SPARK-34306 URL: https://issues.apache.org/jira/browse/SPARK-34306 Project: Spark Issue Type: Do

[jira] [Commented] (SPARK-34233) NPE for char padding in binary comparison

[ https://issues.apache.org/jira/browse/SPARK-34233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276048#comment-17276048 ] Apache Spark commented on SPARK-34233: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-34233) NPE for char padding in binary comparison

[ https://issues.apache.org/jira/browse/SPARK-34233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276049#comment-17276049 ] Apache Spark commented on SPARK-34233: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-33990) v2 ALTER TABLE .. DROP PARTITION does not remove data from dropped partition

[ https://issues.apache.org/jira/browse/SPARK-33990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276051#comment-17276051 ] Apache Spark commented on SPARK-33990: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-33990) v2 ALTER TABLE .. DROP PARTITION does not remove data from dropped partition

[ https://issues.apache.org/jira/browse/SPARK-33990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276050#comment-17276050 ] Apache Spark commented on SPARK-33990: -- User 'yaooqinn' has created a pull request

[jira] [Created] (SPARK-34307) TakeOrderedAndProjectExec avoid shuffle if input rdd has single partition

zhengruifeng created SPARK-34307: Summary: TakeOrderedAndProjectExec avoid shuffle if input rdd has single partition Key: SPARK-34307 URL: https://issues.apache.org/jira/browse/SPARK-34307 Project: Sp

[jira] [Commented] (SPARK-34307) TakeOrderedAndProjectExec avoid shuffle if input rdd has single partition

[ https://issues.apache.org/jira/browse/SPARK-34307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276071#comment-17276071 ] Apache Spark commented on SPARK-34307: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-34307) TakeOrderedAndProjectExec avoid shuffle if input rdd has single partition

[ https://issues.apache.org/jira/browse/SPARK-34307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34307: Assignee: (was: Apache Spark) > TakeOrderedAndProjectExec avoid shuffle if input rdd

[jira] [Commented] (SPARK-34306) Use Snake naming rule across the function APIs

[ https://issues.apache.org/jira/browse/SPARK-34306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276072#comment-17276072 ] Apache Spark commented on SPARK-34306: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-34307) TakeOrderedAndProjectExec avoid shuffle if input rdd has single partition

[ https://issues.apache.org/jira/browse/SPARK-34307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34307: Assignee: Apache Spark > TakeOrderedAndProjectExec avoid shuffle if input rdd has single

[jira] [Assigned] (SPARK-34306) Use Snake naming rule across the function APIs

[ https://issues.apache.org/jira/browse/SPARK-34306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34306: Assignee: (was: Apache Spark) > Use Snake naming rule across the function APIs >

[jira] [Assigned] (SPARK-34306) Use Snake naming rule across the function APIs

[ https://issues.apache.org/jira/browse/SPARK-34306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34306: Assignee: Apache Spark > Use Snake naming rule across the function APIs > ---

[jira] [Commented] (SPARK-34306) Use Snake naming rule across the function APIs

[ https://issues.apache.org/jira/browse/SPARK-34306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276073#comment-17276073 ] Apache Spark commented on SPARK-34306: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-33245) Add built-in UDF - GETBIT

[ https://issues.apache.org/jira/browse/SPARK-33245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276074#comment-17276074 ] Apache Spark commented on SPARK-33245: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-33245) Add built-in UDF - GETBIT

[ https://issues.apache.org/jira/browse/SPARK-33245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276075#comment-17276075 ] Apache Spark commented on SPARK-33245: -- User 'HyukjinKwon' has created a pull reque

[jira] [Created] (SPARK-34308) Escape meta-characters in printSchema

Kousuke Saruta created SPARK-34308: -- Summary: Escape meta-characters in printSchema Key: SPARK-34308 URL: https://issues.apache.org/jira/browse/SPARK-34308 Project: Spark Issue Type: Improve

[jira] [Updated] (SPARK-34308) Escape meta-characters in printSchema

[ https://issues.apache.org/jira/browse/SPARK-34308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34308: --- Description: Similar to SPARK-33690, the output layout of printSchema can break if column n

[jira] [Commented] (SPARK-33990) v2 ALTER TABLE .. DROP PARTITION does not remove data from dropped partition

[ https://issues.apache.org/jira/browse/SPARK-33990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276079#comment-17276079 ] Apache Spark commented on SPARK-33990: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-32985) Decouple bucket filter pruning and bucket table scan

[ https://issues.apache.org/jira/browse/SPARK-32985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276083#comment-17276083 ] Apache Spark commented on SPARK-32985: -- User 'c21' has created a pull request for t

[jira] [Assigned] (SPARK-32985) Decouple bucket filter pruning and bucket table scan

[ https://issues.apache.org/jira/browse/SPARK-32985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32985: Assignee: (was: Apache Spark) > Decouple bucket filter pruning and bucket table scan

[jira] [Assigned] (SPARK-32985) Decouple bucket filter pruning and bucket table scan

[ https://issues.apache.org/jira/browse/SPARK-32985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32985: Assignee: Apache Spark > Decouple bucket filter pruning and bucket table scan > -

[jira] [Assigned] (SPARK-34308) Escape meta-characters in printSchema

[ https://issues.apache.org/jira/browse/SPARK-34308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34308: Assignee: Kousuke Saruta (was: Apache Spark) > Escape meta-characters in printSchema > -

[jira] [Commented] (SPARK-34308) Escape meta-characters in printSchema

[ https://issues.apache.org/jira/browse/SPARK-34308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276086#comment-17276086 ] Apache Spark commented on SPARK-34308: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-34308) Escape meta-characters in printSchema

[ https://issues.apache.org/jira/browse/SPARK-34308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34308: Assignee: Apache Spark (was: Kousuke Saruta) > Escape meta-characters in printSchema > -