[jira] [Assigned] (SPARK-36848) Migrate ShowCurrentNamespaceStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36848: --- Assignee: Huaxin Gao > Migrate ShowCurrentNamespaceStatement to v2 command framework >

[jira] [Resolved] (SPARK-36848) Migrate ShowCurrentNamespaceStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36848. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34104

[jira] [Assigned] (SPARK-36721) Simplify boolean equalities if one side is literal

[ https://issues.apache.org/jira/browse/SPARK-36721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36721: --- Assignee: Kazuyuki Tanimura > Simplify boolean equalities if one side is literal >

[jira] [Resolved] (SPARK-36721) Simplify boolean equalities if one side is literal

[ https://issues.apache.org/jira/browse/SPARK-36721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36721. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34055

[jira] [Assigned] (SPARK-36815) Found duplicate rewrite attributes

[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36815: --- Assignee: gaoyajun02 > Found duplicate rewrite attributes >

[jira] [Resolved] (SPARK-36815) Found duplicate rewrite attributes

[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36815. - Resolution: Fixed > Found duplicate rewrite attributes > -- > >

[jira] [Commented] (SPARK-36815) Found duplicate rewrite attributes

[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418703#comment-17418703 ] L. C. Hsieh commented on SPARK-36815: - It was resolved by

[jira] [Resolved] (SPARK-36820) Disable LZ4 test for Hadoop 2.7 profile

[ https://issues.apache.org/jira/browse/SPARK-36820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36820. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34064

[jira] [Assigned] (SPARK-36820) Disable LZ4 test for Hadoop 2.7 profile

[ https://issues.apache.org/jira/browse/SPARK-36820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36820: --- Assignee: Chao Sun > Disable LZ4 test for Hadoop 2.7 profile >

[jira] [Commented] (SPARK-36818) Fix filtering a Series by a boolean Series

[ https://issues.apache.org/jira/browse/SPARK-36818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418446#comment-17418446 ] L. C. Hsieh commented on SPARK-36818: - For JIRA, it is better to fill some description there. I

[jira] [Updated] (SPARK-36818) Fix filtering a Series by a boolean Series

[ https://issues.apache.org/jira/browse/SPARK-36818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36818: Description: There is an error when filtering a Series using a condition from a DataFrame

[jira] [Created] (SPARK-36809) Remove broadcast for InSubqueryExec used in DPP

L. C. Hsieh created SPARK-36809: --- Summary: Remove broadcast for InSubqueryExec used in DPP Key: SPARK-36809 URL: https://issues.apache.org/jira/browse/SPARK-36809 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36790) Update user-facing catalog to adapt CatalogPlugin

[ https://issues.apache.org/jira/browse/SPARK-36790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36790: Issue Type: Improvement (was: Task) > Update user-facing catalog to adapt CatalogPlugin >

[jira] [Resolved] (SPARK-36776) Partition filter of DataSourceV2ScanRelation can not push down when select none dataSchema from FileScan

[ https://issues.apache.org/jira/browse/SPARK-36776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36776. - Resolution: Duplicate > Partition filter of DataSourceV2ScanRelation can not push down when

[jira] [Commented] (SPARK-36776) Partition filter of DataSourceV2ScanRelation can not push down when select none dataSchema from FileScan

[ https://issues.apache.org/jira/browse/SPARK-36776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17417234#comment-17417234 ] L. C. Hsieh commented on SPARK-36776: - This is duplicated to SPARK-35985. We just need backport

[jira] [Created] (SPARK-36797) Union should resolve nested columns as top-level columns

L. C. Hsieh created SPARK-36797: --- Summary: Union should resolve nested columns as top-level columns Key: SPARK-36797 URL: https://issues.apache.org/jira/browse/SPARK-36797 Project: Spark Issue

[jira] [Commented] (SPARK-36673) Incorrect Unions of struct with mismatched field name case

[ https://issues.apache.org/jira/browse/SPARK-36673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415921#comment-17415921 ] L. C. Hsieh commented on SPARK-36673: - The schema after union looks incorrect. By the definition of

[jira] [Resolved] (SPARK-36735) Adjust overhead of cached relation for DPP

[ https://issues.apache.org/jira/browse/SPARK-36735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36735. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33975

[jira] [Assigned] (SPARK-36735) Adjust overhead of cached relation for DPP

[ https://issues.apache.org/jira/browse/SPARK-36735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36735: --- Assignee: L. C. Hsieh > Adjust overhead of cached relation for DPP >

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414792#comment-17414792 ] L. C. Hsieh commented on SPARK-36681: - Unfortunately, I found some issues with the pure java

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414577#comment-17414577 ] L. C. Hsieh commented on SPARK-36681: - The possible workaround is to use pure java implementation

[jira] [Created] (SPARK-36735) Adjust overhead of cached relation for DPP

L. C. Hsieh created SPARK-36735: --- Summary: Adjust overhead of cached relation for DPP Key: SPARK-36735 URL: https://issues.apache.org/jira/browse/SPARK-36735 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-36670) Add end-to-end codec test cases for main datasources

[ https://issues.apache.org/jira/browse/SPARK-36670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36670: --- Assignee: L. C. Hsieh (was: Apache Spark) > Add end-to-end codec test cases for main

[jira] [Resolved] (SPARK-36461) Enable ObjectHashAggregate for more Aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-36461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36461. - Resolution: Won't Fix > Enable ObjectHashAggregate for more Aggregate functions >

[jira] [Assigned] (SPARK-36556) Add DSV2 filters

[ https://issues.apache.org/jira/browse/SPARK-36556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36556: --- Assignee: Huaxin Gao > Add DSV2 filters > > > Key:

[jira] [Resolved] (SPARK-36556) Add DSV2 filters

[ https://issues.apache.org/jira/browse/SPARK-36556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36556. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33803

[jira] [Resolved] (SPARK-36669) Fail to load Lz4 codec

[ https://issues.apache.org/jira/browse/SPARK-36669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36669. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33940

[jira] [Assigned] (SPARK-36669) Fail to load Lz4 codec

[ https://issues.apache.org/jira/browse/SPARK-36669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36669: --- Assignee: L. C. Hsieh > Fail to load Lz4 codec > -- > >

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412273#comment-17412273 ] L. C. Hsieh commented on SPARK-36681: - After discussing with some PMC members, as this only affects

[jira] [Updated] (SPARK-36681) Fail to load Snappy codec

[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36681: Priority: Major (was: Blocker) > Fail to load Snappy codec > - > >

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411717#comment-17411717 ] L. C. Hsieh commented on SPARK-36681: - yea. > Fail to load Snappy codec > -

[jira] [Assigned] (SPARK-36677) NestedColumnAliasing pushes down aggregate functions into projections

[ https://issues.apache.org/jira/browse/SPARK-36677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36677: --- Assignee: Venkata Sai Akhil Gudesa (was: L. C. Hsieh) > NestedColumnAliasing pushes down

[jira] [Resolved] (SPARK-36677) NestedColumnAliasing pushes down aggregate functions into projections

[ https://issues.apache.org/jira/browse/SPARK-36677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36677. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33921

[jira] [Assigned] (SPARK-36677) NestedColumnAliasing pushes down aggregate functions into projections

[ https://issues.apache.org/jira/browse/SPARK-36677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36677: --- Assignee: L. C. Hsieh > NestedColumnAliasing pushes down aggregate functions into

[jira] [Resolved] (SPARK-36670) Add end-to-end codec test cases for main datasources

[ https://issues.apache.org/jira/browse/SPARK-36670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36670. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33912

[jira] [Assigned] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

[ https://issues.apache.org/jira/browse/SPARK-36682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36682: --- Assignee: L. C. Hsieh > Add Hadoop sequence file test for Hadoop codecs >

[jira] [Resolved] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

[ https://issues.apache.org/jira/browse/SPARK-36682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36682. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33924

[jira] [Created] (SPARK-36682) Add Hadoop sequence file test for Hadoop codecs

L. C. Hsieh created SPARK-36682: --- Summary: Add Hadoop sequence file test for Hadoop codecs Key: SPARK-36682 URL: https://issues.apache.org/jira/browse/SPARK-36682 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36681) Fail to load Snappy codec

[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36681: Priority: Blocker (was: Major) > Fail to load Snappy codec > - > >

[jira] [Created] (SPARK-36681) Fail to load Snappy codec

L. C. Hsieh created SPARK-36681: --- Summary: Fail to load Snappy codec Key: SPARK-36681 URL: https://issues.apache.org/jira/browse/SPARK-36681 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-36667) Close resources properly in StateStoreSuite/RocksDBStateStoreSuite

[ https://issues.apache.org/jira/browse/SPARK-36667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36667. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33916

[jira] [Assigned] (SPARK-36667) Close resources properly in StateStoreSuite/RocksDBStateStoreSuite

[ https://issues.apache.org/jira/browse/SPARK-36667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36667: --- Assignee: Jungtaek Lim > Close resources properly in

[jira] [Created] (SPARK-36679) Remove lz4 hadoop wrapper classes after Hadoop 3.3.2

L. C. Hsieh created SPARK-36679: --- Summary: Remove lz4 hadoop wrapper classes after Hadoop 3.3.2 Key: SPARK-36679 URL: https://issues.apache.org/jira/browse/SPARK-36679 Project: Spark Issue

[jira] [Updated] (SPARK-36669) Fail to load Lz4 codec

[ https://issues.apache.org/jira/browse/SPARK-36669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36669: Priority: Blocker (was: Major) > Fail to load Lz4 codec > -- > >

[jira] [Created] (SPARK-36670) Add end-to-end codec test cases for main datasources

L. C. Hsieh created SPARK-36670: --- Summary: Add end-to-end codec test cases for main datasources Key: SPARK-36670 URL: https://issues.apache.org/jira/browse/SPARK-36670 Project: Spark Issue

[jira] [Created] (SPARK-36669) Fail to load Lz4 codec

L. C. Hsieh created SPARK-36669: --- Summary: Fail to load Lz4 codec Key: SPARK-36669 URL: https://issues.apache.org/jira/browse/SPARK-36669 Project: Spark Issue Type: Bug Components:

[jira] [Resolved] (SPARK-36351) Separate partition filters and data filters in PushDownUtils

[ https://issues.apache.org/jira/browse/SPARK-36351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36351. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33650

[jira] [Assigned] (SPARK-36351) Separate partition filters and data filters in PushDownUtils

[ https://issues.apache.org/jira/browse/SPARK-36351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36351: --- Assignee: Huaxin Gao > Separate partition filters and data filters in PushDownUtils >

[jira] [Resolved] (SPARK-36605) Upgrade Jackson to 2.12.5

[ https://issues.apache.org/jira/browse/SPARK-36605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36605. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33860

[jira] [Resolved] (SPARK-36519) Store the RocksDB format in the checkpoint for a streaming query

[ https://issues.apache.org/jira/browse/SPARK-36519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36519. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33749

[jira] [Commented] (SPARK-36465) Dynamic gap duration in session window

[ https://issues.apache.org/jira/browse/SPARK-36465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400805#comment-17400805 ] L. C. Hsieh commented on SPARK-36465: - Thanks [~Gengliang.Wang]! > Dynamic gap duration in session

[jira] [Resolved] (SPARK-36041) Introduce the RocksDBStateStoreProvider in the programming guide

[ https://issues.apache.org/jira/browse/SPARK-36041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36041. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33683

[jira] [Assigned] (SPARK-36041) Introduce the RocksDBStateStoreProvider in the programming guide

[ https://issues.apache.org/jira/browse/SPARK-36041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36041: --- Assignee: Yuanjian Li > Introduce the RocksDBStateStoreProvider in the programming guide >

[jira] [Updated] (SPARK-36465) Dynamic gap duration in session window

[ https://issues.apache.org/jira/browse/SPARK-36465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36465: Affects Version/s: (was: 3.3.0) 3.2.0 > Dynamic gap duration in

[jira] [Assigned] (SPARK-36480) SessionWindowStateStoreSaveExec should not filter input rows against watermark

[ https://issues.apache.org/jira/browse/SPARK-36480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36480: --- Assignee: Jungtaek Lim > SessionWindowStateStoreSaveExec should not filter input rows

[jira] [Commented] (SPARK-36480) SessionWindowStateStoreSaveExec should not filter input rows against watermark

[ https://issues.apache.org/jira/browse/SPARK-36480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397775#comment-17397775 ] L. C. Hsieh commented on SPARK-36480: - The issue was resolved at

[jira] [Resolved] (SPARK-36480) SessionWindowStateStoreSaveExec should not filter input rows against watermark

[ https://issues.apache.org/jira/browse/SPARK-36480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36480. - Resolution: Fixed > SessionWindowStateStoreSaveExec should not filter input rows against

[jira] [Updated] (SPARK-36480) SessionWindowStateStoreSaveExec should not filter input rows against watermark

[ https://issues.apache.org/jira/browse/SPARK-36480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36480: Fix Version/s: 3.2.0 > SessionWindowStateStoreSaveExec should not filter input rows against

[jira] [Created] (SPARK-36465) Dynamic gap duration in session window

L. C. Hsieh created SPARK-36465: --- Summary: Dynamic gap duration in session window Key: SPARK-36465 URL: https://issues.apache.org/jira/browse/SPARK-36465 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-36463) Prohibit update mode in native support of session window

[ https://issues.apache.org/jira/browse/SPARK-36463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396440#comment-17396440 ] L. C. Hsieh commented on SPARK-36463: - Thanks [~kabhwan] ,[~Gengliang.Wang] . I will do the review

[jira] [Created] (SPARK-36461) Enable ObjectHashAggregate for more Aggregate functions

L. C. Hsieh created SPARK-36461: --- Summary: Enable ObjectHashAggregate for more Aggregate functions Key: SPARK-36461 URL: https://issues.apache.org/jira/browse/SPARK-36461 Project: Spark Issue

[jira] [Commented] (SPARK-36393) Try to raise memory and parallelism again for GA

[ https://issues.apache.org/jira/browse/SPARK-36393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393717#comment-17393717 ] L. C. Hsieh commented on SPARK-36393: - The issue was resolved at

[jira] [Resolved] (SPARK-36393) Try to raise memory and parallelism again for GA

[ https://issues.apache.org/jira/browse/SPARK-36393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36393. - Fix Version/s: 3.2.0 Assignee: L. C. Hsieh Resolution: Fixed > Try to raise

[jira] [Created] (SPARK-36393) Try to raise memory and parallelism again for GA

L. C. Hsieh created SPARK-36393: --- Summary: Try to raise memory and parallelism again for GA Key: SPARK-36393 URL: https://issues.apache.org/jira/browse/SPARK-36393 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36137) HiveShim always fallback to getAllPartitionsOf regardless of whether directSQL is enabled in remote HMS

[ https://issues.apache.org/jira/browse/SPARK-36137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36137. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33382

[jira] [Assigned] (SPARK-36137) HiveShim always fallback to getAllPartitionsOf regardless of whether directSQL is enabled in remote HMS

[ https://issues.apache.org/jira/browse/SPARK-36137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36137: --- Assignee: Chao Sun > HiveShim always fallback to getAllPartitionsOf regardless of whether

[jira] [Assigned] (SPARK-36136) Move PruneFileSourcePartitionsSuite out of org.apache.spark.sql.hive

[ https://issues.apache.org/jira/browse/SPARK-36136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36136: --- Assignee: Chao Sun > Move PruneFileSourcePartitionsSuite out of org.apache.spark.sql.hive

[jira] [Resolved] (SPARK-36136) Move PruneFileSourcePartitionsSuite out of org.apache.spark.sql.hive

[ https://issues.apache.org/jira/browse/SPARK-36136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36136. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33564

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389144#comment-17389144 ] L. C. Hsieh commented on SPARK-18105: - Looked at lz4 codebase and the reported failures. I suspect

[jira] [Resolved] (SPARK-36236) RocksDB state store: Add additional metrics for better observability into state store operations

[ https://issues.apache.org/jira/browse/SPARK-36236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36236. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33455

[jira] [Assigned] (SPARK-36236) RocksDB state store: Add additional metrics for better observability into state store operations

[ https://issues.apache.org/jira/browse/SPARK-36236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36236: --- Assignee: Venki Korukanti > RocksDB state store: Add additional metrics for better

[jira] [Assigned] (SPARK-36314) Update Sessionization example to use native support of session window

[ https://issues.apache.org/jira/browse/SPARK-36314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36314: --- Assignee: Jungtaek Lim > Update Sessionization example to use native support of session

[jira] [Resolved] (SPARK-36314) Update Sessionization example to use native support of session window

[ https://issues.apache.org/jira/browse/SPARK-36314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36314. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33548

[jira] [Commented] (SPARK-35211) Support UDT for Pandas with Arrow Disabled

[ https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17387630#comment-17387630 ] L. C. Hsieh commented on SPARK-35211: - The Jira title looks more like a new feature/improvement. But

[jira] [Resolved] (SPARK-36136) Move PruneFileSourcePartitionsSuite out of org.apache.spark.sql.hive

[ https://issues.apache.org/jira/browse/SPARK-36136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36136. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33350

[jira] [Assigned] (SPARK-36136) Move PruneFileSourcePartitionsSuite out of org.apache.spark.sql.hive

[ https://issues.apache.org/jira/browse/SPARK-36136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36136: --- Assignee: Chao Sun > Move PruneFileSourcePartitionsSuite out of org.apache.spark.sql.hive

[jira] [Resolved] (SPARK-36281) Re-enable the test of external listerners in SparkSQLEnvSuite

[ https://issues.apache.org/jira/browse/SPARK-36281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36281. - Resolution: Invalid > Re-enable the test of external listerners in SparkSQLEnvSuite >

[jira] [Created] (SPARK-36281) Re-enable the test of external listerners in SparkSQLEnvSuite

L. C. Hsieh created SPARK-36281: --- Summary: Re-enable the test of external listerners in SparkSQLEnvSuite Key: SPARK-36281 URL: https://issues.apache.org/jira/browse/SPARK-36281 Project: Spark

[jira] [Created] (SPARK-36272) Re-enable SPARK-32629 ShuffledHashJoin(full outer) metrics

L. C. Hsieh created SPARK-36272: --- Summary: Re-enable SPARK-32629 ShuffledHashJoin(full outer) metrics Key: SPARK-36272 URL: https://issues.apache.org/jira/browse/SPARK-36272 Project: Spark

[jira] [Created] (SPARK-36270) Change memory settings for enabling GA

L. C. Hsieh created SPARK-36270: --- Summary: Change memory settings for enabling GA Key: SPARK-36270 URL: https://issues.apache.org/jira/browse/SPARK-36270 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-36030) Support DS v2 metrics at writing path

[ https://issues.apache.org/jira/browse/SPARK-36030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36030. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33239

[jira] [Commented] (SPARK-10816) EventTime based sessionization (session window)

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384592#comment-17384592 ] L. C. Hsieh commented on SPARK-10816: - Yea, excited to have the great work in the next 3.2 release!

[jira] [Updated] (SPARK-36210) Preserve column insertion order in Dataset.withColumns

[ https://issues.apache.org/jira/browse/SPARK-36210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36210: Affects Version/s: 3.2.0 3.0.3 > Preserve column insertion order in

[jira] [Resolved] (SPARK-36210) Preserve column insertion order in Dataset.withColumns

[ https://issues.apache.org/jira/browse/SPARK-36210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36210. - Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution: Fixed

[jira] [Assigned] (SPARK-36210) Preserve column insertion order in Dataset.withColumns

[ https://issues.apache.org/jira/browse/SPARK-36210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36210: --- Assignee: koert kuipers > Preserve column insertion order in Dataset.withColumns >

[jira] [Resolved] (SPARK-36128) CatalogFileIndex.filterPartitions should respect spark.sql.hive.metastorePartitionPruning

[ https://issues.apache.org/jira/browse/SPARK-36128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36128. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33348

[jira] [Assigned] (SPARK-36128) CatalogFileIndex.filterPartitions should respect spark.sql.hive.metastorePartitionPruning

[ https://issues.apache.org/jira/browse/SPARK-36128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36128: --- Assignee: Chao Sun > CatalogFileIndex.filterPartitions should respect >

[jira] [Updated] (SPARK-35972) When replace ExtractValue in NestedColumnAliasing we should use semanticEquals

[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-35972: Fix Version/s: 3.1.3 > When replace ExtractValue in NestedColumnAliasing we should use

[jira] [Assigned] (SPARK-35972) When replace ExtractValue in NestedColumnAliasing we should use semanticEquals

[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-35972: --- Assignee: angerszhu > When replace ExtractValue in NestedColumnAliasing we should use

[jira] [Assigned] (SPARK-36157) TimeWindow expression: apply filter before project

[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36157: --- Assignee: Jungtaek Lim > TimeWindow expression: apply filter before project >

[jira] [Resolved] (SPARK-36157) TimeWindow expression: apply filter before project

[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36157. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33367

[jira] [Resolved] (SPARK-34891) Introduce state store manager for session window in streaming query

[ https://issues.apache.org/jira/browse/SPARK-34891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34891. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31989

[jira] [Assigned] (SPARK-34891) Introduce state store manager for session window in streaming query

[ https://issues.apache.org/jira/browse/SPARK-34891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-34891: --- Assignee: Jungtaek Lim > Introduce state store manager for session window in streaming

[jira] [Updated] (SPARK-36109) Fix flaky KafkaSourceStressSuite

[ https://issues.apache.org/jira/browse/SPARK-36109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36109: Affects Version/s: 3.0.3 > Fix flaky KafkaSourceStressSuite > >

[jira] [Updated] (SPARK-36109) Fix flaky KafkaSourceStressSuite

[ https://issues.apache.org/jira/browse/SPARK-36109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36109: Affects Version/s: 3.1.2 > Fix flaky KafkaSourceStressSuite > >

[jira] [Created] (SPARK-36109) Fix flaky KafkaSourceStressSuite

L. C. Hsieh created SPARK-36109: --- Summary: Fix flaky KafkaSourceStressSuite Key: SPARK-36109 URL: https://issues.apache.org/jira/browse/SPARK-36109 Project: Spark Issue Type: Test

[jira] [Resolved] (SPARK-35861) Introduce "prefix match scan" feature on state store

[ https://issues.apache.org/jira/browse/SPARK-35861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-35861. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33038

[jira] [Assigned] (SPARK-35861) Introduce "prefix match scan" feature on state store

[ https://issues.apache.org/jira/browse/SPARK-35861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-35861: --- Assignee: Jungtaek Lim > Introduce "prefix match scan" feature on state store >

[jira] [Assigned] (SPARK-36032) Use inputPlan instead of currentPhysicalPlan to initialize logical link

[ https://issues.apache.org/jira/browse/SPARK-36032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36032: --- Assignee: XiDuo You > Use inputPlan instead of currentPhysicalPlan to initialize logical

[jira] [Resolved] (SPARK-36032) Use inputPlan instead of currentPhysicalPlan to initialize logical link

[ https://issues.apache.org/jira/browse/SPARK-36032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36032. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33244

<    1   2   3   4   5   6   7   8   9   10   >