[jira] [Updated] (SPARK-45794) Introduce state metadata source to query the streaming state metadata information

2023-11-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45794: --- Labels: pull-request-available (was: ) > Introduce state metadata source to query the

[jira] [Created] (SPARK-45794) Introduce state metadata source to query the streaming state metadata information

2023-11-04 Thread Chaoqin Li (Jira)
Chaoqin Li created SPARK-45794: -- Summary: Introduce state metadata source to query the streaming state metadata information Key: SPARK-45794 URL: https://issues.apache.org/jira/browse/SPARK-45794

[jira] [Updated] (SPARK-45793) Improve the built-in compression codecs

2023-11-04 Thread Jiaan Geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-45793: --- Description: Currently, Spark supported many built-in compression codecs used for I/O and storage.

[jira] [Updated] (SPARK-44365) Use PartitionEvaluator API in FileSourceScanExec, RowDataSourceScanExec, MergeRowsExec

2023-11-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44365: --- Labels: pull-request-available (was: ) > Use PartitionEvaluator API in FileSourceScanExec,

[jira] [Updated] (SPARK-44412) Use PartitionEvaluator API in ArrowEvalPythonUDTFExec & BatchEvalPythonUDTFExec

2023-11-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44412: --- Labels: pull-request-available (was: ) > Use PartitionEvaluator API in

[jira] [Updated] (SPARK-44886) Introduce CLUSTER BY SQL clause to CREATE/REPLACE TABLE

2023-11-04 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-44886: -- Description: This proposes to introduce CLUSTER BY clause to CREATE/REPLACE SQL syntax: {code:java}

[jira] [Commented] (SPARK-45792) SPIP: ShuffleManager short name registration via SparkPlugin

2023-11-04 Thread Alessandro Bellina (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782931#comment-17782931 ] Alessandro Bellina commented on SPARK-45792: Added a link to an issue that needs to be

[jira] [Created] (SPARK-45792) SPIP: ShuffleManager short name registration via SparkPlugin

2023-11-04 Thread Alessandro Bellina (Jira)
Alessandro Bellina created SPARK-45792: -- Summary: SPIP: ShuffleManager short name registration via SparkPlugin Key: SPARK-45792 URL: https://issues.apache.org/jira/browse/SPARK-45792 Project:

[jira] [Commented] (SPARK-44662) SPIP: Improving performance of BroadcastHashJoin queries with stream side join key on non partition columns

2023-11-04 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782927#comment-17782927 ] Asif commented on SPARK-44662: -- The majority of file changes are due to additional tpcds tests for iceberg.

[jira] [Updated] (SPARK-44662) SPIP: Improving performance of BroadcastHashJoin queries with stream side join key on non partition columns

2023-11-04 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-44662: - Attachment: perf results broadcast var pushdown - Partitioned TPCDS.pdf > SPIP: Improving performance of

[jira] [Updated] (SPARK-44662) SPIP: Improving performance of BroadcastHashJoin queries with stream side join key on non partition columns

2023-11-04 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-44662: - Description: h2. *Q1. What are you trying to do? Articulate your objectives using absolutely no jargon.* On

[jira] [Updated] (SPARK-44662) SPIP: Improving performance of BroadcastHashJoin queries with stream side join key on non partition columns

2023-11-04 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-44662: - Affects Version/s: 3.5.1 (was: 3.3.3) > SPIP: Improving performance of

[jira] [Updated] (SPARK-44662) SPIP: Improving performance of BroadcastHashJoin queries with stream side join key on non partition columns

2023-11-04 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-44662: - Description: h2. *Q1. What are you trying to do? Articulate your objectives using absolutely no jargon.* On

[jira] [Updated] (SPARK-44662) SPIP: Improving performance of BroadcastHashJoin queries with stream side join key on non partition columns

2023-11-04 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-44662: - Description: h2. *Q1. What are you trying to do? Articulate your objectives using absolutely no jargon.* On

[jira] [Resolved] (SPARK-45790) Move `graphx` to `mllib*` test pipeline

2023-11-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45790. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43656

[jira] [Assigned] (SPARK-45791) Rename `SparkConnectSessionHodlerSuite.scala` to `SparkConnectSessionHolderSuite.scala`

2023-11-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45791: - Assignee: Dongjoon Hyun > Rename `SparkConnectSessionHodlerSuite.scala` to >

[jira] [Resolved] (SPARK-45791) Rename `SparkConnectSessionHodlerSuite.scala` to `SparkConnectSessionHolderSuite.scala`

2023-11-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45791. --- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-45699) Fix "Widening conversion from `TypeA` to `TypeB` is deprecated because it loses precision"

2023-11-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45699: - Description: {code:java} error]

[jira] [Commented] (SPARK-45699) Fix "Widening conversion from `TypeA` to `TypeB` is deprecated because it loses precision"

2023-11-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782893#comment-17782893 ] Yang Jie commented on SPARK-45699: -- [~hannahkamundson]  Okay, I'm looking forward to your pr.          

[jira] [Assigned] (SPARK-45781) Upgrade Arrow to 14.0.0

2023-11-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45781: - Assignee: Yang Jie > Upgrade Arrow to 14.0.0 > --- > >

[jira] [Resolved] (SPARK-45781) Upgrade Arrow to 14.0.0

2023-11-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45781. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43650

[jira] [Updated] (SPARK-45791) Rename `SparkConnectSessionHodlerSuite.scala` to `SparkConnectSessionHolderSuite.scala`

2023-11-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45791: --- Labels: pull-request-available (was: ) > Rename `SparkConnectSessionHodlerSuite.scala` to

[jira] [Created] (SPARK-45791) Rename `SparkConnectSessionHodlerSuite.scala` to `SparkConnectSessionHolderSuite.scala`

2023-11-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45791: - Summary: Rename `SparkConnectSessionHodlerSuite.scala` to `SparkConnectSessionHolderSuite.scala` Key: SPARK-45791 URL: https://issues.apache.org/jira/browse/SPARK-45791

[jira] [Updated] (SPARK-45790) Move `graphx` to `mllib*` test pipeline

2023-11-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45790: --- Labels: pull-request-available (was: ) > Move `graphx` to `mllib*` test pipeline >

[jira] [Created] (SPARK-45790) Move `graphx` to `mllib*` test pipeline

2023-11-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45790: - Summary: Move `graphx` to `mllib*` test pipeline Key: SPARK-45790 URL: https://issues.apache.org/jira/browse/SPARK-45790 Project: Spark Issue Type: Task