[jira] [Updated] (SPARK-46714) Overwrite partitions with custom location should reset partition locations

[ https://issues.apache.org/jira/browse/SPARK-46714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46714: --- Labels: pull-request-available (was: ) > Overwrite partitions with custom location should

[jira] [Created] (SPARK-46714) Overwrite partitions with custom location should reset partition locations

Adrian Wang created SPARK-46714: --- Summary: Overwrite partitions with custom location should reset partition locations Key: SPARK-46714 URL: https://issues.apache.org/jira/browse/SPARK-46714 Project:

[jira] [Updated] (SPARK-46712) [Minor] Fix indentation for streaming aggregation operator

[ https://issues.apache.org/jira/browse/SPARK-46712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46712: --- Labels: pull-request-available (was: ) > [Minor] Fix indentation for streaming aggregation

[jira] [Created] (SPARK-46712) [Minor] Fix indentation for streaming aggregation operator

Anish Shrigondekar created SPARK-46712: -- Summary: [Minor] Fix indentation for streaming aggregation operator Key: SPARK-46712 URL: https://issues.apache.org/jira/browse/SPARK-46712 Project: Spark

[jira] [Updated] (SPARK-46713) Refine docstring of `map_keys/map_values/map_entries`

[ https://issues.apache.org/jira/browse/SPARK-46713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46713: --- Labels: pull-request-available (was: ) > Refine docstring of

[jira] [Created] (SPARK-46713) Refine docstring of `map_keys/map_values/map_entries`

Yang Jie created SPARK-46713: Summary: Refine docstring of `map_keys/map_values/map_entries` Key: SPARK-46713 URL: https://issues.apache.org/jira/browse/SPARK-46713 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-46709) Expose partition_id column in state datasource by default

[ https://issues.apache.org/jira/browse/SPARK-46709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46709: Assignee: Chaoqin Li > Expose partition_id column in state datasource by default >

[jira] [Comment Edited] (SPARK-37913) Null Pointer Exception when Loading ML Pipeline Model with Custom Transformer

[ https://issues.apache.org/jira/browse/SPARK-37913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17795697#comment-17795697 ] APeng Zhang edited comment on SPARK-37913 at 1/15/24 12:35 AM: ---

[jira] [Resolved] (SPARK-46709) Expose partition_id column in state datasource by default

[ https://issues.apache.org/jira/browse/SPARK-46709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46709. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44717

[jira] [Assigned] (SPARK-46711) Fix race condition during rollback with RocksDBStateStoreProvider

[ https://issues.apache.org/jira/browse/SPARK-46711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-46711: Assignee: Anish Shrigondekar > Fix race condition during rollback with

[jira] [Resolved] (SPARK-46711) Fix race condition during rollback with RocksDBStateStoreProvider

[ https://issues.apache.org/jira/browse/SPARK-46711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-46711. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44722

[jira] [Created] (SPARK-46715) Pin `sphinxcontrib-*`

Ruifeng Zheng created SPARK-46715: - Summary: Pin `sphinxcontrib-*` Key: SPARK-46715 URL: https://issues.apache.org/jira/browse/SPARK-46715 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-28551) CTAS SQL with LOCATION properties won't check location path, cause data under this location lose

[ https://issues.apache.org/jira/browse/SPARK-28551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-28551: --- Labels: pull-request-available (was: ) > CTAS SQL with LOCATION properties won't check

[jira] [Updated] (SPARK-46718) Upgrade Arrow to 15.0.0

[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46718: Attachment: image-2024-01-15-14-02-57-814.png > Upgrade Arrow to 15.0.0 > ---

[jira] [Updated] (SPARK-46717) Simplify the ReloadingX509TrustManager by the exit operation only depend on interrupt thread

[ https://issues.apache.org/jira/browse/SPARK-46717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46717: --- Labels: pull-request-available (was: ) > Simplify the ReloadingX509TrustManager by the

[jira] [Created] (SPARK-46719) Rebalance `pyspark_pandas` and `pyspark_pandas_slow`

Ruifeng Zheng created SPARK-46719: - Summary: Rebalance `pyspark_pandas` and `pyspark_pandas_slow` Key: SPARK-46719 URL: https://issues.apache.org/jira/browse/SPARK-46719 Project: Spark Issue

[jira] [Created] (SPARK-46720) Refactor Python Data Source to aline with other built-in Data Sources

Hyukjin Kwon created SPARK-46720: Summary: Refactor Python Data Source to aline with other built-in Data Sources Key: SPARK-46720 URL: https://issues.apache.org/jira/browse/SPARK-46720 Project: Spark

[jira] [Commented] (SPARK-45393) Upgrade Hadoop to 3.3.7

[ https://issues.apache.org/jira/browse/SPARK-45393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806639#comment-17806639 ] Yang Jie commented on SPARK-45393: -- Friendly ping [~dongjoon]  It looks like the next version is

[jira] [Comment Edited] (SPARK-45393) Upgrade Hadoop to 3.3.7

[ https://issues.apache.org/jira/browse/SPARK-45393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806639#comment-17806639 ] Yang Jie edited comment on SPARK-45393 at 1/15/24 6:16 AM: --- Friendly ping

[jira] [Resolved] (SPARK-46716) Add a test regarding to backward compatibility check for Scala StreamingQueryListener

[ https://issues.apache.org/jira/browse/SPARK-46716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46716. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44730

[jira] [Resolved] (SPARK-45435) Document that lazy checkpoint may not be a consistent

[ https://issues.apache.org/jira/browse/SPARK-45435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45435. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43247

[jira] [Assigned] (SPARK-45435) Document that lazy checkpoint may not be a consistent

[ https://issues.apache.org/jira/browse/SPARK-45435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45435: --- Assignee: Juliusz Sompolski > Document that lazy checkpoint may not be a consistent >

[jira] [Assigned] (SPARK-46719) Rebalance `pyspark_pandas` and `pyspark_pandas_slow`

[ https://issues.apache.org/jira/browse/SPARK-46719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46719: - Assignee: Ruifeng Zheng > Rebalance `pyspark_pandas` and `pyspark_pandas_slow` >

[jira] [Assigned] (SPARK-46713) Refine docstring of `map_keys/map_values/map_entries`

[ https://issues.apache.org/jira/browse/SPARK-46713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46713: Assignee: Yang Jie > Refine docstring of `map_keys/map_values/map_entries` >

[jira] [Resolved] (SPARK-46713) Refine docstring of `map_keys/map_values/map_entries`

[ https://issues.apache.org/jira/browse/SPARK-46713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46713. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44724

[jira] [Created] (SPARK-46717) Simplify the ReloadingX509TrustManager by the exit operation only depend on interrupt thread

Yang Jie created SPARK-46717: Summary: Simplify the ReloadingX509TrustManager by the exit operation only depend on interrupt thread Key: SPARK-46717 URL: https://issues.apache.org/jira/browse/SPARK-46717

[jira] [Created] (SPARK-46718) Upgrade Arrow to 15.0.0

Yang Jie created SPARK-46718: Summary: Upgrade Arrow to 15.0.0 Key: SPARK-46718 URL: https://issues.apache.org/jira/browse/SPARK-46718 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-46718) Upgrade Arrow to 15.0.0

[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806635#comment-17806635 ] Yang Jie commented on SPARK-46718: -- cc [~panbingkun] could we upgrade to use this version? Does this

[jira] [Commented] (SPARK-46718) Upgrade Arrow to 15.0.0

[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806638#comment-17806638 ] Yang Jie commented on SPARK-46718: -- ok > Upgrade Arrow to 15.0.0 > --- > >

[jira] [Commented] (SPARK-46718) Upgrade Arrow to 15.0.0

[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806637#comment-17806637 ] BingKun Pan commented on SPARK-46718: - !image-2024-01-15-14-02-57-814.png|width=1118,height=102!

[jira] [Resolved] (SPARK-46719) Rebalance `pyspark_pandas` and `pyspark_pandas_slow`

[ https://issues.apache.org/jira/browse/SPARK-46719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46719. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44731

[jira] [Updated] (SPARK-46715) Pin `sphinxcontrib-*`

[ https://issues.apache.org/jira/browse/SPARK-46715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46715: --- Labels: pull-request-available (was: ) > Pin `sphinxcontrib-*` > - > >

[jira] [Commented] (SPARK-46716) Add a test regarding to backward compatibility check for Scala StreamingQueryListener

[ https://issues.apache.org/jira/browse/SPARK-46716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806612#comment-17806612 ] Jungtaek Lim commented on SPARK-46716: -- Will submit a PR shortly. > Add a test regarding to

[jira] [Created] (SPARK-46716) Add a test regarding to backward compatibility check for Scala StreamingQueryListener

Jungtaek Lim created SPARK-46716: Summary: Add a test regarding to backward compatibility check for Scala StreamingQueryListener Key: SPARK-46716 URL: https://issues.apache.org/jira/browse/SPARK-46716

[jira] [Commented] (SPARK-46718) Upgrade Arrow to 15.0.0

[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806636#comment-17806636 ] BingKun Pan commented on SPARK-46718: - Let me take a look at this version first to see if it

[jira] [Assigned] (SPARK-46716) Add a test regarding to backward compatibility check for Scala StreamingQueryListener

[ https://issues.apache.org/jira/browse/SPARK-46716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46716: Assignee: Jungtaek Lim > Add a test regarding to backward compatibility check for Scala

[jira] [Assigned] (SPARK-46274) Range operator computeStats() proper long conversions

[ https://issues.apache.org/jira/browse/SPARK-46274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46274: --- Assignee: Nick Young (was: Kelvin Jiang) > Range operator computeStats() proper long

[jira] [Updated] (SPARK-46716) Add a test regarding to backward compatibility check for Scala StreamingQueryListener

[ https://issues.apache.org/jira/browse/SPARK-46716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46716: --- Labels: pull-request-available (was: ) > Add a test regarding to backward compatibility

[jira] [Resolved] (SPARK-46715) Pin `sphinxcontrib-*`

[ https://issues.apache.org/jira/browse/SPARK-46715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46715. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44727

[jira] [Assigned] (SPARK-46715) Pin `sphinxcontrib-*`

[ https://issues.apache.org/jira/browse/SPARK-46715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46715: - Assignee: Ruifeng Zheng > Pin `sphinxcontrib-*` > - > >

[jira] [Updated] (SPARK-46719) Rebalance `pyspark_pandas` and `pyspark_pandas_slow`

[ https://issues.apache.org/jira/browse/SPARK-46719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46719: --- Labels: pull-request-available (was: ) > Rebalance `pyspark_pandas` and