[jira] [Commented] (SPARK-44804) SortMergeJoin should respect the streamed side ordering

[ https://issues.apache.org/jira/browse/SPARK-44804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756227#comment-17756227 ] Snoot.io commented on SPARK-44804: -- User 'wankunde' has created a pull request for this issue:

[jira] [Assigned] (SPARK-44782) Adjust Pull Request Template to incorporate the ASF Generative Tooling Guidance recommendations

[ https://issues.apache.org/jira/browse/SPARK-44782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44782: Assignee: Maciej Szymkiewicz > Adjust Pull Request Template to incorporate the ASF

[jira] [Resolved] (SPARK-44782) Adjust Pull Request Template to incorporate the ASF Generative Tooling Guidance recommendations

[ https://issues.apache.org/jira/browse/SPARK-44782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44782. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42469

[jira] [Updated] (SPARK-44782) Adjust Pull Request Template to incorporate the ASF Generative Tooling Guidance recommendations

[ https://issues.apache.org/jira/browse/SPARK-44782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-44782: - Priority: Trivial (was: Major) > Adjust Pull Request Template to incorporate the ASF

[jira] [Commented] (SPARK-44873) Alter nested view fails because of HMS client

[ https://issues.apache.org/jira/browse/SPARK-44873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756212#comment-17756212 ] Paul King commented on SPARK-44873: --- User 'kylerong-db' has created a pull request for this issue:

[jira] [Created] (SPARK-44879) Refine docstring of `createDataFrame`

Allison Wang created SPARK-44879: Summary: Refine docstring of `createDataFrame` Key: SPARK-44879 URL: https://issues.apache.org/jira/browse/SPARK-44879 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-44728) Improve PySpark documentations

[ https://issues.apache.org/jira/browse/SPARK-44728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-44728: - Affects Version/s: 3.5.0 > Improve PySpark documentations > -- > >

[jira] [Commented] (SPARK-44878) Address LRU cache insertion failure for RocksDB with strict limit

[ https://issues.apache.org/jira/browse/SPARK-44878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756119#comment-17756119 ] Anish Shrigondekar commented on SPARK-44878: [~kabhwan] - PR here -

[jira] [Updated] (SPARK-44817) Incremental Stats Collection

[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-44817: --- Affects Version/s: 3.5.0 > Incremental Stats Collection > > >

[jira] [Created] (SPARK-44878) Address LRU cache insertion failure for RocksDB with strict limit

Anish Shrigondekar created SPARK-44878: -- Summary: Address LRU cache insertion failure for RocksDB with strict limit Key: SPARK-44878 URL: https://issues.apache.org/jira/browse/SPARK-44878

[jira] [Created] (SPARK-44877) Support python protobuf functions for Spark Connect

Bo Gao created SPARK-44877: -- Summary: Support python protobuf functions for Spark Connect Key: SPARK-44877 URL: https://issues.apache.org/jira/browse/SPARK-44877 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-44871) Fix PERCENTILE_DISC behaviour

[ https://issues.apache.org/jira/browse/SPARK-44871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756097#comment-17756097 ] Peter Toth commented on SPARK-44871: [~tgraves], sure, I've just updated it. It looks like my PR

[jira] [Updated] (SPARK-44871) Fix PERCENTILE_DISC behaviour

[ https://issues.apache.org/jira/browse/SPARK-44871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-44871: --- Description: Currently {{percentile_disc()}} returns incorrect results in some cases: E.g.:

[jira] [Assigned] (SPARK-44873) Alter nested view fails because of HMS client

[ https://issues.apache.org/jira/browse/SPARK-44873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-44873: -- Assignee: Kyle Rong > Alter nested view fails because of HMS client >

[jira] [Resolved] (SPARK-44873) Alter nested view fails because of HMS client

[ https://issues.apache.org/jira/browse/SPARK-44873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-44873. Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-44813) The JIRA Python misses our assignee when it searches user again

[ https://issues.apache.org/jira/browse/SPARK-44813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-44813: Assignee: Kent Yao > The JIRA Python misses our assignee when it searches user again >

[jira] [Resolved] (SPARK-44813) The JIRA Python misses our assignee when it searches user again

[ https://issues.apache.org/jira/browse/SPARK-44813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-44813. -- Fix Version/s: 3.3.3 3.5.0 4.0.0 3.4.2

[jira] [Updated] (SPARK-44874) Handle unrecognizable exceptions

[ https://issues.apache.org/jira/browse/SPARK-44874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-44874: -- Summary: Handle unrecognizable exceptions (was: Implement SparkConnectServerException) > Handle

[jira] [Assigned] (SPARK-44875) commentor to commenter in merge script

[ https://issues.apache.org/jira/browse/SPARK-44875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-44875: Assignee: Kent Yao > commentor to commenter in merge script >

[jira] [Updated] (SPARK-44813) The JIRA Python misses our assignee when it searches user again

[ https://issues.apache.org/jira/browse/SPARK-44813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-44813: - Fix Version/s: (was: 3.5.0) (was: 4.0.0) (was: 3.4.2)

[jira] [Reopened] (SPARK-44813) The JIRA Python misses our assignee when it searches user again

[ https://issues.apache.org/jira/browse/SPARK-44813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reopened SPARK-44813: -- Assignee: (was: Kent Yao) > The JIRA Python misses our assignee when it searches user again >

[jira] [Updated] (SPARK-44876) Enable and fix test_parity_arrow_python_udf

[ https://issues.apache.org/jira/browse/SPARK-44876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-44876: -- Description: {{pyspark.sql.tests.connect.test_parity_arrow_python_udf}} is not listed in

[jira] [Created] (SPARK-44876) Enable and fix test_parity_arrow_python_udf

Takuya Ueshin created SPARK-44876: - Summary: Enable and fix test_parity_arrow_python_udf Key: SPARK-44876 URL: https://issues.apache.org/jira/browse/SPARK-44876 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-44875) commentor to commenter in merge script

[ https://issues.apache.org/jira/browse/SPARK-44875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-44875. -- Fix Version/s: 3.5.0 4.0.0 3.4.2 Resolution: Fixed Issue

[jira] [Commented] (SPARK-44871) Fix PERCENTILE_DISC behaviour

[ https://issues.apache.org/jira/browse/SPARK-44871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756077#comment-17756077 ] Thomas Graves commented on SPARK-44871: --- Can you add a description to this please > Fix

[jira] [Commented] (SPARK-44433) Implement termination of Python process for foreachBatch & streaming listener

[ https://issues.apache.org/jira/browse/SPARK-44433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756075#comment-17756075 ] Ignite TC Bot commented on SPARK-44433: --- User 'rangadi' has created a pull request for this issue:

[jira] [Created] (SPARK-44875) commentor to commenter in merge script

Kent Yao created SPARK-44875: Summary: commentor to commenter in merge script Key: SPARK-44875 URL: https://issues.apache.org/jira/browse/SPARK-44875 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-44858) Refine docstring of `DataFrame.isEmpty`

[ https://issues.apache.org/jira/browse/SPARK-44858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756071#comment-17756071 ] Kent Yao commented on SPARK-44858: -- 1 > Refine docstring of `DataFrame.isEmpty` >

[jira] [Updated] (SPARK-44874) Implement SparkConnectServerException

[ https://issues.apache.org/jira/browse/SPARK-44874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-44874: -- Summary: Implement SparkConnectServerException (was: Implement SparkConnectGrpcException) >

[jira] [Updated] (SPARK-44874) Implement SparkConnectGrpcException

[ https://issues.apache.org/jira/browse/SPARK-44874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-44874: -- Summary: Implement SparkConnectGrpcException (was: Implement SparkConnectServerException) >

[jira] [Commented] (SPARK-44869) Add doc for insert by name statement

[ https://issues.apache.org/jira/browse/SPARK-44869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756065#comment-17756065 ] Kent Yao commented on SPARK-44869: -- Issue resolved by https://github.com/apache/spark/pull/42558 > Add

[jira] [Resolved] (SPARK-44869) Add doc for insert by name statement

[ https://issues.apache.org/jira/browse/SPARK-44869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-44869. -- Fix Version/s: 4.0.0 Assignee: Jia Fan Resolution: Fixed > Add doc for insert by name

[jira] [Commented] (SPARK-44869) Add doc for insert by name statement

[ https://issues.apache.org/jira/browse/SPARK-44869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756063#comment-17756063 ] Kent Yao commented on SPARK-44869: -- LGTM > Add doc for insert by name statement >

[jira] [Created] (SPARK-44874) Implement SparkConnectServerException

Yihong He created SPARK-44874: - Summary: Implement SparkConnectServerException Key: SPARK-44874 URL: https://issues.apache.org/jira/browse/SPARK-44874 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-44873) Alter nested view fails because of HMS client

Kyle Rong created SPARK-44873: - Summary: Alter nested view fails because of HMS client Key: SPARK-44873 URL: https://issues.apache.org/jira/browse/SPARK-44873 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-44852) Need exclude `junit-jupiter-api` from `curator-test`

[ https://issues.apache.org/jira/browse/SPARK-44852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44852. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42539

[jira] [Assigned] (SPARK-44852) Need exclude `junit-jupiter-api` from `curator-test`

[ https://issues.apache.org/jira/browse/SPARK-44852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44852: - Assignee: Yang Jie > Need exclude `junit-jupiter-api` from `curator-test` >

[jira] [Created] (SPARK-44872) Testing reattachable execute

Juliusz Sompolski created SPARK-44872: - Summary: Testing reattachable execute Key: SPARK-44872 URL: https://issues.apache.org/jira/browse/SPARK-44872 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-44813) The JIRA Python misses our assignee when it searches user again

[ https://issues.apache.org/jira/browse/SPARK-44813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44813: Assignee: Kent Yao > The JIRA Python misses our assignee when it searches user again >

[jira] [Resolved] (SPARK-44813) The JIRA Python misses our assignee when it searches user again

[ https://issues.apache.org/jira/browse/SPARK-44813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44813. -- Fix Version/s: 3.3.4 3.5.0 4.0.0

[jira] [Assigned] (SPARK-44840) array_insert() give wrong results for ngative index

[ https://issues.apache.org/jira/browse/SPARK-44840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44840: Assignee: Max Gekk > array_insert() give wrong results for ngative index >

[jira] [Commented] (SPARK-44866) Spark wrongly map the BOOLEAN Type to BIT(1) in Snowflake

[ https://issues.apache.org/jira/browse/SPARK-44866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755970#comment-17755970 ] Hayssam Saleh commented on SPARK-44866: --- Created PR [https://github.com/apache/spark/pull/42545]

[jira] [Created] (SPARK-44871) Fix PERCENTILE_DISC behaviour

Peter Toth created SPARK-44871: -- Summary: Fix PERCENTILE_DISC behaviour Key: SPARK-44871 URL: https://issues.apache.org/jira/browse/SPARK-44871 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-44729) Add canonical links to the PySpark docs page

[ https://issues.apache.org/jira/browse/SPARK-44729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44729. --- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-44729) Add canonical links to the PySpark docs page

[ https://issues.apache.org/jira/browse/SPARK-44729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44729: - Assignee: BingKun Pan > Add canonical links to the PySpark docs page >

[jira] [Created] (SPARK-44870) Convert HashAggregate to SortAggregate if all grouping expressions are in child output orderings

Wan Kun created SPARK-44870: --- Summary: Convert HashAggregate to SortAggregate if all grouping expressions are in child output orderings Key: SPARK-44870 URL: https://issues.apache.org/jira/browse/SPARK-44870

[jira] [Created] (SPARK-44869) Add doc for insert by name statement

Jia Fan created SPARK-44869: --- Summary: Add doc for insert by name statement Key: SPARK-44869 URL: https://issues.apache.org/jira/browse/SPARK-44869 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-44868) Convert datetime to string by `to_char`/`to_varchar`

Max Gekk created SPARK-44868: Summary: Convert datetime to string by `to_char`/`to_varchar` Key: SPARK-44868 URL: https://issues.apache.org/jira/browse/SPARK-44868 Project: Spark Issue Type: New

[jira] [Resolved] (SPARK-44853) Refine docstring of `DataFrame.columns` property

[ https://issues.apache.org/jira/browse/SPARK-44853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44853. --- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-44853) Refine docstring of `DataFrame.columns` property

[ https://issues.apache.org/jira/browse/SPARK-44853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44853: - Assignee: Allison Wang > Refine docstring of `DataFrame.columns` property >

[jira] [Created] (SPARK-44867) Refactor Spark Connect Docs to incorporate Scala setup

Venkata Sai Akhil Gudesa created SPARK-44867: Summary: Refactor Spark Connect Docs to incorporate Scala setup Key: SPARK-44867 URL: https://issues.apache.org/jira/browse/SPARK-44867

[jira] [Created] (SPARK-44866) Spark wrongly map the BOOLEAN Type to BIT(1) in Snowflake

Hayssam Saleh created SPARK-44866: - Summary: Spark wrongly map the BOOLEAN Type to BIT(1) in Snowflake Key: SPARK-44866 URL: https://issues.apache.org/jira/browse/SPARK-44866 Project: Spark

[jira] [Created] (SPARK-44865) Make StreamingRelationV2 support metadata column

Zerui Bao created SPARK-44865: - Summary: Make StreamingRelationV2 support metadata column Key: SPARK-44865 URL: https://issues.apache.org/jira/browse/SPARK-44865 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-44864) Align streaming statistics link format with other page links

[ https://issues.apache.org/jira/browse/SPARK-44864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated SPARK-44864: -- Issue Type: Improvement (was: Bug) > Align streaming statistics link format with other page links >

[jira] [Created] (SPARK-44864) Align streaming statistics link format with other page links

leesf created SPARK-44864: - Summary: Align streaming statistics link format with other page links Key: SPARK-44864 URL: https://issues.apache.org/jira/browse/SPARK-44864 Project: Spark Issue Type: