[jira] [Commented] (SPARK-42763) Upgrade ZooKeeper from 3.6.3 to 3.6.4

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699298#comment-17699298 ] Apache Spark commented on SPARK-42763: -- User 'panbingkun' has created a pull request for this

[jira] [Resolved] (SPARK-42763) Upgrade ZooKeeper from 3.6.3 to 3.6.4

2023-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42763. --- Resolution: Duplicate > Upgrade ZooKeeper from 3.6.3 to 3.6.4 >

[jira] [Closed] (SPARK-42763) Upgrade ZooKeeper from 3.6.3 to 3.6.4

2023-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-42763. - > Upgrade ZooKeeper from 3.6.3 to 3.6.4 > - > >

[jira] [Resolved] (SPARK-42762) Improve Logging for disconnects during exec id request

2023-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42762. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40383

[jira] [Assigned] (SPARK-42762) Improve Logging for disconnects during exec id request

2023-03-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42762: - Assignee: Holden Karau > Improve Logging for disconnects during exec id request >

[jira] [Created] (SPARK-42763) Upgrade ZooKeeper from 3.6.3 to 3.6.4

2023-03-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-42763: --- Summary: Upgrade ZooKeeper from 3.6.3 to 3.6.4 Key: SPARK-42763 URL: https://issues.apache.org/jira/browse/SPARK-42763 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-42758) Remove dependency on breeze

2023-03-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42758. -- Fix Version/s: 3.5.0 Assignee: BingKun Pan Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-42758) Remove dependency on breeze

2023-03-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42758: - Priority: Trivial (was: Minor) > Remove dependency on breeze > --- > >

[jira] [Commented] (SPARK-42760) The partition of result data frame of join is always 1

2023-03-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699291#comment-17699291 ] Yuming Wang commented on SPARK-42760: - Could you try to disable AQE(set spark.sql.adaptive.enabled =

[jira] [Assigned] (SPARK-42762) Improve Logging for disconnects during exec id request

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42762: Assignee: (was: Apache Spark) > Improve Logging for disconnects during exec id

[jira] [Assigned] (SPARK-42762) Improve Logging for disconnects during exec id request

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42762: Assignee: Apache Spark > Improve Logging for disconnects during exec id request >

[jira] [Commented] (SPARK-42762) Improve Logging for disconnects during exec id request

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699280#comment-17699280 ] Apache Spark commented on SPARK-42762: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-42762) Improve Logging for disconnects during exec id request

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699279#comment-17699279 ] Apache Spark commented on SPARK-42762: -- User 'holdenk' has created a pull request for this issue:

[jira] [Created] (SPARK-42762) Improve Logging for disconnects during exec id request

2023-03-11 Thread Holden Karau (Jira)
Holden Karau created SPARK-42762: Summary: Improve Logging for disconnects during exec id request Key: SPARK-42762 URL: https://issues.apache.org/jira/browse/SPARK-42762 Project: Spark Issue

[jira] [Commented] (SPARK-42679) createDataFrame doesn't work with non-nullable schema.

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699271#comment-17699271 ] Apache Spark commented on SPARK-42679: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42761) kubernetes-client from 6.4.1 to 6.5.0

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42761: Assignee: (was: Apache Spark) > kubernetes-client from 6.4.1 to 6.5.0 >

[jira] [Assigned] (SPARK-42761) kubernetes-client from 6.4.1 to 6.5.0

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42761: Assignee: Apache Spark > kubernetes-client from 6.4.1 to 6.5.0 >

[jira] [Commented] (SPARK-42761) kubernetes-client from 6.4.1 to 6.5.0

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699269#comment-17699269 ] Apache Spark commented on SPARK-42761: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Created] (SPARK-42761) kubernetes-client from 6.4.1 to 6.5.0

2023-03-11 Thread Jira
Bjørn Jørgensen created SPARK-42761: --- Summary: kubernetes-client from 6.4.1 to 6.5.0 Key: SPARK-42761 URL: https://issues.apache.org/jira/browse/SPARK-42761 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42760) The partition of result data frame of join is always 1

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699264#comment-17699264 ] Apache Spark commented on SPARK-42760: -- User '1511351836' has created a pull request for this

[jira] [Assigned] (SPARK-42760) The partition of result data frame of join is always 1

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42760: Assignee: Apache Spark > The partition of result data frame of join is always 1 >

[jira] [Assigned] (SPARK-42760) The partition of result data frame of join is always 1

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42760: Assignee: (was: Apache Spark) > The partition of result data frame of join is always

[jira] [Commented] (SPARK-42425) spark-hadoop-cloud is not provided in the default Spark distribution

2023-03-11 Thread Arseniy Tashoyan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699248#comment-17699248 ] Arseniy Tashoyan commented on SPARK-42425: -- The doc says to declare this dependency as

[jira] [Resolved] (SPARK-42759) Avoid duplicated `build/apache-maven` install when target already exists

2023-03-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-42759. -- Resolution: Not A Problem > Avoid duplicated `build/apache-maven` install when target already exists

[jira] [Assigned] (SPARK-42759) Avoid duplicated `build/apache-maven` install when target already exists

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42759: Assignee: (was: Apache Spark) > Avoid duplicated `build/apache-maven` install when

[jira] [Assigned] (SPARK-42759) Avoid duplicated `build/apache-maven` install when target already exists

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42759: Assignee: Apache Spark > Avoid duplicated `build/apache-maven` install when target

[jira] [Updated] (SPARK-42759) Avoid duplicated `build/apache-maven` install when target already exists

2023-03-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42759: - Summary: Avoid duplicated `build/apache-maven` install when target already exists (was: Avoid repeated

[jira] [Reopened] (SPARK-42759) Avoid repeated install of `build/apache-maven`

2023-03-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reopened SPARK-42759: -- > Avoid repeated install of `build/apache-maven` > -- > >

[jira] [Resolved] (SPARK-42759) Avoid repeated install of `build/apache-maven`

2023-03-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-42759. -- Resolution: Not A Problem > Avoid repeated install of `build/apache-maven` >

[jira] [Updated] (SPARK-42759) Avoid repeated install of `build/apache-maven`

2023-03-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42759: - Summary: Avoid repeated install of `build/apache-maven` (was: Avoid repeated downloads of

[jira] [Created] (SPARK-42760) The partition of result data frame of join is always 1

2023-03-11 Thread binyang (Jira)
binyang created SPARK-42760: --- Summary: The partition of result data frame of join is always 1 Key: SPARK-42760 URL: https://issues.apache.org/jira/browse/SPARK-42760 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-42747) Fix incorrect internal status of LoR and AFT

2023-03-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42747. -- Fix Version/s: 3.2.4 3.4.1 3.5.0

[jira] [Commented] (SPARK-42759) Avoid repeated downloads of maven.tar.gz

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699229#comment-17699229 ] Apache Spark commented on SPARK-42759: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-42759) Avoid repeated downloads of maven.tar.gz

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699228#comment-17699228 ] Apache Spark commented on SPARK-42759: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42759) Avoid repeated downloads of maven.tar.gz

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42759: Assignee: (was: Apache Spark) > Avoid repeated downloads of maven.tar.gz >

[jira] [Assigned] (SPARK-42759) Avoid repeated downloads of maven.tar.gz

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42759: Assignee: Apache Spark > Avoid repeated downloads of maven.tar.gz >

[jira] [Created] (SPARK-42759) Avoid repeated downloads of maven.tar.gz

2023-03-11 Thread Yang Jie (Jira)
Yang Jie created SPARK-42759: Summary: Avoid repeated downloads of maven.tar.gz Key: SPARK-42759 URL: https://issues.apache.org/jira/browse/SPARK-42759 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-42670) Upgrade maven-surefire-plugin to 3.0.0-M9 & eliminate build warnings

2023-03-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42670. -- Fix Version/s: 3.5.0 Assignee: BingKun Pan Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-42670) Upgrade maven-surefire-plugin to 3.0.0-M9 & eliminate build warnings

2023-03-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42670: - Priority: Trivial (was: Minor) > Upgrade maven-surefire-plugin to 3.0.0-M9 & eliminate build

[jira] [Assigned] (SPARK-42758) Remove dependency on breeze

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42758: Assignee: Apache Spark > Remove dependency on breeze > --- > >

[jira] [Assigned] (SPARK-42758) Remove dependency on breeze

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42758: Assignee: (was: Apache Spark) > Remove dependency on breeze >

[jira] [Commented] (SPARK-42758) Remove dependency on breeze

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699214#comment-17699214 ] Apache Spark commented on SPARK-42758: -- User 'panbingkun' has created a pull request for this

[jira] [Created] (SPARK-42758) Remove dependency on breeze

2023-03-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-42758: --- Summary: Remove dependency on breeze Key: SPARK-42758 URL: https://issues.apache.org/jira/browse/SPARK-42758 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42669) Short circuit local relation rpcs

2023-03-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699213#comment-17699213 ] jiaan.geng commented on SPARK-42669: I will take a look! > Short circuit local relation rpcs >

[jira] [Commented] (SPARK-42757) Implement textFile for DataFrameReader

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699204#comment-17699204 ] Apache Spark commented on SPARK-42757: -- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-42757) Implement textFile for DataFrameReader

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699203#comment-17699203 ] Apache Spark commented on SPARK-42757: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-42757) Implement textFile for DataFrameReader

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42757: Assignee: Apache Spark > Implement textFile for DataFrameReader >

[jira] [Assigned] (SPARK-42757) Implement textFile for DataFrameReader

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42757: Assignee: (was: Apache Spark) > Implement textFile for DataFrameReader >

[jira] [Created] (SPARK-42757) Implement textFile for DataFrameReader

2023-03-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-42757: --- Summary: Implement textFile for DataFrameReader Key: SPARK-42757 URL: https://issues.apache.org/jira/browse/SPARK-42757 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-42691) Implement Dataset.semanticHash

2023-03-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42691. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40366

[jira] [Assigned] (SPARK-42756) Helper function to convert proto literal to value in Python Client

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42756: Assignee: Apache Spark > Helper function to convert proto literal to value in Python

[jira] [Assigned] (SPARK-42756) Helper function to convert proto literal to value in Python Client

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42756: Assignee: (was: Apache Spark) > Helper function to convert proto literal to value in

[jira] [Commented] (SPARK-42756) Helper function to convert proto literal to value in Python Client

2023-03-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699196#comment-17699196 ] Apache Spark commented on SPARK-42756: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-42756) Helper function to convert proto literal to value in Python Client

2023-03-11 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-42756: - Summary: Helper function to convert proto literal to value in Python Client Key: SPARK-42756 URL: https://issues.apache.org/jira/browse/SPARK-42756 Project: Spark