[jira] [Updated] (SPARK-38237) Introduce a new config to require all cluster keys on Aggregate

2022-02-17 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38237: - Description: We still find HashClusteredDistribution be useful for batch query as well. For

[jira] [Updated] (SPARK-38237) Introduce a new config to require all cluster keys on Aggregate

2022-02-17 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38237: - Summary: Introduce a new config to require all cluster keys on Aggregate (was: Rename back

[jira] [Comment Edited] (SPARK-32975) Add config for driver readiness timeout before executors start

2022-02-17 Thread Abhijeet Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494396#comment-17494396 ] Abhijeet Singh edited comment on SPARK-32975 at 2/18/22, 6:52 AM: --

[jira] [Comment Edited] (SPARK-32975) Add config for driver readiness timeout before executors start

2022-02-17 Thread Abhijeet Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494396#comment-17494396 ] Abhijeet Singh edited comment on SPARK-32975 at 2/18/22, 6:52 AM: --

[jira] [Commented] (SPARK-32975) Add config for driver readiness timeout before executors start

2022-02-17 Thread Abhijeet Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494396#comment-17494396 ] Abhijeet Singh commented on SPARK-32975: Though the issue points to driver and the fix is

[jira] [Assigned] (SPARK-38138) Materialize QueryPlan subqueries

2022-02-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38138: --- Assignee: Cheng Pan > Materialize QueryPlan subqueries >

[jira] [Resolved] (SPARK-38138) Materialize QueryPlan subqueries

2022-02-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38138. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35438

[jira] [Resolved] (SPARK-38225) Adjust input `format` of function `to_binary`

2022-02-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38225. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35533

[jira] [Resolved] (SPARK-38247) Unify the output of df.explain and "explain " if plan is command

2022-02-17 Thread yikf (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yikf resolved SPARK-38247. -- Resolution: Invalid > Unify the output of df.explain and "explain " if plan is command >

[jira] [Assigned] (SPARK-38225) Adjust input `format` of function `to_binary`

2022-02-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38225: --- Assignee: Xinrong Meng > Adjust input `format` of function `to_binary` >

[jira] [Commented] (SPARK-38237) Rename back StatefulOpClusteredDistribution to HashClusteredDistribution

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494376#comment-17494376 ] Apache Spark commented on SPARK-38237: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Resolved] (SPARK-38195) Add the TIMESTAMPADD() function

2022-02-17 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38195. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35502

[jira] [Commented] (SPARK-38175) Clean up unused parameters in private methods signature

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494372#comment-17494372 ] Apache Spark commented on SPARK-38175: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-38245) Avro Complex Union Type return `member$I`

2022-02-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38245: - Component/s: SQL (was: Spark Core) > Avro Complex Union Type return

[jira] [Commented] (SPARK-38249) Cleanup unused private methods and fields

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494367#comment-17494367 ] Apache Spark commented on SPARK-38249: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-38249) Cleanup unused private methods and fields

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494368#comment-17494368 ] Apache Spark commented on SPARK-38249: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38249) Cleanup unused private methods and fields

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38249: Assignee: Apache Spark > Cleanup unused private methods and fields >

[jira] [Assigned] (SPARK-38249) Cleanup unused private methods and fields

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38249: Assignee: (was: Apache Spark) > Cleanup unused private methods and fields >

[jira] [Created] (SPARK-38249) Cleanup unused private methods and fields

2022-02-17 Thread Yang Jie (Jira)
Yang Jie created SPARK-38249: Summary: Cleanup unused private methods and fields Key: SPARK-38249 URL: https://issues.apache.org/jira/browse/SPARK-38249 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-38248) Add @nowarn to suppress warnings related to Serializable interface

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38248: Assignee: (was: Apache Spark) > Add @nowarn to suppress warnings related to

[jira] [Commented] (SPARK-38248) Add @nowarn to suppress warnings related to Serializable interface

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494358#comment-17494358 ] Apache Spark commented on SPARK-38248: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38248) Add @nowarn to suppress warnings related to Serializable interface

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38248: Assignee: Apache Spark > Add @nowarn to suppress warnings related to Serializable

[jira] [Assigned] (SPARK-38247) Unify the output of df.explain and "explain " if plan is command

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38247: Assignee: (was: Apache Spark) > Unify the output of df.explain and "explain " if

[jira] [Commented] (SPARK-38247) Unify the output of df.explain and "explain " if plan is command

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494357#comment-17494357 ] Apache Spark commented on SPARK-38247: -- User 'Yikf' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38247) Unify the output of df.explain and "explain " if plan is command

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38247: Assignee: Apache Spark > Unify the output of df.explain and "explain " if plan is

[jira] [Commented] (SPARK-38247) Unify the output of df.explain and "explain " if plan is command

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494356#comment-17494356 ] Apache Spark commented on SPARK-38247: -- User 'Yikf' has created a pull request for this issue:

[jira] [Created] (SPARK-38248) Add @nowarn to suppress warnings related to Serializable interface

2022-02-17 Thread Yang Jie (Jira)
Yang Jie created SPARK-38248: Summary: Add @nowarn to suppress warnings related to Serializable interface Key: SPARK-38248 URL: https://issues.apache.org/jira/browse/SPARK-38248 Project: Spark

[jira] [Created] (SPARK-38247) Unify the output of df.explain and "explain " if plan is command

2022-02-17 Thread yikf (Jira)
yikf created SPARK-38247: Summary: Unify the output of df.explain and "explain " if plan is command Key: SPARK-38247 URL: https://issues.apache.org/jira/browse/SPARK-38247 Project: Spark Issue

[jira] [Commented] (SPARK-25271) Creating parquet table with all the column null throws exception

2022-02-17 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494342#comment-17494342 ] L. C. Hsieh commented on SPARK-25271: - Based on this JIRA, we only have this fix since 2.4.8. I

[jira] [Commented] (SPARK-31345) Spark fails to write hive parquet table with empty array

2022-02-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-31345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494336#comment-17494336 ] Mr.黄 commented on SPARK-31345: -- Hello, I did not have this problem in Spark2.4.0-CDH6.3.2 version, but this

[jira] [Commented] (SPARK-25271) Creating parquet table with all the column null throws exception

2022-02-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-25271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494333#comment-17494333 ] Mr.黄 commented on SPARK-25271: -- [~viirya] [~apachespark] Hello, I did not have this problem in

[jira] [Commented] (SPARK-38246) Refactor KVUtils and add UTs related to RocksDB

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494331#comment-17494331 ] Apache Spark commented on SPARK-38246: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38246) Refactor KVUtils and add UTs related to RocksDB

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38246: Assignee: (was: Apache Spark) > Refactor KVUtils and add UTs related to RocksDB >

[jira] [Assigned] (SPARK-38246) Refactor KVUtils and add UTs related to RocksDB

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38246: Assignee: Apache Spark > Refactor KVUtils and add UTs related to RocksDB >

[jira] [Created] (SPARK-38246) Refactor KVUtils and add UTs related to RocksDB

2022-02-17 Thread Yang Jie (Jira)
Yang Jie created SPARK-38246: Summary: Refactor KVUtils and add UTs related to RocksDB Key: SPARK-38246 URL: https://issues.apache.org/jira/browse/SPARK-38246 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38197) Improve error message of BlockManager.fetchRemoteManagedBuffer

2022-02-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-38197: - Priority: Trivial (was: Major) > Improve error message of

[jira] [Resolved] (SPARK-38197) Improve error message of BlockManager.fetchRemoteManagedBuffer

2022-02-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38197. -- Resolution: Fixed Issue resolved by pull request 35505

[jira] [Assigned] (SPARK-38197) Improve error message of BlockManager.fetchRemoteManagedBuffer

2022-02-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38197: Assignee: angerszhu > Improve error message of BlockManager.fetchRemoteManagedBuffer >

[jira] [Assigned] (SPARK-38214) No need to filter windows when windowDuration is multiple of slideDuration

2022-02-17 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-38214: Assignee: nyingping > No need to filter windows when windowDuration is multiple of

[jira] [Resolved] (SPARK-38214) No need to filter windows when windowDuration is multiple of slideDuration

2022-02-17 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-38214. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35526

[jira] [Updated] (SPARK-34378) Loosen AvroSerializer validation to allow extra nullable user-provided fields

2022-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34378: -- Summary: Loosen AvroSerializer validation to allow extra nullable user-provided fields (was:

[jira] [Resolved] (SPARK-34378) Support extra optional Avro fields in AvroSerializer

2022-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34378. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34009

[jira] [Assigned] (SPARK-34378) Support extra optional Avro fields in AvroSerializer

2022-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34378: - Assignee: Erik Krogen > Support extra optional Avro fields in AvroSerializer >

[jira] [Assigned] (SPARK-38118) MEAN(Boolean) in the HAVING claus should throw data mismatch error

2022-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38118: - Assignee: Rui Wang > MEAN(Boolean) in the HAVING claus should throw data mismatch

[jira] [Updated] (SPARK-38118) Func(wrong data type) in HAVING clause should throw data mismatch error

2022-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38118: -- Summary: Func(wrong data type) in HAVING clause should throw data mismatch error (was:

[jira] [Resolved] (SPARK-38118) MEAN(Boolean) in the HAVING claus should throw data mismatch error

2022-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38118. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35404

[jira] [Comment Edited] (SPARK-38245) Avro Complex Union Type return `member$I`

2022-02-17 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494294#comment-17494294 ] Erik Krogen edited comment on SPARK-38245 at 2/17/22, 11:45 PM: This

[jira] [Commented] (SPARK-38245) Avro Complex Union Type return `member$I`

2022-02-17 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494294#comment-17494294 ] Erik Krogen commented on SPARK-38245: - This behavior is expected. The fields of the union are

[jira] [Updated] (SPARK-38245) Avro Complex Union Type return `member$I`

2022-02-17 Thread Teddy Crepineau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teddy Crepineau updated SPARK-38245: Summary: Avro Complex Union Type return `member$I` (was: Avro Complex Union Type return

[jira] [Created] (SPARK-38245) Avro Complex Union Type return `member$i`

2022-02-17 Thread Teddy Crepineau (Jira)
Teddy Crepineau created SPARK-38245: --- Summary: Avro Complex Union Type return `member$i` Key: SPARK-38245 URL: https://issues.apache.org/jira/browse/SPARK-38245 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-38182) Fix NoSuchElementException if pushed filter does not contain any references

2022-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38182: - Assignee: XiDuo You > Fix NoSuchElementException if pushed filter does not contain any

[jira] [Resolved] (SPARK-38182) Fix NoSuchElementException if pushed filter does not contain any references

2022-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38182. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35487

[jira] [Commented] (SPARK-38232) Explain formatted does not collect subqueries under query stage in AQE

2022-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494224#comment-17494224 ] Dongjoon Hyun commented on SPARK-38232: --- Thank you for adding this under SPARK-37063 > Explain

[jira] [Commented] (SPARK-33206) Spark Shuffle Index Cache calculates memory usage wrong

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494151#comment-17494151 ] Apache Spark commented on SPARK-33206: -- User 'attilapiros' has created a pull request for this

[jira] [Assigned] (SPARK-33206) Spark Shuffle Index Cache calculates memory usage wrong

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33206: Assignee: (was: Apache Spark) > Spark Shuffle Index Cache calculates memory usage

[jira] [Commented] (SPARK-33206) Spark Shuffle Index Cache calculates memory usage wrong

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494150#comment-17494150 ] Apache Spark commented on SPARK-33206: -- User 'attilapiros' has created a pull request for this

[jira] [Assigned] (SPARK-33206) Spark Shuffle Index Cache calculates memory usage wrong

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33206: Assignee: Apache Spark > Spark Shuffle Index Cache calculates memory usage wrong >

[jira] [Resolved] (SPARK-38244) Upgrade kubernetes-client to 5.12.1

2022-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38244. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35557

[jira] [Assigned] (SPARK-38244) Upgrade kubernetes-client to 5.12.1

2022-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38244: - Assignee: Yikun Jiang > Upgrade kubernetes-client to 5.12.1 >

[jira] [Commented] (SPARK-33349) ExecutorPodsWatchSnapshotSource: Kubernetes client has been closed

2022-02-17 Thread Kent (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494121#comment-17494121 ] Kent commented on SPARK-33349: -- [~jkleckner] Just curious when you see "too old resource" in the driver pod

[jira] [Assigned] (SPARK-38243) Unintended exception thrown in pyspark.ml.LogisticRegression.getThreshold

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38243: Assignee: (was: Apache Spark) > Unintended exception thrown in

[jira] [Commented] (SPARK-38243) Unintended exception thrown in pyspark.ml.LogisticRegression.getThreshold

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494036#comment-17494036 ] Apache Spark commented on SPARK-38243: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38243) Unintended exception thrown in pyspark.ml.LogisticRegression.getThreshold

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38243: Assignee: Apache Spark > Unintended exception thrown in

[jira] [Commented] (SPARK-38244) Upgrade kubernetes-client to 5.12.1

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494033#comment-17494033 ] Apache Spark commented on SPARK-38244: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38244) Upgrade kubernetes-client to 5.12.1

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38244: Assignee: Apache Spark > Upgrade kubernetes-client to 5.12.1 >

[jira] [Commented] (SPARK-38244) Upgrade kubernetes-client to 5.12.1

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494034#comment-17494034 ] Apache Spark commented on SPARK-38244: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38244) Upgrade kubernetes-client to 5.12.1

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38244: Assignee: (was: Apache Spark) > Upgrade kubernetes-client to 5.12.1 >

[jira] [Updated] (SPARK-38243) Unintended exception thrown in pyspark.ml.LogisticRegression.getThreshold

2022-02-17 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-38243: --- Description: If {{LogisticRegression.getThreshold}} is called with model having

[jira] [Created] (SPARK-38244) Upgrade kubernetes-client to 5.12.1

2022-02-17 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-38244: --- Summary: Upgrade kubernetes-client to 5.12.1 Key: SPARK-38244 URL: https://issues.apache.org/jira/browse/SPARK-38244 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-38243) Unintended exception thrown in pyspark.ml.LogisticRegression.getThreshold

2022-02-17 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-38243: --- Description: If {{LogisticRegression.getThreshold}} is called with model having

[jira] [Created] (SPARK-38243) Unintended exception thrown in pyspark.ml.LogisticRegression.getThreshold

2022-02-17 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-38243: -- Summary: Unintended exception thrown in pyspark.ml.LogisticRegression.getThreshold Key: SPARK-38243 URL: https://issues.apache.org/jira/browse/SPARK-38243

[jira] [Commented] (SPARK-38242) Sort the SparkSubmit debug output

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493971#comment-17493971 ] Apache Spark commented on SPARK-38242: -- User 'martin-g' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38242) Sort the SparkSubmit debug output

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38242: Assignee: (was: Apache Spark) > Sort the SparkSubmit debug output >

[jira] [Commented] (SPARK-38242) Sort the SparkSubmit debug output

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493970#comment-17493970 ] Apache Spark commented on SPARK-38242: -- User 'martin-g' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38242) Sort the SparkSubmit debug output

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38242: Assignee: Apache Spark > Sort the SparkSubmit debug output >

[jira] [Created] (SPARK-38242) Sort the SparkSubmit debug output

2022-02-17 Thread Martin Tzvetanov Grigorov (Jira)
Martin Tzvetanov Grigorov created SPARK-38242: - Summary: Sort the SparkSubmit debug output Key: SPARK-38242 URL: https://issues.apache.org/jira/browse/SPARK-38242 Project: Spark

[jira] [Commented] (SPARK-38241) Close KubernetesClient in K8S integrations tests

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493952#comment-17493952 ] Apache Spark commented on SPARK-38241: -- User 'martin-g' has created a pull request for this issue:

[jira] [Commented] (SPARK-38241) Close KubernetesClient in K8S integrations tests

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493950#comment-17493950 ] Apache Spark commented on SPARK-38241: -- User 'martin-g' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38241) Close KubernetesClient in K8S integrations tests

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38241: Assignee: Apache Spark > Close KubernetesClient in K8S integrations tests >

[jira] [Assigned] (SPARK-38241) Close KubernetesClient in K8S integrations tests

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38241: Assignee: (was: Apache Spark) > Close KubernetesClient in K8S integrations tests >

[jira] [Created] (SPARK-38241) Close KubernetesClient in K8S integrations tests

2022-02-17 Thread Martin Tzvetanov Grigorov (Jira)
Martin Tzvetanov Grigorov created SPARK-38241: - Summary: Close KubernetesClient in K8S integrations tests Key: SPARK-38241 URL: https://issues.apache.org/jira/browse/SPARK-38241 Project:

[jira] [Assigned] (SPARK-38240) Improve RuntimeReplaceable and add a guideline for adding new functions

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38240: Assignee: (was: Apache Spark) > Improve RuntimeReplaceable and add a guideline for

[jira] [Commented] (SPARK-38240) Improve RuntimeReplaceable and add a guideline for adding new functions

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493930#comment-17493930 ] Apache Spark commented on SPARK-38240: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38240) Improve RuntimeReplaceable and add a guideline for adding new functions

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38240: Assignee: Apache Spark > Improve RuntimeReplaceable and add a guideline for adding new

[jira] [Created] (SPARK-38240) Improve RuntimeReplaceable and add a guideline for adding new functions

2022-02-17 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-38240: --- Summary: Improve RuntimeReplaceable and add a guideline for adding new functions Key: SPARK-38240 URL: https://issues.apache.org/jira/browse/SPARK-38240 Project: Spark

[jira] [Commented] (SPARK-38239) AttributeError: 'LogisticRegressionModel' object has no attribute '_call_java'

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493919#comment-17493919 ] Apache Spark commented on SPARK-38239: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38239) AttributeError: 'LogisticRegressionModel' object has no attribute '_call_java'

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38239: Assignee: (was: Apache Spark) > AttributeError: 'LogisticRegressionModel' object has

[jira] [Commented] (SPARK-38239) AttributeError: 'LogisticRegressionModel' object has no attribute '_call_java'

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493918#comment-17493918 ] Apache Spark commented on SPARK-38239: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38239) AttributeError: 'LogisticRegressionModel' object has no attribute '_call_java'

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38239: Assignee: Apache Spark > AttributeError: 'LogisticRegressionModel' object has no

[jira] [Created] (SPARK-38239) AttributeError: 'LogisticRegressionModel' object has no attribute '_call_java'

2022-02-17 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-38239: -- Summary: AttributeError: 'LogisticRegressionModel' object has no attribute '_call_java' Key: SPARK-38239 URL: https://issues.apache.org/jira/browse/SPARK-38239

[jira] [Assigned] (SPARK-38188) Support queue scheduling (Introduce queue) with volcano implementations

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38188: Assignee: (was: Apache Spark) > Support queue scheduling (Introduce queue) with

[jira] [Assigned] (SPARK-38188) Support queue scheduling (Introduce queue) with volcano implementations

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38188: Assignee: Apache Spark > Support queue scheduling (Introduce queue) with volcano

[jira] [Commented] (SPARK-38188) Support queue scheduling (Introduce queue) with volcano implementations

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493911#comment-17493911 ] Apache Spark commented on SPARK-38188: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-38237) Rename back StatefulOpClusteredDistribution to HashClusteredDistribution

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493872#comment-17493872 ] Apache Spark commented on SPARK-38237: -- User 'HeartSaVioR' has created a pull request for this

[jira] (SPARK-38237) Rename back StatefulOpClusteredDistribution to HashClusteredDistribution

2022-02-17 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38237 ] Jungtaek Lim deleted comment on SPARK-38237: -- was (Author: apachespark): User 'HeartSaVioR' has created a pull request for this issue: https://github.com/apache/spark/pull/35551 > Rename

[jira] [Commented] (SPARK-38237) Rename back StatefulOpClusteredDistribution to HashClusteredDistribution

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493871#comment-17493871 ] Apache Spark commented on SPARK-38237: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-38237) Rename back StatefulOpClusteredDistribution to HashClusteredDistribution

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493869#comment-17493869 ] Apache Spark commented on SPARK-38237: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-38237) Rename back StatefulOpClusteredDistribution to HashClusteredDistribution

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38237: Assignee: Apache Spark > Rename back StatefulOpClusteredDistribution to

[jira] [Assigned] (SPARK-38237) Rename back StatefulOpClusteredDistribution to HashClusteredDistribution

2022-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38237: Assignee: (was: Apache Spark) > Rename back StatefulOpClusteredDistribution to

[jira] [Assigned] (SPARK-37410) Inline type hints for python/pyspark/ml/recommendation.py

2022-02-17 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37410: -- Assignee: Maciej Szymkiewicz > Inline type hints for

  1   2   >