[jira] [Created] (SPARK-39371) Review and fix issues in Scala/Java API docs of Core module

2022-06-02 Thread Yuanjian Li (Jira)
Yuanjian Li created SPARK-39371: --- Summary: Review and fix issues in Scala/Java API docs of Core module Key: SPARK-39371 URL: https://issues.apache.org/jira/browse/SPARK-39371 Project: Spark

[jira] [Resolved] (SPARK-39320) Add the MEDIAN() function

2022-06-02 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39320. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36714

[jira] [Assigned] (SPARK-39320) Add the MEDIAN() function

2022-06-02 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-39320: Assignee: jiaan.geng > Add the MEDIAN() function > - > >

[jira] [Resolved] (SPARK-39370) Inline type hints in PySpark

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39370. -- Fix Version/s: 3.3.0 Resolution: Done > Inline type hints in PySpark >

[jira] [Updated] (SPARK-37396) Inline type hint files for files in python/pyspark/mllib

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37396: - Epic Link: SPARK-39370 > Inline type hint files for files in python/pyspark/mllib >

[jira] [Updated] (SPARK-37093) Inline type hints python/pyspark/streaming

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37093: - Epic Link: SPARK-39370 > Inline type hints python/pyspark/streaming >

[jira] [Updated] (SPARK-37395) Inline type hint files for files in python/pyspark/ml

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37395: - Epic Link: SPARK-39370 > Inline type hint files for files in python/pyspark/ml >

[jira] [Updated] (SPARK-36845) Inline type hint files for files in python/pyspark/sql

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36845: - Epic Link: SPARK-39370 > Inline type hint files for files in python/pyspark/sql >

[jira] [Updated] (SPARK-37094) Inline type hints for files in python/pyspark

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37094: - Epic Link: SPARK-39370 > Inline type hints for files in python/pyspark >

[jira] [Created] (SPARK-39370) Inline type hints in PySpark

2022-06-02 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-39370: Summary: Inline type hints in PySpark Key: SPARK-39370 URL: https://issues.apache.org/jira/browse/SPARK-39370 Project: Spark Issue Type: Epic

[jira] [Assigned] (SPARK-39366) BlockInfoManager should not release write locks on task end

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39366: Assignee: Herman van Hövell (was: Apache Spark) > BlockInfoManager should not release

[jira] [Assigned] (SPARK-39366) BlockInfoManager should not release write locks on task end

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39366: Assignee: Apache Spark (was: Herman van Hövell) > BlockInfoManager should not release

[jira] [Commented] (SPARK-39366) BlockInfoManager should not release write locks on task end

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545728#comment-17545728 ] Apache Spark commented on SPARK-39366: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-39369) Increase memory in AppVeyor build

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39369: Assignee: (was: Apache Spark) > Increase memory in AppVeyor build >

[jira] [Commented] (SPARK-39369) Increase memory in AppVeyor build

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545727#comment-17545727 ] Apache Spark commented on SPARK-39369: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-39369) Increase memory in AppVeyor build

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39369: Assignee: Apache Spark > Increase memory in AppVeyor build >

[jira] [Commented] (SPARK-29260) Enable supported Hive metastore versions once it support altering database location

2022-06-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545726#comment-17545726 ] Yuming Wang commented on SPARK-29260: - Please backport HIVE-8472 to your Hive metastore service if

[jira] [Resolved] (SPARK-29260) Enable supported Hive metastore versions once it support altering database location

2022-06-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-29260. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36750

[jira] [Assigned] (SPARK-29260) Enable supported Hive metastore versions once it support altering database location

2022-06-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-29260: --- Assignee: Chao Sun > Enable supported Hive metastore versions once it support altering

[jira] [Resolved] (SPARK-39351) ShowCreateTable should redact properties

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39351. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36736

[jira] [Assigned] (SPARK-39351) ShowCreateTable should redact properties

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39351: Assignee: angerszhu > ShowCreateTable should redact properties >

[jira] [Created] (SPARK-39369) Increase memory in AppVeyor build

2022-06-02 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-39369: Summary: Increase memory in AppVeyor build Key: SPARK-39369 URL: https://issues.apache.org/jira/browse/SPARK-39369 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-39356) Add option to skip initial message in Pregel API

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39356: - Target Version/s: (was: 3.3.0) > Add option to skip initial message in Pregel API >

[jira] (SPARK-39336) Redact table/partition properties

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39336 ] Hyukjin Kwon deleted comment on SPARK-39336: -- was (Author: apachespark): User 'hvanhovell' has created a pull request for this issue: https://github.com/apache/spark/pull/36751 > Redact

[jira] [Assigned] (SPARK-39368) Move RewritePredicateSubquery into InjectRuntimeFilter

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39368: Assignee: Apache Spark > Move RewritePredicateSubquery into InjectRuntimeFilter >

[jira] [Assigned] (SPARK-39368) Move RewritePredicateSubquery into InjectRuntimeFilter

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39368: Assignee: (was: Apache Spark) > Move RewritePredicateSubquery into

[jira] [Commented] (SPARK-39368) Move RewritePredicateSubquery into InjectRuntimeFilter

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545721#comment-17545721 ] Apache Spark commented on SPARK-39368: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-39368) Move RewritePredicateSubquery into InjectRuntimeFilter

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545720#comment-17545720 ] Apache Spark commented on SPARK-39368: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-39368) Move RewritePredicateSubquery into InjectRuntimeFilter

2022-06-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545719#comment-17545719 ] Yuming Wang commented on SPARK-39368: - https://github.com/apache/spark/pull/36755 > Move

[jira] [Created] (SPARK-39368) Move RewritePredicateSubquery into InjectRuntimeFilter

2022-06-02 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39368: --- Summary: Move RewritePredicateSubquery into InjectRuntimeFilter Key: SPARK-39368 URL: https://issues.apache.org/jira/browse/SPARK-39368 Project: Spark Issue

[jira] [Updated] (SPARK-37649) Switch default index to distributed-sequence by default in pandas API on Spark

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37649: - Description: pandas API on Spark currently sets {{compute.default_index_type}} to {{sequence}}

[jira] [Updated] (SPARK-37649) Switch default index to distributed-sequence by default in pandas API on Spark

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37649: - Priority: Critical (was: Major) > Switch default index to distributed-sequence by default in

[jira] [Resolved] (SPARK-39367) Review and fix issues in Scala/Java API docs of SQL module

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39367. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36754

[jira] [Assigned] (SPARK-39367) Review and fix issues in Scala/Java API docs of SQL module

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39367: Assignee: Gengliang Wang (was: Apache Spark) > Review and fix issues in Scala/Java API

[jira] [Assigned] (SPARK-39367) Review and fix issues in Scala/Java API docs of SQL module

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39367: Assignee: Apache Spark (was: Gengliang Wang) > Review and fix issues in Scala/Java API

[jira] [Commented] (SPARK-39367) Review and fix issues in Scala/Java API docs of SQL module

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545626#comment-17545626 ] Apache Spark commented on SPARK-39367: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-39367) Review and fix issues in Scala/Java API docs of SQL module

2022-06-02 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39367: -- Summary: Review and fix issues in Scala/Java API docs of SQL module Key: SPARK-39367 URL: https://issues.apache.org/jira/browse/SPARK-39367 Project: Spark

[jira] [Commented] (SPARK-39259) Timestamps returned by now() and equivalent functions are not consistent in subqueries

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545609#comment-17545609 ] Apache Spark commented on SPARK-39259: -- User 'olaky' has created a pull request for this issue:

[jira] [Commented] (SPARK-39259) Timestamps returned by now() and equivalent functions are not consistent in subqueries

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545608#comment-17545608 ] Apache Spark commented on SPARK-39259: -- User 'olaky' has created a pull request for this issue:

[jira] [Updated] (SPARK-39295) Improve documentation of pandas API support list.

2022-06-02 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39295: - Fix Version/s: 3.3.0 > Improve documentation of pandas API support list. >

[jira] [Resolved] (SPARK-39259) Timestamps returned by now() and equivalent functions are not consistent in subqueries

2022-06-02 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39259. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36654

[jira] [Assigned] (SPARK-39259) Timestamps returned by now() and equivalent functions are not consistent in subqueries

2022-06-02 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-39259: Assignee: Jan-Ole Sasse > Timestamps returned by now() and equivalent functions are not

[jira] [Commented] (SPARK-39336) Redact table/partition properties

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545592#comment-17545592 ] Apache Spark commented on SPARK-39336: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-39336) Redact table/partition properties

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39336: Assignee: Apache Spark > Redact table/partition properties >

[jira] [Assigned] (SPARK-39336) Redact table/partition properties

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39336: Assignee: (was: Apache Spark) > Redact table/partition properties >

[jira] [Updated] (SPARK-39283) Spark tasks stuck forever due to deadlock between TaskMemoryManager and UnsafeExternalSorter

2022-06-02 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-39283: --- Fix Version/s: 3.3.0 (was: 3.3.1) > Spark tasks stuck forever due to

[jira] [Resolved] (SPARK-39361) Stop using Log4J2's extended throwable logging pattern in default logging configurations

2022-06-02 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-39361. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36747

[jira] [Commented] (SPARK-29260) Enable supported Hive metastore versions once it support altering database location

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545512#comment-17545512 ] Apache Spark commented on SPARK-29260: -- User 'sunchao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-29260) Enable supported Hive metastore versions once it support altering database location

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29260: Assignee: Apache Spark > Enable supported Hive metastore versions once it support

[jira] [Assigned] (SPARK-29260) Enable supported Hive metastore versions once it support altering database location

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29260: Assignee: (was: Apache Spark) > Enable supported Hive metastore versions once it

[jira] [Commented] (SPARK-29260) Enable supported Hive metastore versions once it support altering database location

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545511#comment-17545511 ] Apache Spark commented on SPARK-29260: -- User 'sunchao' has created a pull request for this issue:

[jira] [Created] (SPARK-39366) BlockInfoManager should not release write locks on task end

2022-06-02 Thread Jira
Herman van Hövell created SPARK-39366: - Summary: BlockInfoManager should not release write locks on task end Key: SPARK-39366 URL: https://issues.apache.org/jira/browse/SPARK-39366 Project: Spark

[jira] [Updated] (SPARK-39365) Truncate fragment of query context if it is too long

2022-06-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39365: --- Summary: Truncate fragment of query context if it is too long (was: Truncate fragment if

[jira] [Created] (SPARK-39365) Truncate fragment if it is too long

2022-06-02 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39365: -- Summary: Truncate fragment if it is too long Key: SPARK-39365 URL: https://issues.apache.org/jira/browse/SPARK-39365 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-39364) Logs are still "in_progress" when we read HDFS files

2022-06-02 Thread Marek Czuma (Jira)
Marek Czuma created SPARK-39364: --- Summary: Logs are still "in_progress" when we read HDFS files Key: SPARK-39364 URL: https://issues.apache.org/jira/browse/SPARK-39364 Project: Spark Issue

[jira] [Commented] (SPARK-39363) fix spark.kubernetes.memoryOverheadFactor deprecation warning

2022-06-02 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545479#comment-17545479 ] Thomas Graves commented on SPARK-39363: --- [~Kimahriman]  > fix

[jira] [Updated] (SPARK-39363) fix spark.kubernetes.memoryOverheadFactor deprecation warning

2022-06-02 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-39363: -- Description: see [https://github.com/apache/spark/pull/36744] for details.   It looks like

[jira] [Created] (SPARK-39363) fix spark.kubernetes.memoryOverheadFactor deprecation warning

2022-06-02 Thread Thomas Graves (Jira)
Thomas Graves created SPARK-39363: - Summary: fix spark.kubernetes.memoryOverheadFactor deprecation warning Key: SPARK-39363 URL: https://issues.apache.org/jira/browse/SPARK-39363 Project: Spark

[jira] [Assigned] (SPARK-38807) Error when starting spark shell on Windows system

2022-06-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38807: Assignee: Ming Li > Error when starting spark shell on Windows system >

[jira] [Resolved] (SPARK-38807) Error when starting spark shell on Windows system

2022-06-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38807. -- Fix Version/s: 3.3.1 3.2.2 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-33121) Spark Streaming 3.1.1 hangs on shutdown

2022-06-02 Thread Stephen Kestle (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545437#comment-17545437 ] Stephen Kestle commented on SPARK-33121: I seem to have encountered this problem without

[jira] [Resolved] (SPARK-39354) The analysis exception is incorrect

2022-06-02 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39354. -- Fix Version/s: 3.3.0 3.4.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-39354) The analysis exception is incorrect

2022-06-02 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-39354: Assignee: Yang Jie > The analysis exception is incorrect > --- >

[jira] [Created] (SPARK-39362) Datasource v2 scan not pruned in tpcds q10

2022-06-02 Thread Zhen Wang (Jira)
Zhen Wang created SPARK-39362: - Summary: Datasource v2 scan not pruned in tpcds q10 Key: SPARK-39362 URL: https://issues.apache.org/jira/browse/SPARK-39362 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-39346) Convert asserts/illegal state exception to internal errors on each phase

2022-06-02 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39346: - Fix Version/s: 3.3.1 > Convert asserts/illegal state exception to internal errors on each phase >

[jira] [Commented] (SPARK-39295) Improve documentation of pandas API support list.

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545361#comment-17545361 ] Apache Spark commented on SPARK-39295: -- User 'beobest2' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-33320) ExecutorMetrics are not written to CSV and StatsD sinks

2022-06-02 Thread oskarryn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545339#comment-17545339 ] oskarryn edited comment on SPARK-33320 at 6/2/22 8:48 AM: -- I'm afraid the

[jira] [Resolved] (SPARK-38675) Race condition in BlockInfoManager during unlock

2022-06-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38675. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35991

[jira] [Comment Edited] (SPARK-33320) ExecutorMetrics are not written to CSV and StatsD sinks

2022-06-02 Thread oskarryn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545339#comment-17545339 ] oskarryn edited comment on SPARK-33320 at 6/2/22 8:40 AM: -- Executors should

[jira] [Comment Edited] (SPARK-33320) ExecutorMetrics are not written to CSV and StatsD sinks

2022-06-02 Thread oskarryn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545339#comment-17545339 ] oskarryn edited comment on SPARK-33320 at 6/2/22 8:35 AM: -- I have the same

[jira] [Commented] (SPARK-33320) ExecutorMetrics are not written to CSV and StatsD sinks

2022-06-02 Thread oskarryn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545339#comment-17545339 ] oskarryn commented on SPARK-33320: -- I have the same issue while on Spark 2.4.8. Supposedly executors

[jira] [Commented] (SPARK-38961) Enhance to automatically generate the pandas API support list

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545296#comment-17545296 ] Apache Spark commented on SPARK-38961: -- User 'beobest2' has created a pull request for this issue:

[jira] [Commented] (SPARK-38961) Enhance to automatically generate the pandas API support list

2022-06-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545295#comment-17545295 ] Apache Spark commented on SPARK-38961: -- User 'beobest2' has created a pull request for this issue:

[jira] [Resolved] (SPARK-39295) Improve documentation of pandas API support list.

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39295. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36729

[jira] [Assigned] (SPARK-39295) Improve documentation of pandas API support list.

2022-06-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39295: Assignee: Hyunwoo Park > Improve documentation of pandas API support list. >