[
https://issues.apache.org/jira/browse/SPARK-39357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tianshuang updated SPARK-39357:
---
Attachment: JVM Heap Long Lived Pool.jpg
JVM Heap.jpg
> pmCache memory leak caused b
[
https://issues.apache.org/jira/browse/SPARK-39357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tianshuang updated SPARK-39357:
---
Description:
I found this bug in Spark 2.4.4, because the related code has not changed, so
this bug
[
https://issues.apache.org/jira/browse/SPARK-39369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-39369:
-
Description:
https://ci.appveyor.com/project/ApacheSoftwareFoundation/spark/builds/43740704
Ap
[
https://issues.apache.org/jira/browse/SPARK-39369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-39369:
-
Summary: Use JAVA_OPTS for AppVeyer build to increase the memory properly
(was: Increase memory
[
https://issues.apache.org/jira/browse/SPARK-37623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-37623.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36708
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-37623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-37623:
Assignee: jiaan.geng
> Support ANSI Aggregate Function: regr_intercept
>
[
https://issues.apache.org/jira/browse/SPARK-39259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-39259:
-
Fix Version/s: 3.3.0
> Timestamps returned by now() and equivalent functions are not consistent in
> su
[
https://issues.apache.org/jira/browse/SPARK-39371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545748#comment-17545748
]
Apache Spark commented on SPARK-39371:
--
User 'xuanyuanking' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-39371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39371:
Assignee: (was: Apache Spark)
> Review and fix issues in Scala/Java API docs of Core
[
https://issues.apache.org/jira/browse/SPARK-39371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545747#comment-17545747
]
Apache Spark commented on SPARK-39371:
--
User 'xuanyuanking' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-39371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39371:
Assignee: Apache Spark
> Review and fix issues in Scala/Java API docs of Core module
> --
Yuanjian Li created SPARK-39371:
---
Summary: Review and fix issues in Scala/Java API docs of Core
module
Key: SPARK-39371
URL: https://issues.apache.org/jira/browse/SPARK-39371
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-39320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-39320.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36714
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-39320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-39320:
Assignee: jiaan.geng
> Add the MEDIAN() function
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-39370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-39370.
--
Fix Version/s: 3.3.0
Resolution: Done
> Inline type hints in PySpark
>
[
https://issues.apache.org/jira/browse/SPARK-37396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-37396:
-
Epic Link: SPARK-39370
> Inline type hint files for files in python/pyspark/mllib
>
[
https://issues.apache.org/jira/browse/SPARK-37093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-37093:
-
Epic Link: SPARK-39370
> Inline type hints python/pyspark/streaming
> --
[
https://issues.apache.org/jira/browse/SPARK-37395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-37395:
-
Epic Link: SPARK-39370
> Inline type hint files for files in python/pyspark/ml
> ---
[
https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-36845:
-
Epic Link: SPARK-39370
> Inline type hint files for files in python/pyspark/sql
> --
[
https://issues.apache.org/jira/browse/SPARK-37094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-37094:
-
Epic Link: SPARK-39370
> Inline type hints for files in python/pyspark
> ---
Hyukjin Kwon created SPARK-39370:
Summary: Inline type hints in PySpark
Key: SPARK-39370
URL: https://issues.apache.org/jira/browse/SPARK-39370
Project: Spark
Issue Type: Epic
Compo
[
https://issues.apache.org/jira/browse/SPARK-39366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39366:
Assignee: Herman van Hövell (was: Apache Spark)
> BlockInfoManager should not release wr
[
https://issues.apache.org/jira/browse/SPARK-39366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39366:
Assignee: Apache Spark (was: Herman van Hövell)
> BlockInfoManager should not release wr
[
https://issues.apache.org/jira/browse/SPARK-39366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545728#comment-17545728
]
Apache Spark commented on SPARK-39366:
--
User 'hvanhovell' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-39369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39369:
Assignee: (was: Apache Spark)
> Increase memory in AppVeyor build
> -
[
https://issues.apache.org/jira/browse/SPARK-39369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545727#comment-17545727
]
Apache Spark commented on SPARK-39369:
--
User 'HyukjinKwon' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-39369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39369:
Assignee: Apache Spark
> Increase memory in AppVeyor build
>
[
https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545726#comment-17545726
]
Yuming Wang commented on SPARK-29260:
-
Please backport HIVE-8472 to your Hive metast
[
https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-29260.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36750
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-29260:
---
Assignee: Chao Sun
> Enable supported Hive metastore versions once it support altering data
[
https://issues.apache.org/jira/browse/SPARK-39351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-39351.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36736
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-39351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-39351:
Assignee: angerszhu
> ShowCreateTable should redact properties
>
Hyukjin Kwon created SPARK-39369:
Summary: Increase memory in AppVeyor build
Key: SPARK-39369
URL: https://issues.apache.org/jira/browse/SPARK-39369
Project: Spark
Issue Type: Test
[
https://issues.apache.org/jira/browse/SPARK-39356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-39356:
-
Target Version/s: (was: 3.3.0)
> Add option to skip initial message in Pregel API
> --
[ https://issues.apache.org/jira/browse/SPARK-39336 ]
Hyukjin Kwon deleted comment on SPARK-39336:
--
was (Author: apachespark):
User 'hvanhovell' has created a pull request for this issue:
https://github.com/apache/spark/pull/36751
> Redact tab
[
https://issues.apache.org/jira/browse/SPARK-39368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39368:
Assignee: Apache Spark
> Move RewritePredicateSubquery into InjectRuntimeFilter
> ---
[
https://issues.apache.org/jira/browse/SPARK-39368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39368:
Assignee: (was: Apache Spark)
> Move RewritePredicateSubquery into InjectRuntimeFilte
[
https://issues.apache.org/jira/browse/SPARK-39368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545721#comment-17545721
]
Apache Spark commented on SPARK-39368:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-39368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545720#comment-17545720
]
Apache Spark commented on SPARK-39368:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-39368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545719#comment-17545719
]
Yuming Wang commented on SPARK-39368:
-
https://github.com/apache/spark/pull/36755
>
Yuming Wang created SPARK-39368:
---
Summary: Move RewritePredicateSubquery into InjectRuntimeFilter
Key: SPARK-39368
URL: https://issues.apache.org/jira/browse/SPARK-39368
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-37649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-37649:
-
Description:
pandas API on Spark currently sets {{compute.default_index_type}} to
{{sequence}}
[
https://issues.apache.org/jira/browse/SPARK-37649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-37649:
-
Priority: Critical (was: Major)
> Switch default index to distributed-sequence by default in pa
[
https://issues.apache.org/jira/browse/SPARK-39367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-39367.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 36754
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-39367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39367:
Assignee: Gengliang Wang (was: Apache Spark)
> Review and fix issues in Scala/Java API d
[
https://issues.apache.org/jira/browse/SPARK-39367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39367:
Assignee: Apache Spark (was: Gengliang Wang)
> Review and fix issues in Scala/Java API d
[
https://issues.apache.org/jira/browse/SPARK-39367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545626#comment-17545626
]
Apache Spark commented on SPARK-39367:
--
User 'gengliangwang' has created a pull req
Gengliang Wang created SPARK-39367:
--
Summary: Review and fix issues in Scala/Java API docs of SQL module
Key: SPARK-39367
URL: https://issues.apache.org/jira/browse/SPARK-39367
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-39259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545609#comment-17545609
]
Apache Spark commented on SPARK-39259:
--
User 'olaky' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-39259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545608#comment-17545608
]
Apache Spark commented on SPARK-39259:
--
User 'olaky' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-39295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-39295:
-
Fix Version/s: 3.3.0
> Improve documentation of pandas API support list.
> -
[
https://issues.apache.org/jira/browse/SPARK-39259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-39259.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36654
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-39259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-39259:
Assignee: Jan-Ole Sasse
> Timestamps returned by now() and equivalent functions are not consisten
[
https://issues.apache.org/jira/browse/SPARK-39336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545592#comment-17545592
]
Apache Spark commented on SPARK-39336:
--
User 'hvanhovell' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-39336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39336:
Assignee: Apache Spark
> Redact table/partition properties
>
[
https://issues.apache.org/jira/browse/SPARK-39336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39336:
Assignee: (was: Apache Spark)
> Redact table/partition properties
> -
[
https://issues.apache.org/jira/browse/SPARK-39283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-39283:
---
Fix Version/s: 3.3.0
(was: 3.3.1)
> Spark tasks stuck forever due to deadlock
[
https://issues.apache.org/jira/browse/SPARK-39361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-39361.
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 36747
[https://github
[
https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545512#comment-17545512
]
Apache Spark commented on SPARK-29260:
--
User 'sunchao' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-29260:
Assignee: Apache Spark
> Enable supported Hive metastore versions once it support alterin
[
https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-29260:
Assignee: (was: Apache Spark)
> Enable supported Hive metastore versions once it supp
[
https://issues.apache.org/jira/browse/SPARK-29260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545511#comment-17545511
]
Apache Spark commented on SPARK-29260:
--
User 'sunchao' has created a pull request f
Herman van Hövell created SPARK-39366:
-
Summary: BlockInfoManager should not release write locks on task
end
Key: SPARK-39366
URL: https://issues.apache.org/jira/browse/SPARK-39366
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-39365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-39365:
---
Summary: Truncate fragment of query context if it is too long (was:
Truncate fragment if it
Gengliang Wang created SPARK-39365:
--
Summary: Truncate fragment if it is too long
Key: SPARK-39365
URL: https://issues.apache.org/jira/browse/SPARK-39365
Project: Spark
Issue Type: Sub-task
Marek Czuma created SPARK-39364:
---
Summary: Logs are still "in_progress" when we read HDFS files
Key: SPARK-39364
URL: https://issues.apache.org/jira/browse/SPARK-39364
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-39363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545479#comment-17545479
]
Thomas Graves commented on SPARK-39363:
---
[~Kimahriman]
> fix spark.kubernetes.me
[
https://issues.apache.org/jira/browse/SPARK-39363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-39363:
--
Description:
see [https://github.com/apache/spark/pull/36744] for details.
It looks like w
Thomas Graves created SPARK-39363:
-
Summary: fix spark.kubernetes.memoryOverheadFactor deprecation
warning
Key: SPARK-39363
URL: https://issues.apache.org/jira/browse/SPARK-39363
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-38807:
Assignee: Ming Li
> Error when starting spark shell on Windows system
> -
[
https://issues.apache.org/jira/browse/SPARK-38807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-38807.
--
Fix Version/s: 3.3.1
3.2.2
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-33121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545437#comment-17545437
]
Stephen Kestle commented on SPARK-33121:
I seem to have encountered this problem
[
https://issues.apache.org/jira/browse/SPARK-39354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-39354.
--
Fix Version/s: 3.3.0
3.4.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-39354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-39354:
Assignee: Yang Jie
> The analysis exception is incorrect
> ---
>
Zhen Wang created SPARK-39362:
-
Summary: Datasource v2 scan not pruned in tpcds q10
Key: SPARK-39362
URL: https://issues.apache.org/jira/browse/SPARK-39362
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-39346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-39346:
-
Fix Version/s: 3.3.1
> Convert asserts/illegal state exception to internal errors on each phase
> --
[
https://issues.apache.org/jira/browse/SPARK-39295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545361#comment-17545361
]
Apache Spark commented on SPARK-39295:
--
User 'beobest2' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-33320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545339#comment-17545339
]
oskarryn edited comment on SPARK-33320 at 6/2/22 8:48 AM:
--
I'm
[
https://issues.apache.org/jira/browse/SPARK-38675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-38675.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35991
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-33320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545339#comment-17545339
]
oskarryn edited comment on SPARK-33320 at 6/2/22 8:40 AM:
--
Exec
[
https://issues.apache.org/jira/browse/SPARK-33320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545339#comment-17545339
]
oskarryn edited comment on SPARK-33320 at 6/2/22 8:35 AM:
--
I ha
[
https://issues.apache.org/jira/browse/SPARK-33320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545339#comment-17545339
]
oskarryn commented on SPARK-33320:
--
I have the same issue while on Spark 2.4.8. Suppose
[
https://issues.apache.org/jira/browse/SPARK-38961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545296#comment-17545296
]
Apache Spark commented on SPARK-38961:
--
User 'beobest2' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-38961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545295#comment-17545295
]
Apache Spark commented on SPARK-38961:
--
User 'beobest2' has created a pull request
84 matches
Mail list logo