[
https://issues.apache.org/jira/browse/SPARK-44509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-44509:
-
Fix Version/s: (was: 3.5.0)
(was: 4.0.0)
> Fine grained interrupt in
[
https://issues.apache.org/jira/browse/SPARK-44509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-44509:
-
Reporter: Hyukjin Kwon (was: Juliusz Sompolski)
> Fine grained interrupt in Python Spark
Hyukjin Kwon created SPARK-44509:
Summary: Fine grained interrupt in Python Spark Connect
Key: SPARK-44509
URL: https://issues.apache.org/jira/browse/SPARK-44509
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-44509:
-
Description:
Same as https://issues.apache.org/jira/browse/SPARK-44422 but need it for Python
[
https://issues.apache.org/jira/browse/SPARK-44509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-44509:
-
Component/s: PySpark
> Fine grained interrupt in Python Spark Connect
>
[
https://issues.apache.org/jira/browse/SPARK-44509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44509:
Assignee: (was: Juliusz Sompolski)
> Fine grained interrupt in Python Spark Connect
[
https://issues.apache.org/jira/browse/SPARK-44422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44422:
Assignee: Juliusz Sompolski
> Fine grained interrupt in Spark Connect
>
[
https://issues.apache.org/jira/browse/SPARK-44422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44422.
--
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-39634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-39634.
-
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40728
[
https://issues.apache.org/jira/browse/SPARK-39634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-39634:
---
Assignee: Ala Luszczak
> Allow file splitting in combination with row index generation
>
[
https://issues.apache.org/jira/browse/SPARK-44464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-44464:
-
Fix Version/s: 3.4.2
> Fix applyInPandasWithStatePythonRunner to output rows that have Null as
[
https://issues.apache.org/jira/browse/SPARK-44484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim reassigned SPARK-44484:
Assignee: Wei Liu
> Add missing json field batchDuration to StreamingQueryProgress
>
[
https://issues.apache.org/jira/browse/SPARK-44484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-44484.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42077
[
https://issues.apache.org/jira/browse/SPARK-44504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-44504:
-
Fix Version/s: 3.5.0
> Maintenance task should clean up loaded providers on stop error
>
[
https://issues.apache.org/jira/browse/SPARK-44504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim reassigned SPARK-44504:
Assignee: Anish Shrigondekar
> Maintenance task should clean up loaded providers on stop
[
https://issues.apache.org/jira/browse/SPARK-44504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-44504.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42098
[
https://issues.apache.org/jira/browse/SPARK-44504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-44504:
-
Issue Type: Bug (was: Task)
> Maintenance task should clean up loaded providers on stop error
[ https://issues.apache.org/jira/browse/SPARK-44464 ]
Jungtaek Lim deleted comment on SPARK-44464:
--
was (Author: JIRAUSER39):
[~kabhwan] should we backport it all the way to 11.3? Or it's OK to only fix
newer versions?
> Fix
[
https://issues.apache.org/jira/browse/SPARK-43966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-43966:
---
Assignee: Allison Wang
> Support non-deterministic Python UDTFs
>
[
https://issues.apache.org/jira/browse/SPARK-43966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-43966.
-
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 42075
[
https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741837#comment-17741837
]
Vinod KC edited comment on SPARK-44365 at 7/21/23 4:15 AM:
---
Raise PR :
Allison Wang created SPARK-44508:
Summary: Add user guide and documentation for Python UDTFs
Key: SPARK-44508
URL: https://issues.apache.org/jira/browse/SPARK-44508
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-42898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17745365#comment-17745365
]
Kent Yao commented on SPARK-42898:
--
Issue resolved https://github.com/apache/spark/pull/42089
> Cast
[
https://issues.apache.org/jira/browse/SPARK-42898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-42898.
--
Assignee: Robert Joseph Evans
Resolution: Fixed
> Cast from string to date and date to string
Rui Wang created SPARK-44507:
Summary: SCSC does not depend on AnalysisException
Key: SPARK-44507
URL: https://issues.apache.org/jira/browse/SPARK-44507
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44502.
--
Assignee: Wei Liu
Resolution: Fixed
Fixed in https://github.com/apache/spark/pull/42097
[
https://issues.apache.org/jira/browse/SPARK-44502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-44502:
-
Fix Version/s: 3.5.0
4.0.0
> Add mission versionchanged field to docs
>
BingKun Pan created SPARK-44506:
---
Summary: Upgrade mima-core & sbt-mima-plugin from 1.1.2 to 1.1.3
Key: SPARK-44506
URL: https://issues.apache.org/jira/browse/SPARK-44506
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-42118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17745345#comment-17745345
]
Jia Fan commented on SPARK-42118:
-
Seem like already fixed on master branch.
> Wrong result when
[
https://issues.apache.org/jira/browse/SPARK-44359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-44359:
-
Summary: Define the computing logic through PartitionEvaluator API and use
it in
[
https://issues.apache.org/jira/browse/SPARK-44359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-44359:
-
Description:
Define the computing logic through PartitionEvaluator API and use it in SQL
aggregate
[
https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-44365:
-
Description:
Define the computing logic through PartitionEvaluator API and use it in SQL
operators
[
https://issues.apache.org/jira/browse/SPARK-44365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-44365:
-
Summary: Use PartitionEvaluator API in FileSourceScanExec,
RowDataSourceScanExec, MergeRowsExec (was:
[
https://issues.apache.org/jira/browse/SPARK-44487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44487:
Assignee: Jia Fan
> KubernetesSuite report NPE when not set
[
https://issues.apache.org/jira/browse/SPARK-44487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44487.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42081
[
https://issues.apache.org/jira/browse/SPARK-44477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44477:
Assignee: Bruce Robbins
> CheckAnalysis uses error subclass as an error class
>
[
https://issues.apache.org/jira/browse/SPARK-44477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44477.
--
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-44252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-44252.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 41705
[
https://issues.apache.org/jira/browse/SPARK-44252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim reassigned SPARK-44252:
Assignee: Lucy Yao
> Add error class for the case when loading state from DFS fails
>
Martin Grund created SPARK-44505:
Summary: DataSource v2 Scans should not require planning the input
partitions on explain
Key: SPARK-44505
URL: https://issues.apache.org/jira/browse/SPARK-44505
[
https://issues.apache.org/jira/browse/SPARK-44504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17745272#comment-17745272
]
Anish Shrigondekar commented on SPARK-44504:
Sent PR here:
[
https://issues.apache.org/jira/browse/SPARK-44504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17745272#comment-17745272
]
Anish Shrigondekar edited comment on SPARK-44504 at 7/20/23 8:57 PM:
-
Anish Shrigondekar created SPARK-44504:
--
Summary: Maintenance task should clean up loaded providers on stop
error
Key: SPARK-44504
URL: https://issues.apache.org/jira/browse/SPARK-44504
Project:
[
https://issues.apache.org/jira/browse/SPARK-44501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44501.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 42094
[
https://issues.apache.org/jira/browse/SPARK-44501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-44501:
-
Assignee: Dongjoon Hyun
> Ignore checksum files in
[
https://issues.apache.org/jira/browse/SPARK-44503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17745258#comment-17745258
]
Daniel commented on SPARK-44503:
I can work on this part
> Support PARTITION BY and ORDER BY clause for
Daniel created SPARK-44503:
--
Summary: Support PARTITION BY and ORDER BY clause for table
arguments
Key: SPARK-44503
URL: https://issues.apache.org/jira/browse/SPARK-44503
Project: Spark
Issue
Wei Liu created SPARK-44502:
---
Summary: Add mission versionchanged field to docs
Key: SPARK-44502
URL: https://issues.apache.org/jira/browse/SPARK-44502
Project: Spark
Issue Type: New Feature
Dongjoon Hyun created SPARK-44501:
-
Summary: Ignore checksum files in
KubernetesLocalDiskShuffleExecutorComponents
Key: SPARK-44501
URL: https://issues.apache.org/jira/browse/SPARK-44501
Project:
[
https://issues.apache.org/jira/browse/SPARK-44501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44501:
--
Issue Type: Improvement (was: Bug)
> Ignore checksum files in
[
https://issues.apache.org/jira/browse/SPARK-44464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17745191#comment-17745191
]
Siying Dong commented on SPARK-44464:
-
[~kabhwan] should we backport it all the way to 11.3? Or it's
Robert Joseph Evans created SPARK-44500:
---
Summary: parse_url treats key as regular expression
Key: SPARK-44500
URL: https://issues.apache.org/jira/browse/SPARK-44500
Project: Spark
Tushar Mahale created SPARK-44499:
-
Summary: FileSourceScanExec OutputPartitioning for non bucketed
scan
Key: SPARK-44499
URL: https://issues.apache.org/jira/browse/SPARK-44499
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-44466:
Summary: Exclude configs starting with SPARK_DRIVER_PREFIX and
SPARK_EXECUTOR_PREFIX from
Marcin Grzejszczak created SPARK-44498:
--
Summary: Add support for Micrometer Observation
Key: SPARK-44498
URL: https://issues.apache.org/jira/browse/SPARK-44498
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-44494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44494:
--
Fix Version/s: 3.5.0
> K8s-it test failed
> --
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-44494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-44494:
-
Assignee: Yang Jie
> K8s-it test failed
> --
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-44494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44494.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42091
[
https://issues.apache.org/jira/browse/SPARK-44497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744987#comment-17744987
]
ASF GitHub Bot commented on SPARK-44497:
User 'cxzl25' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dzcxzl updated SPARK-44497:
---
Description: In SPARK-37831, the partition id is added in taskinfo, and the
task partition id cannot be
dzcxzl created SPARK-44497:
--
Summary: Show task partition id in Task table
Key: SPARK-44497
URL: https://issues.apache.org/jira/browse/SPARK-44497
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-44484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744978#comment-17744978
]
ASF GitHub Bot commented on SPARK-44484:
User 'WweiL' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-43001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744973#comment-17744973
]
padavan commented on SPARK-43001:
-
[~kabhwan] ?
> Spark last window dont flush in append mode
>
Rui Wang created SPARK-44496:
Summary: Move Interfaces needed by SCSC to sql/api
Key: SPARK-44496
URL: https://issues.apache.org/jira/browse/SPARK-44496
Project: Spark
Issue Type: Sub-task
Yang Jie created SPARK-44495:
Summary: Resume to use the latest minikube for k8s-it on GitHub
Action
Key: SPARK-44495
URL: https://issues.apache.org/jira/browse/SPARK-44495
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-44494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744935#comment-17744935
]
Yang Jie commented on SPARK-44494:
--
It seems that the test started to fail after Minikube upgrading to
Yang Jie created SPARK-44494:
Summary: K8s-it test failed
Key: SPARK-44494
URL: https://issues.apache.org/jira/browse/SPARK-44494
Project: Spark
Issue Type: Bug
Components: Kubernetes,
[
https://issues.apache.org/jira/browse/SPARK-44494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744933#comment-17744933
]
Yang Jie commented on SPARK-44494:
--
cc [~yikunkero] Do you have any suggestions?
> K8s-it test
[
https://issues.apache.org/jira/browse/SPARK-44493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-44493:
Attachment: before.png
> Extract pushable predicates from disjunctive predicates
>
Yuming Wang created SPARK-44493:
---
Summary: Extract pushable predicates from disjunctive predicates
Key: SPARK-44493
URL: https://issues.apache.org/jira/browse/SPARK-44493
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-44493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-44493:
Description:
Example:
{code:sql}
select count(*)
from
db.very_large_table
where
[
https://issues.apache.org/jira/browse/SPARK-44493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-44493:
Attachment: after.png
> Extract pushable predicates from disjunctive predicates
>
[
https://issues.apache.org/jira/browse/SPARK-44475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-44475.
-
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41928
[
https://issues.apache.org/jira/browse/SPARK-44491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44491:
Assignee: BingKun Pan
> Add `branch-3.5` to `publish_snapshot` GitHub Action job
>
[
https://issues.apache.org/jira/browse/SPARK-44491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44491.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42088
Haejoon Lee created SPARK-44492:
---
Summary: Resolve remaining AnalysisException
Key: SPARK-44492
URL: https://issues.apache.org/jira/browse/SPARK-44492
Project: Spark
Issue Type: Sub-task
76 matches
Mail list logo
