[
https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513817#comment-17513817
]
Apache Spark commented on SPARK-30835:
--
User 'abhishekd0907' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513816#comment-17513816
]
Apache Spark commented on SPARK-30835:
--
User 'abhishekd0907' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-30835:
Assignee: (was: Apache Spark)
> Add support for YARN decommissioning & pre-emption
>
[
https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-30835:
Assignee: Apache Spark
> Add support for YARN decommissioning & pre-emption
>
[
https://issues.apache.org/jira/browse/SPARK-38633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513815#comment-17513815
]
Apache Spark commented on SPARK-38633:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513813#comment-17513813
]
Abhishek Dixit commented on SPARK-30835:
A pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-35253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513801#comment-17513801
]
Shardul Mahadik commented on SPARK-35253:
-
Hi folks, what is the path forward for this ticket?
[
https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513796#comment-17513796
]
Apache Spark commented on SPARK-32268:
--
User 'ulysses-you' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-38633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-38633.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35947
[
https://issues.apache.org/jira/browse/SPARK-38633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-38633:
---
Assignee: jiaan.geng
> Support push down Cast to JDBC data source V2
>
[
https://issues.apache.org/jira/browse/SPARK-38656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-38656.
--
Fix Version/s: 3.3.0
Assignee: Hyukjin Kwon
Resolution: Fixed
Fixed in
[
https://issues.apache.org/jira/browse/SPARK-38680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-38680.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35996
[
https://issues.apache.org/jira/browse/SPARK-38680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-38680:
Assignee: Hyukjin Kwon
> Set upperbound for pandas-stubs in CI
>
[
https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38679:
Assignee: Apache Spark
> Expose the number partitions in a stage to TaskContext
>
[
https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38679:
Assignee: (was: Apache Spark)
> Expose the number partitions in a stage to
[
https://issues.apache.org/jira/browse/SPARK-38680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38680:
Assignee: Apache Spark
> Set upperbound for pandas-stubs in CI
>
[
https://issues.apache.org/jira/browse/SPARK-38680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513741#comment-17513741
]
Apache Spark commented on SPARK-38680:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-38680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38680:
Assignee: (was: Apache Spark)
> Set upperbound for pandas-stubs in CI
>
[
https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513742#comment-17513742
]
Apache Spark commented on SPARK-38679:
--
User 'vkorukanti' has created a pull request for this
Hyukjin Kwon created SPARK-38680:
Summary: Set upperbound for pandas-stubs in CI
Key: SPARK-38680
URL: https://issues.apache.org/jira/browse/SPARK-38680
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Venki Korukanti updated SPARK-38679:
Description:
Add a new api to expose total partition count in the stage belonging to the
[
https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Venki Korukanti updated SPARK-38679:
Description:
Add a new api to expose total partition count in the stage belonging to the
[
https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Venki Korukanti updated SPARK-38679:
Description:
Add a new api to expose total partition count in the stage belonging to the
[
https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513727#comment-17513727
]
Hyukjin Kwon commented on SPARK-38677:
--
Thanks for the analysis, [~tgraves]. taking a look now.
>
Venki Korukanti created SPARK-38679:
---
Summary: Expose the number partitions in a stage to TaskContext
Key: SPARK-38679
URL: https://issues.apache.org/jira/browse/SPARK-38679
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-38673:
-
Priority: Trivial (was: Minor)
> Replace java assert with Junit api in Java UTs
>
[
https://issues.apache.org/jira/browse/SPARK-38673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-38673:
-
Issue Type: Improvement (was: Bug)
> Replace java assert with Junit api in Java UTs
>
[
https://issues.apache.org/jira/browse/SPARK-38673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-38673:
Assignee: Yang Jie
> Replace java assert with Junit api in Java UTs
>
[
https://issues.apache.org/jira/browse/SPARK-38673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-38673.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 35987
[
https://issues.apache.org/jira/browse/SPARK-38678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-38678:
-
Assignee: Dongjoon Hyun
> Enable RocksDB tests on Apple Silicon on MacOS
>
[
https://issues.apache.org/jira/browse/SPARK-38678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-38678.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 35993
[
https://issues.apache.org/jira/browse/SPARK-38605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38605:
Assignee: (was: Apache Spark)
> Retrying on file manager operation in
[
https://issues.apache.org/jira/browse/SPARK-38605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38605:
Assignee: Apache Spark
> Retrying on file manager operation in HDFSMetadataLog
>
[
https://issues.apache.org/jira/browse/SPARK-38605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513643#comment-17513643
]
Apache Spark commented on SPARK-38605:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-38678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513590#comment-17513590
]
Apache Spark commented on SPARK-38678:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-38678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38678:
Assignee: Apache Spark
> Enable RocksDB tests on Apple Silicon on MacOS
>
[
https://issues.apache.org/jira/browse/SPARK-38678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38678:
Assignee: (was: Apache Spark)
> Enable RocksDB tests on Apple Silicon on MacOS
>
Dongjoon Hyun created SPARK-38678:
-
Summary: Enable RocksDB tests on Apple Silicon on MacOS
Key: SPARK-38678
URL: https://issues.apache.org/jira/browse/SPARK-38678
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-38677:
--
Description:
In spark 3.2.1 (spark 3.2.0 doesn't show this issue), pyspark will hang when
[
https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513536#comment-17513536
]
Thomas Graves commented on SPARK-38677:
---
Note, if you kill the python.daemon process while its
[
https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-38677:
--
Affects Version/s: 3.3.0
> pyspark hangs in local mode running rdd map operation
>
Thomas Graves created SPARK-38677:
-
Summary: pyspark hangs in local mode running rdd map operation
Key: SPARK-38677
URL: https://issues.apache.org/jira/browse/SPARK-38677
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-38257.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 35580
[
https://issues.apache.org/jira/browse/SPARK-38676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38676:
Assignee: Gengliang Wang (was: Apache Spark)
> Provide query context in runtime error
[
https://issues.apache.org/jira/browse/SPARK-38676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513438#comment-17513438
]
Apache Spark commented on SPARK-38676:
--
User 'gengliangwang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-38676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38676:
Assignee: Apache Spark (was: Gengliang Wang)
> Provide query context in runtime error
Gengliang Wang created SPARK-38676:
--
Summary: Provide query context in runtime error of
Add/Subtract/Multiply
Key: SPARK-38676
URL: https://issues.apache.org/jira/browse/SPARK-38676
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513392#comment-17513392
]
Apache Spark commented on SPARK-38675:
--
User 'hvanhovell' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-37853:
-
Priority: Trivial (was: Minor)
> Clean up deprecation compilation warning related to log4j2
>
[
https://issues.apache.org/jira/browse/SPARK-38639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513318#comment-17513318
]
Apache Spark commented on SPARK-38639:
--
User 'TonyDoen' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-38639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513316#comment-17513316
]
Apache Spark commented on SPARK-38639:
--
User 'TonyDoen' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-38673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38673:
Assignee: Apache Spark
> Replace java assert with Junit api in Java UTs
>
[
https://issues.apache.org/jira/browse/SPARK-38673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38673:
Assignee: (was: Apache Spark)
> Replace java assert with Junit api in Java UTs
>
Herman van Hövell created SPARK-38675:
-
Summary: Race condition in BlockInfoManager during unlock
Key: SPARK-38675
URL: https://issues.apache.org/jira/browse/SPARK-38675
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513302#comment-17513302
]
Apache Spark commented on SPARK-38674:
--
User 'wangyum' has created a pull request for this issue:
[ https://issues.apache.org/jira/browse/SPARK-38674 ]
Yuming Wang deleted comment on SPARK-38674:
-
was (Author: q79969786):
https://github.com/apache/spark/pull/35989
> Remove useless deduplicate in SubqueryBroadcastExec
>
[
https://issues.apache.org/jira/browse/SPARK-38674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513300#comment-17513300
]
Apache Spark commented on SPARK-38674:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-38674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513301#comment-17513301
]
Yuming Wang commented on SPARK-38674:
-
https://github.com/apache/spark/pull/35989
> Remove useless
[
https://issues.apache.org/jira/browse/SPARK-38674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38674:
Assignee: (was: Apache Spark)
> Remove useless deduplicate in SubqueryBroadcastExec
[
https://issues.apache.org/jira/browse/SPARK-38674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38674:
Assignee: Apache Spark
> Remove useless deduplicate in SubqueryBroadcastExec
>
[
https://issues.apache.org/jira/browse/SPARK-38674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-38674:
Description:
Distinct performance:
[
https://issues.apache.org/jira/browse/SPARK-38671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-38671.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 35986
[
https://issues.apache.org/jira/browse/SPARK-38671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-38671:
Assignee: Yuming Wang
> Publish snapshot from branch-3.3
>
[
https://issues.apache.org/jira/browse/SPARK-38432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513248#comment-17513248
]
Apache Spark commented on SPARK-38432:
--
User 'beliefer' has created a pull request for this issue:
Yuming Wang created SPARK-38674:
---
Summary: Remove useless deduplicate in SubqueryBroadcastExec
Key: SPARK-38674
URL: https://issues.apache.org/jira/browse/SPARK-38674
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-37673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513179#comment-17513179
]
Apache Spark commented on SPARK-37673:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513178#comment-17513178
]
Apache Spark commented on SPARK-37673:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-38672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-38672.
--
Resolution: Invalid
> Kafka, spark data frame read fails when a message does not exist for
[
https://issues.apache.org/jira/browse/SPARK-38672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513175#comment-17513175
]
Jungtaek Lim commented on SPARK-38672:
--
Could you please add the option
[
https://issues.apache.org/jira/browse/SPARK-38655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-38655:
Fix Version/s: 3.2.2
> OffsetWindowFunctionFrameBase cannot find the offset row whose input is
[
https://issues.apache.org/jira/browse/SPARK-38655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-38655.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35971
[
https://issues.apache.org/jira/browse/SPARK-38655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-38655:
---
Assignee: jiaan.geng
> OffsetWindowFunctionFrameBase cannot find the offset row whose
Yang Jie created SPARK-38673:
Summary: Replace java assert with Junit api in Java UTs
Key: SPARK-38673
URL: https://issues.apache.org/jira/browse/SPARK-38673
Project: Spark
Issue Type: Bug
73 matches
Mail list logo