[
https://issues.apache.org/jira/browse/SPARK-27371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27371:
Assignee: Apache Spark
> Standalone master receives resource info from worker and
[
https://issues.apache.org/jira/browse/SPARK-27371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27371:
Assignee: (was: Apache Spark)
> Standalone master receives resource info from worker
[
https://issues.apache.org/jira/browse/SPARK-28244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16878246#comment-16878246
]
Alberto Andreotti commented on SPARK-28244:
---
see SPARK-28245
> Problem to recognize
[
https://issues.apache.org/jira/browse/SPARK-28245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alberto Andreotti updated SPARK-28245:
--
Description:
This works in PySpark,
from pyspark.sql import SparkSession
spark =
Alberto Andreotti created SPARK-28245:
-
Summary: Problem to recognize Kubernetes cluster address from Scala
Key: SPARK-28245
URL: https://issues.apache.org/jira/browse/SPARK-28245
Project: Spark
Alberto Andreotti created SPARK-28244:
-
Summary: Problem to recognize Kubernetes cluster address from Scala
Key: SPARK-28244
URL: https://issues.apache.org/jira/browse/SPARK-28244
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28188:
--
Affects Version/s: (was: 2.4.3)
3.0.0
> Materialize Dataframe API
[
https://issues.apache.org/jira/browse/SPARK-27768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16878185#comment-16878185
]
Dilip Biswal commented on SPARK-27768:
--
[~dongjoon] Thank you very much for your response.
>
[
https://issues.apache.org/jira/browse/SPARK-26675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16878075#comment-16878075
]
Andrei Koiro commented on SPARK-26675:
--
Have the same issue on spark 2.4.3 scala 2.11
{code:java}
[
https://issues.apache.org/jira/browse/SPARK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877982#comment-16877982
]
Apache Spark commented on SPARK-28155:
--
User 'yeshengm' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-28155.
-
Resolution: Fixed
Fix Version/s: 3.0.0
> Improve SQL optimizer's predicate pushdown performance
[
https://issues.apache.org/jira/browse/SPARK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877975#comment-16877975
]
Xiao Li commented on SPARK-28155:
-
[https://github.com/apache/spark/pull/24956]
> Improve SQL
[
https://issues.apache.org/jira/browse/SPARK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-28155:
---
Assignee: Yesheng Ma
> Improve SQL optimizer's predicate pushdown performance for cascading joins
[
https://issues.apache.org/jira/browse/SPARK-27977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877918#comment-16877918
]
Gabor Somogyi commented on SPARK-27977:
---
Yeah, the latest master looks like:
{code:java}
== Parsed
[
https://issues.apache.org/jira/browse/SPARK-28243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28243:
Assignee: Apache Spark
> remove setFeatureSubsetStrategy and setSubsamplingRate from
[
https://issues.apache.org/jira/browse/SPARK-28243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28243:
Assignee: (was: Apache Spark)
> remove setFeatureSubsetStrategy and
Huaxin Gao created SPARK-28243:
--
Summary: remove setFeatureSubsetStrategy and setSubsamplingRate
from Python TreeEnsembleParams
Key: SPARK-28243
URL: https://issues.apache.org/jira/browse/SPARK-28243
Miquel Canes created SPARK-28242:
Summary: DataStreamer keeps logging errors even after fixing
writeStream output sink
Key: SPARK-28242
URL: https://issues.apache.org/jira/browse/SPARK-28242
Project:
[
https://issues.apache.org/jira/browse/SPARK-27975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877836#comment-16877836
]
Gabor Somogyi edited comment on SPARK-27975 at 7/3/19 1:48 PM:
---
After I've
[
https://issues.apache.org/jira/browse/SPARK-27975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877836#comment-16877836
]
Gabor Somogyi commented on SPARK-27975:
---
After I've moved console sink from v1 to v2 the progress
[
https://issues.apache.org/jira/browse/SPARK-28156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-28156:
---
Assignee: Liang-Chi Hsieh
> Join plan sometimes does not use cached query
>
[
https://issues.apache.org/jira/browse/SPARK-28156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-28156.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24960
[
https://issues.apache.org/jira/browse/SPARK-28233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28233:
Assignee: Yuming Wang
> Upgrade maven-jar-plugin and maven-source-plugin
>
[
https://issues.apache.org/jira/browse/SPARK-28233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28233.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25031
[
https://issues.apache.org/jira/browse/SPARK-28036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877765#comment-16877765
]
ShuMing Li commented on SPARK-28036:
[~shivuson...@gmail.com] It's not the same with `Postgres`:
*
[
https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877683#comment-16877683
]
jiaan.geng commented on SPARK-27924:
I'm working on.
> ANSI SQL: Boolean Test
>
[
https://issues.apache.org/jira/browse/SPARK-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28241:
Attachment: (was: SPARK-28024.png)
> Show metadata operations on ThriftServerTab
>
[
https://issues.apache.org/jira/browse/SPARK-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28241:
Assignee: (was: Apache Spark)
> Show metadata operations on ThriftServerTab
>
[
https://issues.apache.org/jira/browse/SPARK-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28241:
Attachment: SPARK-28024.png
> Show metadata operations on ThriftServerTab
>
[
https://issues.apache.org/jira/browse/SPARK-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28241:
Description:
[
https://issues.apache.org/jira/browse/SPARK-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28241:
Assignee: Apache Spark
> Show metadata operations on ThriftServerTab
>
Yuming Wang created SPARK-28241:
---
Summary: Show metadata operations on ThriftServerTab
Key: SPARK-28241
URL: https://issues.apache.org/jira/browse/SPARK-28241
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-28226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28226:
-
Summary: Document Pandas UDF mapParitionsInPandas (was: Rename Pandas UDF
SCALAR_ITER to
[
https://issues.apache.org/jira/browse/SPARK-28226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28226:
-
Description: {{mapPartitionsInPandas}} was added as of SPARK-28198. This
JIRA targets to
[
https://issues.apache.org/jira/browse/SPARK-28240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28240.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25042
[
https://issues.apache.org/jira/browse/SPARK-28240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28240:
Assignee: Hyukjin Kwon
> Fix Arrow tests to pass with Python 2.7 and latest PyArrow and
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Summary: Allow TCP connections created by shuffle service auto close on
YARN NodeManagers (was: Make TCP
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description:
When executing shuffle tasks, TCP connections(on port 7337 by default) will be
established by
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description:
When executing shuffle tasks, TCP connections(on port 7337 by default) will be
established by
[
https://issues.apache.org/jira/browse/SPARK-28240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28240:
Assignee: (was: Apache Spark)
> Fix Arrow tests to pass with Python 2.7 and latest
[
https://issues.apache.org/jira/browse/SPARK-28240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28240:
Assignee: Apache Spark
> Fix Arrow tests to pass with Python 2.7 and latest PyArrow and
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description:
When executing shuffle tasks, TCP connections(on port 7337 by default) will be
established by
[
https://issues.apache.org/jira/browse/SPARK-28240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28240:
-
Summary: Fix Arrow tests to pass with Python 2.7 and latest PyArrow and
Pandas in PySpark
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description:
When executing shuffle tasks, TCP connections(on port 7337 by default) will be
established by
[
https://issues.apache.org/jira/browse/SPARK-28240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28240:
-
Summary: Fix Arrow tests to pass with Python 2.7, PyArrow 0.13, Pandas
0.24.2 in PySpark (was:
Hyukjin Kwon created SPARK-28240:
Summary: Fix Arrow tests to pass with Python 2.7 in PySpark
Key: SPARK-28240
URL: https://issues.apache.org/jira/browse/SPARK-28240
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description:
When executing shuffle tasks, TCP connections(on port 7337 by default) will be
established by
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Environment:
Hadoop2.6.0-CDH5.8.3(netty3)
Spark2.4.0(netty4)
Configs:
spark.shuffle.service.enabled=true
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description:
When executing shuffle tasks, TCP connections(on port 7337 by default) will be
established by
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Attachment: screenshot-2.png
> Make TCP connections created by shuffle service auto close on YARN
>
[
https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877599#comment-16877599
]
Sascha Wiegleb commented on SPARK-17647:
I have tested this behavior with spark 2.4.2 and it
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Attachment: (was: screenshot-1.png)
> Make TCP connections created by shuffle service auto close on
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Attachment: screenshot-1.png
> Make TCP connections created by shuffle service auto close on YARN
>
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Attachment: screenshot-1.png
> Make TCP connections created by shuffle service auto close on YARN
>
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description: When executing shuffle tasks, (was: When we set
spark.shuffle.service.enabled=true, )
>
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description: When we set spark.shuffle.service.enabled=true,
> Make TCP connections created by shuffle
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Environment:
Hadoop2.6.0-CDH5.8.3(netty3)
Spark2.4.0(netty4)
set spark.shuffle.service.enabled=true
Deegue created SPARK-28239:
--
Summary: Make TCP connections created by shuffle service auto
close on YARN NodeManagers
Key: SPARK-28239
URL: https://issues.apache.org/jira/browse/SPARK-28239
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-28167.
-
Resolution: Fixed
Assignee: Yuming Wang
Fix Version/s: 3.0.0
> Show global temporary
59 matches
Mail list logo
