[
https://issues.apache.org/jira/browse/SPARK-28246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pavel Parkhomenko updated SPARK-28246:
--
Description:
Buffer object for UserDefinedAggregateFunction contains data from previou
[
https://issues.apache.org/jira/browse/SPARK-28246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pavel Parkhomenko updated SPARK-28246:
--
Summary: State of UDAF: buffer is not cleared (was: State of UDAF: buffer
is not clea
Pavel Parkhomenko created SPARK-28246:
-
Summary: State of UDAF: buffer is not cleaned
Key: SPARK-28246
URL: https://issues.apache.org/jira/browse/SPARK-28246
Project: Spark
Issue Type: Bu
[
https://issues.apache.org/jira/browse/SPARK-27371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27371:
Assignee: Apache Spark
> Standalone master receives resource info from worker and allocat
[
https://issues.apache.org/jira/browse/SPARK-27371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27371:
Assignee: (was: Apache Spark)
> Standalone master receives resource info from worker
[
https://issues.apache.org/jira/browse/SPARK-28244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16878246#comment-16878246
]
Alberto Andreotti commented on SPARK-28244:
---
see SPARK-28245
> Problem to rec
[
https://issues.apache.org/jira/browse/SPARK-28245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alberto Andreotti updated SPARK-28245:
--
Description:
This works in PySpark,
from pyspark.sql import SparkSession
spark = S
Alberto Andreotti created SPARK-28245:
-
Summary: Problem to recognize Kubernetes cluster address from Scala
Key: SPARK-28245
URL: https://issues.apache.org/jira/browse/SPARK-28245
Project: Spark
Alberto Andreotti created SPARK-28244:
-
Summary: Problem to recognize Kubernetes cluster address from Scala
Key: SPARK-28244
URL: https://issues.apache.org/jira/browse/SPARK-28244
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28188:
--
Affects Version/s: (was: 2.4.3)
3.0.0
> Materialize Dataframe API
[
https://issues.apache.org/jira/browse/SPARK-27768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16878185#comment-16878185
]
Dilip Biswal commented on SPARK-27768:
--
[~dongjoon] Thank you very much for your re
[
https://issues.apache.org/jira/browse/SPARK-26675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16878075#comment-16878075
]
Andrei Koiro commented on SPARK-26675:
--
Have the same issue on spark 2.4.3 scala 2.
[
https://issues.apache.org/jira/browse/SPARK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877982#comment-16877982
]
Apache Spark commented on SPARK-28155:
--
User 'yeshengm' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-28155.
-
Resolution: Fixed
Fix Version/s: 3.0.0
> Improve SQL optimizer's predicate pushdown performance f
[
https://issues.apache.org/jira/browse/SPARK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877975#comment-16877975
]
Xiao Li commented on SPARK-28155:
-
[https://github.com/apache/spark/pull/24956]
> Impro
[
https://issues.apache.org/jira/browse/SPARK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-28155:
---
Assignee: Yesheng Ma
> Improve SQL optimizer's predicate pushdown performance for cascading joins
>
[
https://issues.apache.org/jira/browse/SPARK-27977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877918#comment-16877918
]
Gabor Somogyi commented on SPARK-27977:
---
Yeah, the latest master looks like:
{code
[
https://issues.apache.org/jira/browse/SPARK-28243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28243:
Assignee: Apache Spark
> remove setFeatureSubsetStrategy and setSubsamplingRate from Pyth
[
https://issues.apache.org/jira/browse/SPARK-28243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28243:
Assignee: (was: Apache Spark)
> remove setFeatureSubsetStrategy and setSubsamplingRat
Huaxin Gao created SPARK-28243:
--
Summary: remove setFeatureSubsetStrategy and setSubsamplingRate
from Python TreeEnsembleParams
Key: SPARK-28243
URL: https://issues.apache.org/jira/browse/SPARK-28243
Pro
Miquel Canes created SPARK-28242:
Summary: DataStreamer keeps logging errors even after fixing
writeStream output sink
Key: SPARK-28242
URL: https://issues.apache.org/jira/browse/SPARK-28242
Project:
[
https://issues.apache.org/jira/browse/SPARK-27975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877836#comment-16877836
]
Gabor Somogyi edited comment on SPARK-27975 at 7/3/19 1:48 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-27975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877836#comment-16877836
]
Gabor Somogyi commented on SPARK-27975:
---
After I've moved console sink from v1 to
[
https://issues.apache.org/jira/browse/SPARK-28156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-28156:
---
Assignee: Liang-Chi Hsieh
> Join plan sometimes does not use cached query
> ---
[
https://issues.apache.org/jira/browse/SPARK-28156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-28156.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24960
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-28233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28233:
Assignee: Yuming Wang
> Upgrade maven-jar-plugin and maven-source-plugin
> --
[
https://issues.apache.org/jira/browse/SPARK-28233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28233.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25031
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-28036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877765#comment-16877765
]
ShuMing Li commented on SPARK-28036:
[~shivuson...@gmail.com] It's not the same with
[
https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877683#comment-16877683
]
jiaan.geng commented on SPARK-27924:
I'm working on.
> ANSI SQL: Boolean Test
> ---
[
https://issues.apache.org/jira/browse/SPARK-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28241:
Attachment: (was: SPARK-28024.png)
> Show metadata operations on ThriftServerTab
> ---
[
https://issues.apache.org/jira/browse/SPARK-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28241:
Assignee: (was: Apache Spark)
> Show metadata operations on ThriftServerTab
> ---
[
https://issues.apache.org/jira/browse/SPARK-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28241:
Attachment: SPARK-28024.png
> Show metadata operations on ThriftServerTab
> --
[
https://issues.apache.org/jira/browse/SPARK-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28241:
Description:
!https://user-images.githubusercontent.com/5399861/60579741-4cd2c180-9db6-11e9-822a-0
[
https://issues.apache.org/jira/browse/SPARK-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28241:
Assignee: Apache Spark
> Show metadata operations on ThriftServerTab
> --
Yuming Wang created SPARK-28241:
---
Summary: Show metadata operations on ThriftServerTab
Key: SPARK-28241
URL: https://issues.apache.org/jira/browse/SPARK-28241
Project: Spark
Issue Type: Improve
[
https://issues.apache.org/jira/browse/SPARK-28226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28226:
-
Summary: Document Pandas UDF mapParitionsInPandas (was: Rename Pandas UDF
SCALAR_ITER to MAP_IT
[
https://issues.apache.org/jira/browse/SPARK-28226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28226:
-
Description: {{mapPartitionsInPandas}} was added as of SPARK-28198. This
JIRA targets to documen
[
https://issues.apache.org/jira/browse/SPARK-28240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28240.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25042
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-28240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28240:
Assignee: Hyukjin Kwon
> Fix Arrow tests to pass with Python 2.7 and latest PyArrow and P
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Summary: Allow TCP connections created by shuffle service auto close on
YARN NodeManagers (was: Make TCP co
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description:
When executing shuffle tasks, TCP connections(on port 7337 by default) will be
established by
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description:
When executing shuffle tasks, TCP connections(on port 7337 by default) will be
established by
[
https://issues.apache.org/jira/browse/SPARK-28240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28240:
Assignee: Apache Spark
> Fix Arrow tests to pass with Python 2.7 and latest PyArrow and P
[
https://issues.apache.org/jira/browse/SPARK-28240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28240:
Assignee: (was: Apache Spark)
> Fix Arrow tests to pass with Python 2.7 and latest Py
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description:
When executing shuffle tasks, TCP connections(on port 7337 by default) will be
established by
[
https://issues.apache.org/jira/browse/SPARK-28240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28240:
-
Summary: Fix Arrow tests to pass with Python 2.7 and latest PyArrow and
Pandas in PySpark (was:
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description:
When executing shuffle tasks, TCP connections(on port 7337 by default) will be
established by
[
https://issues.apache.org/jira/browse/SPARK-28240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28240:
-
Summary: Fix Arrow tests to pass with Python 2.7, PyArrow 0.13, Pandas
0.24.2 in PySpark (was:
Hyukjin Kwon created SPARK-28240:
Summary: Fix Arrow tests to pass with Python 2.7 in PySpark
Key: SPARK-28240
URL: https://issues.apache.org/jira/browse/SPARK-28240
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description:
When executing shuffle tasks, TCP connections(on port 7337 by default) will be
established by
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Environment:
Hadoop2.6.0-CDH5.8.3(netty3)
Spark2.4.0(netty4)
Configs:
spark.shuffle.service.enabled=true
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description:
When executing shuffle tasks, TCP connections(on port 7337 by default) will be
established by
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Attachment: screenshot-2.png
> Make TCP connections created by shuffle service auto close on YARN
> NodeMan
[
https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877599#comment-16877599
]
Sascha Wiegleb commented on SPARK-17647:
I have tested this behavior with spark
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Attachment: (was: screenshot-1.png)
> Make TCP connections created by shuffle service auto close on YARN
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Attachment: screenshot-1.png
> Make TCP connections created by shuffle service auto close on YARN
> NodeMan
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Attachment: screenshot-1.png
> Make TCP connections created by shuffle service auto close on YARN
> NodeMan
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description: When executing shuffle tasks, (was: When we set
spark.shuffle.service.enabled=true, )
> Make
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Description: When we set spark.shuffle.service.enabled=true,
> Make TCP connections created by shuffle serv
[
https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deegue updated SPARK-28239:
---
Environment:
Hadoop2.6.0-CDH5.8.3(netty3)
Spark2.4.0(netty4)
set spark.shuffle.service.enabled=true
was:
Deegue created SPARK-28239:
--
Summary: Make TCP connections created by shuffle service auto
close on YARN NodeManagers
Key: SPARK-28239
URL: https://issues.apache.org/jira/browse/SPARK-28239
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-28167.
-
Resolution: Fixed
Assignee: Yuming Wang
Fix Version/s: 3.0.0
> Show global temporary vie
62 matches
Mail list logo
