Wang Shuo created SPARK-26418:
-
Summary: Only OpenBlocks without any ChunkFetch for one stream
will cause memory leak in ExternalShuffleService
Key: SPARK-26418
URL: https://issues.apache.org/jira/browse/SPARK-26418
[
https://issues.apache.org/jira/browse/SPARK-26418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725649#comment-16725649
]
Wang Shuo commented on SPARK-26418:
---
We use YarnShuffleService as aux service of NodeM
[
https://issues.apache.org/jira/browse/SPARK-26418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725649#comment-16725649
]
Wang Shuo edited comment on SPARK-26418 at 12/20/18 8:38 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-26418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26418:
Assignee: (was: Apache Spark)
> Only OpenBlocks without any ChunkFetch for one stream
[
https://issues.apache.org/jira/browse/SPARK-26418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26418:
Assignee: Apache Spark
> Only OpenBlocks without any ChunkFetch for one stream will cause
[
https://issues.apache.org/jira/browse/SPARK-26418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725679#comment-16725679
]
Apache Spark commented on SPARK-26418:
--
User 'wangshuo128' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-26408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725683#comment-16725683
]
Liang-Chi Hsieh commented on SPARK-26408:
-
Looks like an issue at https://github
[
https://issues.apache.org/jira/browse/SPARK-26396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725685#comment-16725685
]
Kaspar Tint commented on SPARK-26396:
-
Yes, issue can be closed. I do think the docu
Si Chen created SPARK-26419:
---
Summary: spark metric source
Key: SPARK-26419
URL: https://issues.apache.org/jira/browse/SPARK-26419
Project: Spark
Issue Type: Bug
Components: Spark Core
[
https://issues.apache.org/jira/browse/SPARK-26418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725677#comment-16725677
]
Apache Spark commented on SPARK-26418:
--
User 'wangshuo128' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-26405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725691#comment-16725691
]
Liang-Chi Hsieh commented on SPARK-26405:
-
I think the exception message is some
[
https://issues.apache.org/jira/browse/SPARK-26419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Si Chen updated SPARK-26419:
Attachment: image-2018-12-20-17-07-40-920.png
> spark metric source
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-26419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Si Chen updated SPARK-26419:
Attachment: image-2018-12-20-17-07-48-020.png
> spark metric source
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-26419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Si Chen updated SPARK-26419:
Attachment: image-2018-12-20-17-05-42-245.png
> spark metric source
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-26419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Si Chen updated SPARK-26419:
Attachment: image-2018-12-20-17-14-35-157.png
> spark metric source
> ---
>
>
Viktor Bogdanov created SPARK-26420:
---
Summary: [kubernetes] driver service id is not random
Key: SPARK-26420
URL: https://issues.apache.org/jira/browse/SPARK-26420
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-26419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Si Chen updated SPARK-26419:
Description:
Today I write a metric source to collect HikariCp metrics.
My source code like this:
!image-2
[
https://issues.apache.org/jira/browse/SPARK-26419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Si Chen updated SPARK-26419:
Description:
Today I write a metric source to collect HikariCp metrics.
My source code like this:
!image
[
https://issues.apache.org/jira/browse/SPARK-26420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Viktor Bogdanov updated SPARK-26420:
Description:
I faced with a very rare situation
{code:java}
2018-12-20 04:34:46 WARN Drive
[
https://issues.apache.org/jira/browse/SPARK-26419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Si Chen updated SPARK-26419:
Attachment: image-2018-12-20-17-11-44-568.png
> spark metric source
> ---
>
>
thinktothings created SPARK-26421:
-
Summary: Spark2.4.0 integration hadoop3.1.1 causes hive sql not to
use,just in idea local mode
Key: SPARK-26421
URL: https://issues.apache.org/jira/browse/SPARK-26421
[
https://issues.apache.org/jira/browse/SPARK-24687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-24687:
-
Assignee: zhoukang
> When NoClassDefError thrown during task serialization will cause job hang
[
https://issues.apache.org/jira/browse/SPARK-24687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725892#comment-16725892
]
ASF GitHub Bot commented on SPARK-24687:
srowen closed pull request #21664: [SPA
[
https://issues.apache.org/jira/browse/SPARK-26324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-26324:
-
Assignee: Jorge Machado
> Spark submit does not work with messos over ssl [Missing docs]
>
[
https://issues.apache.org/jira/browse/SPARK-26324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-26324.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 23342
[https://github.c
[
https://issues.apache.org/jira/browse/SPARK-26324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725898#comment-16725898
]
ASF GitHub Bot commented on SPARK-26324:
srowen closed pull request #23342: [SPA
[
https://issues.apache.org/jira/browse/SPARK-26324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-26324:
--
Priority: Minor (was: Major)
Component/s: (was: Spark Submit)
Mesos
I
[
https://issues.apache.org/jira/browse/SPARK-24687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-24687.
---
Resolution: Fixed
Fix Version/s: 2.4.1
3.0.0
2.3.3
Issu
[
https://issues.apache.org/jira/browse/SPARK-18092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18092.
---
Resolution: Not A Problem
>From the PR, it seems this isn't a problem now.
> add type cast to avoid
[
https://issues.apache.org/jira/browse/SPARK-18092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725930#comment-16725930
]
ASF GitHub Bot commented on SPARK-18092:
srowen closed pull request #15622: [SPA
Hyukjin Kwon created SPARK-26422:
Summary: Unable to disable Hive support in SparkR when Hadoop
version is unsupported
Key: SPARK-26422
URL: https://issues.apache.org/jira/browse/SPARK-26422
Project:
[
https://issues.apache.org/jira/browse/SPARK-26422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725946#comment-16725946
]
ASF GitHub Bot commented on SPARK-26422:
HyukjinKwon opened a new pull request #
[
https://issues.apache.org/jira/browse/SPARK-26410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725948#comment-16725948
]
Li Jin commented on SPARK-26410:
I am curious why would user want to configure maxRecord
[
https://issues.apache.org/jira/browse/SPARK-26422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26422:
Assignee: Apache Spark
> Unable to disable Hive support in SparkR when Hadoop version is
[
https://issues.apache.org/jira/browse/SPARK-26422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26422:
Assignee: (was: Apache Spark)
> Unable to disable Hive support in SparkR when Hadoop
[
https://issues.apache.org/jira/browse/SPARK-26359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725949#comment-16725949
]
Steve Loughran commented on SPARK-26359:
bq. This seems to be related to the fac
[
https://issues.apache.org/jira/browse/SPARK-26412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725957#comment-16725957
]
Li Jin commented on SPARK-26412:
So this is similar to the mapPartitions API in Scala bu
[
https://issues.apache.org/jira/browse/SPARK-26284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved SPARK-26284.
Resolution: Invalid
> Spark History server object vs file storage behavior difference
> --
[
https://issues.apache.org/jira/browse/SPARK-26284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725958#comment-16725958
]
Steve Loughran commented on SPARK-26284:
This is how object stores work. PUTs /
[
https://issues.apache.org/jira/browse/SPARK-26409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-26409.
-
Resolution: Fixed
Assignee: Gengliang Wang
Fix Version/s: 3.0.0
> SQLConf should be seri
[
https://issues.apache.org/jira/browse/SPARK-26409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726097#comment-16726097
]
ASF GitHub Bot commented on SPARK-26409:
asfgit closed pull request #23352: [SPA
[
https://issues.apache.org/jira/browse/SPARK-26392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726113#comment-16726113
]
ASF GitHub Bot commented on SPARK-26392:
asfgit closed pull request #23344: [SPA
[
https://issues.apache.org/jira/browse/SPARK-26392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-26392.
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 23344
[https:
[
https://issues.apache.org/jira/browse/SPARK-26392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-26392:
--
Assignee: wuyi
> Cancel pending allocate requests by taking locality preference into
[
https://issues.apache.org/jira/browse/SPARK-26410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726155#comment-16726155
]
Xiangrui Meng commented on SPARK-26410:
---
On the same cluster, there could be diffe
[
https://issues.apache.org/jira/browse/SPARK-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726156#comment-16726156
]
Matt Foley commented on SPARK-21544:
The problem described in detail in the Descript
[
https://issues.apache.org/jira/browse/SPARK-25970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng reassigned SPARK-25970:
-
Assignee: zhengruifeng
> Add Instrumentation to PrefixSpan
> --
[
https://issues.apache.org/jira/browse/SPARK-25970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-25970.
---
Resolution: Done
> Add Instrumentation to PrefixSpan
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-25970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726164#comment-16726164
]
ASF GitHub Bot commented on SPARK-25970:
asfgit closed pull request #22971: [SPA
[
https://issues.apache.org/jira/browse/SPARK-26415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-26415:
--
Target Version/s: (was: 2.2.3, 2.3.3, 2.4.1, 2.5.0)
> Mark StreamSinkProvider and StreamSour
[
https://issues.apache.org/jira/browse/SPARK-26415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-26415.
---
Resolution: Not A Problem
According to the discussion, the API will be effectively `Stable`
[
https://issues.apache.org/jira/browse/SPARK-26409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-26409:
--
Fix Version/s: 2.4.1
> SQLConf should be serializable in test sessions
> -
[
https://issues.apache.org/jira/browse/SPARK-26415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726190#comment-16726190
]
ASF GitHub Bot commented on SPARK-26415:
dongjoon-hyun closed pull request #2335
[
https://issues.apache.org/jira/browse/SPARK-26415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-26415.
-
> Mark StreamSinkProvider and StreamSourceProvider as stable
> -
David Vogelbacher created SPARK-26423:
-
Summary: [K8s] Make sure that disconnected executors eventually
get deleted
Key: SPARK-26423
URL: https://issues.apache.org/jira/browse/SPARK-26423
Project:
[
https://issues.apache.org/jira/browse/SPARK-26423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-26423:
--
Description:
If an executor disconnects we currently only disable it in the
{{Kuberne
Maxim Gekk created SPARK-26424:
--
Summary: Use java.time API in timestamp/date function
Key: SPARK-26424
URL: https://issues.apache.org/jira/browse/SPARK-26424
Project: Spark
Issue Type: Improve
[
https://issues.apache.org/jira/browse/SPARK-26424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-26424:
---
Summary: Use java.time API in timestamp/date functions (was: Use
java.time API in timestamp/date f
[
https://issues.apache.org/jira/browse/SPARK-26424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726270#comment-16726270
]
ASF GitHub Bot commented on SPARK-26424:
MaxGekk opened a new pull request #2335
[
https://issues.apache.org/jira/browse/SPARK-26424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26424:
Assignee: (was: Apache Spark)
> Use java.time API in timestamp/date functions
>
[
https://issues.apache.org/jira/browse/SPARK-25064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726281#comment-16726281
]
ASF GitHub Bot commented on SPARK-25064:
vanzin closed pull request #22051: [SPA
[
https://issues.apache.org/jira/browse/SPARK-25064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-25064:
--
Assignee: (was: Marcelo Vanzin)
> Total Tasks in WebUI does not match Active+Fail
[
https://issues.apache.org/jira/browse/SPARK-25064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25064:
Assignee: Apache Spark
> Total Tasks in WebUI does not match Active+Failed+Complete Tasks
[
https://issues.apache.org/jira/browse/SPARK-25064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25064:
Assignee: (was: Apache Spark)
> Total Tasks in WebUI does not match Active+Failed+Com
[
https://issues.apache.org/jira/browse/SPARK-25064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-25064:
--
Assignee: Marcelo Vanzin
> Total Tasks in WebUI does not match Active+Failed+Complete
[
https://issues.apache.org/jira/browse/SPARK-26424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26424:
Assignee: Apache Spark
> Use java.time API in timestamp/date functions
> ---
[
https://issues.apache.org/jira/browse/SPARK-23155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23155:
Assignee: Marcelo Vanzin (was: Apache Spark)
> YARN-aggregated executor/driver logs appe
[
https://issues.apache.org/jira/browse/SPARK-23155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-23155:
--
Assignee: (was: Marcelo Vanzin)
> YARN-aggregated executor/driver logs appear una
[
https://issues.apache.org/jira/browse/SPARK-23155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-23155:
--
Assignee: (was: Marcelo Vanzin)
> YARN-aggregated executor/driver logs appear una
[
https://issues.apache.org/jira/browse/SPARK-23155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-23155:
--
Assignee: Marcelo Vanzin
> YARN-aggregated executor/driver logs appear unavailable wh
[
https://issues.apache.org/jira/browse/SPARK-23155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-23155:
--
Assignee: Marcelo Vanzin
> YARN-aggregated executor/driver logs appear unavailable wh
[
https://issues.apache.org/jira/browse/SPARK-23155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23155:
Assignee: Apache Spark (was: Marcelo Vanzin)
> YARN-aggregated executor/driver logs appe
[
https://issues.apache.org/jira/browse/SPARK-26311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-26311.
Resolution: Duplicate
Duping to the existing bug; no need to track this in two different p
[
https://issues.apache.org/jira/browse/SPARK-23155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726287#comment-16726287
]
ASF GitHub Bot commented on SPARK-23155:
vanzin closed pull request #20326: [SPA
[
https://issues.apache.org/jira/browse/SPARK-26416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726326#comment-16726326
]
ASF GitHub Bot commented on SPARK-26416:
dbtsai opened a new pull request #23359
[
https://issues.apache.org/jira/browse/SPARK-26416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26416:
Assignee: DB Tsai (was: Apache Spark)
> Refactor `ColumnPruning` from `Optimizer.scala`
[
https://issues.apache.org/jira/browse/SPARK-26416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26416:
Assignee: Apache Spark (was: DB Tsai)
> Refactor `ColumnPruning` from `Optimizer.scala`
77 matches
Mail list logo