[
https://issues.apache.org/jira/browse/SPARK-18893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824848#comment-15824848
]
Hong Shen commented on SPARK-18893:
---
+1, "alter table add/replace columns" is a very important feature.
[
https://issues.apache.org/jira/browse/SPARK-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-18910:
--
Description:
When I create a UDF that jar file in hdfs, I can't use the UDF.
{code}
spark-sql> create
[
https://issues.apache.org/jira/browse/SPARK-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-18910:
--
Description:
When I create a UDF that jar file in hdfs, I can't use the UDF.
{code}
spark-sql> create
[
https://issues.apache.org/jira/browse/SPARK-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-18910:
--
Description:
When I create a UDF that jar file in hdfs, I can't use the UDF.
spark-sql> create
[
https://issues.apache.org/jira/browse/SPARK-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15756385#comment-15756385
]
Hong Shen commented on SPARK-18910:
---
Should I add a pull request to resolve this problem?
> Can't use
[
https://issues.apache.org/jira/browse/SPARK-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-18910:
--
Description:
When I create a UDF that jar file in hdfs, I can't use the UDF.
spark-sql> create
[
https://issues.apache.org/jira/browse/SPARK-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-18910:
--
Summary: Can't use UDF that jar file in hdfs (was: Can't use UDF that
source file in hdfs)
> Can't
[
https://issues.apache.org/jira/browse/SPARK-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-18910:
--
Description:
When I create a UDF that jar
spark-sql> create function trans_array as
Hong Shen created SPARK-18910:
-
Summary: Can't use UDF that source file in hdfs
Key: SPARK-18910
URL: https://issues.apache.org/jira/browse/SPARK-18910
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-16989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416320#comment-15416320
]
Hong Shen commented on SPARK-16989:
---
Thanks for your comment.
In our cluster, the log directory is a
[
https://issues.apache.org/jira/browse/SPARK-16989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16989:
--
Description:
If log directory does not exist, it will throw exception as the follow log.
{code}
Hong Shen created SPARK-16989:
-
Summary: fileSystem.getFileStatus throw exception in
EventLoggingListener
Key: SPARK-16989
URL: https://issues.apache.org/jira/browse/SPARK-16989
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-16985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414644#comment-15414644
]
Hong Shen commented on SPARK-16985:
---
The reason is the output file use
[
https://issues.apache.org/jira/browse/SPARK-16985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16985:
--
Description:
In our cluster, sometimes the sql output maybe overrided. When I submit some
sql, all
Hong Shen created SPARK-16985:
-
Summary: SQL Output maybe overrided
Key: SPARK-16985
URL: https://issues.apache.org/jira/browse/SPARK-16985
Project: Spark
Issue Type: Bug
Components:
[
https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411620#comment-15411620
]
Hong Shen commented on SPARK-16709:
---
If you agree it's a bug, then I will reopen the jira and add a
[
https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411616#comment-15411616
]
Hong Shen commented on SPARK-16709:
---
Sorry for late, this is different from SPARK-14915, in the fact,
[
https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393062#comment-15393062
]
Hong Shen edited comment on SPARK-16709 at 7/26/16 2:10 AM:
It different, the
[
https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393062#comment-15393062
]
Hong Shen commented on SPARK-16709:
---
It different, the task has no attempt succeed. this happen when a
[
https://issues.apache.org/jira/browse/SPARK-16708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393054#comment-15393054
]
Hong Shen commented on SPARK-16708:
---
It's different,ExecutorAllocationManager.numRunningTasks be
[
https://issues.apache.org/jira/browse/SPARK-16707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392987#comment-15392987
]
Hong Shen commented on SPARK-16707:
---
It happened many times in our cluster(with thousand of machines),
[
https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16709:
--
Attachment: commit failed.png
> Task with commit failed will retry infinite when speculation set to
[
https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16709:
--
Attachment: (was: `N0)80~9A(AMT~2}%Q`M[RY.png)
> Task with commit failed will retry infinite when
[
https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16709:
--
Attachment: `N0)80~9A(AMT~2}%Q`M[RY.png
> Task with commit failed will retry infinite when speculation
[
https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16709:
--
Description:
In our cluster, we set spark.speculation=true, but when a task throw exception
at
[
https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16709:
--
Description:
In our cluster, we set spark.speculation=true, but when a task throw exception
at
[
https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16709:
--
Description:
In our cluster, we set spark. When a task throw exception at
[
https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16709:
--
Description:
In our cluster, we set spark.speculation=true, but when a task throw exception
at
[
https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16709:
--
Affects Version/s: 1.6.0
> Task with commit failed will retry infinite when speculation set to true
>
Hong Shen created SPARK-16709:
-
Summary: Task with commit failed will retry infinite when
speculation set to true
Key: SPARK-16709
URL: https://issues.apache.org/jira/browse/SPARK-16709
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-16708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16708:
--
Description:
When a task fetch failed, the stage will complete and retry, when the stage
complete,
[
https://issues.apache.org/jira/browse/SPARK-16708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16708:
--
Description:
When a task fetch failed, the stage will complete and retry, when the stage
complete,
[
https://issues.apache.org/jira/browse/SPARK-16708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16708:
--
Affects Version/s: 1.6.0
> ExecutorAllocationManager.numRunningTasks can be negative when stage retry
Hong Shen created SPARK-16708:
-
Summary: ExecutorAllocationManager.numRunningTasks can be negative
when stage retry
Key: SPARK-16708
URL: https://issues.apache.org/jira/browse/SPARK-16708
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-16707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391596#comment-15391596
]
Hong Shen commented on SPARK-16707:
---
There is a same error here:
[
https://issues.apache.org/jira/browse/SPARK-16707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16707:
--
Description:
I have encounter some NullPointerException when
TransportClientFactory.createClient in
[
https://issues.apache.org/jira/browse/SPARK-16707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16707:
--
Description:
I have encounter some NullPointerException when
TransportClientFactory.createClient in
[
https://issues.apache.org/jira/browse/SPARK-16707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16707:
--
Description:
I have encounter some NullPointerException when
TransportClientFactory.createClient in
[
https://issues.apache.org/jira/browse/SPARK-16707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16707:
--
Affects Version/s: 1.6.0
> TransportClientFactory.createClient may throw NPE
>
[
https://issues.apache.org/jira/browse/SPARK-16707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-16707:
--
Description:
org.apache.spark.shuffle.FetchFailedException
at
Hong Shen created SPARK-16707:
-
Summary: TransportClientFactory.createClient may throw NPE
Key: SPARK-16707
URL: https://issues.apache.org/jira/browse/SPARK-16707
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-13510:
--
Attachment: spark-13510.diff
Add FetchStream for shuffle, if the fetch file is bigger than
[
https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15173675#comment-15173675
]
Hong Shen commented on SPARK-13510:
---
I have resolve in our own edition, I will add a pull request this
[
https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-13510:
--
Description:
In our cluster, when I test spark-1.6.0 with a sql, it throw exception and
failed.
[
https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-13510:
--
Description:
In our cluster, when I test spark-1.6.0 with a sql, it throw exception and
failed.
[
https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15173658#comment-15173658
]
Hong Shen commented on SPARK-13510:
---
We can't resolve all the shuffle OOM by allocate more memory, If
[
https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15173648#comment-15173648
]
Hong Shen commented on SPARK-13510:
---
In our cluster, we have lot of sql run on hive, I want to use
[
https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen reopened SPARK-13510:
---
> Shuffle may throw FetchFailedException: Direct buffer memory
>
[
https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171330#comment-15171330
]
Hong Shen commented on SPARK-13510:
---
Add more log, fetch a block of 915.4 MB.
16/02/17 15:36:03 INFO
[
https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-13510:
--
Description:
In our cluster, when I test spark-1.6.0 with a sql, it throw exception and
failed.
[
https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168693#comment-15168693
]
Hong Shen commented on SPARK-13510:
---
I will add the logic in my edition.
> Shuffle may throw
[
https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-13510:
--
Description:
In our cluster, when I test spark-1.6.0 with a sql, it throw exception and
failed.
Hong Shen created SPARK-13510:
-
Summary: Shuffle may throw FetchFailedException: Direct buffer
memory
Key: SPARK-13510
URL: https://issues.apache.org/jira/browse/SPARK-13510
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-13510:
--
Description:
In our cluster, when I test spark-1.6.0 with a sql, it throw exception and
failed.
[
https://issues.apache.org/jira/browse/SPARK-13450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15162858#comment-15162858
]
Hong Shen commented on SPARK-13450:
---
Thanks, I will add in my own branch first.
> SortMergeJoin will
[
https://issues.apache.org/jira/browse/SPARK-13450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15160271#comment-15160271
]
Hong Shen commented on SPARK-13450:
---
A join has a lot of rows with the same key.
> SortMergeJoin will
[
https://issues.apache.org/jira/browse/SPARK-13450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158566#comment-15158566
]
Hong Shen commented on SPARK-13450:
---
I think we should add a ExternalAppendOnlyArrayBuffer to replace
[
https://issues.apache.org/jira/browse/SPARK-13450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-13450:
--
Description:
When I run a sql with join, task throw java.lang.OutOfMemoryError and sql
failed. I
Hong Shen created SPARK-13450:
-
Summary: SortMergeJoin will OOM when join rows have lot of same
keys
Key: SPARK-13450
URL: https://issues.apache.org/jira/browse/SPARK-13450
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-7271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960363#comment-14960363
]
Hong Shen commented on SPARK-7271:
--
Hi, I have a question, are you plan to rededign the shuffle reader to
Hong Shen created SPARK-10918:
-
Summary: Task failed because executor kill by driver
Key: SPARK-10918
URL: https://issues.apache.org/jira/browse/SPARK-10918
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-8403:
-
Description:
When partition field and fieldSchema exist in sql predicates, pruner partition
won't
[
https://issues.apache.org/jira/browse/SPARK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-8403:
-
Description:
When partition field and fieldSchema exist in sql predicates, pruner partition
won't
[
https://issues.apache.org/jira/browse/SPARK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-8403:
-
Summary: Pruner partition won't effective when partition field and
fieldSchema exist in sql predicate
[
https://issues.apache.org/jira/browse/SPARK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-8403:
-
Summary: Pruner partition won't effective when partition field and
fieldSchema exit in sql predicate
Hong Shen created SPARK-8403:
Summary: Pruner partition won't effective when udf exit in sql
predicates
Key: SPARK-8403
URL: https://issues.apache.org/jira/browse/SPARK-8403
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-8403:
-
Description:
When udf exit in sql predicates, pruner partition won't effective.
Here is the sql,
{code}
[
https://issues.apache.org/jira/browse/SPARK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-8403:
-
Description:
When udf exit in sql predicates, pruner partition won't effective.
Here is the sql,
{code}
[
https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512244#comment-14512244
]
Hong Shen commented on SPARK-5529:
--
1.4.0 version would be release in june.
[
https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-6738:
-
Description:
ExternalAppendOnlyMap spill 2.2 GB data to disk:
{code}
15/04/07 20:27:37 INFO
[
https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen reopened SPARK-6738:
--
There is a in SizeEstimator
EstimateSize is difference with spill file size
[
https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-6738:
-
Description:
ExternalAppendOnlyMap spill 2.2 GB data to disk:
{code}
15/04/07 20:27:37 INFO
[
https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504202#comment-14504202
]
Hong Shen edited comment on SPARK-6738 at 4/21/15 2:54 AM:
---
Hong Shen created SPARK-6738:
Summary: EstimateSize is difference with spill file size
Key: SPARK-6738
URL: https://issues.apache.org/jira/browse/SPARK-6738
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-6738:
-
Description:
ExternalAppendOnlyMap spill 1100M data to disk:
{code}
15/04/07 16:39:48 INFO
[
https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483011#comment-14483011
]
Hong Shen commented on SPARK-6738:
--
Yes, it spill lots of files, but each one has only
[
https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-6738:
-
Description:
ExternalAppendOnlyMap spill 1100M data to disk:
{code}
15/04/07 16:39:48 INFO
[
https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-6738:
-
Description:
ExternalAppendOnlyMap spill 1100M data to disk:
{code}
15/04/07 16:39:48 INFO
[
https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-6738:
-
Description:
ExternalAppendOnlyMap spill 2.2 GB data to disk:
{code}
15/04/07 20:27:37 INFO
[
https://issues.apache.org/jira/browse/SPARK-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483104#comment-14483104
]
Hong Shen commented on SPARK-6738:
--
I don't think it's serialized cause the problem. the
[
https://issues.apache.org/jira/browse/SPARK-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14350323#comment-14350323
]
Hong Shen commented on SPARK-6104:
--
[~rxin]
Can you link to the duplicate issue?
spark
[
https://issues.apache.org/jira/browse/SPARK-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-6104:
-
Affects Version/s: 1.2.0
spark sql shuffle OOM
-
Key: SPARK-6104
[
https://issues.apache.org/jira/browse/SPARK-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-6104:
-
Description:
Currently, spark shuffle can use ExternalAppendOnlyMap to combine data that
have fetched,
[
https://issues.apache.org/jira/browse/SPARK-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-6104:
-
Description:
Currently, spark shuffle can use ExternalAppendOnlyMap to combine data that
have fetched,
[
https://issues.apache.org/jira/browse/SPARK-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-6104:
-
Summary: spark SQL shuffle OOM (was: spark sql shuffle OOM)
spark SQL shuffle OOM
[
https://issues.apache.org/jira/browse/SPARK-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342863#comment-14342863
]
Hong Shen commented on SPARK-6104:
--
[~rxin] [~sandyryza], can you pay attention to this
[
https://issues.apache.org/jira/browse/SPARK-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-6104:
-
Description:
Currently, spark shuffle can use ExternalAppendOnlyMap to combine data that
have fetched,
[
https://issues.apache.org/jira/browse/SPARK-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342872#comment-14342872
]
Hong Shen commented on SPARK-6104:
--
Can you link to the Duplicate issue?
spark SQL
[
https://issues.apache.org/jira/browse/SPARK-6104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342872#comment-14342872
]
Hong Shen edited comment on SPARK-6104 at 3/2/15 7:25 AM:
--
Can
Hong Shen created SPARK-6104:
Summary: spark sql shuffle OOM
Key: SPARK-6104
URL: https://issues.apache.org/jira/browse/SPARK-6104
Project: Spark
Issue Type: Improvement
Reporter:
Hong Shen created SPARK-5736:
Summary: Add executor log url
Key: SPARK-5736
URL: https://issues.apache.org/jira/browse/SPARK-5736
Project: Spark
Issue Type: Bug
Reporter: Hong Shen
[
https://issues.apache.org/jira/browse/SPARK-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-5736:
-
Summary: Add executor log url to Executors page on Yarn (was: Add executor
log url to Executors page)
[
https://issues.apache.org/jira/browse/SPARK-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-5736:
-
Component/s: Web UI
Add executor log url to Executors page
--
[
https://issues.apache.org/jira/browse/SPARK-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-5736:
-
Affects Version/s: 1.2.0
Add executor log url to Executors page
--
[
https://issues.apache.org/jira/browse/SPARK-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-5736:
-
Summary: Add executor log url to Executors page (was: Add executor log url)
Add executor log url to
[
https://issues.apache.org/jira/browse/SPARK-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-5736:
-
Issue Type: Improvement (was: Bug)
Add executor log url to Executors page
[
https://issues.apache.org/jira/browse/SPARK-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-5736:
-
Description: Currently, there is not executor log url in spark ui (on
Yarn), we have to read executor
[
https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304819#comment-14304819
]
Hong Shen commented on SPARK-5529:
--
I had changed it in our own branch.
Executor is
[
https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated SPARK-5529:
-
Attachment: SPARK-5529.patch
Executor is still hold while BlockManager has been removed
[
https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304433#comment-14304433
]
Hong Shen commented on SPARK-5529:
--
Executor will lost when a akka throw a
1 - 100 of 133 matches
Mail list logo
