[
https://issues.apache.org/jira/browse/SPARK-20079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-20079:
Description:
The ExecutorAllocationManager.reset method is called when re-registering AM,
which
[
https://issues.apache.org/jira/browse/SPARK-20079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949164#comment-15949164
]
Guoqiang Li commented on SPARK-20079:
-
I met the problem when doing reliability test. After the
Guoqiang Li created SPARK-20079:
---
Summary: Re registration of AM hangs spark cluster in yarn-client
mode
Key: SPARK-20079
URL: https://issues.apache.org/jira/browse/SPARK-20079
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-18890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931115#comment-15931115
]
Guoqiang Li commented on SPARK-18890:
-
[~kayousterhout] done.
> Do all task serialization in
Guoqiang Li created SPARK-19991:
---
Summary: FileSegmentManagedBuffer performance improvement.
Key: SPARK-19991
URL: https://issues.apache.org/jira/browse/SPARK-19991
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-19991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-19991:
Description:
When we do not set the value of the configuration items
[
https://issues.apache.org/jira/browse/SPARK-18890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809212#comment-15809212
]
Guoqiang Li commented on SPARK-18890:
-
OK, I see.
In fact, the most difficult to deal with the
[
https://issues.apache.org/jira/browse/SPARK-18890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753833#comment-15753833
]
Guoqiang Li commented on SPARK-18890:
-
[~kayousterhout]
I ran a test having 10 million tasks, and did
[
https://issues.apache.org/jira/browse/SPARK-18383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-18383:
Affects Version/s: 1.6.2
2.0.1
> Utils.isBindCollision does not properly
[
https://issues.apache.org/jira/browse/SPARK-18383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-18383:
Component/s: Spark Core
> Utils.isBindCollision does not properly handle all possible address-port
Guoqiang Li created SPARK-18383:
---
Summary: Utils.isBindCollision does not properly handle all
possible address-port collisions when binding
Key: SPARK-18383
URL: https://issues.apache.org/jira/browse/SPARK-18383
[
https://issues.apache.org/jira/browse/SPARK-18375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-18375:
Issue Type: Improvement (was: Bug)
> Upgrade netty to 4.0.42.Final
>
[
https://issues.apache.org/jira/browse/SPARK-18375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-18375:
Summary: Upgrade netty to 4.0.42.Final (was: Upgrade netty to 4.0.42)
> Upgrade netty to
[
https://issues.apache.org/jira/browse/SPARK-18375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-18375:
Summary: Upgrade netty to 4.0.42 (was: Upgrade netty to 4.042)
> Upgrade netty to 4.0.42
>
[
https://issues.apache.org/jira/browse/SPARK-18375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-18375:
Description:
One of the important changes for 4.0.42.Final is "Support any FileRegion
[
https://issues.apache.org/jira/browse/SPARK-18375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-18375:
Affects Version/s: 1.6.2
> Upgrade netty to 4.042
> --
>
>
Guoqiang Li created SPARK-18375:
---
Summary: Upgrade netty to 4.042
Key: SPARK-18375
URL: https://issues.apache.org/jira/browse/SPARK-18375
Project: Spark
Issue Type: Bug
Components:
[
https://issues.apache.org/jira/browse/SPARK-17930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581119#comment-15581119
]
Guoqiang Li commented on SPARK-17930:
-
TPC-DS 2T data (Parquet) and the SQL(query 2) =>
{noformat}
[
https://issues.apache.org/jira/browse/SPARK-17930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577506#comment-15577506
]
Guoqiang Li commented on SPARK-17930:
-
If a stage contains a lot of tasks, eg one million tasks, the
Guoqiang Li created SPARK-17931:
---
Summary: taskScheduler has some unneeded serialization
Key: SPARK-17931
URL: https://issues.apache.org/jira/browse/SPARK-17931
Project: Spark
Issue Type:
Guoqiang Li created SPARK-17930:
---
Summary: The SerializerInstance instance used when deserializing a
TaskResult is not reused
Key: SPARK-17930
URL: https://issues.apache.org/jira/browse/SPARK-17930
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515042#comment-15515042
]
Guoqiang Li commented on SPARK-6235:
ping [~rxin]
> Address various 2G limits
>
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508670#comment-15508670
]
Guoqiang Li commented on SPARK-6235:
[~rxin] Any comments?
> Address various 2G limits
>
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-6235:
---
Attachment: (was: SPARK-6235_Design_V0.01.pdf)
> Address various 2G limits
>
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-6235:
---
Attachment: SPARK-6235_Design_V0.02.pdf
> Address various 2G limits
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-6235:
---
Attachment: SPARK-6235_Design_V0.01.pdf
Preliminary Design Document.
> Address various 2G limits
>
[
https://issues.apache.org/jira/browse/SPARK-17082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432284#comment-15432284
]
Guoqiang Li commented on SPARK-17082:
-
OK
> Replace ByteBuffer with ChunkedByteBuffer
>
[
https://issues.apache.org/jira/browse/SPARK-17184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432279#comment-15432279
]
Guoqiang Li commented on SPARK-17184:
-
ok
> Replace ByteBuf with InputStream
>
[
https://issues.apache.org/jira/browse/SPARK-17184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431903#comment-15431903
]
Guoqiang Li commented on SPARK-17184:
-
OK, I'll post the detailed design document later.
> Replace
Guoqiang Li created SPARK-17184:
---
Summary: Replace ByteBuf with InputStream
Key: SPARK-17184
URL: https://issues.apache.org/jira/browse/SPARK-17184
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-17082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-17082:
Description: The size of ByteBuffers can not be greater than 2G, should be
replaced by
[
https://issues.apache.org/jira/browse/SPARK-17082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-17082:
Description: The size of ByteBuffers can not be greater than 2G, should be
replaced by Java (was:
[
https://issues.apache.org/jira/browse/SPARK-17082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-17082:
Issue Type: Sub-task (was: New Feature)
Parent: SPARK-6235
> Replace ByteBuffer with
Guoqiang Li created SPARK-17082:
---
Summary: Replace ByteBuffer with ChunkedByteBuffer
Key: SPARK-17082
URL: https://issues.apache.org/jira/browse/SPARK-17082
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421048#comment-15421048
]
Guoqiang Li commented on SPARK-6235:
Yes, it contains a lot of minor changes, eg: Replace ByteBuffer
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420554#comment-15420554
]
Guoqiang Li edited comment on SPARK-6235 at 8/15/16 1:53 AM:
-
[~hvanhovell]
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420554#comment-15420554
]
Guoqiang Li commented on SPARK-6235:
[~hvanhovell]
The main changes.
1. Replace DiskStore method
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15418225#comment-15418225
]
Guoqiang Li commented on SPARK-6235:
I'm doing this work and I'll put the patch in this month.
>
[
https://issues.apache.org/jira/browse/SPARK-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-14178:
Summary: DAGScheduler should get map output statuses directly, not by
Guoqiang Li created SPARK-14178:
---
Summary: Compare Option[String] and String directly
Key: SPARK-14178
URL: https://issues.apache.org/jira/browse/SPARK-14178
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152424#comment-15152424
]
Guoqiang Li commented on SPARK-13371:
-
[~srowen] Of course not.
>
[
https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-13371:
Comment: was deleted
(was: [~srowen] Of course not.)
> TaskSetManager.dequeueSpeculativeTask
[
https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152425#comment-15152425
]
Guoqiang Li commented on SPARK-13371:
-
[~srowen] Of course not.
>
[
https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-13371:
Summary: TaskSetManager.dequeueSpeculativeTask compares Option[String] and
String directly. (was:
[
https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-13371:
Summary: Compare Option[String] and String directly in (was: Compare
Option[String] and String
[
https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-13371:
Description:
{noformat}
TaskSetManager.dequeueSpeculativeTask compares Option[String] and String
Guoqiang Li created SPARK-13371:
---
Summary: Compare Option[String] and String directly
Key: SPARK-13371
URL: https://issues.apache.org/jira/browse/SPARK-13371
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984912#comment-14984912
]
Guoqiang Li commented on SPARK-5575:
Hi [~bing],
It is under development, and temporarily is private.
[
https://issues.apache.org/jira/browse/SPARK-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984809#comment-14984809
]
Guoqiang Li edited comment on SPARK-5575 at 11/2/15 6:59 AM:
-
Hi All,
There is
[
https://issues.apache.org/jira/browse/SPARK-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984809#comment-14984809
]
Guoqiang Li commented on SPARK-5575:
Hi All,
There is a MLP implementation with the Parameter Server
Guoqiang Li created SPARK-10350:
---
Summary: Fix SQL Programming Guide
Key: SPARK-10350
URL: https://issues.apache.org/jira/browse/SPARK-10350
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-10350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-10350:
Description:
[
https://issues.apache.org/jira/browse/SPARK-10350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-10350:
Description:
[
https://issues.apache.org/jira/browse/SPARK-10350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-10350:
Description:
[
https://issues.apache.org/jira/browse/SPARK-8276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582185#comment-14582185
]
Guoqiang Li commented on SPARK-8276:
Can you give more error log of this issue ?
NPE
[
https://issues.apache.org/jira/browse/SPARK-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-8273:
---
Affects Version/s: 1.4.0
1.3.1
Driver hangs up when yarn shutdown in client
[
https://issues.apache.org/jira/browse/SPARK-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-8273:
---
Component/s: YARN
Driver hangs up when yarn shutdown in client mode
[
https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-7934:
---
Description:
The conf/spark-defaults.conf
{noformat}
spark.executor.extraJavaOptions -XX:+UseG1GC
[
https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-7934:
---
Description:
The conf/spark-defaults.conf
{noformat}
spark.executor.extraJavaOptions -XX:+UseG1GC
[
https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564386#comment-14564386
]
Guoqiang Li commented on SPARK-7934:
OK, the information is a little less, but I can
[
https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-7934:
---
Description:
The conf/spark-defaults.conf
{noformat}
spark.executor.extraJavaOptions -XX:+UseG1GC
[
https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564409#comment-14564409
]
Guoqiang Li commented on SPARK-7934:
cc [~srowen]
In some cases, Spark hangs in
[
https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li reopened SPARK-7934:
In some cases, Spark hangs in yarn-client mode.
---
[
https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564562#comment-14564562
]
Guoqiang Li commented on SPARK-7934:
[~srowen] I want to say that some reasons cause
Guoqiang Li created SPARK-7934:
--
Summary: In some cases, Spark hangs in yarn-client mode.
Key: SPARK-7934
URL: https://issues.apache.org/jira/browse/SPARK-7934
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14530029#comment-14530029
]
Guoqiang Li commented on SPARK-5556:
[
https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li reopened SPARK-7008:
This jira should not be closed..
An implementation of Factorization Machine (LibFM)
[
https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518602#comment-14518602
]
Guoqiang Li commented on SPARK-5556:
I put the latest LDA code in
[
https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-5556:
---
Attachment: LDA_test.xlsx
Latent Dirichlet Allocation (LDA) using Gibbs sampler
[
https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-5556:
---
Attachment: spark-summit.pptx
Latent Dirichlet Allocation (LDA) using Gibbs sampler
[
https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518618#comment-14518618
]
Guoqiang Li commented on SPARK-5556:
LDA_Gibbs combines the advantages of AliasLDA,
[
https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518621#comment-14518621
]
Guoqiang Li commented on SPARK-5556:
[
https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-7162:
---
Description:
{code:none}
HADOOP_CONF_DIR=/usr/local/CDH5/hadoop-2.3.0-cdh5.0.1/etc/hadoop/
[
https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-7162:
---
Description:
{code:none}
HADOOP_CONF_DIR=/usr/local/CDH5/hadoop-2.3.0-cdh5.0.1/etc/hadoop/
[
https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513856#comment-14513856
]
Guoqiang Li commented on SPARK-7008:
[~mengxr] what's your view for [~podongfeng]
[
https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-7162:
---
Summary: Launcher error in yarn-client (was: spark-shell launcher error
in yarn-client)
Launcher
[
https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-7162:
---
Description:
{code:none}
HADOOP_CONF_DIR=/usr/local/CDH5/hadoop-2.3.0-cdh5.0.1/etc/hadoop/
Guoqiang Li created SPARK-7162:
--
Summary: spark-shell launcher failure in yarn-client
Key: SPARK-7162
URL: https://issues.apache.org/jira/browse/SPARK-7162
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-7162:
---
Summary: spark-shell launcher error in yarn-client (was: spark-shell
launcher failure in
[
https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512238#comment-14512238
]
Guoqiang Li commented on SPARK-7008:
In practice, relative to the {{LBFGS}} ,{{SGD
[
https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504435#comment-14504435
]
Guoqiang Li edited comment on SPARK-7008 at 4/25/15 4:16 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-7008:
---
Attachment: FM_convergence_rate.xlsx
QQ20150421-1.png
QQ20150421-2.png
[
https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502616#comment-14502616
]
Guoqiang Li edited comment on SPARK-7008 at 4/20/15 10:34 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502332#comment-14502332
]
Guoqiang Li commented on SPARK-6932:
I have three questions:
1. {code:none} def
[
https://issues.apache.org/jira/browse/SPARK-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498189#comment-14498189
]
Guoqiang Li commented on SPARK-3937:
[~joshrosen]
This bug occurs every time. I'm not
[
https://issues.apache.org/jira/browse/SPARK-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14491861#comment-14491861
]
Guoqiang Li commented on SPARK-6849:
[~srowen]
https://github.com/cloudml/zen
The
[
https://issues.apache.org/jira/browse/SPARK-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14491857#comment-14491857
]
Guoqiang Li commented on SPARK-3937:
Get data:
{code:none}wget
[
https://issues.apache.org/jira/browse/SPARK-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14490642#comment-14490642
]
Guoqiang Li commented on SPARK-6849:
[~srowen] This should be a bug. The
[
https://issues.apache.org/jira/browse/SPARK-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14486810#comment-14486810
]
Guoqiang Li commented on SPARK-3937:
The bug seems to be caused by
[
https://issues.apache.org/jira/browse/SPARK-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14486763#comment-14486763
]
Guoqiang Li commented on SPARK-3937:
I have encountered this issues in spark 1.3 .
[
https://issues.apache.org/jira/browse/SPARK-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-5261:
---
Description:
Get data:
{code:none}
normalize_text() {
awk '{print tolower($0);}' | sed -e s/’/'/g
[
https://issues.apache.org/jira/browse/SPARK-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-5261:
---
Description:
Get data:
{code:none}
normalize_text() {
awk '{print tolower($0);}' | sed -e s/’/'/g
[
https://issues.apache.org/jira/browse/SPARK-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14481378#comment-14481378
]
Guoqiang Li commented on SPARK-5261:
I'm sorry, the after one 's mincount is 100
[
https://issues.apache.org/jira/browse/SPARK-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-5261:
---
Description:
Get data:
{code:none}
normalize_text() {
awk '{print tolower($0);}' | sed -e s/’/'/g
[
https://issues.apache.org/jira/browse/SPARK-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-5261:
---
Description:
Get data:
{code:none}
normalize_text() {
awk '{print tolower($0);}' | sed -e s/’/'/g
[
https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395613#comment-14395613
]
Guoqiang Li commented on SPARK-3625:
Sometimes, when calling the RDD.checkpoint ,
[
https://issues.apache.org/jira/browse/SPARK-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li reopened SPARK-5261:
[~srowen] SPARK-5261 andSPARK-4846 are not the same problem. This is a
algorithm error. The
Guoqiang Li created SPARK-6697:
--
Summary: PeriodicGraphCheckpointer is not clear Edges.
Key: SPARK-6697
URL: https://issues.apache.org/jira/browse/SPARK-6697
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395492#comment-14395492
]
Guoqiang Li commented on SPARK-3625:
When we run the machine learning and graph
[
https://issues.apache.org/jira/browse/SPARK-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-6697:
---
Attachment: QQ20150403-1.png
Web UI Screenshot
PeriodicGraphCheckpointer is not clear Edges.
1 - 100 of 439 matches
Mail list logo