[jira] [Updated] (SPARK-6697) PeriodicGraphCheckpointer is not clear Edges.

2015-04-03 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-6697: --- Description: When I run this [branch(lrGraphxSGD)| https://github.com/witgo/spark/tree/lrGraphxSGD]

[jira] [Updated] (SPARK-6697) PeriodicGraphCheckpointer is not clear edges.

2015-04-03 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-6697: --- Summary: PeriodicGraphCheckpointer is not clear edges. (was: PeriodicGraphCheckpointer is not clear

[jira] [Updated] (SPARK-6610) mlllib explicit ALS checkpoint does not work

2015-03-30 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-6610: --- Target Version/s: 1.3.1 (was: 1.3.0) Fix Version/s: (was: 1.3.0) mlllib explicit ALS

[jira] [Commented] (SPARK-6609) explicit checkpoint does not work

2015-03-30 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386781#comment-14386781 ] Guoqiang Li commented on SPARK-6609: We should merge [the PR

[jira] [Comment Edited] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-02-27 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339847#comment-14339847 ] Guoqiang Li edited comment on SPARK-5556 at 2/27/15 9:47 AM: -

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-02-26 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339847#comment-14339847 ] Guoqiang Li commented on SPARK-5556: [This

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-02-05 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308615#comment-14308615 ] Guoqiang Li commented on SPARK-5556: LightLDA's computational complexity is O(1) The

[jira] [Updated] (SPARK-5557) spark-shell failed to start

2015-02-03 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-5557: --- Component/s: Spark Core spark-shell failed to start ---

[jira] [Updated] (SPARK-5557) spark-shell failed to start

2015-02-03 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-5557: --- Affects Version/s: 1.3.0 spark-shell failed to start ---

[jira] [Created] (SPARK-5557) spark-shell failed to start

2015-02-03 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-5557: -- Summary: spark-shell failed to start Key: SPARK-5557 URL: https://issues.apache.org/jira/browse/SPARK-5557 Project: Spark Issue Type: Bug Reporter:

[jira] [Created] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-02-03 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-5556: -- Summary: Latent Dirichlet Allocation (LDA) using Gibbs sampler Key: SPARK-5556 URL: https://issues.apache.org/jira/browse/SPARK-5556 Project: Spark Issue Type:

[jira] [Commented] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2015-01-30 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298351#comment-14298351 ] Guoqiang Li commented on SPARK-1405: Here is a sampling faster branch(work in

[jira] [Comment Edited] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2015-01-30 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298351#comment-14298351 ] Guoqiang Li edited comment on SPARK-1405 at 1/30/15 8:33 AM: -

[jira] [Comment Edited] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2015-01-30 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298351#comment-14298351 ] Guoqiang Li edited comment on SPARK-1405 at 1/30/15 8:34 AM: -

[jira] [Created] (SPARK-5474) curl should support URL redirection in build/mvn

2015-01-28 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-5474: -- Summary: curl should support URL redirection in build/mvn Key: SPARK-5474 URL: https://issues.apache.org/jira/browse/SPARK-5474 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5261) In some cases ,The value of word's vector representation is too big

2015-01-26 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292823#comment-14292823 ] Guoqiang Li commented on SPARK-5261: [~lewuathe] {code} normalize_text() { awk

[jira] [Commented] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2015-01-15 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14278453#comment-14278453 ] Guoqiang Li commented on SPARK-1405: We can use the demo scripts in word2vec to get

[jira] [Created] (SPARK-5261) In some cases ,The value of word's vector representation is too big

2015-01-14 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-5261: -- Summary: In some cases ,The value of word's vector representation is too big Key: SPARK-5261 URL: https://issues.apache.org/jira/browse/SPARK-5261 Project: Spark

[jira] [Commented] (SPARK-5104) Distributed Representations of Sentences and Documents

2015-01-06 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267226#comment-14267226 ] Guoqiang Li commented on SPARK-5104: Dimension reduction in text classification. It

[jira] [Created] (SPARK-5104) Distributed Representations of Sentences and Documents

2015-01-06 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-5104: -- Summary: Distributed Representations of Sentences and Documents Key: SPARK-5104 URL: https://issues.apache.org/jira/browse/SPARK-5104 Project: Spark Issue Type:

[jira] [Created] (SPARK-4952) In some cases, spark on yarn failed to start

2014-12-23 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-4952: -- Summary: In some cases, spark on yarn failed to start Key: SPARK-4952 URL: https://issues.apache.org/jira/browse/SPARK-4952 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-4902) gap-sampling performance optimization

2014-12-19 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-4902: -- Summary: gap-sampling performance optimization Key: SPARK-4902 URL: https://issues.apache.org/jira/browse/SPARK-4902 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-4844) SGD should support custom sampling.

2014-12-19 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li resolved SPARK-4844. Resolution: Won't Fix See: SPARK-4902 SGD should support custom sampling.

[jira] [Updated] (SPARK-4902) gap-sampling performance optimization

2014-12-19 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4902: --- Description: {{CacheManager.getOrCompute}} returns an instance of InterruptibleIterator that

[jira] [Commented] (SPARK-4844) SGD should support custom sampling.

2014-12-15 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246738#comment-14246738 ] Guoqiang Li commented on SPARK-4844: The main reason is that {{RDD.sample}} is not

[jira] [Commented] (SPARK-4844) SGD should support custom sampling.

2014-12-15 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247652#comment-14247652 ] Guoqiang Li commented on SPARK-4844: Sorry, I mean, all of the data need to be

[jira] [Created] (SPARK-4844) SGD should support custom sampling.

2014-12-14 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-4844: -- Summary: SGD should support custom sampling. Key: SPARK-4844 URL: https://issues.apache.org/jira/browse/SPARK-4844 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-3625) In some cases, the RDD.checkpoint does not work

2014-12-05 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li resolved SPARK-3625. Resolution: Won't Fix In some cases, the RDD.checkpoint does not work

[jira] [Commented] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2014-11-22 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222033#comment-14222033 ] Guoqiang Li commented on SPARK-1405: OK, Where is the download URL? parallel Latent

[jira] [Commented] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2014-11-22 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222048#comment-14222048 ] Guoqiang Li commented on SPARK-1405: Sorry, I mean the wikipedia data download URL.

[jira] [Commented] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2014-11-21 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221768#comment-14221768 ] Guoqiang Li commented on SPARK-1405: [~debasish83] Yes, we should use the same dataset

[jira] [Created] (SPARK-4530) GradientDescent get a wrong gradient value according to the gradient formula, which is caused by the miniBatchSize parameter.

2014-11-20 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-4530: -- Summary: GradientDescent get a wrong gradient value according to the gradient formula, which is caused by the miniBatchSize parameter. Key: SPARK-4530 URL:

[jira] [Updated] (SPARK-4530) GradientDescent get a wrong gradient value according to the gradient formula, which is caused by the miniBatchSize parameter.

2014-11-20 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4530: --- Priority: Blocker (was: Major) GradientDescent get a wrong gradient value according to the gradient

[jira] [Commented] (SPARK-3445) Deprecate and later remove YARN alpha support

2014-11-14 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14213300#comment-14213300 ] Guoqiang Li commented on SPARK-3445: I think there are a lot of people are using

[jira] [Created] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

2014-11-14 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-4422: -- Summary: In some cases, Vectors.fromBreeze get wrong results. Key: SPARK-4422 URL: https://issues.apache.org/jira/browse/SPARK-4422 Project: Spark Issue Type:

[jira] [Created] (SPARK-4288) Add Sparse Autoencoder algorithm to MLlib

2014-11-06 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-4288: -- Summary: Add Sparse Autoencoder algorithm to MLlib Key: SPARK-4288 URL: https://issues.apache.org/jira/browse/SPARK-4288 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-4251) Add Restricted Boltzmann machine(RBM) algorithm to MLlib

2014-11-05 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-4251: -- Summary: Add Restricted Boltzmann machine(RBM) algorithm to MLlib Key: SPARK-4251 URL: https://issues.apache.org/jira/browse/SPARK-4251 Project: Spark Issue

[jira] [Resolved] (SPARK-4164) spark.kryo.registrator shall use comma separated value to support multiple registrator

2014-11-01 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li resolved SPARK-4164. Resolution: Fixed Fix Version/s: 1.2.0 Target Version/s: 1.2.0

[jira] [Resolved] (SPARK-4165) Actor with Companion throws ambiguous reference error in REPL

2014-11-01 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li resolved SPARK-4165. Resolution: Duplicate Actor with Companion throws ambiguous reference error in REPL

[jira] [Updated] (SPARK-4161) Spark shell class path is not correctly set if spark.driver.extraClassPath is set in defaults.conf

2014-11-01 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4161: --- Affects Version/s: 1.2.0 Spark shell class path is not correctly set if spark.driver.extraClassPath

[jira] [Updated] (SPARK-4161) Spark shell class path is not correctly set if spark.driver.extraClassPath is set in defaults.conf

2014-11-01 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4161: --- Target Version/s: 1.1.1, 1.2.0 Spark shell class path is not correctly set if

[jira] [Resolved] (SPARK-1720) use LD_LIBRARY_PATH instead of -Djava.library.path

2014-10-30 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li resolved SPARK-1720. Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2711

[jira] [Resolved] (SPARK-1719) spark.executor.extraLibraryPath isn't applied on yarn

2014-10-30 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li resolved SPARK-1719. Resolution: Fixed Target Version/s: 1.2.0 Issue resolved by pull request 2711

[jira] [Created] (SPARK-4064) In the case of creating A lot of uge broadcast variable,spark hangs.

2014-10-23 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-4064: -- Summary: In the case of creating A lot of uge broadcast variable,spark hangs. Key: SPARK-4064 URL: https://issues.apache.org/jira/browse/SPARK-4064 Project: Spark

[jira] [Updated] (SPARK-4064) In the case of creating A lot of uge broadcast variable,spark hangs.

2014-10-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4064: --- Attachment: executor.log In the case of creating A lot of uge broadcast variable,spark hangs.

[jira] [Updated] (SPARK-4064) In the case of creating A lot of uge broadcast variable,spark hangs.

2014-10-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4064: --- Attachment: screenshot.png In the case of creating A lot of uge broadcast variable,spark hangs.

[jira] [Updated] (SPARK-4064) In the case of creating A lot of uge broadcast variable,spark hangs.

2014-10-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4064: --- Fix Version/s: 1.2.0 In the case of creating A lot of uge broadcast variable,spark hangs.

[jira] [Updated] (SPARK-4064) In the case of creating A lot of huge broadcast variable,spark hangs.

2014-10-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4064: --- Summary: In the case of creating A lot of huge broadcast variable,spark hangs. (was: In the case of

[jira] [Updated] (SPARK-4064) In the case of creating a lot of huge broadcast variable,spark hangs.

2014-10-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4064: --- Summary: In the case of creating a lot of huge broadcast variable,spark hangs. (was: In the case of

[jira] [Updated] (SPARK-4064) In the case of creating a lot of huge broadcast variable,spark hangs.

2014-10-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4064: --- Attachment: jstack.txt In the case of creating a lot of huge broadcast variable,spark hangs.

[jira] [Updated] (SPARK-4064) If we create too many broadcast variables, the spark has great possibility to hang

2014-10-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4064: --- Summary: If we create too many broadcast variables, the spark has great possibility to hang (was: In

[jira] [Updated] (SPARK-4064) If we create too many big broadcast variables, the spark has great possibility to hang

2014-10-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4064: --- Summary: If we create too many big broadcast variables, the spark has great possibility to hang

[jira] [Updated] (SPARK-4064) If we create a lot of big broadcast variables, Spark has great possibility to hang

2014-10-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4064: --- Summary: If we create a lot of big broadcast variables, Spark has great possibility to hang (was:

[jira] [Updated] (SPARK-4064) If we create a lot of big broadcast variables, Spark has great possibility to hang

2014-10-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4064: --- Priority: Critical (was: Major) If we create a lot of big broadcast variables, Spark has great

[jira] [Updated] (SPARK-4064) If we create a lot of big broadcast variables, Spark has great possibility to hang

2014-10-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4064: --- Affects Version/s: 1.2.0 If we create a lot of big broadcast variables, Spark has great possibility

[jira] [Comment Edited] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2014-10-22 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157605#comment-14157605 ] Guoqiang Li edited comment on SPARK-1405 at 10/22/14 3:28 PM: --

[jira] [Comment Edited] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2014-10-22 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157605#comment-14157605 ] Guoqiang Li edited comment on SPARK-1405 at 10/22/14 3:30 PM: --

[jira] [Comment Edited] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2014-10-22 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157605#comment-14157605 ] Guoqiang Li edited comment on SPARK-1405 at 10/22/14 3:57 PM: --

[jira] [Created] (SPARK-4036) Conditional Random Fields (CRF) atop of spark in MLlib

2014-10-21 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-4036: -- Summary: Conditional Random Fields (CRF) atop of spark in MLlib Key: SPARK-4036 URL: https://issues.apache.org/jira/browse/SPARK-4036 Project: Spark Issue Type:

[jira] [Updated] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2014-10-21 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4036: --- Summary: Add Conditional Random Fields (CRF) algorithm to Spark MLlib (was: Conditional Random

[jira] [Updated] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2014-10-21 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4036: --- Description: Conditional random fields (CRFs) are a class of statistical modelling method often

[jira] [Created] (SPARK-4010) spark UI returns 500 in yarn-client mode

2014-10-20 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-4010: -- Summary: spark UI returns 500 in yarn-client mode Key: SPARK-4010 URL: https://issues.apache.org/jira/browse/SPARK-4010 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4010) spark UI returns 500 in yarn-client mode

2014-10-20 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4010: --- Component/s: Web UI spark UI returns 500 in yarn-client mode

[jira] [Updated] (SPARK-4010) Spark UI returns 500 in yarn-client mode

2014-10-20 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4010: --- Summary: Spark UI returns 500 in yarn-client mode (was: spark UI returns 500 in yarn-client mode )

[jira] [Updated] (SPARK-3997) scalastyle should output the error location

2014-10-19 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3997: --- Summary: scalastyle should output the error location (was: scalastyle does not output the error

[jira] [Updated] (SPARK-3997) scalastyle should output the error location

2014-10-19 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3997: --- Description: {{./dev/scalastyle}} = {noformat} Scalastyle checks failed at following occurrences:

[jira] [Updated] (SPARK-3997) scalastyle should output the error location

2014-10-19 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3997: --- Description: {{./dev/scalastyle}} = {noformat} Scalastyle checks failed at following occurrences:

[jira] [Updated] (SPARK-3997) scalastyle should output the error location

2014-10-19 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3997: --- Description: {{./dev/scalastyle}} = {noformat} Scalastyle checks failed at following occurrences:

[jira] [Updated] (SPARK-3997) scalastyle should output the error location

2014-10-19 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3997: --- Component/s: Build scalastyle should output the error location

[jira] [Updated] (SPARK-3997) scalastyle does not output the error location

2014-10-18 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3997: --- Description: {{./dev/scalastyle }} = {noformat} Scalastyle checks failed at following occurrences:

[jira] [Created] (SPARK-3997) scalastyle does not output the error location

2014-10-18 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-3997: -- Summary: scalastyle does not output the error location Key: SPARK-3997 URL: https://issues.apache.org/jira/browse/SPARK-3997 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3997) scalastyle does not output the error location

2014-10-18 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3997: --- Description: {{./dev/scalastyle}} = {noformat} Scalastyle checks failed at following occurrences:

[jira] [Created] (SPARK-3905) The keys for sorting the columns of Executor page ,Stage page Storage page are incorrect

2014-10-11 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-3905: -- Summary: The keys for sorting the columns of Executor page ,Stage page Storage page are incorrect Key: SPARK-3905 URL: https://issues.apache.org/jira/browse/SPARK-3905

[jira] [Updated] (SPARK-2809) update chill to version 0.5.0

2014-10-02 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-2809: --- Summary: update chill to version 0.5.0 (was: update chill to version 0.4) update chill to version

[jira] [Commented] (SPARK-2809) update chill to version 0.5.0

2014-10-02 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156440#comment-14156440 ] Guoqiang Li commented on SPARK-2809: The related work.

[jira] [Commented] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2014-10-02 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156623#comment-14156623 ] Guoqiang Li commented on SPARK-1405: Hi everyone [The PR

[jira] [Updated] (SPARK-2811) update algebird to 0.8

2014-10-02 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-2811: --- Summary: update algebird to 0.8 (was: update algebird to 0.7) update algebird to 0.8

[jira] [Updated] (SPARK-2811) update algebird to 0.8

2014-10-02 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-2811: --- Description: First algebird_2.11 0.8.1 has to be released (was: First algebird_2.11 0.7.0 has to be

[jira] [Updated] (SPARK-2811) update algebird to 0.8.1

2014-10-02 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-2811: --- Summary: update algebird to 0.8.1 (was: update algebird to 0.8) update algebird to 0.8.1

[jira] [Comment Edited] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2014-09-28 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151017#comment-14151017 ] Guoqiang Li edited comment on SPARK-1405 at 9/28/14 12:05 PM: --

[jira] [Updated] (SPARK-3625) In some cases, the RDD.checkpoint does not work

2014-09-22 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3625: --- Description: The reproduce code: {code} sc.setCheckpointDir(checkpointDir) val c =

[jira] [Updated] (SPARK-3625) In some cases, the RDD.checkpoint does not work

2014-09-22 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3625: --- Issue Type: Improvement (was: Bug) In some cases, the RDD.checkpoint does not work

[jira] [Updated] (SPARK-3625) In some cases, the RDD.checkpoint does not work

2014-09-22 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3625: --- Priority: Major (was: Blocker) In some cases, the RDD.checkpoint does not work

[jira] [Commented] (SPARK-3625) In some cases, the RDD.checkpoint does not work

2014-09-22 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143410#comment-14143410 ] Guoqiang Li commented on SPARK-3625: Ok, it has been modified to improvement This

[jira] [Updated] (SPARK-3625) In some cases, the RDD.checkpoint does not work

2014-09-22 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3625: --- Description: The reproduce code: {code} sc.setCheckpointDir(checkpointDir) val c =

[jira] [Updated] (SPARK-3625) In some cases, the RDD.checkpoint does not work

2014-09-22 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3625: --- Description: The reproduce code: {code} sc.setCheckpointDir(checkpointDir) val c =

[jira] [Created] (SPARK-3623) GraphX does not support the checkpoint operation

2014-09-21 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-3623: -- Summary: GraphX does not support the checkpoint operation Key: SPARK-3623 URL: https://issues.apache.org/jira/browse/SPARK-3623 Project: Spark Issue Type:

[jira] [Updated] (SPARK-3623) GraphX does not support the checkpoint operation

2014-09-21 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3623: --- Description: Consider the following code: {code} for (i - 0 until totalIter) { val

[jira] [Updated] (SPARK-3623) Graph should support the checkpoint operation

2014-09-21 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3623: --- Summary: Graph should support the checkpoint operation (was: GraphX does not support the checkpoint

[jira] [Created] (SPARK-3625) In some cases, the RDD.checkpoint does not work

2014-09-21 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-3625: -- Summary: In some cases, the RDD.checkpoint does not work Key: SPARK-3625 URL: https://issues.apache.org/jira/browse/SPARK-3625 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2014-09-16 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14135134#comment-14135134 ] Guoqiang Li commented on SPARK-1405: Here are some related papers: [Towards Topic

[jira] [Created] (SPARK-3517) mapPartitions is not correct clearing closure

2014-09-12 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-3517: -- Summary: mapPartitions is not correct clearing closure Key: SPARK-3517 URL: https://issues.apache.org/jira/browse/SPARK-3517 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3517) mapPartitions is not correct clearing closure

2014-09-12 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3517: --- Description: {code} for (iter - 1 to totalIter) { logInfo(Start Gibbs sampling (Iteration

[jira] [Updated] (SPARK-3517) mapPartitions is not correct clearing closure

2014-09-12 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3517: --- Description: {code} for (iter - 1 to totalIter) { logInfo(Start Gibbs sampling (Iteration

[jira] [Updated] (SPARK-3517) mapPartitions is not correct clearing up the closure

2014-09-12 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3517: --- Summary: mapPartitions is not correct clearing up the closure (was: mapPartitions is not correct

[jira] [Resolved] (SPARK-3364) Zip equal-length but unequally-partition

2014-09-10 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li resolved SPARK-3364. Resolution: Fixed Zip equal-length but unequally-partition

[jira] [Resolved] (SPARK-3345) Do correct parameters for ShuffleFileGroup

2014-09-10 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li resolved SPARK-3345. Resolution: Fixed Fix Version/s: (was: 1.1.1) Do correct parameters for

[jira] [Resolved] (SPARK-3326) can't access a static variable after init in mapper

2014-09-10 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li resolved SPARK-3326. Resolution: Not a Problem can't access a static variable after init in mapper

[jira] [Updated] (SPARK-3293) yarn's web show SUCCEEDED when the driver throw a exception in yarn-client

2014-09-07 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3293: --- Affects Version/s: 1.1.0 yarn's web show SUCCEEDED when the driver throw a exception in yarn-client

[jira] [Commented] (SPARK-2491) When an OOM is thrown,the executor does not stop properly.

2014-09-05 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122579#comment-14122579 ] Guoqiang Li commented on SPARK-2491: Executor running multiple tasks at the same

<    1   2   3   4   5   >