[jira] [Comment Edited] (SPARK-15678) Not use cache on appends and overwrites

2017-02-24 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877735#comment-15877735 ] Gen TANG edited comment on SPARK-15678 at 2/24/17 10:44 AM: Hi, All It

[jira] [Comment Edited] (SPARK-15678) Not use cache on appends and overwrites

2017-02-24 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877735#comment-15877735 ] Gen TANG edited comment on SPARK-15678 at 2/24/17 10:44 AM: Hi, All It

[jira] [Comment Edited] (SPARK-15678) Not use cache on appends and overwrites

2017-02-22 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877735#comment-15877735 ] Gen TANG edited comment on SPARK-15678 at 2/22/17 8:17 AM: --- Hi, All I seems

[jira] [Commented] (SPARK-15678) Not use cache on appends and overwrites

2017-02-22 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877735#comment-15877735 ] Gen TANG commented on SPARK-15678: -- Hi, All I seems that refreshByPath(_path_) should be called n

[jira] [Comment Edited] (SPARK-15678) Not use cache on appends and overwrites

2017-02-21 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877513#comment-15877513 ] Gen TANG edited comment on SPARK-15678 at 2/22/17 5:41 AM: --- hi, I found a bug

[jira] [Commented] (SPARK-15678) Not use cache on appends and overwrites

2017-02-21 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877513#comment-15877513 ] Gen TANG commented on SPARK-15678: -- hi, I found a bug which is probably related with this

[jira] [Commented] (SPARK-17110) Pyspark with locality ANY throw java.io.StreamCorruptedException

2016-08-29 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15445591#comment-15445591 ] Gen TANG commented on SPARK-17110: -- Hi, I tried the similar code in python, scala, java and with

[jira] [Commented] (SPARK-17110) Pyspark with locality ANY throw java.io.StreamCorruptedException

2016-08-24 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436120#comment-15436120 ] Gen TANG commented on SPARK-17110: -- [~radost...@gmail.com], It seems spark scala doesn't have this bug

[jira] [Updated] (SPARK-9928) LogicalLocalTable in ExistingRDD.scala is not referenced by any code else

2015-08-12 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gen TANG updated SPARK-9928: Description: The case class LogicalLocalTable in

[jira] [Created] (SPARK-9928) LogicalLocalTable in ExistingRDD.scala is not referenced by any code else

2015-08-12 Thread Gen TANG (JIRA)
Gen TANG created SPARK-9928: --- Summary: LogicalLocalTable in ExistingRDD.scala is not referenced by any code else Key: SPARK-9928 URL: https://issues.apache.org/jira/browse/SPARK-9928 Project: Spark

[jira] [Updated] (SPARK-9928) LogicalLocalTable in ExistingRDD.scala is not referenced by any code else

2015-08-12 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gen TANG updated SPARK-9928: Description: The case class LogicalLocalTable in

[jira] [Updated] (SPARK-9928) LogicalLocalTable in ExistingRDD.scala is not referenced by any code else

2015-08-12 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gen TANG updated SPARK-9928: Description: The case class

[jira] [Commented] (SPARK-9928) LogicalLocalTable in ExistingRDD.scala is not referenced by any code else

2015-08-12 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694672#comment-14694672 ] Gen TANG commented on SPARK-9928: - I think right now spark use

[jira] [Updated] (SPARK-9928) LogicalLocalTable in ExistingRDD.scala is not referenced by any code else

2015-08-12 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gen TANG updated SPARK-9928: Description: The case class

[jira] [Commented] (SPARK-4983) Tag EC2 instances in the same call that launches them

2015-01-08 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270084#comment-14270084 ] Gen TANG commented on SPARK-4983: - By boto, we can only tag instance after it launched, to

[jira] [Updated] (SPARK-5090) The improvement of python converter for hbase

2015-01-05 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gen TANG updated SPARK-5090: Description: The python converter `HBaseResultToStringConverter` provided in the HBaseConverter.scala

[jira] [Created] (SPARK-5090) The improvement of python converter for hbase

2015-01-05 Thread Gen TANG (JIRA)
Gen TANG created SPARK-5090: --- Summary: The improvement of python converter for hbase Key: SPARK-5090 URL: https://issues.apache.org/jira/browse/SPARK-5090 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-3183) Add option for requesting full YARN cluster

2014-10-31 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191781#comment-14191781 ] Gen TANG commented on SPARK-3183: - The same workaround for --num-executors. For the

[jira] [Commented] (SPARK-1977) mutable.BitSet in ALS not serializable with KryoSerializer

2014-10-23 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181120#comment-14181120 ] Gen TANG commented on SPARK-1977: - [~sinisa_lyh] Sorry to bother you. According to

[jira] [Commented] (SPARK-2652) Turning default configurations for PySpark

2014-10-23 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181282#comment-14181282 ] Gen TANG commented on SPARK-2652: - If we set {code} spark.serializer,

[jira] [Comment Edited] (SPARK-2652) Turning default configurations for PySpark

2014-10-23 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181282#comment-14181282 ] Gen TANG edited comment on SPARK-2652 at 10/23/14 12:29 PM: If

[jira] [Commented] (SPARK-1977) mutable.BitSet in ALS not serializable with KryoSerializer

2014-10-23 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181287#comment-14181287 ] Gen TANG commented on SPARK-1977: - In fact, the problem about transformation between

[jira] [Commented] (SPARK-3990) kryo.KryoException caused by ALS.trainImplicit in pyspark

2014-10-20 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14176788#comment-14176788 ] Gen TANG commented on SPARK-3990: - [~mengxr] I tried the code that you provided and it

[jira] [Commented] (SPARK-3990) kryo.KryoException caused by ALS.trainImplicit in pyspark

2014-10-20 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14177365#comment-14177365 ] Gen TANG commented on SPARK-3990: - Yeah, I will try. But I am afraid that I couldn't fix

[jira] [Commented] (SPARK-3990) kryo.KryoException caused by ALS.trainImplicit in pyspark

2014-10-18 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175920#comment-14175920 ] Gen TANG commented on SPARK-3990: - Thanks a lot for your reply. Right now, I use scala to

[jira] [Created] (SPARK-3990) kryo.KryoException caused by ALS.trainImplicit in pyspark

2014-10-17 Thread Gen TANG (JIRA)
Gen TANG created SPARK-3990: --- Summary: kryo.KryoException caused by ALS.trainImplicit in pyspark Key: SPARK-3990 URL: https://issues.apache.org/jira/browse/SPARK-3990 Project: Spark Issue Type:

[jira] [Updated] (SPARK-3990) kryo.KryoException caused by ALS.trainImplicit in pyspark

2014-10-17 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gen TANG updated SPARK-3990: Description: When we tried ALS.trainImplicit() in pyspark environment, it only works for iterations = 1.

[jira] [Updated] (SPARK-3990) kryo.KryoException caused by ALS.trainImplicit in pyspark

2014-10-17 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gen TANG updated SPARK-3990: I think this problem is related to https://issues.apache.org/jira/browse/SPARK-1977 kryo.KryoException