[jira] [Commented] (SPARK-11475) DataFrame API saveAsTable() does not work well for HDFS HA

2015-11-04 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991258#comment-14991258 ] zhangxiongfei commented on SPARK-11475: --- Hi [~rekhajoshm] Thanks for pointing out my wrong Hive

[jira] [Updated] (SPARK-11475) DataFrame API saveAsTable() does not work well for HDFS HA

2015-11-03 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxiongfei updated SPARK-11475: -- Attachment: hive-site.xml hdfs-site.xml > DataFrame API saveAsTable() does not

[jira] [Commented] (SPARK-11475) DataFrame API saveAsTable() does not work well for HDFS HA

2015-11-03 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988998#comment-14988998 ] zhangxiongfei commented on SPARK-11475: --- Hi [~rekhajoshm] I think my Hive/Hdfs configuration is

[jira] [Created] (SPARK-11475) DataFrame API saveAsTable() does not work well for HDFS HA

2015-11-03 Thread zhangxiongfei (JIRA)
zhangxiongfei created SPARK-11475: - Summary: DataFrame API saveAsTable() does not work well for HDFS HA Key: SPARK-11475 URL: https://issues.apache.org/jira/browse/SPARK-11475 Project: Spark

[jira] [Created] (SPARK-8778) The item of Scheduler delay is not consistent between Event Timeline and Task List

2015-07-01 Thread zhangxiongfei (JIRA)
zhangxiongfei created SPARK-8778: Summary: The item of Scheduler delay is not consistent between Event Timeline and Task List Key: SPARK-8778 URL: https://issues.apache.org/jira/browse/SPARK-8778

[jira] [Updated] (SPARK-8778) The item of Scheduler delay is not consistent between Event Timeline and Task List

2015-07-01 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxiongfei updated SPARK-8778: - Description: In the page Details for Stage of Spark Web UI, Scheduler delay of some running

[jira] [Updated] (SPARK-8778) The item of Scheduler delay is not consistent between Event Timeline and Task List

2015-07-01 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxiongfei updated SPARK-8778: - Attachment: Event Timeline.png Tasks.png The item of Scheduler delay is not

[jira] [Updated] (SPARK-6921) Spark SQL API saveAsParquetFile will output tachyon file with different block size

2015-04-27 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxiongfei updated SPARK-6921: - Affects Version/s: 1.3.1 Spark SQL API saveAsParquetFile will output tachyon file with different

[jira] [Commented] (SPARK-6921) Spark SQL API saveAsParquetFile will output tachyon file with different block size

2015-04-27 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516299#comment-14516299 ] zhangxiongfei commented on SPARK-6921: -- I think the reason for this issue is below:

[jira] [Commented] (SPARK-6921) Spark SQL API saveAsParquetFile will output tachyon file with different block size

2015-04-23 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509349#comment-14509349 ] zhangxiongfei commented on SPARK-6921: -- I think the root cause may be the following:

[jira] [Issue Comment Deleted] (SPARK-6921) Spark SQL API saveAsParquetFile will output tachyon file with different block size

2015-04-23 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxiongfei updated SPARK-6921: - Comment: was deleted (was: I think the root cause may be the following: 1)When the

[jira] [Comment Edited] (SPARK-6921) Spark SQL API saveAsParquetFile will output tachyon file with different block size

2015-04-23 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509349#comment-14509349 ] zhangxiongfei edited comment on SPARK-6921 at 4/23/15 4:52 PM:

[jira] [Commented] (SPARK-6921) Spark SQL API saveAsParquetFile will output tachyon file with different block size

2015-04-15 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497580#comment-14497580 ] zhangxiongfei commented on SPARK-6921: -- I also did another test on HDFS files. 1)Set

[jira] [Created] (SPARK-6921) Spark SQL API saveAsParquetFile will output tachyon file with different block size

2015-04-14 Thread zhangxiongfei (JIRA)
zhangxiongfei created SPARK-6921: Summary: Spark SQL API saveAsParquetFile will output tachyon file with different block size Key: SPARK-6921 URL: https://issues.apache.org/jira/browse/SPARK-6921