[jira] [Created] (SPARK-21883) when a stage failed,should remove it's child stages's pending state on spark UI,and mark jobs which this stage belongs to failed

2017-08-31 Thread xianlongZhang (JIRA)
xianlongZhang created SPARK-21883: - Summary: when a stage failed,should remove it's child stages's pending state on spark UI,and mark jobs which this stage belongs to failed Key: SPARK-21883 URL:

[jira] [Commented] (SPARK-16188) Spark sql create a lot of small files

2017-08-18 Thread xianlongZhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131772#comment-16131772 ] xianlongZhang commented on SPARK-16188: --- cen yuhai,thanks for your advice, but my company's data

[jira] [Commented] (SPARK-16188) Spark sql create a lot of small files

2017-08-16 Thread xianlongZhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129742#comment-16129742 ] xianlongZhang commented on SPARK-16188: --- But when we use Spark sql, we can not call the 'coalesce'