[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-06 Thread lichenglin
Github user lichenglin commented on the issue: https://github.com/apache/spark/pull/15819 In fact,I'm using zeppelin to run sql. When I restart spark interpreter , the folders are deleted. Thank you a lot --- If your project is set up for it, you can reply to this emai

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-06 Thread lichenglin
Github user lichenglin commented on the issue: https://github.com/apache/spark/pull/15819 here is some result for `du -h --max-depth=1 .` 3.3G./.hive-staging_hive_2016-12-06_18-17-48_899_1400956608265117052-5 13G ./.hive-staging_hive_2016-12-06_15-43

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-06 Thread lichenglin
Github user lichenglin commented on the issue: https://github.com/apache/spark/pull/15819 I'm using spark 2.0.2 I got a really big hive-stage folder. May I delete the folder Manually ? does it make any bad affect on warehouse? --- If your project is set up for it, yo

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-18 Thread lichenglin
Github user lichenglin commented on the issue: https://github.com/apache/spark/pull/15868 In fact,I have idea . We can change the param to "connections pool size on each executor",every partition task on the same executor use the same connection pool to save data.

[GitHub] spark issue #15868: [SPARK-18413][SQL] Control the number of JDBC connection...

2016-11-13 Thread lichenglin
Github user lichenglin commented on the issue: https://github.com/apache/spark/pull/15868 I'm sorry,my network is too bad to download dependencies from maven rep for building spark. I have seen your PR and here is some suggestions: 1. I notice the PR has