[GitHub] spark pull request #20090: [SPARK-22907]Clean broadcast garbage when IOExcep...

2017-12-27 Thread liupc
GitHub user liupc opened a pull request: https://github.com/apache/spark/pull/20090 [SPARK-22907]Clean broadcast garbage when IOException occurred in MetadataFetch ## What changes were proposed in this pull request? This PR will clean garbage broadcast when IOException

[GitHub] spark pull request #20086: [SPARK-22903]Fix already being created exception ...

2017-12-26 Thread liupc
GitHub user liupc opened a pull request: https://github.com/apache/spark/pull/20086 [SPARK-22903]Fix already being created exception in stage retry caused by wrong at… …temptNumber ## What changes were proposed in this pull request? This PR fix the wrong

[GitHub] spark pull request #18985: [SPARK-21772] Fix staging parent directory for In...

2017-08-20 Thread liupc
Github user liupc closed the pull request at: https://github.com/apache/spark/pull/18985 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #18985: [SPARK-21772] Fix staging parent directory for InsertInt...

2017-08-20 Thread liupc
Github user liupc commented on the issue: https://github.com/apache/spark/pull/18985 Sorry, I think SPARK-18675 has solved this problem. https://issues.apache.org/jira/browse/SPARK-18675 My environment is hive-0.13, spark2.1.0, There are two reasons caused this problem

[GitHub] spark issue #18985: [SPARK-21772] Fix staging parent directory for InsertInt...

2017-08-19 Thread liupc
Github user liupc commented on the issue: https://github.com/apache/spark/pull/18985 You can try this very simple test case: ``` use test; // change db create table t1 as select * from t2; ``` --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request #18985: [SPARK-21772] Fix staging parent directory for In...

2017-08-17 Thread liupc
GitHub user liupc opened a pull request: https://github.com/apache/spark/pull/18985 [SPARK-21772] Fix staging parent directory for InsertIntoHiveTable Summary: Due to the incorrect tmpLocation in InsertIntoHiveTable is set. SQL queries like create table as select or insert

[GitHub] spark pull request #18171: [SPARK-20945] Fix TID key not found in TaskSchedu...

2017-06-01 Thread liupc
Github user liupc commented on a diff in the pull request: https://github.com/apache/spark/pull/18171#discussion_r119763935 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -240,8 +240,10 @@ private[spark] class TaskSchedulerImpl private

[GitHub] spark pull request #18171: Fix tid key not found in TaskSchedulerImpl

2017-05-31 Thread liupc
GitHub user liupc opened a pull request: https://github.com/apache/spark/pull/18171 Fix tid key not found in TaskSchedulerImpl ## What changes were proposed in this pull request? This pull request fix the TaskScheulerImpl bug in some condition. Detail see: https