[GitHub] spark pull request: [SPARK-10216][SQL]Avoid creating empty files d...

2015-08-24 Thread sirpkt
GitHub user sirpkt opened a pull request: https://github.com/apache/spark/pull/8411 [SPARK-10216][SQL]Avoid creating empty files during overwrite into Hive table with group by query I added check routine at saveAsHiveFile() of InsertIntoHiveTable. It checks whether the given

[GitHub] spark pull request: [SPARK-8783] [SQL] CTAS with WITH clause does ...

2015-07-01 Thread sirpkt
GitHub user sirpkt opened a pull request: https://github.com/apache/spark/pull/7180 [SPARK-8783] [SQL] CTAS with WITH clause does not work Currently, CTESubstitution only handles the case that WITH is on the top of the plan. I think it SHOULD handle the case that WITH is child

[GitHub] spark pull request: [SPARK-8728] Add configuration for limiting th...

2015-06-30 Thread sirpkt
GitHub user sirpkt opened a pull request: https://github.com/apache/spark/pull/7119 [SPARK-8728] Add configuration for limiting the maximum number of active stages in a fair scheduling queue It only takes predefined number of Schedulables in getSortedTaskSetQueue