spark git commit: [SPARK-21549][CORE] Respect OutputFormats with no output directory provided

2017-10-06 Thread mridulm80
Repository: spark Updated Branches: refs/heads/branch-2.2 8a4e7dd89 -> 0d3f1667e [SPARK-21549][CORE] Respect OutputFormats with no output directory provided ## What changes were proposed in this pull request? Fix for https://issues.apache.org/jira/browse/SPARK-21549 JIRA issue. Since

spark git commit: [SPARK-21549][CORE] Respect OutputFormats with no output directory provided

2017-10-06 Thread mridulm80
Repository: spark Updated Branches: refs/heads/master debcbec74 -> 2030f1951 [SPARK-21549][CORE] Respect OutputFormats with no output directory provided ## What changes were proposed in this pull request? Fix for https://issues.apache.org/jira/browse/SPARK-21549 JIRA issue. Since version

spark git commit: [SPARK-21947][SS] Check and report error when monotonically_increasing_id is used in streaming query

2017-10-06 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 08b204fd2 -> debcbec74 [SPARK-21947][SS] Check and report error when monotonically_increasing_id is used in streaming query ## What changes were proposed in this pull request? `monotonically_increasing_id` doesn't work in Structured

spark git commit: [SPARK-22214][SQL] Refactor the list hive partitions code

2017-10-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master c7b46d4d8 -> 08b204fd2 [SPARK-22214][SQL] Refactor the list hive partitions code ## What changes were proposed in this pull request? In this PR we make a few changes to the list hive partitions code, to make the code more extensible. The

spark git commit: [SPARK-21877][DEPLOY, WINDOWS] Handle quotes in Windows command scripts

2017-10-06 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 0c03297bf -> c7b46d4d8 [SPARK-21877][DEPLOY, WINDOWS] Handle quotes in Windows command scripts ## What changes were proposed in this pull request? All the windows command scripts can not handle quotes in parameter. Run a windows command

spark git commit: [SPARK-22142][BUILD][STREAMING] Move Flume support behind a profile, take 2

2017-10-06 Thread srowen
Repository: spark Updated Branches: refs/heads/master 83488cc31 -> 0c03297bf [SPARK-22142][BUILD][STREAMING] Move Flume support behind a profile, take 2 ## What changes were proposed in this pull request? Move flume behind a profile, take 2. See https://github.com/apache/spark/pull/19365

spark git commit: [SPARK-21871][SQL] Fix infinite loop when bytecode size is larger than spark.sql.codegen.hugeMethodLimit

2017-10-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master ae61f187a -> 83488cc31 [SPARK-21871][SQL] Fix infinite loop when bytecode size is larger than spark.sql.codegen.hugeMethodLimit ## What changes were proposed in this pull request? When exceeding `spark.sql.codegen.hugeMethodLimit`, the