spark git commit: [SQL][MINOR] use stricter type parameter to make it clear that parquet reader returns UnsafeRow

2016-08-02 Thread lian
Repository: spark Updated Branches: refs/heads/master 386127377 -> ae226283e [SQL][MINOR] use stricter type parameter to make it clear that parquet reader returns UnsafeRow ## What changes were proposed in this pull request? a small code style change, it's better to make the type parameter

spark git commit: [SPARK-16796][WEB UI] Visible passwords on Spark environment page

2016-08-02 Thread srowen
Repository: spark Updated Branches: refs/heads/master b73a57060 -> 386127377 [SPARK-16796][WEB UI] Visible passwords on Spark environment page ## What changes were proposed in this pull request? Mask spark.ssl.keyPassword, spark.ssl.keyStorePassword, spark.ssl.trustStorePassword in Web UI

spark git commit: [SPARK-15541] Casting ConcurrentHashMap to ConcurrentMap (branch-1.6)

2016-08-02 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.6 8a22275de -> 797e758b1 [SPARK-15541] Casting ConcurrentHashMap to ConcurrentMap (branch-1.6) ## What changes were proposed in this pull request? Casting ConcurrentHashMap to ConcurrentMap allows to run code compiled with Java 8 on

spark git commit: [SPARK-16858][SQL][TEST] Removal of TestHiveSharedState

2016-08-02 Thread rxin
Repository: spark Updated Branches: refs/heads/master e9fc0b6a8 -> b73a57060 [SPARK-16858][SQL][TEST] Removal of TestHiveSharedState ### What changes were proposed in this pull request? This PR is to remove `TestHiveSharedState`. Also, this is also associated with the Hive refractoring for

spark git commit: [SPARK-16787] SparkContext.addFile() should not throw if called twice with the same file

2016-08-02 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master a9beeaaae -> e9fc0b6a8 [SPARK-16787] SparkContext.addFile() should not throw if called twice with the same file ## What changes were proposed in this pull request? The behavior of `SparkContext.addFile()` changed slightly with the

spark git commit: [SPARK-16787] SparkContext.addFile() should not throw if called twice with the same file

2016-08-02 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-2.0 f190bb83b -> 063a507fc [SPARK-16787] SparkContext.addFile() should not throw if called twice with the same file ## What changes were proposed in this pull request? The behavior of `SparkContext.addFile()` changed slightly with the

spark git commit: [SPARK-16855][SQL] move Greatest and Least from conditionalExpressions.scala to arithmetic.scala

2016-08-02 Thread rxin
Repository: spark Updated Branches: refs/heads/master cbdff4935 -> a9beeaaae [SPARK-16855][SQL] move Greatest and Least from conditionalExpressions.scala to arithmetic.scala ## What changes were proposed in this pull request? `Greatest` and `Least` are not conditional expressions, but

spark git commit: [SPARK-16816] Modify java example which is also reflect in documentation exmaple

2016-08-02 Thread srowen
Repository: spark Updated Branches: refs/heads/master 2330f3ecb -> cbdff4935 [SPARK-16816] Modify java example which is also reflect in documentation exmaple ## What changes were proposed in this pull request? Modify java example which is also reflect in document. ## How was this patch

spark git commit: [SPARK-16850][SQL] Improve type checking error message for greatest/least

2016-08-02 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 a937c9ee4 -> f190bb83b [SPARK-16850][SQL] Improve type checking error message for greatest/least Greatest/least function does not have the most friendly error message for data types. This patch improves the error message to not show

spark git commit: [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_TIMESTAMP literals

2016-08-02 Thread rxin
Repository: spark Updated Branches: refs/heads/master 146001a9f -> 2330f3ecb [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_TIMESTAMP literals ## What changes were proposed in this pull request? In Spark 1.6 (with Hive support) we could use `CURRENT_DATE` and `CURRENT_TIMESTAMP`

spark git commit: [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_TIMESTAMP literals

2016-08-02 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 ef7927e8e -> a937c9ee4 [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_TIMESTAMP literals ## What changes were proposed in this pull request? In Spark 1.6 (with Hive support) we could use `CURRENT_DATE` and `CURRENT_TIMESTAMP`

spark git commit: [SPARK-16062] [SPARK-15989] [SQL] Fix two bugs of Python-only UDTs

2016-08-02 Thread davies
Repository: spark Updated Branches: refs/heads/branch-2.0 22f0899bc -> ef7927e8e [SPARK-16062] [SPARK-15989] [SQL] Fix two bugs of Python-only UDTs ## What changes were proposed in this pull request? There are two related bugs of Python-only UDTs. Because the test case of second one needs

spark git commit: [SPARK-16062] [SPARK-15989] [SQL] Fix two bugs of Python-only UDTs

2016-08-02 Thread davies
Repository: spark Updated Branches: refs/heads/master 1dab63d8d -> 146001a9f [SPARK-16062] [SPARK-15989] [SQL] Fix two bugs of Python-only UDTs ## What changes were proposed in this pull request? There are two related bugs of Python-only UDTs. Because the test case of second one needs the

spark git commit: [SPARK-16837][SQL] TimeWindow incorrectly drops slideDuration in constructors

2016-08-02 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 fc18e259a -> 22f0899bc [SPARK-16837][SQL] TimeWindow incorrectly drops slideDuration in constructors ## What changes were proposed in this pull request? Fix of incorrect arguments (dropping slideDuration and using windowDuration) in

spark git commit: [SPARK-16837][SQL] TimeWindow incorrectly drops slideDuration in constructors

2016-08-02 Thread srowen
Repository: spark Updated Branches: refs/heads/master 36827ddaf -> 1dab63d8d [SPARK-16837][SQL] TimeWindow incorrectly drops slideDuration in constructors ## What changes were proposed in this pull request? Fix of incorrect arguments (dropping slideDuration and using windowDuration) in

spark git commit: [SPARK-16822][DOC] Support latex in scaladoc.

2016-08-02 Thread srowen
Repository: spark Updated Branches: refs/heads/master 511dede11 -> 36827ddaf [SPARK-16822][DOC] Support latex in scaladoc. ## What changes were proposed in this pull request? Support using latex in scaladoc by adding MathJax javascript to the js template. ## How was this patch tested?

spark git commit: [SPARK-15541] Casting ConcurrentHashMap to ConcurrentMap (master branch)

2016-08-02 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.6 1b2e6f636 -> 8a22275de [SPARK-15541] Casting ConcurrentHashMap to ConcurrentMap (master branch) Casting ConcurrentHashMap to ConcurrentMap allows to run code compiled with Java 8 on Java 7 Compilation. Existing automatic tests

spark git commit: [SPARK-15541] Casting ConcurrentHashMap to ConcurrentMap (master branch)

2016-08-02 Thread srowen
Repository: spark Updated Branches: refs/heads/master dd8514fa2 -> 511dede11 [SPARK-15541] Casting ConcurrentHashMap to ConcurrentMap (master branch) ## What changes were proposed in this pull request? Casting ConcurrentHashMap to ConcurrentMap allows to run code compiled with Java 8 on

spark git commit: [SPARK-15541] Casting ConcurrentHashMap to ConcurrentMap (master branch)

2016-08-02 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 c5516ab60 -> fc18e259a [SPARK-15541] Casting ConcurrentHashMap to ConcurrentMap (master branch) ## What changes were proposed in this pull request? Casting ConcurrentHashMap to ConcurrentMap allows to run code compiled with Java 8 on

spark git commit: [SPARK-16558][EXAMPLES][MLLIB] examples/mllib/LDAExample should use MLVector instead of MLlib Vector

2016-08-02 Thread yliang
Repository: spark Updated Branches: refs/heads/branch-2.0 9d9956e8f -> c5516ab60 [SPARK-16558][EXAMPLES][MLLIB] examples/mllib/LDAExample should use MLVector instead of MLlib Vector ## What changes were proposed in this pull request? mllib.LDAExample uses ML pipeline and MLlib LDA

spark git commit: [SPARK-16558][EXAMPLES][MLLIB] examples/mllib/LDAExample should use MLVector instead of MLlib Vector

2016-08-02 Thread yliang
Repository: spark Updated Branches: refs/heads/master d9e0919d3 -> dd8514fa2 [SPARK-16558][EXAMPLES][MLLIB] examples/mllib/LDAExample should use MLVector instead of MLlib Vector ## What changes were proposed in this pull request? mllib.LDAExample uses ML pipeline and MLlib LDA algorithm.

spark git commit: [SPARK-16851][ML] Incorrect threshould length in 'setThresholds()' evoke Exception

2016-08-02 Thread yliang
Repository: spark Updated Branches: refs/heads/master a1ff72e1c -> d9e0919d3 [SPARK-16851][ML] Incorrect threshould length in 'setThresholds()' evoke Exception ## What changes were proposed in this pull request? Add a length checking for threshoulds' length in method `setThreshoulds()` of

spark git commit: [SPARK-16850][SQL] Improve type checking error message for greatest/least

2016-08-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 10e1c0e63 -> a1ff72e1c [SPARK-16850][SQL] Improve type checking error message for greatest/least ## What changes were proposed in this pull request? Greatest/least function does not have the most friendly error message for data types.

spark git commit: [SPARK-16734][EXAMPLES][SQL] Revise examples of all language bindings

2016-08-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.0 5fbf5f93e -> 9d9956e8f [SPARK-16734][EXAMPLES][SQL] Revise examples of all language bindings ## What changes were proposed in this pull request? This PR makes various minor updates to examples of all language bindings to make sure

spark git commit: [SPARK-16734][EXAMPLES][SQL] Revise examples of all language bindings

2016-08-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 5184df06b -> 10e1c0e63 [SPARK-16734][EXAMPLES][SQL] Revise examples of all language bindings ## What changes were proposed in this pull request? This PR makes various minor updates to examples of all language bindings to make sure they

spark git commit: [SPARK-16793][SQL] Set the temporary warehouse path to sc'conf in TestHive.

2016-08-02 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2eedc00b0 -> 5184df06b [SPARK-16793][SQL] Set the temporary warehouse path to sc'conf in TestHive. ## What changes were proposed in this pull request? With SPARK-15034, we could use the value of spark.sql.warehouse.dir to set the