spark git commit: [SPARK-17991][SQL] Enable metastore partition pruning by default.

2016-10-19 Thread rxin
Repository: spark Updated Branches: refs/heads/master 39755169f -> 4bd17c460 [SPARK-17991][SQL] Enable metastore partition pruning by default. ## What changes were proposed in this pull request? This should apply to non-converted metastore relations. WIP to see if this causes any test failur

spark git commit: [SPARK-18003][SPARK CORE] Fix bug of RDD zipWithIndex & zipWithUniqueId index value overflowing

2016-10-19 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 995f602d2 -> 4131623a8 [SPARK-18003][SPARK CORE] Fix bug of RDD zipWithIndex & zipWithUniqueId index value overflowing ## What changes were proposed in this pull request? - Fix bug of RDD `zipWithIndex` generating wrong result when on

spark git commit: [SPARK-18003][SPARK CORE] Fix bug of RDD zipWithIndex & zipWithUniqueId index value overflowing

2016-10-19 Thread rxin
Repository: spark Updated Branches: refs/heads/master f313117bc -> 39755169f [SPARK-18003][SPARK CORE] Fix bug of RDD zipWithIndex & zipWithUniqueId index value overflowing ## What changes were proposed in this pull request? - Fix bug of RDD `zipWithIndex` generating wrong result when one pa

spark git commit: [SPARK-16078][SQL] Backport: from_utc_timestamp/to_utc_timestamp should not depends on local timezone

2016-10-19 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.6 b95ac0d00 -> 82e98f126 [SPARK-16078][SQL] Backport: from_utc_timestamp/to_utc_timestamp should not depends on local timezone ## What changes were proposed in this pull request? Back-port of https://github.com/apache/spark/pull/13784 t

spark git commit: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread lian
Repository: spark Updated Branches: refs/heads/master 4b2011ec9 -> f313117bc [SPARK-18012][SQL] Simplify WriterContainer ## What changes were proposed in this pull request? This patch refactors WriterContainer to simplify the logic and make control flow more obvious.The previous code setup ma

spark git commit: [SPARK-17989][SQL] Check ascendingOrder type in sort_array function rather than throwing ClassCastException

2016-10-19 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 cdd2570e6 -> 995f602d2 [SPARK-17989][SQL] Check ascendingOrder type in sort_array function rather than throwing ClassCastException ## What changes were proposed in this pull request? This PR proposes to check the second argument, `asc

spark git commit: [SPARK-17989][SQL] Check ascendingOrder type in sort_array function rather than throwing ClassCastException

2016-10-19 Thread rxin
Repository: spark Updated Branches: refs/heads/master 444c2d22e -> 4b2011ec9 [SPARK-17989][SQL] Check ascendingOrder type in sort_array function rather than throwing ClassCastException ## What changes were proposed in this pull request? This PR proposes to check the second argument, `ascendi

spark git commit: [SPARK-10541][WEB UI] Allow ApplicationHistoryProviders to provide their own text when there aren't any complete apps

2016-10-19 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 9540357ad -> 444c2d22e [SPARK-10541][WEB UI] Allow ApplicationHistoryProviders to provide their own text when there aren't any complete apps ## What changes were proposed in this pull request? I've added a method to `ApplicationHistoryPro

spark git commit: [SPARK-17985][CORE] Bump commons-lang3 version to 3.5.

2016-10-19 Thread srowen
Repository: spark Updated Branches: refs/heads/master f39852e59 -> 9540357ad [SPARK-17985][CORE] Bump commons-lang3 version to 3.5. ## What changes were proposed in this pull request? `SerializationUtils.clone()` of commons-lang3 (<3.5) has a bug that breaks thread safety, which gets stack s