spark git commit: [SPARK-19816][SQL][TESTS] Fix an issue that DataFrameCallbackSuite doesn't recover the log level

2017-03-03 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.1 da04d45c2 -> 664c9795c [SPARK-19816][SQL][TESTS] Fix an issue that DataFrameCallbackSuite doesn't recover the log level ## What changes were proposed in this pull request? "DataFrameCallbackSuite.execute callback functions when a

spark git commit: [SPARK-19816][SQL][TESTS] Fix an issue that DataFrameCallbackSuite doesn't recover the log level

2017-03-03 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 9e5b4ce72 -> fbc405803 [SPARK-19816][SQL][TESTS] Fix an issue that DataFrameCallbackSuite doesn't recover the log level ## What changes were proposed in this pull request? "DataFrameCallbackSuite.execute callback functions when a

spark git commit: [SPARK-19084][SQL] Ensure context class loader is set when initializing Hive.

2017-03-03 Thread lixiao
Repository: spark Updated Branches: refs/heads/master a6a7a95e2 -> 9e5b4ce72 [SPARK-19084][SQL] Ensure context class loader is set when initializing Hive. A change in Hive 2.2 (most probably HIVE-13149) causes this code path to fail, since the call to "state.getConf.setClassLoader" does not

spark git commit: [SPARK-19718][SS] Handle more interrupt cases properly for Hadoop

2017-03-03 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master f5fdbe043 -> a6a7a95e2 [SPARK-19718][SS] Handle more interrupt cases properly for Hadoop ## What changes were proposed in this pull request? [SPARK-19617](https://issues.apache.org/jira/browse/SPARK-19617) changed `HDFSMetadataLog` to

spark git commit: [SPARK-13446][SQL] Support reading data from Hive 2.0.1 metastore

2017-03-03 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 44281ca81 -> f5fdbe043 [SPARK-13446][SQL] Support reading data from Hive 2.0.1 metastore ### What changes were proposed in this pull request? This PR is to make Spark work with Hive 2.0's metastores. Compared with Hive 1.2, Hive 2.0's

spark git commit: [SPARK-19348][PYTHON] PySpark keyword_only decorator is not thread-safe

2017-03-03 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 2a7921a81 -> 44281ca81 [SPARK-19348][PYTHON] PySpark keyword_only decorator is not thread-safe ## What changes were proposed in this pull request? The `keyword_only` decorator in PySpark is not thread-safe. It writes kwargs to a static

spark git commit: [SPARK-18939][SQL] Timezone support in partition values.

2017-03-03 Thread wenchen
Repository: spark Updated Branches: refs/heads/master ba186a841 -> 2a7921a81 [SPARK-18939][SQL] Timezone support in partition values. ## What changes were proposed in this pull request? This is a follow-up pr of #16308 and #16750. This pr enables timezone support in partition values. We

spark git commit: [MINOR][DOC] Fix doc for web UI https configuration

2017-03-03 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 9314c0837 -> ba186a841 [MINOR][DOC] Fix doc for web UI https configuration ## What changes were proposed in this pull request? Doc about enabling web UI https is not correct, "spark.ui.https.enabled" is not existed, actually enabling SSL

spark git commit: [SPARK-19774] StreamExecution should call stop() on sources when a stream fails

2017-03-03 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 accbed7c2 -> da04d45c2 [SPARK-19774] StreamExecution should call stop() on sources when a stream fails ## What changes were proposed in this pull request? We call stop() on a Structured Streaming Source only when the stream is

spark git commit: [SPARK-19774] StreamExecution should call stop() on sources when a stream fails

2017-03-03 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 37a1c0e46 -> 9314c0837 [SPARK-19774] StreamExecution should call stop() on sources when a stream fails ## What changes were proposed in this pull request? We call stop() on a Structured Streaming Source only when the stream is shutdown

spark git commit: [SPARK-19710][SQL][TESTS] Fix ordering of rows in query results

2017-03-03 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 98bcc188f -> 37a1c0e46 [SPARK-19710][SQL][TESTS] Fix ordering of rows in query results ## What changes were proposed in this pull request? Changes to SQLQueryTests to make the order of the results constant. Where possible ORDER BY has been

spark git commit: [SPARK-19758][SQL] Resolving timezone aware expressions with time zone when resolving inline table

2017-03-03 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 776fac398 -> 98bcc188f [SPARK-19758][SQL] Resolving timezone aware expressions with time zone when resolving inline table ## What changes were proposed in this pull request? When we resolve inline tables in analyzer, we will evaluate the

spark-website git commit: Update commiter list

2017-03-03 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 470b7ed51 -> c1b9ad3cb Update commiter list Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/c1b9ad3c Tree:

spark git commit: [SPARK-19801][BUILD] Remove JDK7 from Travis CI

2017-03-03 Thread srowen
Repository: spark Updated Branches: refs/heads/master 0bac3e4cd -> 776fac398 [SPARK-19801][BUILD] Remove JDK7 from Travis CI ## What changes were proposed in this pull request? Since Spark 2.1.0, Travis CI was supported by SPARK-15207 for automated PR verification (JDK7/JDK8 maven

spark git commit: [SPARK-19797][DOC] ML pipeline document correction

2017-03-03 Thread srowen
Repository: spark Updated Branches: refs/heads/master fa50143cd -> 0bac3e4cd [SPARK-19797][DOC] ML pipeline document correction ## What changes were proposed in this pull request? Description about pipeline in this paragraph is incorrect

spark git commit: [SPARK-19797][DOC] ML pipeline document correction

2017-03-03 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 1237aaea2 -> accbed7c2 [SPARK-19797][DOC] ML pipeline document correction ## What changes were proposed in this pull request? Description about pipeline in this paragraph is incorrect

spark git commit: [SPARK-19739][CORE] propagate S3 session token to cluser

2017-03-03 Thread srowen
Repository: spark Updated Branches: refs/heads/master d556b3170 -> fa50143cd [SPARK-19739][CORE] propagate S3 session token to cluser ## What changes were proposed in this pull request? propagate S3 session token to cluser ## How was this patch tested? existing ut Author: uncleGen

spark git commit: [SPARK-18699][SQL][FOLLOWUP] Add explanation in CSV parser and minor cleanup

2017-03-03 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 982f3223b -> d556b3170 [SPARK-18699][SQL][FOLLOWUP] Add explanation in CSV parser and minor cleanup ## What changes were proposed in this pull request? This PR suggests adding some comments in `UnivocityParser` logics to explain what