spark git commit: [SPARK-6317][SQL]Fixed HIVE console startup issue

://git-wip-us.apache.org/repos/asf/spark/diff/e360d5e4 Branch: refs/heads/master Commit: e360d5e4adf287444c10e72f8e4d57548839bf6e Parents: cdc34ed Author: vinodkc vinod.kc...@gmail.com Authored: Sat Mar 14 07:17:54 2015 +0800 Committer: Cheng Lian l...@databricks.com Committed: Sat Mar 14 07:17:54

spark git commit: [SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide

on Reviewable/](https://reviewable.io/reviews/apache/spark/5001) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #5001 from liancheng/parquet-doc and squashes the following commits: 89ad3db [Cheng Lian] Addresses @rxin's comments 7eb6955 [Cheng Lian] Docs for the new Parquet

spark git commit: [SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide

on Reviewable/](https://reviewable.io/reviews/apache/spark/5001) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #5001 from liancheng/parquet-doc and squashes the following commits: 89ad3db [Cheng Lian] Addresses @rxin's comments 7eb6955 [Cheng Lian] Docs for the new Parquet data

spark git commit: [SPARK-6153] [SQL] promote guava dep for hive-thriftserver

and squashes the following commits: 4600ae7 [Daoyuan Wang] only promote for thriftserver 44dda18 [Daoyuan Wang] promote guava dep for hive (cherry picked from commit e06c7dfbc2331db2d1c365959c12aaac640a610a) Signed-off-by: Cheng Lian l...@databricks.com Project: http://git-wip-us.apache.org/repos/asf

spark git commit: Revert [SPARK-6153] [SQL] promote guava dep for hive-thriftserver

-us.apache.org/repos/asf/spark/commit/f8205d3b Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f8205d3b Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f8205d3b Branch: refs/heads/branch-1.3 Commit: f8205d3be30c76c60e361b3426fc82e0da425580 Parents: b92d925 Author: Cheng Lian l

spark git commit: [SPARK-6134][SQL] Fix wrong datatype for casting FloatType and default LongType value in defaultPrimitive

Commit: aef8a84e42351419a67d56abaf1ee75a05eb11ea Parents: 76b472f Author: Liang-Chi Hsieh vii...@gmail.com Authored: Wed Mar 4 20:23:43 2015 +0800 Committer: Cheng Lian l...@databricks.com Committed: Wed Mar 4 20:23:43 2015 +0800

spark git commit: [SPARK-6134][SQL] Fix wrong datatype for casting FloatType and default LongType value in defaultPrimitive

in defaultPrimitive. (cherry picked from commit aef8a84e42351419a67d56abaf1ee75a05eb11ea) Signed-off-by: Cheng Lian l...@databricks.com Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/bfa4e319 Tree: http://git-wip-us.apache.org/repos

spark git commit: [SPARK-6073][SQL] Need to refresh metastore cache after append data in CreateMetastoreDataSourceAsSelect

Closes #4824 from yhuai/refreshCache and squashes the following commits: b9542ef [Yin Huai] Refresh metadata cache in the Catalog in CreateMetastoreDataSourceAsSelect. (cherry picked from commit 39a54b40aff66816f8b8f5c6133eaaad6eaecae1) Signed-off-by: Cheng Lian l...@databricks.com Project: http

spark git commit: [SPARK-6073][SQL] Need to refresh metastore cache after append data in CreateMetastoreDataSourceAsSelect

Committer: Cheng Lian l...@databricks.com Committed: Mon Mar 2 22:42:18 2015 +0800 -- .../spark/sql/hive/execution/commands.scala | 2 + .../sql/hive/MetastoreDataSourcesSuite.scala| 52 2 files changed

spark git commit: [SPARK-6052][SQL]In JSON schema inference, we should always set containsNull of an ArrayType to true

Committer: Cheng Lian l...@databricks.com Committed: Mon Mar 2 23:18:07 2015 +0800 -- .../org/apache/spark/sql/json/JsonRDD.scala | 9 +++-- .../org/apache/spark/sql/json/JsonSuite.scala | 38 ++-- 2 files changed

spark git commit: [SPARK-5775] [SQL] BugFix: GenericRow cannot be cast to SpecificMutableRow when nested data and partitioned table

of #4697 for details. !-- Reviewable:start -- [img src=https://reviewable.io/review_button.png; height=40 alt=Review on Reviewable/](https://reviewable.io/reviews/apache/spark/4792) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Author: Cheng Lian lianch...@users.noreply.github.com

spark git commit: [SPARK-5775] [SQL] BugFix: GenericRow cannot be cast to SpecificMutableRow when nested data and partitioned table

of #4697 for details. !-- Reviewable:start -- [img src=https://reviewable.io/review_button.png; height=40 alt=Review on Reviewable/](https://reviewable.io/reviews/apache/spark/4792) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Author: Cheng Lian lianch...@users.noreply.github.com Author

spark git commit: [SPARK-5751] [SQL] Sets SPARK_HOME as SPARK_PID_DIR when running Thrift server test suites

on Reviewable/](https://reviewable.io/reviews/apache/spark/4758) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4758 from liancheng/thriftserver-pid-dir and squashes the following commits: 252fa0f [Cheng Lian] Uses temporary directory as Thrift server PID directory 1b3d1e3 [Cheng Lian

spark git commit: [SPARK-5751] [SQL] Sets SPARK_HOME as SPARK_PID_DIR when running Thrift server test suites

/](https://reviewable.io/reviews/apache/spark/4758) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4758 from liancheng/thriftserver-pid-dir and squashes the following commits: 252fa0f [Cheng Lian] Uses temporary directory as Thrift server PID directory 1b3d1e3 [Cheng Lian

spark git commit: [SPARK-6023][SQL] ParquetConversions fails to replace the destination MetastoreRelation of an InsertIntoTable node to ParquetRelation2

picked from commit f02394d06473889d0d7897c4583239e6e136ff46) Signed-off-by: Cheng Lian l...@databricks.com Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e0f5fb0a Tree: http://git-wip-us.apache.org/repos/asf/spark/tree

spark git commit: [SPARK-6023][SQL] ParquetConversions fails to replace the destination MetastoreRelation of an InsertIntoTable node to ParquetRelation2

: f02394d06473889d0d7897c4583239e6e136ff46 Parents: 51a6f90 Author: Yin Huai yh...@databricks.com Authored: Thu Feb 26 22:39:49 2015 +0800 Committer: Cheng Lian l...@databricks.com Committed: Thu Feb 26 22:39:49 2015 +0800 -- .../spark/sql/hive

spark git commit: [SPARK-6016][SQL] Cannot read the parquet table after overwriting the existing table when spark.sql.parquet.cacheMetadata=true

Huai yh...@databricks.com Authored: Fri Feb 27 01:01:32 2015 +0800 Committer: Cheng Lian l...@databricks.com Committed: Fri Feb 27 01:01:32 2015 +0800 -- .../sql/parquet/ParquetTableOperations.scala| 49

spark git commit: [SPARK-6037][SQL] Avoiding duplicate Parquet schema merging

: 4ad5153f5449319a7e82c9013ccff4494ab58ef1 Parents: 18f2098 Author: Liang-Chi Hsieh vii...@gmail.com Authored: Fri Feb 27 11:06:47 2015 +0800 Committer: Cheng Lian l...@databricks.com Committed: Fri Feb 27 11:06:47 2015 +0800 -- .../sql/parquet

spark git commit: [SPARK-6037][SQL] Avoiding duplicate Parquet schema merging

commit 4ad5153f5449319a7e82c9013ccff4494ab58ef1) Signed-off-by: Cheng Lian l...@databricks.com Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/25a109e4 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/25a109e4 Diff: http

spark git commit: [SPARK-5751] [SQL] [WIP] Revamped HiveThriftServer2Suite for robustness

/review_button.png; height=40 alt=Review on Reviewable/](https://reviewable.io/reviews/apache/spark/4720) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4720 from liancheng/revamp-thrift-server-tests and squashes the following commits: d6c80eb [Cheng Lian] Relaxes server

spark git commit: [SPARK-5751] [SQL] [WIP] Revamped HiveThriftServer2Suite for robustness

/review_button.png; height=40 alt=Review on Reviewable/](https://reviewable.io/reviews/apache/spark/4720) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4720 from liancheng/revamp-thrift-server-tests and squashes the following commits: d6c80eb [Cheng Lian] Relaxes server startup

spark git commit: [SPARK-5846] Correctly set job description and pool for SQL jobs

Author: Kay Ousterhout kayousterh...@gmail.com Authored: Thu Feb 19 09:49:34 2015 +0800 Committer: Cheng Lian l...@databricks.com Committed: Thu Feb 19 09:49:34 2015 +0800 -- .../org/apache/spark/sql/hive/thriftserver/Shim12

spark git commit: [SPARK-5846] Correctly set job description and pool for SQL jobs

: 36e15b4 Author: Kay Ousterhout kayousterh...@gmail.com Authored: Thu Feb 19 10:03:56 2015 +0800 Committer: Cheng Lian l...@databricks.com Committed: Thu Feb 19 10:03:56 2015 +0800 -- .../org/apache/spark/sql/hive/thriftserver/Shim12

spark git commit: [Minor] [SQL] Renames stringRddToDataFrame to stringRddToDataFrameHolder for consistency

://reviewable.io/reviews/apache/spark/4613) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4613 from liancheng/df-implicit-rename and squashes the following commits: db8bdd3 [Cheng Lian] Renames stringRddToDataFrame to stringRddToDataFrameHolder for consistency (cherry picked

[2/2] spark git commit: [SPARK-4553] [SPARK-5767] [SQL] Wires Parquet data source with the newly introduced write support for data source API

alt=Review on Reviewable/](https://reviewable.io/reviews/apache/spark/4563) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4563 from liancheng/parquet-refining and squashes the following commits: fa98d27 [Cheng Lian] Fixes test cases which should disable off Parquet data

[1/2] spark git commit: [SPARK-4553] [SPARK-5767] [SQL] Wires Parquet data source with the newly introduced write support for data source API

Repository: spark Updated Branches: refs/heads/master 199a9e802 - 3ce58cf9c http://git-wip-us.apache.org/repos/asf/spark/blob/3ce58cf9/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala -- diff --git

spark git commit: [Minor] [SQL] Renames stringRddToDataFrame to stringRddToDataFrameHolder for consistency

://reviewable.io/reviews/apache/spark/4613) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4613 from liancheng/df-implicit-rename and squashes the following commits: db8bdd3 [Cheng Lian] Renames stringRddToDataFrame to stringRddToDataFrameHolder for consistency Project: http://git

[1/2] spark git commit: [SPARK-4553] [SPARK-5767] [SQL] Wires Parquet data source with the newly introduced write support for data source API

Repository: spark Updated Branches: refs/heads/branch-1.3 066301c65 - 78f7edb85 http://git-wip-us.apache.org/repos/asf/spark/blob/78f7edb8/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala -- diff --git

spark git commit: [SPARK-3365][SQL]Wrong schema generated for List type

/repos/asf/spark/tree/1c8633f3 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/1c8633f3 Branch: refs/heads/master Commit: 1c8633f3fe9d814c83384e339b958740c250c00c Parents: 2aea892 Author: tianyi tianyi.asiai...@gmail.com Authored: Thu Feb 12 22:18:39 2015 -0800 Committer: Cheng Lian l

spark git commit: [SPARK-3365][SQL]Wrong schema generated for List type

#4581 from tianyi/SPARK-3365 and squashes the following commits: a097e86 [tianyi] change the order of resolution in ScalaReflection.scala (cherry picked from commit 1c8633f3fe9d814c83384e339b958740c250c00c) Signed-off-by: Cheng Lian l...@databricks.com Project: http://git-wip-us.apache.org/repos

spark git commit: [SPARK-5700] [SQL] [Build] Bumps jets3t to 0.9.3 for hadoop-2.3 and hadoop-2.4 profiles

/review_button.png; height=40 alt=Review on Reviewable/](https://reviewable.io/reviews/apache/spark/4499) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4499 from liancheng/spark-5700 and squashes the following commits: 4f020c7 [Cheng Lian] Bumps jets3t to 0.9.3 for hadoop-2.3

spark git commit: [SPARK-5700] [SQL] [Build] Bumps jets3t to 0.9.3 for hadoop-2.3 and hadoop-2.4 profiles

/review_button.png; height=40 alt=Review on Reviewable/](https://reviewable.io/reviews/apache/spark/4499) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4499 from liancheng/spark-5700 and squashes the following commits: 4f020c7 [Cheng Lian] Bumps jets3t to 0.9.3 for hadoop-2.3

spark git commit: [SPARK-5592][SQL] java.net.URISyntaxException when insert data to a partitioned table

(cherry picked from commit 59272dad77eb95c5ae8e0652e00d02a2675cda53) Signed-off-by: Cheng Lian l...@databricks.com Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/dbfce30f Tree: http://git-wip-us.apache.org/repos/asf/spark

spark git commit: [SPARK-5725] [SQL] Fixes ParquetRelation2.equals

) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4513 from liancheng/spark-5725 and squashes the following commits: bf6a087 [Cheng Lian] Fixes ParquetRelation2.equals Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark

spark git commit: [SPARK-5699] [SQL] [Tests] Runs hive-thriftserver tests whenever SQL code is modified

://reviewable.io/reviews/apache/spark/4486) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4486 from liancheng/spark-5699 and squashes the following commits: 538001d [Cheng Lian] Runs hive-thriftserver tests whenever SQL code is modified Project: http://git-wip-us.apache.org/repos/asf

spark git commit: [SPARK-5699] [SQL] [Tests] Runs hive-thriftserver tests whenever SQL code is modified

://reviewable.io/reviews/apache/spark/4486) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4486 from liancheng/spark-5699 and squashes the following commits: 538001d [Cheng Lian] Runs hive-thriftserver tests whenever SQL code is modified (cherry picked from commit

spark git commit: [SPARK-5696] [SQL] [HOTFIX] Asks HiveThriftServer2 to re-initialize log4j using Hive configurations

. !-- Reviewable:start -- [img src=https://reviewable.io/review_button.png; height=40 alt=Review on Reviewable/](https://reviewable.io/reviews/apache/spark/4484) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4484 from liancheng/spark-5696 and squashes the following commits

spark git commit: [SPARK-5696] [SQL] [HOTFIX] Asks HiveThriftServer2 to re-initialize log4j using Hive configurations

. !-- Reviewable:start -- [img src=https://reviewable.io/review_button.png; height=40 alt=Review on Reviewable/](https://reviewable.io/reviews/apache/spark/4484) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4484 from liancheng/spark-5696 and squashes the following commits: df83956

spark git commit: [SQL] [Minor] HiveParquetSuite was disabled by mistake, re-enable them

/apache/spark/4440) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4440 from liancheng/parquet-oops and squashes the following commits: f21ede4 [Cheng Lian] HiveParquetSuite was disabled by mistake, re-enable them. Project: http://git-wip-us.apache.org/repos/asf/spark/repo

spark git commit: [SQL] [Minor] HiveParquetSuite was disabled by mistake, re-enable them

/apache/spark/4440) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4440 from liancheng/parquet-oops and squashes the following commits: f21ede4 [Cheng Lian] HiveParquetSuite was disabled by mistake, re-enable them. (cherry picked from commit

spark git commit: [HOTFIX] [SQL] Disables Metastore Parquet table conversion for SQLQuerySuite.CTAS with serde

://reviewable.io/reviews/apache/spark/4413) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4413 from liancheng/hotfix-parquet-ctas and squashes the following commits: 5291289 [Cheng Lian] Hot fix for SQLQuerySuite.CTAS with serde Project: http://git-wip-us.apache.org/repos

spark git commit: [HOTFIX] [SQL] Disables Metastore Parquet table conversion for SQLQuerySuite.CTAS with serde

/](https://reviewable.io/reviews/apache/spark/4413) !-- Reviewable:end -- Author: Cheng Lian l...@databricks.com Closes #4413 from liancheng/hotfix-parquet-ctas and squashes the following commits: 5291289 [Cheng Lian] Hot fix for SQLQuerySuite.CTAS with serde (cherry picked from commit

spark git commit: [SPARK-4520] [SQL] This pr fixes the ArrayIndexOutOfBoundsException as r...

and squashes the following commits: c5ccde8 [Sadhan Sood] [SPARK-4520] [SQL] This pr fixes the ArrayIndexOutOfBoundsException as raised in SPARK-4520. (cherry picked from commit dba98bf6987ec39380f1a5b0ca2772b694452231) Signed-off-by: Cheng Lian l...@databricks.com Project: http://git-wip

spark git commit: [SPARK-4520] [SQL] This pr fixes the ArrayIndexOutOfBoundsException as r...

Lian l...@databricks.com Committed: Wed Feb 4 19:18:06 2015 -0800 -- .../spark/sql/parquet/ParquetConverter.scala| 5 +++ .../spark/sql/parquet/ParquetTableSupport.scala | 6 +++- .../apache/spark/sql/parquet

<    1   2   3   4   5