spark git commit: [SPARK-16556][SPARK-16559][SQL] Fix Two Bugs in Bucket Specification

2016-07-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master df2c6d59d -> 94f14b52a [SPARK-16556][SPARK-16559][SQL] Fix Two Bugs in Bucket Specification ### What changes were proposed in this pull request? **Issue 1: Silent Ignorance of Bucket Specification When Creating Table Using Schema

spark git commit: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.0 4cb8ff73f -> 70bf8ce72 [SPARK-16287][SQL] Implement str_to_map SQL function ## What changes were proposed in this pull request? This PR adds `str_to_map` SQL function in order to remove Hive fallback. ## How was this patch tested?

spark git commit: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 46f80a307 -> df2c6d59d [SPARK-16287][SQL] Implement str_to_map SQL function ## What changes were proposed in this pull request? This PR adds `str_to_map` SQL function in order to remove Hive fallback. ## How was this patch tested? Pass

spark git commit: [SPARK-16334] Maintain single dictionary per row-batch in vectorized parquet reader

2016-07-21 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9abd99b3c -> 46f80a307 [SPARK-16334] Maintain single dictionary per row-batch in vectorized parquet reader ## What changes were proposed in this pull request? As part of the bugfix in https://github.com/apache/spark/pull/12279, if a row

spark git commit: [SPARK-16334] Maintain single dictionary per row-batch in vectorized parquet reader

2016-07-21 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 cd41e6a33 -> 4cb8ff73f [SPARK-16334] Maintain single dictionary per row-batch in vectorized parquet reader ## What changes were proposed in this pull request? As part of the bugfix in https://github.com/apache/spark/pull/12279, if a

spark git commit: [SPARK-16656][SQL] Try to make CreateTableAsSelectSuite more stable

2016-07-21 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.0 933d76a22 -> cd41e6a33 [SPARK-16656][SQL] Try to make CreateTableAsSelectSuite more stable ## What changes were proposed in this pull request?

spark git commit: [SPARK-16194] Mesos Driver env vars

2016-07-21 Thread srowen
Repository: spark Updated Branches: refs/heads/master 69626addd -> 235cb256d [SPARK-16194] Mesos Driver env vars ## What changes were proposed in this pull request? Added new configuration namespace: spark.mesos.env.* This allows a user submitting a job in cluster mode to set arbitrary

spark git commit: [SPARK-16632][SQL] Revert PR #14272: Respect Hive schema when merging parquet schema

2016-07-21 Thread lian
Repository: spark Updated Branches: refs/heads/branch-2.0 f9367d6a0 -> 933d76a22 [SPARK-16632][SQL] Revert PR #14272: Respect Hive schema when merging parquet schema ## What changes were proposed in this pull request? PR #14278 is a more general and simpler fix for SPARK-16632 than PR

spark git commit: [SPARK-16632][SQL] Revert PR #14272: Respect Hive schema when merging parquet schema

2016-07-21 Thread lian
Repository: spark Updated Branches: refs/heads/master 6203668d5 -> 69626addd [SPARK-16632][SQL] Revert PR #14272: Respect Hive schema when merging parquet schema ## What changes were proposed in this pull request? PR #14278 is a more general and simpler fix for SPARK-16632 than PR #14272.

spark git commit: [SPARK-16640][SQL] Add codegen for Elt function

2016-07-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 8674054d3 -> 6203668d5 [SPARK-16640][SQL] Add codegen for Elt function ## What changes were proposed in this pull request? Elt function doesn't support codegen execution now. We should add the support. ## How was this patch tested?

spark git commit: [SPARK-16632][SQL] Use Spark requested schema to guide vectorized Parquet reader initialization

2016-07-21 Thread lian
Repository: spark Updated Branches: refs/heads/branch-2.0 c2b4228d7 -> f9367d6a0 [SPARK-16632][SQL] Use Spark requested schema to guide vectorized Parquet reader initialization In `SpecificParquetRecordReaderBase`, which is used by the vectorized Parquet reader, we convert the Parquet

spark git commit: [SPARK-16632][SQL] Use Spark requested schema to guide vectorized Parquet reader initialization

2016-07-21 Thread lian
Repository: spark Updated Branches: refs/heads/master 864b764ea -> 8674054d3 [SPARK-16632][SQL] Use Spark requested schema to guide vectorized Parquet reader initialization ## What changes were proposed in this pull request? In `SpecificParquetRecordReaderBase`, which is used by the

spark git commit: [SPARK-16226][SQL] Weaken JDBC isolation level to avoid locking when writing partitions

2016-07-21 Thread srowen
Repository: spark Updated Branches: refs/heads/master 1bf13ba3a -> 864b764ea [SPARK-16226][SQL] Weaken JDBC isolation level to avoid locking when writing partitions ## What changes were proposed in this pull request? Saving partitions to JDBC in transaction can use a weaker transaction

spark git commit: [MINOR][DOCS][STREAMING] Minor docfix schema of csv rather than parquet in comments

2016-07-21 Thread srowen
Repository: spark Updated Branches: refs/heads/master cfa5ae84e -> 1bf13ba3a [MINOR][DOCS][STREAMING] Minor docfix schema of csv rather than parquet in comments ## What changes were proposed in this pull request? Fix parquet to csv in a comment to match the input format being read. ## How

spark git commit: [MINOR][DOCS][STREAMING] Minor docfix schema of csv rather than parquet in comments

2016-07-21 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 a804c9260 -> c2b4228d7 [MINOR][DOCS][STREAMING] Minor docfix schema of csv rather than parquet in comments ## What changes were proposed in this pull request? Fix parquet to csv in a comment to match the input format being read. ##