svn commit: r36656 - /release/spark/KEYS

2019-11-06 Thread lian
Author: lian Date: Wed Nov 6 23:21:34 2019 New Revision: 36656 Log: Update KEYS Modified: release/spark/KEYS Modified: release/spark/KEYS == --- release/spark/KEYS (original) +++ release/spark/KEYS Wed Nov 6 23:21

svn commit: r36655 - /dev/spark/v3.0.0-preview-rc2-bin/ /release/spark/spark-3.0.0-preview/

2019-11-06 Thread lian
Author: lian Date: Wed Nov 6 23:15:10 2019 New Revision: 36655 Log: Move 3.0.0-preview artifacts to the release folder Added: release/spark/spark-3.0.0-preview/ - copied from r36654, dev/spark/v3.0.0-preview-rc2-bin/ Removed: dev/spark/v3.0.0-preview-rc2-bin

spark git commit: [SPARK-22951][SQL] fix aggregation after dropDuplicates on empty data frames

2018-01-10 Thread lian
pos/asf/spark/diff/9b33dfc4 Branch: refs/heads/master Commit: 9b33dfc408de986f4203bb0ac0c3f5c56effd69d Parents: 344e3aa Author: Feng Liu <feng...@databricks.com> Authored: Wed Jan 10 14:25:04 2018 -0800 Committer: Cheng Lian <lian.cs@gmail.co

spark git commit: [SPARK-22951][SQL] fix aggregation after dropDuplicates on empty data frames

2018-01-10 Thread lian
;feng...@databricks.com> Closes #20174 from liufengdb/fix-duplicate. (cherry picked from commit 9b33dfc408de986f4203bb0ac0c3f5c56effd69d) Signed-off-by: Cheng Lian <lian.cs@gmail.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/a

spark git commit: [SPARK-17528][SQL][FOLLOWUP] remove unnecessary data copy in object hash aggregate

2017-07-24 Thread lian
iff: http://git-wip-us.apache.org/repos/asf/spark/diff/86664338 Branch: refs/heads/master Commit: 86664338f25f58b2f59db93b68cd57de671a4c0b Parents: 481f079 Author: Wenchen Fan <wenc...@databricks.com> Authored: Mon Jul 24 10:18:28 2017 -0700 Committer: Cheng Lian <l...@databricks.com> Com

spark git commit: [SPARK-20132][DOCS] Add documentation for column string functions

2017-05-05 Thread lian
//git-wip-us.apache.org/repos/asf/spark/diff/f59c74a9 Branch: refs/heads/branch-2.2 Commit: f59c74a9460b0db4e6c3ecbe872e2eaadc43e2cc Parents: 24fffac Author: Michael Patterson <map...@gmail.com> Authored: Sat Apr 22 19:58:54 2017 -0700 Committer: Cheng Lian <l...@databricks.com> Committed: Fr

spark git commit: [SPARK-19716][SQL] support by-name resolution for struct type elements in array

2017-04-04 Thread lian
org/repos/asf/spark/tree/295747e5 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/295747e5 Branch: refs/heads/master Commit: 295747e59739ee8a697ac3eba485d3439e4a04c3 Parents: 402bf2a Author: Wenchen Fan <wenc...@databricks.com> Authored: Tue Apr 4 16:38:32 2017 -0700 Committer

spark git commit: [SPARK-20125][SQL] Dataset of type option of map does not work

2017-03-28 Thread lian
ype` is too strict about this, this PR fixes it. new regression test Author: Wenchen Fan <wenc...@databricks.com> Closes #17454 from cloud-fan/map. (cherry picked from commit d4fac410e0554b7ccd44be44b7ce2fe07ed7f206) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wi

spark git commit: [SPARK-20125][SQL] Dataset of type option of map does not work

2017-03-28 Thread lian
Fan <wenc...@databricks.com> Authored: Tue Mar 28 11:47:43 2017 -0700 Committer: Cheng Lian <l...@databricks.com> Committed: Tue Mar 28 11:47:43 2017 -0700 -- .../src/main/scala/org/apache/spark/sql/types

spark git commit: [SPARK-19737][SQL] New analysis rule for reporting unregistered functions without relying on relation resolution

2017-03-06 Thread lian
ich may incur potentially expensive partition/schema discovery cost. Please refer to [SPARK-19737][1] for more details about the motivation. ## How was this patch tested? New test case added in `AnalysisErrorSuite`. [1]: https://issues.apache.org/jira/browse/SPARK-19737 Author: Cheng Lian

spark git commit: [SPARK-19529] TransportClientFactory.createClient() shouldn't call awaitUninterruptibly()

2017-02-13 Thread lian
cted to complete near instantaneously, so the impact of uninterruptibility there is much smaller. Manually. Author: Josh Rosen <joshro...@databricks.com> Closes #16866 from JoshRosen/SPARK-19529. (cherry picked from commit 1c4d10b10c78d138b55e381ec6828e04fef70d6f) Signed-off-by: Cheng Lia

spark git commit: [SPARK-19529] TransportClientFactory.createClient() shouldn't call awaitUninterruptibly()

2017-02-13 Thread lian
cted to complete near instantaneously, so the impact of uninterruptibility there is much smaller. Manually. Author: Josh Rosen <joshro...@databricks.com> Closes #16866 from JoshRosen/SPARK-19529. (cherry picked from commit 1c4d10b10c78d138b55e381ec6828e04fef70d6f) Signed-off-by: Cheng Lia

spark git commit: [SPARK-19529] TransportClientFactory.createClient() shouldn't call awaitUninterruptibly()

2017-02-13 Thread lian
5e381ec6828e04fef70d6f Parents: ab88b24 Author: Josh Rosen <joshro...@databricks.com> Authored: Mon Feb 13 11:04:27 2017 -0800 Committer: Cheng Lian <l...@databricks.com> Committed: Mon Feb 13 11:04:27 2017 -0800

spark git commit: [SPARK-18717][SQL] Make code generation for Scala Map work with immutable.Map also

2017-02-10 Thread lian
y/fix-map-codegen. (cherry picked from commit 46d30ac4846b3ec94426cc482c42cff72ebd6d92) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e580bb03 Tree: http://git-wip-us.apach

spark git commit: [SPARK-19016][SQL][DOC] Document scalable partition handling

2016-12-30 Thread lian
ion guide. It's not super clear that external datasource tables require an extra `MSCK REPAIR TABLE` command is to have per-partition information persisted since 2.1. N/A. Author: Cheng Lian <l...@databricks.com> Closes #16424 from liancheng/scalable-partition-handling-doc. (cherry pi

spark git commit: [SPARK-19016][SQL][DOC] Document scalable partition handling

2016-12-30 Thread lian
ide. Before this PR, we only mention it in the migration guide. It's not super clear that external datasource tables require an extra `MSCK REPAIR TABLE` command is to have per-partition information persisted since 2.1. ## How was this patch tested? N/A. Author: Cheng Lian <l...@databricks.com>

spark git commit: [SPARK-18753][SQL] Keep pushed-down null literal as a filter in Spark-side post-filter for FileFormat datasources

2016-12-14 Thread lian
` Author: hyukjinkwon <gurwls...@gmail.com> Closes #16184 from HyukjinKwon/SPARK-18753. (cherry picked from commit 89ae26dcdb73266fbc3a8b6da9f5dff30dc4ec95) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/co

spark git commit: [SPARK-18753][SQL] Keep pushed-down null literal as a filter in Spark-side post-filter for FileFormat datasources

2016-12-14 Thread lian
asf/spark/diff/89ae26dc Branch: refs/heads/master Commit: 89ae26dcdb73266fbc3a8b6da9f5dff30dc4ec95 Parents: 169b9d7 Author: hyukjinkwon <gurwls...@gmail.com> Authored: Wed Dec 14 11:29:11 2016 -0800 Committer: Cheng Lian <l...@databricks.com> Committed: Wed Dec 14 11:29:11 2016 -0800

spark git commit: [SPARK-18251][SQL] the type of Dataset can't be Option of non-flat type

2016-11-30 Thread lian
om commit f135b70fd590438bebb2a54012a6f73074219758) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9e96ac5a Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/9e96ac5a Diff:

spark git commit: [SPARK-18251][SQL] the type of Dataset can't be Option of non-flat type

2016-11-30 Thread lian
074219758 Parents: 60022bf Author: Wenchen Fan <wenc...@databricks.com> Authored: Wed Nov 30 13:36:17 2016 -0800 Committer: Cheng Lian <l...@databricks.com> Committed: Wed Nov 30 13:36:17 2016 -0800 -- .../apac

spark git commit: [SPARK-18012][SQL] Simplify WriterContainer

2016-10-19 Thread lian
/f313117b Branch: refs/heads/master Commit: f313117bc93b0bf560528b316d3e6947caa96296 Parents: 4b2011e Author: Reynold Xin <r...@databricks.com> Authored: Wed Oct 19 22:22:35 2016 -0700 Committer: Cheng Lian <l...@databricks.com> Committed: Wed Oct 1

spark git commit: [SPARK-16516][SQL] Support for pushing down filters for decimal and timestamp types in ORC

2016-09-27 Thread lian
org/repos/asf/spark/tree/2cac3b2d Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2cac3b2d Branch: refs/heads/master Commit: 2cac3b2d4a4a4f3d0d45af4defc23bb0ba53484b Parents: 5de1737 Author: hyukjinkwon <gurwls...@gmail.com> Authored: Wed Sep 28 00:50:12 2016 +0800 Committer

spark git commit: [SPARK-16777][SQL] Do not use deprecated listType API in ParquetSchemaConverter

2016-09-27 Thread lian
//git-wip-us.apache.org/repos/asf/spark/diff/5de1737b Branch: refs/heads/master Commit: 5de1737b02710e36f6804d2ae243d1aeb30a0b32 Parents: 6a68c5d Author: hyukjinkwon <gurwls...@gmail.com> Authored: Wed Sep 28 00:39:47 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Wed Sep 2

spark git commit: [SQL][MINOR] correct the comment of SortBasedAggregationIterator.safeProj

2016-09-22 Thread lian
org/repos/asf/spark/tree/8a02410a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/8a02410a Branch: refs/heads/master Commit: 8a02410a92429bff50d6ce082f873cea9e9fa91e Parents: 72d9fba Author: Wenchen Fan <wenc...@databricks.com> Authored: Thu Sep 22 23:25:32 2016 +0800 Committer

spark git commit: [SPARK-17289][SQL] Fix a bug to satisfy sort requirements in partial aggregations

2016-08-30 Thread lian
park/diff/94922d79 Branch: refs/heads/master Commit: 94922d79e9f90fac3777db0974ccf7566b8ac3b3 Parents: 8fb445d Author: Takeshi YAMAMURO <linguin@gmail.com> Authored: Tue Aug 30 16:43:47 2016 +0800 Committer: Cheng Lian <l

spark git commit: [SPARK-16975][SQL] Column-partition path starting '_' should be handled correctly

2016-08-12 Thread lian
ot;_locality_code").save("/tmp/parquet") scala> spark.read.parquet("/tmp/parquet") res2: org.apache.spark.sql.DataFrame = [id: bigint, _locality_code: int] ``` Pass the Jenkins with a new test case. Author: Dongjoon Hyun <dongj...@apache.org> Closes #14585 from dongjoon-hyu

spark git commit: [SPARK-16975][SQL] Column-partition path starting '_' should be handled correctly

2016-08-12 Thread lian
sf/spark/tree/abff92bf Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/abff92bf Branch: refs/heads/master Commit: abff92bfdc7d4c9d2308794f0350561fe0ceb4dd Parents: ccc6dc0 Author: Dongjoon Hyun <dongj...@apache.org> Authored: Fri Aug 12 14:40:12 2016 +0800 Committer: Cheng Lian <l...@databricks.com&g

spark git commit: [SPARK-16867][SQL] createTable and alterTable in ExternalCatalog should not take db

2016-08-04 Thread lian
+0800 Committer: Cheng Lian <l...@databricks.com> Committed: Thu Aug 4 16:48:30 2016 +0800 -- .../sql/catalyst/catalog/ExternalCatalog.scala | 9 + .../sql/catalyst/catalog/InMemoryCatalog.scala | 7 +-- ...

spark git commit: [MINOR][SQL] Fix minor formatting issue of SortAggregateExec.toString

2016-08-03 Thread lian
How was this patch tested? Manually tested. Author: Cheng Lian <l...@databricks.com> Closes #14480 from liancheng/fix-sort-based-agg-string-format. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/780c7224 Tree: http:

spark git commit: [SQL][MINOR] use stricter type parameter to make it clear that parquet reader returns UnsafeRow

2016-08-02 Thread lian
pache.org/repos/asf/spark/tree/ae226283 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ae226283 Branch: refs/heads/master Commit: ae226283e19ce396216c73b0ae2470efa122b65b Parents: 3861273 Author: Wenchen Fan <wenc...@databricks.com> Authored: Wed Aug 3 08:23:26 2016 +0800 Committer

[2/2] spark git commit: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-26 Thread lian
dongj...@apache.org> Authored: Wed Jul 27 13:23:59 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Wed Jul 27 13:23:59 2016 +0800 -- .../apache/spark/sql/catalyst/SQLBuilder.scala | 23 +++-

[1/2] spark git commit: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-26 Thread lian
Repository: spark Updated Branches: refs/heads/master 738b4cc54 -> 5b8e848bb http://git-wip-us.apache.org/repos/asf/spark/blob/5b8e848b/sql/hive/src/test/resources/sqlgen/rollup_cube_4_2.sql -- diff --git

spark git commit: [SPARK-16663][SQL] desc table should be consistent between data source and hive serde tables

2016-07-26 Thread lian
park/tree/a2abb583 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/a2abb583 Branch: refs/heads/master Commit: a2abb583caaec9a2cecd5d65b05d172fc096c125 Parents: 4c96955 Author: Wenchen Fan <wenc...@databricks.com> Authored: Tue Jul 26 18:46:12 2016 +0800 Committer: Cheng Lian <l

spark git commit: [SPARK-16706][SQL] support java map in encoder

2016-07-26 Thread lian
org/repos/asf/spark/tree/6959061f Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/6959061f Branch: refs/heads/master Commit: 6959061f02b02afd4cef683b5eea0b7097eedee7 Parents: 7b06a89 Author: Wenchen Fan <wenc...@databricks.com> Authored: Tue Jul 26 15:33:05 2016 +0800 Committer

spark git commit: [SPARK-16698][SQL] Field names having dots should be allowed for datasources based on FileFormat

2016-07-25 Thread lian
ve '```a.b```' given input columns: [`a.b`]; at org.apache.spark.sql.catalyst.analysis.package$AnalysisErrorAt.failAnalysis(package.scala:42) ``` ## How was this patch tested? Unit tests in `FileSourceStrategySuite`. Author: hyukjinkwon <gurwls...@gmail.com> Closes #14339

spark git commit: [SPARK-16698][SQL] Field names having dots should be allowed for datasources based on FileFormat

2016-07-25 Thread lian
refs/heads/master Commit: 79826f3c7936ee27457d030c7115d5cac69befd7 Parents: d6a5217 Author: hyukjinkwon <gurwls...@gmail.com> Authored: Mon Jul 25 22:51:30 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Mon Jul 25 22:51:30 2016 +0800 -

spark git commit: [SPARK-16668][TEST] Test parquet reader for row groups containing both dictionary and plain encoded pages

2016-07-25 Thread lian
Jul 25 22:31:01 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Mon Jul 25 22:31:01 2016 +0800 -- .../parquet/ParquetEncodingSuite.scala | 29 1 file c

spark git commit: [SPARK-16691][SQL] move BucketSpec to catalyst module and use it in CatalogTable

2016-07-25 Thread lian
tabricks.com> Authored: Mon Jul 25 22:05:48 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Mon Jul 25 22:05:48 2016 +0800 -- .../spark/sql/catalyst/catalog/interface.scala | 49

spark git commit: [SPARK-16660][SQL] CreateViewCommand should not take CatalogTable

2016-07-25 Thread lian
pache.org/repos/asf/spark/diff/d27d362e Branch: refs/heads/master Commit: d27d362ebae0c4a5cc6c99f13ef20049214dd4f9 Parents: 7ffd99e Author: Wenchen Fan <wenc...@databricks.com> Authored: Mon Jul 25 22:02:00 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Mon Jul 2

spark git commit: [SPARK-16632][SQL] Revert PR #14272: Respect Hive schema when merging parquet schema

2016-07-21 Thread lian
PR #14272. After merging #14278, we no longer need changes made in #14272. So here I revert them. This PR targets both master and branch-2.0. ## How was this patch tested? Existing tests. Author: Cheng Lian <l...@databricks.com> Closes #14300 from liancheng/revert-pr-14272. (cherry pi

spark git commit: [SPARK-16632][SQL] Revert PR #14272: Respect Hive schema when merging parquet schema

2016-07-21 Thread lian
272. After merging #14278, we no longer need changes made in #14272. So here I revert them. This PR targets both master and branch-2.0. ## How was this patch tested? Existing tests. Author: Cheng Lian <l...@databricks.com> Closes #14300 from liancheng/revert-pr-14272. Project: http:

spark git commit: [SPARK-16632][SQL] Use Spark requested schema to guide vectorized Parquet reader initialization

2016-07-21 Thread lian
sql/execution/datasources/parquet/ParquetFileFormat.scala#L292-L294 Author: Cheng Lian <l...@databricks.com> Closes #14278 from liancheng/spark-16632-simpler-fix. (cherry picked from commit 8674054d3402b400a4766fe1c9214001cebf2106) Signed-off-by: Cheng Lian <l...@databricks.com>

spark git commit: [SPARK-16632][SQL] Use Spark requested schema to guide vectorized Parquet reader initialization

2016-07-21 Thread lian
tps://github.com/apache/spark/blob/v2.0.0-rc5/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala#L292-L294 Author: Cheng Lian <l...@databricks.com> Closes #14278 from liancheng/spark-16632-simpler-fix. Project: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-16632][SQL] Respect Hive schema when merging parquet schema.

2016-07-19 Thread lian
nce. Tested with unit tests and with tests that create byte / short columns in Hive and try to read them from Spark. Author: Marcelo Vanzin <van...@cloudera.com> Closes #14272 from vanzin/SPARK-16632. (cherry picked from commit 75146be6ba5e9f559f5f15430310bb476ee0812c) Signed-off-by: Chen

spark git commit: [SPARK-16632][SQL] Respect Hive schema when merging parquet schema.

2016-07-19 Thread lian
om> Authored: Wed Jul 20 13:00:22 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Wed Jul 20 13:00:22 2016 +0800 -- .../parquet/ParquetReadSupport.scala| 18 + .../parquet/Par

spark git commit: [SPARK-16529][SQL][TEST] `withTempDatabase` should set `default` database before dropping

2016-07-14 Thread lian
;dongj...@apache.org> Closes #14184 from dongjoon-hyun/SPARK-16529. (cherry picked from commit c576f9fb90853cce2e8e5dcc32a536a0f49cbbd8) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/a

spark git commit: [SPARK-16529][SQL][TEST] `withTempDatabase` should set `default` database before dropping

2016-07-14 Thread lian
s/asf/spark/diff/c576f9fb Branch: refs/heads/master Commit: c576f9fb90853cce2e8e5dcc32a536a0f49cbbd8 Parents: 12005c8 Author: Dongjoon Hyun <dongj...@apache.org> Authored: Fri Jul 15 00:51:11 2016 +0800 Committer: Cheng Lian <l...@databrick

spark git commit: [SPARK-16448] RemoveAliasOnlyProject should not remove alias with metadata

2016-07-14 Thread lian
/db7317ac Branch: refs/heads/master Commit: db7317ac3c2fd2a11088d10060f168178dc99664 Parents: 39c836e Author: Wenchen Fan <wenc...@databricks.com> Authored: Thu Jul 14 15:48:22 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Thu Jul 1

spark git commit: [SPARK-16343][SQL] Improve the PushDownPredicate rule to pushdown predicates correctly in non-deterministic condition.

2016-07-13 Thread lian
pache.org/repos/asf/spark/diff/f376c372 Branch: refs/heads/master Commit: f376c37268848dbb4b2fb57677e22ef2bf207b49 Parents: ea06e4e Author: 蒋星博 <jiangxin...@meituan.com> Authored: Thu Jul 14 00:21:27 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Thu

spark git commit: [SPARK-16303][DOCS][EXAMPLES] Updated SQL programming guide and examples

2016-07-13 Thread lian
606-462a-11e6-9fbe-0818daef65e4.png) Author: aokolnychyi <okolnychyyan...@gmail.com> Closes #14119 from aokolnychyi/spark_16303. (cherry picked from commit 772c213ec702c80d0f25aa6f30b2dffebfbe2d0d) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/

spark git commit: [SPARK-16303][DOCS][EXAMPLES] Updated SQL programming guide and examples

2016-07-13 Thread lian
repos/asf/spark/tree/772c213e Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/772c213e Branch: refs/heads/master Commit: 772c213ec702c80d0f25aa6f30b2dffebfbe2d0d Parents: 1c58fa9 Author: aokolnychyi <okolnychyyan...@gmail.com> Authored: Wed Jul 13 16:12:05 2016 +0800 Committer

spark git commit: [SPARK-16381][SQL][SPARKR] Update SQL examples and programming guide for R language binding

2016-07-11 Thread lian
om commit 9cb1eb7af779e74165552977002158a7dad9bb09) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7e4ba66d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/7e4ba66d Diff: http://git-wip-us.apache.org/

spark git commit: [SPARK-16381][SQL][SPARKR] Update SQL examples and programming guide for R language binding

2016-07-11 Thread lian
: Xin Ren <iamsh...@126.com> Authored: Mon Jul 11 20:05:28 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Mon Jul 11 20:05:28 2016 +0800 -- docs/sql-programming-guide.md | 155 ++-

spark git commit: [SPARK-16388][SQL] Remove spark.sql.nativeView and spark.sql.nativeView.canonical config

2016-07-06 Thread lian
er Commit: 7e28fabdff2da1cc374efbf43372d92ae0cd07aa Parents: 5497242 Author: Reynold Xin <r...@databricks.com> Authored: Wed Jul 6 17:40:55 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Wed Jul

spark git commit: [SPARK-9876][SQL][FOLLOWUP] Enable string and binary tests for Parquet predicate pushdown and replace deprecated fromByteArray.

2016-07-05 Thread lian
2 Branch: refs/heads/master Commit: 07d9c5327f050f9da611d5239f61ed73b36ce4e6 Parents: 7f7eb39 Author: hyukjinkwon <gurwls...@gmail.com> Authored: Tue Jul 5 16:59:40 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Tue Jul

spark git commit: [SPARK-16360][SQL] Speed up SQL query performance by removing redundant `executePlan` call

2016-07-05 Thread lian
742d9f Author: Dongjoon Hyun <dongj...@apache.org> Authored: Tue Jul 5 16:19:22 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Tue Jul 5 16:19:22 2016 +0800 --

spark git commit: [SPARK-15198][SQL] Support for pushing down filters for boolean types in ORC data source

2016-07-05 Thread lian
er Commit: 7742d9f1584150befeb2f3d76cdbd4ea1f37c914 Parents: 8f6cf00 Author: hyukjinkwon <gurwls...@gmail.com> Authored: Tue Jul 5 13:59:13 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Tue Jul 5 13:59:13 2016 +0800 -- .

spark git commit: [SPARK-16208][SQL] Add `PropagateEmptyRelation` optimizer

2016-07-01 Thread lian
Hyun <dongj...@apache.org> Authored: Fri Jul 1 22:13:56 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Fri Jul 1 22:13:56 2016 +0800 -- .../sql/catalyst/optimizer/Optimizer.scala | 3 +-

spark git commit: [SPARK-15820][PYSPARK][SQL] Add Catalog.refreshTable into python API

2016-06-30 Thread lian
tch tested? Existing test. Author: WeichenXu <weichenxu...@outlook.com> Closes #13558 from WeichenXu123/update_python_sql_interface_refreshTable. (cherry picked from commit 5344bade8efb6f12aa43fbfbbbc2e3c0c7d16d98) Signed-off-by: Cheng Lian <l...@databricks.com> Project:

spark git commit: [SPARK-15820][PYSPARK][SQL] Add Catalog.refreshTable into python API

2016-06-30 Thread lian
//git-wip-us.apache.org/repos/asf/spark/tree/5344bade Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/5344bade Branch: refs/heads/master Commit: 5344bade8efb6f12aa43fbfbbbc2e3c0c7d16d98 Parents: 5320adc Author: WeichenXu <weichenxu...@outlook.com> Authored: Thu Jun 30 23:00:39 2016 +0800 Commit

spark git commit: [BUILD] Fix version in poms related to kafka-0-10

2016-06-30 Thread lian
3 Parents: 56207fc Author: Tathagata Das <tathagata.das1...@gmail.com> Authored: Thu Jun 30 22:10:56 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Thu Jun 30 22:10:56 2016 +0800 -- external/kafka-0-10

spark git commit: [SPARK-12177][TEST] Removed test to avoid compilation issue in scala 2.10

2016-06-30 Thread lian
fix broken build. Correct solution is pending. Author: Tathagata Das <tathagata.das1...@gmail.com> Closes #13992 from tdas/SPARK-12177. (cherry picked from commit de8ab313e1fe59f849a62e59349224581ff0b40a) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apach

spark git commit: [SPARK-12177][TEST] Removed test to avoid compilation issue in scala 2.10

2016-06-30 Thread lian
org/repos/asf/spark/tree/de8ab313 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/de8ab313 Branch: refs/heads/master Commit: de8ab313e1fe59f849a62e59349224581ff0b40a Parents: b30a2dc Author: Tathagata Das <tathagata.das1...@gmail.com> Authored: Thu Jun 30 18:06:04 2016 +0800 Committer

spark git commit: Revert "[SPARK-16134][SQL] optimizer rules for typed filter"

2016-06-29 Thread lian
ttp://git-wip-us.apache.org/repos/asf/spark/commit/e1bdf1e0 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e1bdf1e0 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e1bdf1e0 Branch: refs/heads/branch-2.0 Commit: e1bdf1e02483bf513b6e012e8921d440a5efbc11 Parents: 8da4314 Author:

spark git commit: [SPARK-16134][SQL] optimizer rules for typed filter

2016-06-29 Thread lian
cked from commit d063898bebaaf4ec2aad24c3ac70aabdbf97a190) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8da43147 Tree: http://git-wip-us.apache.org/repos/asf/spark/tre

spark git commit: [SPARK-16134][SQL] optimizer rules for typed filter

2016-06-29 Thread lian
er Commit: d063898bebaaf4ec2aad24c3ac70aabdbf97a190 Parents: 2eaabfa Author: Wenchen Fan <wenc...@databricks.com> Authored: Thu Jun 30 08:15:08 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Thu Jun 30 08:15:08 2016 +0800 --

spark git commit: [SPARK-16100][SQL] fix bug when use Map as the buffer type of Aggregator

2016-06-28 Thread lian
ry picked from commit 8a977b065418f07d2bf4fe1607a5534c32d04c47) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d73c38ed Tree: http://git-wip-us.apache.org/repos/asf/spark/tre

spark git commit: [SPARK-16100][SQL] fix bug when use Map as the buffer type of Aggregator

2016-06-28 Thread lian
er Commit: 8a977b065418f07d2bf4fe1607a5534c32d04c47 Parents: 25520e9 Author: Wenchen Fan <wenc...@databricks.com> Authored: Wed Jun 29 06:39:28 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Wed Jun 29 06:39:28 2016 +0800 -- ...

spark git commit: [SPARK-16221][SQL] Redirect Parquet JUL logger via SLF4J for WRITE operations

2016-06-27 Thread lian
Branch: refs/heads/master Commit: a0da854fb3748aca0128377f0955600cb7a2b5bc Parents: 50fdd86 Author: Dongjoon Hyun <dongj...@apache.org> Authored: Tue Jun 28 13:01:18 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Tue Jun 28 13:01:18 2016 +0800 ---

spark git commit: [SPARK-10591][SQL][TEST] Add a testcase to ensure if `checkAnswer` handles map correctly

2016-06-27 Thread lian
ype correctly. ## How was this patch tested? Pass the jenkins tests. Author: Dongjoon Hyun <dongj...@apache.org> Closes #13913 from dongjoon-hyun/SPARK-10591. (cherry picked from commit 11f420b4bbcd607346204fb6fd7db7efe948cdac) Signed-off-by: Cheng Lian <l...@databricks.com> Proj

spark git commit: [SPARK-10591][SQL][TEST] Add a testcase to ensure if `checkAnswer` handles map correctly

2016-06-27 Thread lian
4:50 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Mon Jun 27 19:04:50 2016 +0800 -- .../src/test/scala/org/apache/spark/sql/DatasetSuite.scala| 7 +++ 1 file

spark git commit: [SPARK-16165][SQL] Fix the update logic for InMemoryTableScanExec.readBatches

2016-06-23 Thread lian
yun <dongj...@apache.org> Closes #13870 from dongjoon-hyun/SPARK-16165. (cherry picked from commit 264bc63623b20529abcf84abcb333e7c16ad1ef9) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/

spark git commit: [SPARK-16165][SQL] Fix the update logic for InMemoryTableScanExec.readBatches

2016-06-23 Thread lian
org/repos/asf/spark/diff/264bc636 Branch: refs/heads/master Commit: 264bc63623b20529abcf84abcb333e7c16ad1ef9 Parents: 0e4bdeb Author: Dongjoon Hyun <dongj...@apache.org> Authored: Fri Jun 24 07:19:20 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Fri Jun 2

spark git commit: [SPARK-16097][SQL] Encoders.tuple should handle null object correctly

2016-06-22 Thread lian
om commit 01277d4b259dcf9cad25eece1377162b7a8c946d) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/503eb882 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/503eb882 Diff: http://git-wi

spark git commit: [SPARK-16097][SQL] Encoders.tuple should handle null object correctly

2016-06-22 Thread lian
: 39ad53f Author: Wenchen Fan <wenc...@databricks.com> Authored: Wed Jun 22 18:32:14 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Wed Jun 22 18:32:14 2016 +0800 -- .../catalyst/encoders/Expressio

spark git commit: [SPARK-16121] ListingFileCatalog does not list in parallel anymore

2016-06-22 Thread lian
xes the problem ## How was this patch tested? Tested manually. (This PR also adds a proper test for SPARK-14959) Author: Yin Huai <yh...@databricks.com> Closes #13830 from yhuai/SPARK-16121. (cherry picked from commit 39ad53f7ffddae5ba0ff0a76089ba671b14c44c8) Signed-off-by: Chen

spark git commit: [SPARK-16121] ListingFileCatalog does not list in parallel anymore

2016-06-22 Thread lian
ed Jun 22 18:07:07 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Wed Jun 22 18:07:07 2016 +0800 -- .../datasources/ListingFileCatalog.scala| 58 ++-- .../datasources/fileS

spark git commit: [SQL][DOC] SQL programming guide add deprecated methods in 2.0.0

2016-06-21 Thread lian
ung <felixcheun...@hotmail.com> Closes #13827 from felixcheung/sqldocdeprecate. (cherry picked from commit 79aa1d82ca56eb847cbf4ff81de0564b339988f6) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/

spark git commit: [SQL][DOC] SQL programming guide add deprecated methods in 2.0.0

2016-06-21 Thread lian
org/repos/asf/spark/diff/79aa1d82 Branch: refs/heads/master Commit: 79aa1d82ca56eb847cbf4ff81de0564b339988f6 Parents: 9493b07 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Wed Jun 22 10:37:13 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Wed Jun 2

spark git commit: [SPARK-15894][SQL][DOC] Update docs for controlling #partitions

2016-06-21 Thread lian
Jun 21 14:27:16 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Tue Jun 21 14:27:16 2016 +0800 -- docs/sql-programming-guide.md | 17 + 1 file c

spark git commit: [SPARK-15894][SQL][DOC] Update docs for controlling #partitions

2016-06-21 Thread lian
tes` and `spark.sql.files.openCostInBytes ` in Other Configuration Options. ## How was this patch tested? N/A Author: Takeshi YAMAMURO <linguin@gmail.com> Closes #13797 from maropu/SPARK-15894-2. (cherry picked from commit 41e0ffb19f678e9b1e87f747a5e4e3d44964e39a) Signed-off-by: Cheng Lian <l...@databricks.co

spark git commit: [SPARK-15863][SQL][DOC][SPARKR] sql programming guide updates to include sparkSession in R

2016-06-20 Thread lian
tch tested? manual shivaram liancheng Author: Felix Cheung <felixcheun...@hotmail.com> Closes #13799 from felixcheung/rsqlprogrammingguide. (cherry picked from commit 58f6e27dd70f476f99ac8204e6b405bced4d6de1) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wi

spark git commit: [SPARK-15863][SQL][DOC][SPARKR] sql programming guide updates to include sparkSession in R

2016-06-20 Thread lian
pache.org/repos/asf/spark/tree/58f6e27d Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/58f6e27d Branch: refs/heads/master Commit: 58f6e27dd70f476f99ac8204e6b405bced4d6de1 Parents: 0736753 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Tue Jun 21 13:56:37 2016 +0800 Commit

spark git commit: [SPARK-16030][SQL] Allow specifying static partitions when inserting to data source tables

2016-06-20 Thread lian
ks.com> Closes #13769 from yhuai/SPARK-16030-1. (cherry picked from commit 905f774b71f4b814d5a2412c7c35bd023c3dfdf8) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0b0b5fe5 T

spark git commit: [SPARK-16030][SQL] Allow specifying static partitions when inserting to data source tables

2016-06-20 Thread lian
b Branch: refs/heads/master Commit: 905f774b71f4b814d5a2412c7c35bd023c3dfdf8 Parents: 6d0f921 Author: Yin Huai <yh...@databricks.com> Authored: Mon Jun 20 20:17:47 2016 +0800 Committer: Cheng Lian <l...@databricks.com> Committed: Mon Jun 2

spark git commit: [SPARK-15916][SQL] JDBC filter push down should respect operator precedence

2016-06-17 Thread lian
n 17 17:11:38 2016 -0700 Committer: Cheng Lian <l...@databricks.com> Committed: Fri Jun 17 17:11:38 2016 -0700 -- .../execution/datasources/jdbc/JDBCRDD.scala| 4 +-- .../org/apache/spark/sql/jdbc/JDBCSuite.scala

spark git commit: [SPARK-15916][SQL] JDBC filter push down should respect operator precedence

2016-06-17 Thread lian
d? Unit test. This PR also close #13640 Author: hyukjinkwon <gurwls...@gmail.com> Author: Sean Zhong <seanzh...@databricks.com> Closes #13743 from clockfly/SPARK-15916. (cherry picked from commit ebb9a3b6fd834e2c856a192b4455aab83e9c4dc8) Signed-off-by: Cheng Lian <l...@dat

spark git commit: [SPARK-15862][SQL] Better Error Message When Having Database Name in CACHE TABLE AS SELECT

2016-06-16 Thread lian
a1058561a) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/26359d27 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/26359d27 Diff: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-15862][SQL] Better Error Message When Having Database Name in CACHE TABLE AS SELECT

2016-06-16 Thread lian
atorsmile <gatorsm...@gmail.com> Authored: Thu Jun 16 10:01:59 2016 -0700 Committer: Cheng Lian <l...@databricks.com> Committed: Thu Jun 16 10:01:59 2016 -0700 -- .../apache/spark/sql/catalyst/parser/SqlBase.g4 | 4 +- .

spark git commit: [SPARK-15901][SQL][TEST] Verification of CONVERT_METASTORE_ORC and CONVERT_METASTORE_PARQUET

2016-06-15 Thread lian
il.com> Closes #13622 from gatorsmile/addTestCase4parquetOrcConversion. (cherry picked from commit 09925735b5e53db61ed12abae58864670a3a5f98) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/a

spark git commit: [SPARK-15901][SQL][TEST] Verification of CONVERT_METASTORE_ORC and CONVERT_METASTORE_PARQUET

2016-06-15 Thread lian
repos/asf/spark/diff/09925735 Branch: refs/heads/master Commit: 09925735b5e53db61ed12abae58864670a3a5f98 Parents: 4df8df5 Author: gatorsmile <gatorsm...@gmail.com> Authored: Wed Jun 15 14:08:55 2016 -0700 Committer: Cheng Lian <l...@databricks.com> Committed: Wed Jun 1

spark git commit: [SPARK-15929] Fix portability of DataFrameSuite path globbing tests

2016-06-13 Thread lian
ds/master Commit: a6babca1bf76e70488ce6005ec3b8b53afc7edfd Parents: ced8d66 Author: Josh Rosen <joshro...@databricks.com> Authored: Mon Jun 13 17:06:22 2016 -0700 Committer: Cheng Lian <l...@databricks.com> Committed: Mon Jun 1

spark git commit: [SPARK-15929] Fix portability of DataFrameSuite path globbing tests

2016-06-13 Thread lian
JoshRosen/SPARK-15929. (cherry picked from commit a6babca1bf76e70488ce6005ec3b8b53afc7edfd) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ab9a304a Tree: http://git-wi

spark git commit: Revert "[SPARK-15639][SQL] Try to push down filter at RowGroups level for parquet reader"

2016-06-10 Thread lian
ents: a08715c Author: Cheng Lian <l...@databricks.com> Authored: Fri Jun 10 20:45:27 2016 -0700 Committer: Cheng Lian <l...@databricks.com> Committed: Fri Jun 10 20:45:27 2016 -0700 -- .../catalyst/expressions/na

spark git commit: Revert "[SPARK-15639][SQL] Try to push down filter at RowGroups level for parquet reader"

2016-06-10 Thread lian
9f3c82 Author: Cheng Lian <l...@databricks.com> Authored: Fri Jun 10 20:41:48 2016 -0700 Committer: Cheng Lian <l...@databricks.com> Committed: Fri Jun 10 20:41:48 2016 -0700 -- .../catalyst/expressions/na

spark git commit: [SPARK-15884][SPARKR][SQL] Overriding stringArgs in MapPartitionsInR

2016-06-10 Thread lian
t;narine.kokhlik...@gmail.com> Closes #13610 from NarineK/dapply_MapPartitionsInR_stringArgs. (cherry picked from commit 54f758b5fc60ecb0da6b191939a72ef5829be38c) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wi

spark git commit: [SPARK-15884][SPARKR][SQL] Overriding stringArgs in MapPartitionsInR

2016-06-10 Thread lian
t-wip-us.apache.org/repos/asf/spark/diff/54f758b5 Branch: refs/heads/master Commit: 54f758b5fc60ecb0da6b191939a72ef5829be38c Parents: 2022afe Author: Narine Kokhlikyan <narine.kokhlik...@gmail.com> Authored: Fri Jun 10 17:17:47 2016 -0700 Committer: Cheng Lian <l...@databricks.com> Comm

spark git commit: [SPARK-15753][SQL] Move Analyzer stuff to Analyzer from DataFrameWriter

2016-06-10 Thread lian
zer`. ## How was this patch tested? Existing tests. Author: Liang-Chi Hsieh <sim...@tw.ibm.com> Closes #13496 from viirya/move-analyzer-stuff. (cherry picked from commit 0ec279ffdf92853965e327a9f0f6956cacb7a23e) Signed-off-by: Cheng Lian <l...@databricks.com> Project: http://git-wi

spark git commit: [SPARK-15753][SQL] Move Analyzer stuff to Analyzer from DataFrameWriter

2016-06-10 Thread lian
//git-wip-us.apache.org/repos/asf/spark/tree/0ec279ff Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/0ec279ff Branch: refs/heads/master Commit: 0ec279ffdf92853965e327a9f0f6956cacb7a23e Parents: abdb5d4 Author: Liang-Chi Hsieh <sim...@tw.ibm.com> Authored: Fri Jun 10 11:05:04 2016 -0700 Committer

spark git commit: [SPARK-15792][SQL] Allows operator to change the verbosity in explain output

2016-06-06 Thread lian
) +- LocalTableScan ``` ## How was this patch tested? Manual test. Author: Sean Zhong <seanzh...@databricks.com> Closes #13535 from clockfly/verbose_breakdown_2. (cherry picked from commit 5f731d6859c4516941e5f90c99c966ef76268864) Signed-off-by: Cheng Lian <l...@databric

  1   2   3   4   5   >