Repository: spark
Updated Branches:
refs/heads/master 5ada60614 -> e5d703bca
[SPARK-15706][SQL] Fix Wrong Answer when using IF NOT EXISTS in INSERT
OVERWRITE for DYNAMIC PARTITION
What changes were proposed in this pull request?
`IF NOT EXISTS` in `INSERT OVERWRITE` should not support
Repository: spark
Updated Branches:
refs/heads/branch-2.0 3994372f4 -> b82abde06
[SPARK-15706][SQL] Fix Wrong Answer when using IF NOT EXISTS in INSERT
OVERWRITE for DYNAMIC PARTITION
What changes were proposed in this pull request?
`IF NOT EXISTS` in `INSERT OVERWRITE` should not
Repository: spark
Updated Branches:
refs/heads/branch-2.0 f530331e6 -> 3994372f4
[SPARK-15822] [SQL] Prevent byte array backed classes from referencing freed
memory
## What changes were proposed in this pull request?
`UTF8String` and all `Unsafe*` classes are backed by either on-heap or
Repository: spark
Updated Branches:
refs/heads/master 513a03e41 -> 5ada60614
[SPARK-15822] [SQL] Prevent byte array backed classes from referencing freed
memory
## What changes were proposed in this pull request?
`UTF8String` and all `Unsafe*` classes are backed by either on-heap or off-heap
Repository: spark
Updated Branches:
refs/heads/master 5fd20b66f -> 513a03e41
[SPARK-15908][R] Add varargs-type dropDuplicates() function in SparkR
## What changes were proposed in this pull request?
This PR adds varargs-type `dropDuplicates` function to SparkR for API parity.
Refer to
Repository: spark
Updated Branches:
refs/heads/branch-2.0 feaba979b -> 2127f99f2
[SPARK-15490][R][DOC] SparkR 2.0 QA: New R APIs and API docs for non-MLib
changes
## What changes were proposed in this pull request?
R Docs changes
include typos, format, layout.
## How was this patch tested?
Repository: spark
Updated Branches:
refs/heads/master f1bf0d2f3 -> 63470afc9
[SPARK-15782][YARN] Fix spark.jars and spark.yarn.dist.jars handling
When `--packages` is specified with spark-shell the classes from those packages
cannot be found, which I think is due to some of the changes in
Repository: spark
Updated Branches:
refs/heads/branch-2.0 68e7a25cc -> feaba979b
[SPARK-15782][YARN] Fix spark.jars and spark.yarn.dist.jars handling
When `--packages` is specified with spark-shell the classes from those packages
cannot be found, which I think is due to some of the changes
Repository: spark
Updated Branches:
refs/heads/master 9040d83bc -> f1bf0d2f3
[SPARK-15966][DOC] Add closing tag to fix rendering issue for Spark monitoring
## What changes were proposed in this pull request?
Adds the missing closing tag for spark.ui.view.acls.groups
## How was this patch
Repository: spark
Updated Branches:
refs/heads/branch-2.0 8f7138859 -> b3678eb7e
[SPARK-15991] SparkContext.hadoopConfiguration should be always the base of
hadoop conf created by SessionState
## What changes were proposed in this pull request?
Before this patch, after a SparkSession has
Repository: spark
Updated Branches:
refs/heads/master 62d2fa5e9 -> d9c6628c4
[SPARK-15991] SparkContext.hadoopConfiguration should be always the base of
hadoop conf created by SessionState
## What changes were proposed in this pull request?
Before this patch, after a SparkSession has been
Repository: spark
Updated Branches:
refs/heads/branch-2.0 2280ad8a3 -> 8f7138859
[SPARK-15966][DOC] Add closing tag to fix rendering issue for Spark monitoring
## What changes were proposed in this pull request?
Adds the missing closing tag for spark.ui.view.acls.groups
## How was this patch
Repository: spark
Updated Branches:
refs/heads/branch-1.6 b8f380f79 -> 4621fe94b
Preparing Spark release v1.6.2-rc1
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4168d9c9
Tree:
Preparing development version 1.6.3-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4621fe94
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/4621fe94
Diff:
Repository: spark
Updated Tags: refs/tags/v1.6.2 [deleted] f16649304
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Preparing development version 1.6.3-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b8f380f7
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b8f380f7
Diff:
Repository: spark
Updated Tags: refs/tags/v1.6.2 [created] f16649304
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.6 0a8ada506 -> a4485c3b5
Update branch-1.6 for 1.6.2 release.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a4485c3b
Tree:
Modified: spark/site/news/spark-tips-from-quantifind.html
URL:
http://svn.apache.org/viewvc/spark/site/news/spark-tips-from-quantifind.html?rev=1748776=1748775=1748776=diff
==
---
Author: yhuai
Date: Thu Jun 16 22:14:05 2016
New Revision: 1748776
URL: http://svn.apache.org/viewvc?rev=1748776=rev
Log:
Add a new news for CFP of Spark Summit 2016 EU
Added:
spark/news/_posts/2016-06-16-submit-talks-to-spark-summit-eu-2016.md
Repository: spark
Updated Branches:
refs/heads/branch-2.0 27e274c3e -> 2280ad8a3
[SPARK-15749][SQL] make the error message more meaningful
## What changes were proposed in this pull request?
For table test1 (C1 varchar (10), C2 varchar (10)), when I insert a row using
```
Repository: spark
Updated Branches:
refs/heads/branch-2.0 fb0fab63c -> 27e274c3e
[SPARK-15868][WEB UI] Executors table in Executors tab should sort Executor IDs
in numerical order
## What changes were proposed in this pull request?
Currently the Executors table sorts by id using a string
Repository: spark
Updated Branches:
refs/heads/master 2d27eb1e7 -> e849285df
[SPARK-15868][WEB UI] Executors table in Executors tab should sort Executor IDs
in numerical order
## What changes were proposed in this pull request?
Currently the Executors table sorts by id using a string sort
Repository: spark
Updated Branches:
refs/heads/branch-2.0 7d8cddfb4 -> fb0fab63c
[MINOR][DOCS][SQL] Fix some comments about types(TypeCoercion,Partition) and
exceptions.
## What changes were proposed in this pull request?
This PR contains a few changes on code comments.
- `HiveTypeCoercion`
Repository: spark
Updated Branches:
refs/heads/master 796429d71 -> 2d27eb1e7
[MINOR][DOCS][SQL] Fix some comments about types(TypeCoercion,Partition) and
exceptions.
## What changes were proposed in this pull request?
This PR contains a few changes on code comments.
- `HiveTypeCoercion` is
Repository: spark
Updated Branches:
refs/heads/branch-2.0 1230516d9 -> 7d8cddfb4
[SPARK-15998][SQL] Verification of SQLConf HIVE_METASTORE_PARTITION_PRUNING
What changes were proposed in this pull request?
`HIVE_METASTORE_PARTITION_PRUNING` is a public `SQLConf`. When `true`, some
Repository: spark
Updated Branches:
refs/heads/master 7a89f2adb -> 796429d71
[SPARK-15998][SQL] Verification of SQLConf HIVE_METASTORE_PARTITION_PRUNING
What changes were proposed in this pull request?
`HIVE_METASTORE_PARTITION_PRUNING` is a public `SQLConf`. When `true`, some
Repository: spark
Updated Branches:
refs/heads/branch-2.0 938988757 -> 1230516d9
[SQL] Minor HashAggregateExec string output fixes
## What changes were proposed in this pull request?
This PR fixes some minor `.toString` format issues for `HashAggregateExec`.
Before:
```
Repository: spark
Updated Branches:
refs/heads/master acef843f6 -> 7a89f2adb
[SQL] Minor HashAggregateExec string output fixes
## What changes were proposed in this pull request?
This PR fixes some minor `.toString` format issues for `HashAggregateExec`.
Before:
```
Repository: spark
Updated Branches:
refs/heads/branch-1.6 cffc0800b -> 0a8ada506
[SPARK-15975] Fix improper Popen retcode code handling in dev/run-tests
In the `dev/run-tests.py` script we check a `Popen.retcode` for success using
`retcode > 0`, but this is subtlety wrong because Popen's
Repository: spark
Updated Branches:
refs/heads/branch-2.0 d9dd46edd -> 938988757
[SPARK-15975] Fix improper Popen retcode code handling in dev/run-tests
In the `dev/run-tests.py` script we check a `Popen.retcode` for success using
`retcode > 0`, but this is subtlety wrong because Popen's
Repository: spark
Updated Branches:
refs/heads/branch-1.5 6043fa8df -> 1891e04a6
[SPARK-15975] Fix improper Popen retcode code handling in dev/run-tests
In the `dev/run-tests.py` script we check a `Popen.retcode` for success using
`retcode > 0`, but this is subtlety wrong because Popen's
Repository: spark
Updated Branches:
refs/heads/master bbad4cb48 -> acef843f6
[SPARK-15975] Fix improper Popen retcode code handling in dev/run-tests
In the `dev/run-tests.py` script we check a `Popen.retcode` for success using
`retcode > 0`, but this is subtlety wrong because Popen's return
Repository: spark
Updated Branches:
refs/heads/branch-2.0 095ddb4c9 -> d9dd46edd
[SPARK-15978][SQL] improve 'show tables' command related codes
## What changes were proposed in this pull request?
I've found some minor issues in "show tables" command:
1. In the `SessionCatalog.scala`,
Repository: spark
Updated Branches:
refs/heads/master 457126e42 -> bbad4cb48
[SPARK-15978][SQL] improve 'show tables' command related codes
## What changes were proposed in this pull request?
I've found some minor issues in "show tables" command:
1. In the `SessionCatalog.scala`,
Repository: spark
Updated Branches:
refs/heads/branch-2.0 579268426 -> 095ddb4c9
[SPARK-15796][CORE] Reduce spark.memory.fraction default to avoid overrunning
old gen in JVM default config
## What changes were proposed in this pull request?
Reduce `spark.memory.fraction` default to 0.6 in
Repository: spark
Updated Branches:
refs/heads/master 36110a830 -> 457126e42
[SPARK-15796][CORE] Reduce spark.memory.fraction default to avoid overrunning
old gen in JVM default config
## What changes were proposed in this pull request?
Reduce `spark.memory.fraction` default to 0.6 in order
Repository: spark
Updated Branches:
refs/heads/master f9bf15d9b -> 36110a830
[SPARK-15922][MLLIB] `toIndexedRowMatrix` should consider the case `cols <
offset+colsPerBlock`
## What changes were proposed in this pull request?
SPARK-15922 reports the following scenario throwing an exception
Repository: spark
Updated Branches:
refs/heads/branch-2.0 e11c27918 -> 5b003c9bc
[SPARK-15977][SQL] Fix TRUNCATE TABLE for Spark specific datasource tables
## What changes were proposed in this pull request?
`TRUNCATE TABLE` is currently broken for Spark specific datasource tables
(json,
Repository: spark
Updated Branches:
refs/heads/master 084dca770 -> f9bf15d9b
[SPARK-15977][SQL] Fix TRUNCATE TABLE for Spark specific datasource tables
## What changes were proposed in this pull request?
`TRUNCATE TABLE` is currently broken for Spark specific datasource tables
(json, csv,
Repository: spark
Updated Branches:
refs/heads/branch-2.0 0a2291cd1 -> e11c27918
[SPARK-15981][SQL][STREAMING] Fixed bug and added tests in DataStreamReader
Python API
## What changes were proposed in this pull request?
- Fixed bug in Python API of DataStreamReader. Because a single path
Repository: spark
Updated Branches:
refs/heads/master a865f6e05 -> 084dca770
[SPARK-15981][SQL][STREAMING] Fixed bug and added tests in DataStreamReader
Python API
## What changes were proposed in this pull request?
- Fixed bug in Python API of DataStreamReader. Because a single path was
Repository: spark
Updated Branches:
refs/heads/branch-2.0 c53eda03a -> 0a2291cd1
[SPARK-15996][R] Fix R examples by removing deprecated functions
## What changes were proposed in this pull request?
Currently, R examples(`dataframe.R` and `data-manipulation.R`) fail like the
following. We
Repository: spark
Updated Branches:
refs/heads/master 9ea0d5e32 -> a865f6e05
[SPARK-15996][R] Fix R examples by removing deprecated functions
## What changes were proposed in this pull request?
Currently, R examples(`dataframe.R` and `data-manipulation.R`) fail like the
following. We had
Repository: spark
Updated Branches:
refs/heads/branch-2.0 26359d27c -> c53eda03a
[SPARK-15983][SQL] Removes FileFormat.prepareRead
## What changes were proposed in this pull request?
Interface method `FileFormat.prepareRead()` was added in #12088 to handle a
special case in the LibSVM data
Repository: spark
Updated Branches:
refs/heads/master 6451cf927 -> 9ea0d5e32
[SPARK-15983][SQL] Removes FileFormat.prepareRead
## What changes were proposed in this pull request?
Interface method `FileFormat.prepareRead()` was added in #12088 to handle a
special case in the LibSVM data
Repository: spark
Updated Branches:
refs/heads/branch-2.0 52cb1ad38 -> 26359d27c
[SPARK-15862][SQL] Better Error Message When Having Database Name in CACHE
TABLE AS SELECT
What changes were proposed in this pull request?
~~If the temp table already exists, we should not silently replace
Repository: spark
Updated Branches:
refs/heads/master 7c6c69263 -> 6451cf927
[SPARK-15862][SQL] Better Error Message When Having Database Name in CACHE
TABLE AS SELECT
What changes were proposed in this pull request?
~~If the temp table already exists, we should not silently replace it
http://git-wip-us.apache.org/repos/asf/spark/blob/52cb1ad3/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/CatalystWriteSupport.scala
--
diff --git
Repository: spark
Updated Branches:
refs/heads/branch-2.0 35c0a60a6 -> 52cb1ad38
http://git-wip-us.apache.org/repos/asf/spark/blob/52cb1ad3/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaConverter.scala
[SPARK-15979][SQL] Rename various Parquet support classes (branch-2.0).
## What changes were proposed in this pull request?
This patch renames various Parquet support classes from CatalystAbc to
ParquetAbc. This new naming makes more sense for two reasons:
1. These are not optimizer related
51 matches
Mail list logo
