spark git commit: [SPARK-20886][CORE] HadoopMapReduceCommitProtocol to handle FileOutputCommitter.getWorkPath==null

2017-08-29 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 3d0e17424 -> e47f48c73 [SPARK-20886][CORE] HadoopMapReduceCommitProtocol to handle FileOutputCommitter.getWorkPath==null ## What changes were proposed in this pull request? Handles the situation where a

spark git commit: [SPARK-21845][SQL] Make codegen fallback of expressions configurable

2017-08-29 Thread lixiao
Repository: spark Updated Branches: refs/heads/master fba9cc846 -> 3d0e17424 [SPARK-21845][SQL] Make codegen fallback of expressions configurable ## What changes were proposed in this pull request? We should make codegen fallback of expressions configurable. So far, it is always on. We might

spark git commit: [SPARK-21813][CORE] Modify TaskMemoryManager.MAXIMUM_PAGE_SIZE_BYTES comments

2017-08-29 Thread srowen
Repository: spark Updated Branches: refs/heads/master d7b1fcf8f -> fba9cc846 [SPARK-21813][CORE] Modify TaskMemoryManager.MAXIMUM_PAGE_SIZE_BYTES comments ## What changes were proposed in this pull request? The variable "TaskMemoryManager.MAXIMUM_PAGE_SIZE_BYTES" comment error, It shouldn't

spark git commit: [SPARK-21728][CORE] Allow SparkSubmit to use Logging.

2017-08-29 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 840ba053b -> d7b1fcf8f [SPARK-21728][CORE] Allow SparkSubmit to use Logging. This change initializes logging when SparkSubmit runs, using a configuration that should avoid printing log messages as much as possible with most configurations,

spark git commit: [MINOR][ML] Document treatment of instance weights in logreg summary

2017-08-29 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 6077e3ef3 -> 840ba053b [MINOR][ML] Document treatment of instance weights in logreg summary ## What changes were proposed in this pull request? Add Scaladoc noting that instance weights are currently ignored in the logistic regression

spark git commit: Revert "[SPARK-21714][CORE][BACKPORT-2.2] Avoiding re-uploading remote resources in yarn client mode"

2017-08-29 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.2 59529b21a -> 917fe6635 Revert "[SPARK-21714][CORE][BACKPORT-2.2] Avoiding re-uploading remote resources in yarn client mode" This reverts commit 59529b21a99f3c4db16b31da9dc7fce62349cf11. Project:

spark git commit: [SPARK-21714][CORE][BACKPORT-2.2] Avoiding re-uploading remote resources in yarn client mode

2017-08-29 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.2 59bb7ebfb -> 59529b21a [SPARK-21714][CORE][BACKPORT-2.2] Avoiding re-uploading remote resources in yarn client mode ## What changes were proposed in this pull request? This is a backport PR to fix issue of re-uploading remote

spark git commit: [SPARK-21801][SPARKR][TEST] unit test randomly fail with randomforest

2017-08-29 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 6327ea570 -> 6077e3ef3 [SPARK-21801][SPARKR][TEST] unit test randomly fail with randomforest ## What changes were proposed in this pull request? fix the random seed to eliminate variability ## How was this patch tested? jenkins,

spark git commit: [SPARK-21255][SQL] simplify encoder for java enum

2017-08-29 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 8fcbda9c9 -> 6327ea570 [SPARK-21255][SQL] simplify encoder for java enum ## What changes were proposed in this pull request? This is a follow-up for https://github.com/apache/spark/pull/18488, to simplify the code. The major change is,

spark git commit: [SPARK-21848][SQL] Add trait UserDefinedExpression to identify user-defined functions

2017-08-29 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 32fa0b814 -> 8fcbda9c9 [SPARK-21848][SQL] Add trait UserDefinedExpression to identify user-defined functions ## What changes were proposed in this pull request? Add trait UserDefinedExpression to identify user-defined functions. UDF can

spark-website git commit: Update committer page

2017-08-29 Thread jshao
Repository: spark-website Updated Branches: refs/heads/asf-site 8f64443a4 -> 434db70b4 Update committer page Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/434db70b Tree:

spark-website git commit: Update committer page

2017-08-29 Thread gurwls223
Repository: spark-website Updated Branches: refs/remotes/apache/asf-site [created] 1895d5cb0 Update committer page Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/1895d5cb Tree:

spark git commit: [SPARK-21781][SQL] Modify DataSourceScanExec to use concrete ColumnVector type.

2017-08-29 Thread wenchen
Repository: spark Updated Branches: refs/heads/master c7270a46f -> 32fa0b814 [SPARK-21781][SQL] Modify DataSourceScanExec to use concrete ColumnVector type. ## What changes were proposed in this pull request? As mentioned at https://github.com/apache/spark/pull/18680#issuecomment-316820409,

spark-website git commit: identify SPIP jira tickets by summary as well as label

2017-08-29 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 35eb14717 -> 8f64443a4 identify SPIP jira tickets by summary as well as label Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/8f64443a Tree: