spark git commit: revert PR#10896 and PR#14865

2016-08-31 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 7a5000f39 -> aaf632b21 revert PR#10896 and PR#14865 ## What changes were proposed in this pull request? according to the discussion in the original PR #10896 and the new approach PR #14876 , we decided to revert these 2 PRs and go with

spark git commit: [SPARK-17241][SPARKR][MLLIB] SparkR spark.glm should have configurable regularization parameter

2016-08-31 Thread shivaram
Repository: spark Updated Branches: refs/heads/master d008638fb -> 7a5000f39 [SPARK-17241][SPARKR][MLLIB] SparkR spark.glm should have configurable regularization parameter https://issues.apache.org/jira/browse/SPARK-17241 ## What changes were proposed in this pull request? Spark has

spark git commit: [SPARKR][MINOR] Fix windowPartitionBy example

2016-08-31 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 191d99692 -> 8711b451d [SPARKR][MINOR] Fix windowPartitionBy example ## What changes were proposed in this pull request? The usage in the original example is incorrect. This PR fixes it. ## How was this patch tested? Manual test.

spark git commit: [SPARKR][MINOR] Fix windowPartitionBy example

2016-08-31 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 2f9c27364 -> d008638fb [SPARKR][MINOR] Fix windowPartitionBy example ## What changes were proposed in this pull request? The usage in the original example is incorrect. This PR fixes it. ## How was this patch tested? Manual test.

spark git commit: [SPARK-17180][SPARK-17309][SPARK-17323][SQL][2.0] create AlterViewAsCommand to handle ALTER VIEW AS

2016-08-31 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.0 8d15c1a6a -> 191d99692 [SPARK-17180][SPARK-17309][SPARK-17323][SQL][2.0] create AlterViewAsCommand to handle ALTER VIEW AS ## What changes were proposed in this pull request? Currently we use `CreateViewCommand` to implement ALTER

spark git commit: [SPARK-16581][SPARKR] Fix JVM API tests in SparkR

2016-08-31 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 d01251c92 -> 8d15c1a6a [SPARK-16581][SPARKR] Fix JVM API tests in SparkR ## What changes were proposed in this pull request? Remove cleanup.jobj test. Use JVM wrapper API for other test cases. ## How was this patch tested? Run R

spark git commit: [SPARK-16581][SPARKR] Fix JVM API tests in SparkR

2016-08-31 Thread shivaram
Repository: spark Updated Branches: refs/heads/master d375c8a3d -> 2f9c27364 [SPARK-16581][SPARKR] Fix JVM API tests in SparkR ## What changes were proposed in this pull request? Remove cleanup.jobj test. Use JVM wrapper API for other test cases. ## How was this patch tested? Run R unit

spark git commit: [SPARK-17326][SPARKR] Fix tests with HiveContext in SparkR not to be skipped always

2016-08-31 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 c17334e47 -> ad3689261 [SPARK-17326][SPARKR] Fix tests with HiveContext in SparkR not to be skipped always ## What changes were proposed in this pull request? Currently, `HiveContext` in SparkR is not being tested and always skipped.

spark git commit: [SPARK-17326][SPARKR] Fix tests with HiveContext in SparkR not to be skipped always

2016-08-31 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 5d84c7fd8 -> 50bb14233 [SPARK-17326][SPARKR] Fix tests with HiveContext in SparkR not to be skipped always ## What changes were proposed in this pull request? Currently, `HiveContext` in SparkR is not being tested and always skipped.

spark git commit: [SPARK-17332][CORE] Make Java Loggers static members

2016-08-31 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 9bcb33c54 -> 5d84c7fd8 [SPARK-17332][CORE] Make Java Loggers static members ## What changes were proposed in this pull request? Make all Java Loggers static members ## How was this patch tested? Jenkins Author: Sean Owen

spark git commit: [SPARK-17316][CORE] Make CoarseGrainedSchedulerBackend.removeExecutor non-blocking

2016-08-31 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 0611b3a2b -> 9bcb33c54 [SPARK-17316][CORE] Make CoarseGrainedSchedulerBackend.removeExecutor non-blocking ## What changes were proposed in this pull request? StandaloneSchedulerBackend.executorRemoved is a blocking call right now. It may

spark git commit: [SPARK-17316][CORE] Make CoarseGrainedSchedulerBackend.removeExecutor non-blocking

2016-08-31 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.0 021aa28f4 -> c17334e47 [SPARK-17316][CORE] Make CoarseGrainedSchedulerBackend.removeExecutor non-blocking ## What changes were proposed in this pull request? StandaloneSchedulerBackend.executorRemoved is a blocking call right now. It

spark git commit: [SPARK-17320] add build_profile_flags entry to mesos build module

2016-08-31 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 9953442ac -> 0611b3a2b [SPARK-17320] add build_profile_flags entry to mesos build module ## What changes were proposed in this pull request? add build_profile_flags entry to mesos build module ## How was this patch tested? unit tests

spark git commit: [MINOR][SPARKR] Verbose build comment in WINDOWS.md rather than promoting default build without Hive

2016-08-31 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 12fd0cd61 -> 9953442ac [MINOR][SPARKR] Verbose build comment in WINDOWS.md rather than promoting default build without Hive ## What changes were proposed in this pull request? This PR fixes `WINDOWS.md` to imply referring other profiles

spark git commit: [SPARK-17243][WEB UI] Spark 2.0 History Server won't load with very large application history

2016-08-31 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-2.0 bc6c0d9f9 -> 021aa28f4 [SPARK-17243][WEB UI] Spark 2.0 History Server won't load with very large application history ## What changes were proposed in this pull request? back port of #14835 addressing merge conflicts With the new

[1/2] spark-website git commit: Re-sync Spark site HTML to output of latest jekyll

2016-08-31 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site fcd0bc3dd -> 0845f49de http://git-wip-us.apache.org/repos/asf/spark-website/blob/0845f49d/site/releases/spark-release-1-1-0.html -- diff --git

spark-website git commit: Push only fix to contributor list to 2.0.0 for Spark

2016-08-31 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site b2cf71427 -> fcd0bc3dd Push only fix to contributor list to 2.0.0 for Spark Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/fcd0bc3d Tree:

spark-website git commit: Hot-fix ec2-scripts.html in Spark docs/2.0.0, which for some reason built correctly in 2.0.0-preview, builds in master, but didn't deploy in 2.0.0

2016-08-31 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site d37a3afce -> b2cf71427 Hot-fix ec2-scripts.html in Spark docs/2.0.0, which for some reason built correctly in 2.0.0-preview, builds in master, but didn't deploy in 2.0.0 Project:

spark git commit: [SPARK-17180][SPARK-17309][SPARK-17323][SQL] create AlterViewAsCommand to handle ALTER VIEW AS

2016-08-31 Thread wenchen
Repository: spark Updated Branches: refs/heads/master fa6347938 -> 12fd0cd61 [SPARK-17180][SPARK-17309][SPARK-17323][SQL] create AlterViewAsCommand to handle ALTER VIEW AS ## What changes were proposed in this pull request? Currently we use `CreateViewCommand` to implement ALTER VIEW AS,

spark git commit: [SPARK-17178][SPARKR][SPARKSUBMIT] Allow to set sparkr shell command through --conf

2016-08-31 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master d92cd227c -> fa6347938 [SPARK-17178][SPARKR][SPARKSUBMIT] Allow to set sparkr shell command through --conf ## What changes were proposed in this pull request? Allow user to set sparkr shell command through --conf spark.r.shell.command