spark git commit: [SPARK-15487][WEB UI] Spark Master UI to reverse proxy Application and Workers UI

2016-09-08 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 722afbb2b -> 92ce8d484 [SPARK-15487][WEB UI] Spark Master UI to reverse proxy Application and Workers UI ## What changes were proposed in this pull request? This pull request adds the functionality to enable accessing worker and

spark git commit: [SPARK-17405] RowBasedKeyValueBatch should use default page size to prevent OOMs

2016-09-08 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 78d5d4dd5 -> 722afbb2b [SPARK-17405] RowBasedKeyValueBatch should use default page size to prevent OOMs ## What changes were proposed in this pull request? Before this change, we would always allocate 64MB per aggregation task for the

spark git commit: [SPARK-17200][PROJECT INFRA][BUILD][SPARKR] Automate building and testing on Windows (currently SparkR only)

2016-09-08 Thread shivaram
Repository: spark Updated Branches: refs/heads/master f0d21b7f9 -> 78d5d4dd5 [SPARK-17200][PROJECT INFRA][BUILD][SPARKR] Automate building and testing on Windows (currently SparkR only) ## What changes were proposed in this pull request? This PR adds the build automation on Windows with

spark git commit: [SPARK-17442][SPARKR] Additional arguments in write.df are not passed to data source

2016-09-08 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 e169085cd -> c6e0dd1d4 [SPARK-17442][SPARKR] Additional arguments in write.df are not passed to data source ## What changes were proposed in this pull request? additional options were not passed down in write.df. ## How was this

spark git commit: [SPARK-17442][SPARKR] Additional arguments in write.df are not passed to data source

2016-09-08 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 3ced39df3 -> f0d21b7f9 [SPARK-17442][SPARKR] Additional arguments in write.df are not passed to data source ## What changes were proposed in this pull request? additional options were not passed down in write.df. ## How was this patch

spark git commit: [SPARK-16711] YarnShuffleService doesn't re-init properly on YARN rolling upgrade

2016-09-08 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-2.0 28377da38 -> e169085cd [SPARK-16711] YarnShuffleService doesn't re-init properly on YARN rolling upgrade branch-2.0 version of this patch. The differences are in the YarnShuffleService for finding the location to put the DB.

spark git commit: [SPARK-17432][SQL] PreprocessDDL should respect case sensitivity when checking duplicated columns

2016-09-08 Thread wenchen
Repository: spark Updated Branches: refs/heads/master b230fb92a -> 3ced39df3 [SPARK-17432][SQL] PreprocessDDL should respect case sensitivity when checking duplicated columns ## What changes were proposed in this pull request? In `PreprocessDDL` we will check if table columns are