[2/2] spark git commit: Preparing development version 1.3.1-SNAPSHOT

2015-02-10 Thread pwendell
Preparing development version 1.3.1-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e57c81b8 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e57c81b8 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e57

[1/2] spark git commit: Preparing Spark release v1.3.0-snapshot1

2015-02-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 6a91d5993 -> e57c81b8c Preparing Spark release v1.3.0-snapshot1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d97bfc6f Tree: http://git-wip-us.apache.org/repos/as

Git Push Summary

2015-02-10 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.0-snapshot1 [created] d97bfc6f2 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Revert "Preparing Spark release v1.3.0-snapshot1"

2015-02-10 Thread pwendell
Revert "Preparing Spark release v1.3.0-snapshot1" This reverts commit 53068f56f40bf03b7fc52e5980fb7e205903fc8b. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6a91d599 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/

[1/2] spark git commit: Revert "Preparing development version 1.3.1-SNAPSHOT"

2015-02-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 0386fc4d6 -> 6a91d5993 Revert "Preparing development version 1.3.1-SNAPSHOT" This reverts commit ba12b793f1f4f432e71439e2a7ebacce74d9c472. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org

spark git commit: HOTFIX: Adding Junit to Hive tests for Maven build

2015-02-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 ba12b793f -> 0386fc4d6 HOTFIX: Adding Junit to Hive tests for Maven build Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0386fc4d Tree: http://git-wip-us.apache.or

Git Push Summary

2015-02-10 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.0-snapshot1 [deleted] 53068f56f - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: HOTFIX: Adding Junit to Hive tests for Maven build

2015-02-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 7e2f8821e -> c2131c0cd HOTFIX: Adding Junit to Hive tests for Maven build Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c2131c0c Tree: http://git-wip-us.apache.org/re

[2/2] spark git commit: Preparing Spark release v1.3.0-snapshot1

2015-02-10 Thread pwendell
Preparing Spark release v1.3.0-snapshot1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/53068f56 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/53068f56 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/53068f5

[1/2] spark git commit: Preparing development version 1.3.1-SNAPSHOT

2015-02-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 15180bcf8 -> ba12b793f Preparing development version 1.3.1-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ba12b793 Tree: http://git-wip-us.apache.org/repo

Git Push Summary

2015-02-10 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.0-snapshot1 [created] 53068f56f - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/3] spark git commit: Revert "Preparing development version 1.3.1-SNAPSHOT"

2015-02-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 db80d0fe2 -> 15180bcf8 Revert "Preparing development version 1.3.1-SNAPSHOT" This reverts commit db80d0fe21daa3202ff217cbefb999ce77c5aa9e. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org

[3/3] spark git commit: HOTFIX: Java 6 compilation error in Spark SQL

2015-02-10 Thread pwendell
HOTFIX: Java 6 compilation error in Spark SQL Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/15180bcf Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/15180bcf Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/15

Git Push Summary

2015-02-10 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.0-snapshot1 [deleted] c2e400103 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/3] spark git commit: Revert "Preparing Spark release v1.3.0-snapshot1"

2015-02-10 Thread pwendell
Revert "Preparing Spark release v1.3.0-snapshot1" This reverts commit c2e4001030cfb881ff33d448fc0aeaf4f05dad0f. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/536dae90 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/

spark git commit: HOTFIX: Java 6 compilation error in Spark SQL

2015-02-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/master f86a89a2e -> 7e2f8821e HOTFIX: Java 6 compilation error in Spark SQL Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7e2f8821 Tree: http://git-wip-us.apache.org/repos/a

[1/2] spark git commit: Preparing development version 1.3.1-SNAPSHOT

2015-02-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 2f52489d2 -> db80d0fe2 Preparing development version 1.3.1-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/db80d0fe Tree: http://git-wip-us.apache.org/repo

Git Push Summary

2015-02-10 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.0-snapshot1 [created] c2e400103 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing Spark release v1.3.0-snapshot1

2015-02-10 Thread pwendell
Preparing Spark release v1.3.0-snapshot1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c2e40010 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c2e40010 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c2e4001

spark git commit: Updating versions for Spark 1.3

2015-02-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 ba3aa8fcb -> 2f52489d2 Updating versions for Spark 1.3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2f52489d Tree: http://git-wip-us.apache.org/repos/asf/spark/t

spark git commit: [SPARK-5714][Mllib] Refactor initial step of LDA to remove redundant operations

2015-02-10 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 63af90c3c -> ba3aa8fcb [SPARK-5714][Mllib] Refactor initial step of LDA to remove redundant operations The `initialState` of LDA performs several RDD operations that looks redundant. This pr tries to simplify these operations. Author:

spark git commit: [SPARK-5714][Mllib] Refactor initial step of LDA to remove redundant operations

2015-02-10 Thread meng
Repository: spark Updated Branches: refs/heads/master b8f88d327 -> f86a89a2e [SPARK-5714][Mllib] Refactor initial step of LDA to remove redundant operations The `initialState` of LDA performs several RDD operations that looks redundant. This pr tries to simplify these operations. Author: Lia

spark git commit: [SPARK-5702][SQL] Allow short names for built-in data sources.

2015-02-10 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.3 1bc75b0a8 -> 63af90c3c [SPARK-5702][SQL] Allow short names for built-in data sources. Also took the chance to fixed up some style ... Author: Reynold Xin Closes #4489 from rxin/SPARK-5702 and squashes the following commits: 74f42e3

spark git commit: [SPARK-5702][SQL] Allow short names for built-in data sources.

2015-02-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master b96918265 -> b8f88d327 [SPARK-5702][SQL] Allow short names for built-in data sources. Also took the chance to fixed up some style ... Author: Reynold Xin Closes #4489 from rxin/SPARK-5702 and squashes the following commits: 74f42e3 [Rey

spark git commit: [SPARK-5729] Potential NPE in standalone REST API

2015-02-10 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 1cb377007 -> b96918265 [SPARK-5729] Potential NPE in standalone REST API If the user specifies a bad REST URL, the server will throw an NPE instead of propagating the error back. This is because the default `ErrorServlet` has the wrong pr

spark git commit: [SPARK-5729] Potential NPE in standalone REST API

2015-02-10 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 79cd59cde -> 1bc75b0a8 [SPARK-5729] Potential NPE in standalone REST API If the user specifies a bad REST URL, the server will throw an NPE instead of propagating the error back. This is because the default `ErrorServlet` has the wron

spark git commit: [SPARK-4879] Use driver to coordinate Hadoop output committing for speculative tasks

2015-02-10 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 e477e91e3 -> 79cd59cde [SPARK-4879] Use driver to coordinate Hadoop output committing for speculative tasks Previously, SparkHadoopWriter always committed its tasks without question. The problem is that when speculation is enabled som

spark git commit: [SPARK-4879] Use driver to coordinate Hadoop output committing for speculative tasks

2015-02-10 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 7e24249af -> 1cb377007 [SPARK-4879] Use driver to coordinate Hadoop output committing for speculative tasks Previously, SparkHadoopWriter always committed its tasks without question. The problem is that when speculation is enabled sometim

spark git commit: [SQL][DataFrame] Fix column computability bug.

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 7fa0d5f5c -> e477e91e3 [SQL][DataFrame] Fix column computability bug. Do not recursively strip out projects. Only strip the first level project. ```scala df("colA") + df("colB").as("colC") ``` Previously, the above would construct an

spark git commit: [SQL][DataFrame] Fix column computability bug.

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 45df77b84 -> 7e24249af [SQL][DataFrame] Fix column computability bug. Do not recursively strip out projects. Only strip the first level project. ```scala df("colA") + df("colB").as("colC") ``` Previously, the above would construct an inva

spark git commit: [SPARK-5709] [SQL] Add EXPLAIN support in DataFrame API for debugging purpose

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 1056c5b1f -> 7fa0d5f5c [SPARK-5709] [SQL] Add EXPLAIN support in DataFrame API for debugging purpose Author: Cheng Hao Closes #4496 from chenghao-intel/df_explain and squashes the following commits: 552aa58 [Cheng Hao] Add explain su

spark git commit: [SPARK-5704] [SQL] [PySpark] createDataFrame from RDD with columns

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 fc0446f66 -> 1056c5b1f [SPARK-5704] [SQL] [PySpark] createDataFrame from RDD with columns Deprecate inferSchema() and applySchema(), use createDataFrame() instead, which could take an optional `schema` to create an DataFrame from an RD

spark git commit: [SPARK-5709] [SQL] Add EXPLAIN support in DataFrame API for debugging purpose

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master ea6028409 -> 45df77b84 [SPARK-5709] [SQL] Add EXPLAIN support in DataFrame API for debugging purpose Author: Cheng Hao Closes #4496 from chenghao-intel/df_explain and squashes the following commits: 552aa58 [Cheng Hao] Add explain suppor

spark git commit: [SPARK-5704] [SQL] [PySpark] createDataFrame from RDD with columns

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master a60aea86b -> ea6028409 [SPARK-5704] [SQL] [PySpark] createDataFrame from RDD with columns Deprecate inferSchema() and applySchema(), use createDataFrame() instead, which could take an optional `schema` to create an DataFrame from an RDD. T

spark git commit: [SPARK-5683] [SQL] Avoid multiple json generator created

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 748cdc15e -> fc0446f66 [SPARK-5683] [SQL] Avoid multiple json generator created Author: Cheng Hao Closes #4468 from chenghao-intel/json and squashes the following commits: aeb7801 [Cheng Hao] avoid multiple json generator created (c

spark git commit: [SPARK-5683] [SQL] Avoid multiple json generator created

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 6195e2473 -> a60aea86b [SPARK-5683] [SQL] Avoid multiple json generator created Author: Cheng Hao Closes #4468 from chenghao-intel/json and squashes the following commits: aeb7801 [Cheng Hao] avoid multiple json generator created Proje

spark git commit: [SQL] Add an exception for analysis errors.

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 a21090ebe -> 748cdc15e [SQL] Add an exception for analysis errors. Also start from the bottom so we show the first error instead of the top error. Author: Michael Armbrust Closes #4439 from marmbrus/analysisException and squashes the

spark git commit: [SQL] Add an exception for analysis errors.

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master aaf50d05c -> 6195e2473 [SQL] Add an exception for analysis errors. Also start from the bottom so we show the first error instead of the top error. Author: Michael Armbrust Closes #4439 from marmbrus/analysisException and squashes the fol

[2/2] spark git commit: [SPARK-5658][SQL] Finalize DDL and write support APIs

2015-02-10 Thread marmbrus
[SPARK-5658][SQL] Finalize DDL and write support APIs https://issues.apache.org/jira/browse/SPARK-5658 Author: Yin Huai This patch had conflicts when merged, resolved by Committer: Michael Armbrust Closes #4446 from yhuai/writeSupportFollowup and squashes the following commits: f3a96f7 [Yin

[2/2] spark git commit: [SPARK-5658][SQL] Finalize DDL and write support APIs

2015-02-10 Thread marmbrus
[SPARK-5658][SQL] Finalize DDL and write support APIs https://issues.apache.org/jira/browse/SPARK-5658 Author: Yin Huai This patch had conflicts when merged, resolved by Committer: Michael Armbrust Closes #4446 from yhuai/writeSupportFollowup and squashes the following commits: f3a96f7 [Yin

[1/2] spark git commit: [SPARK-5658][SQL] Finalize DDL and write support APIs

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master ed167e70c -> aaf50d05c http://git-wip-us.apache.org/repos/asf/spark/blob/aaf50d05/sql/hive/src/main/scala/org/apache/spark/sql/hive/TestHive.scala -- diff --git a/sql/hive/s

[1/2] spark git commit: [SPARK-5658][SQL] Finalize DDL and write support APIs

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 8e75b0ed0 -> a21090ebe http://git-wip-us.apache.org/repos/asf/spark/blob/a21090eb/sql/hive/src/main/scala/org/apache/spark/sql/hive/TestHive.scala -- diff --git a/sql/hi

spark git commit: [SPARK-5493] [core] Add option to impersonate user.

2015-02-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 445dbc721 -> 8e75b0ed0 [SPARK-5493] [core] Add option to impersonate user. Hadoop has a feature that allows users to impersonate other users when submitting applications or talking to HDFS, for example. These impersonated users are refe

spark git commit: [SPARK-5493] [core] Add option to impersonate user.

2015-02-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/master e28b6bdbb -> ed167e70c [SPARK-5493] [core] Add option to impersonate user. Hadoop has a feature that allows users to impersonate other users when submitting applications or talking to HDFS, for example. These impersonated users are referred

spark git commit: [SQL] Make Options in the data source API CREATE TABLE statements optional.

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 f43bc3dff -> 445dbc721 [SQL] Make Options in the data source API CREATE TABLE statements optional. Users will not need to put `Options()` in a CREATE TABLE statement when there is not option provided. Author: Yin Huai Closes #4515 f

spark git commit: [SQL] Make Options in the data source API CREATE TABLE statements optional.

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 2d50a010f -> e28b6bdbb [SQL] Make Options in the data source API CREATE TABLE statements optional. Users will not need to put `Options()` in a CREATE TABLE statement when there is not option provided. Author: Yin Huai Closes #4515 from

spark git commit: [SPARK-5725] [SQL] Fixes ParquetRelation2.equals

2015-02-10 Thread lian
Repository: spark Updated Branches: refs/heads/branch-1.3 5be8902f7 -> f43bc3dff [SPARK-5725] [SQL] Fixes ParquetRelation2.equals [https://reviewable.io/review_button.png"; height=40 alt="Review on Reviewable"/>](https://reviewable.io/reviews/apache/spark/4513) Author: Cheng Lian Closes

spark git commit: [SPARK-5725] [SQL] Fixes ParquetRelation2.equals

2015-02-10 Thread lian
Repository: spark Updated Branches: refs/heads/master 91e351254 -> 2d50a010f [SPARK-5725] [SQL] Fixes ParquetRelation2.equals [https://reviewable.io/review_button.png"; height=40 alt="Review on Reviewable"/>](https://reviewable.io/reviews/apache/spark/4513) Author: Cheng Lian Closes #451

spark git commit: [SQL][Minor] correct some comments

2015-02-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master 52983d7f4 -> 91e351254 [SQL][Minor] correct some comments Author: Sheng, Li Author: OopsOutOfMemory Closes #4508 from OopsOutOfMemory/cmt and squashes the following commits: d8a68c6 [Sheng, Li] Update ddl.scala f24aeaf [OopsOutOfMemory]

spark git commit: [SPARK-5644] [Core]Delete tmp dir when sc is stop

2015-02-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master 582096128 -> 52983d7f4 [SPARK-5644] [Core]Delete tmp dir when sc is stop When we run driver as a service, and for each time we run job we only call sc.stop, then will not delete tmp dir create by HttpFileServer and SparkEnv, it will be de

spark git commit: [SPARK-5343][GraphX]: ShortestPaths traverses backwards

2015-02-10 Thread ankurdave
Repository: spark Updated Branches: refs/heads/branch-1.3 bba095399 -> 5be8902f7 [SPARK-5343][GraphX]: ShortestPaths traverses backwards Corrected the logic with ShortestPaths so that the calculation will run forward rather than backwards. Output before looked like: ```scala import org.apach

spark git commit: [SPARK-5343][GraphX]: ShortestPaths traverses backwards

2015-02-10 Thread ankurdave
Repository: spark Updated Branches: refs/heads/master fd2c032f9 -> 582096128 [SPARK-5343][GraphX]: ShortestPaths traverses backwards Corrected the logic with ShortestPaths so that the calculation will run forward rather than backwards. Output before looked like: ```scala import org.apache.sp

spark git commit: [SPARK-5021] [MLlib] Gaussian Mixture now supports Sparse Input

2015-02-10 Thread meng
Repository: spark Updated Branches: refs/heads/master f98707c04 -> fd2c032f9 [SPARK-5021] [MLlib] Gaussian Mixture now supports Sparse Input Following discussion in the Jira. Author: MechCoder Closes #4459 from MechCoder/sparse_gmm and squashes the following commits: 1b18dab [MechCoder] Re

spark git commit: [SPARK-5021] [MLlib] Gaussian Mixture now supports Sparse Input

2015-02-10 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 4e3aa680b -> bba095399 [SPARK-5021] [MLlib] Gaussian Mixture now supports Sparse Input Following discussion in the Jira. Author: MechCoder Closes #4459 from MechCoder/sparse_gmm and squashes the following commits: 1b18dab [MechCoder

spark git commit: [HOTFIX][SPARK-4136] Fix compilation and tests

2015-02-10 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 8b7587af8 -> 4e3aa680b [HOTFIX][SPARK-4136] Fix compilation and tests Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4e3aa680 Tree: http://git-wip-us.apache.org/re

spark git commit: [SPARK-5686][SQL] Add show current roles command in HiveQl

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 ef739d9ea -> 8b7587af8 [SPARK-5686][SQL] Add show current roles command in HiveQl show current roles Author: OopsOutOfMemory Closes #4471 from OopsOutOfMemory/show_current_role and squashes the following commits: 1c6b210 [OopsOutOf

spark git commit: [SPARK-5686][SQL] Add show current roles command in HiveQl

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master de80b1ba4 -> f98707c04 [SPARK-5686][SQL] Add show current roles command in HiveQl show current roles Author: OopsOutOfMemory Closes #4471 from OopsOutOfMemory/show_current_role and squashes the following commits: 1c6b210 [OopsOutOfMemo

spark git commit: [SQL] Add toString to DataFrame/Column

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 c294216cd -> ef739d9ea [SQL] Add toString to DataFrame/Column Author: Michael Armbrust Closes #4436 from marmbrus/dfToString and squashes the following commits: 8a3c35f [Michael Armbrust] Merge remote-tracking branch 'origin/master'

spark git commit: [SQL] Add toString to DataFrame/Column

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master c49a40498 -> de80b1ba4 [SQL] Add toString to DataFrame/Column Author: Michael Armbrust Closes #4436 from marmbrus/dfToString and squashes the following commits: 8a3c35f [Michael Armbrust] Merge remote-tracking branch 'origin/master' into

spark git commit: SPARK-5613: Catch the ApplicationNotFoundException exception to avoid thread from getting killed on yarn restart.

2015-02-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 dbfce30fc -> c294216cd SPARK-5613: Catch the ApplicationNotFoundException exception to avoid thread from getting killed on yarn restart. [SPARK-5613] Added a catch block to catch the ApplicationNotFoundException. Without this catch b

spark git commit: [SPARK-5668] Display region in spark_ec2.py get_existing_cluster()

2015-02-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master 59272dad7 -> c49a40498 [SPARK-5668] Display region in spark_ec2.py get_existing_cluster() Show the region for the different messages displayed by get_existing_cluster(): The search, found and error messages. Author: Miguel Peralvo Close

spark git commit: [SPARK-5592][SQL] java.net.URISyntaxException when insert data to a partitioned table

2015-02-10 Thread lian
Repository: spark Updated Branches: refs/heads/master b640c841f -> 59272dad7 [SPARK-5592][SQL] java.net.URISyntaxException when insert data to a partitioned table flowing sql get URISyntaxException: ``` create table sc as select * from (select '2011-01-11', '2011-01-11+14:18:26' from src tabl

spark git commit: [SPARK-5592][SQL] java.net.URISyntaxException when insert data to a partitioned table

2015-02-10 Thread lian
Repository: spark Updated Branches: refs/heads/branch-1.3 e53da215c -> dbfce30fc [SPARK-5592][SQL] java.net.URISyntaxException when insert data to a partitioned table flowing sql get URISyntaxException: ``` create table sc as select * from (select '2011-01-11', '2011-01-11+14:18:26' from src

spark git commit: [HOTFIX][SPARK-4136] Fix compilation and tests

2015-02-10 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 69bc3bb6c -> b640c841f [HOTFIX][SPARK-4136] Fix compilation and tests Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b640c841 Tree: http://git-wip-us.apache.org/repos/

spark git commit: SPARK-4136. Under dynamic allocation, cancel outstanding executor requests when no longer needed

2015-02-10 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 e508237f3 -> e53da215c SPARK-4136. Under dynamic allocation, cancel outstanding executor requests when no longer needed This takes advantage of the changes made in SPARK-4337 to cancel pending requests to YARN when they are no longer

spark git commit: SPARK-4136. Under dynamic allocation, cancel outstanding executor requests when no longer needed

2015-02-10 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master c7ad80ae4 -> 69bc3bb6c SPARK-4136. Under dynamic allocation, cancel outstanding executor requests when no longer needed This takes advantage of the changes made in SPARK-4337 to cancel pending requests to YARN when they are no longer need

spark git commit: [SPARK-5716] [SQL] Support TOK_CHARSETLITERAL in HiveQl

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 b32f5535d -> e508237f3 [SPARK-5716] [SQL] Support TOK_CHARSETLITERAL in HiveQl Author: Daoyuan Wang Closes #4502 from adrian-wang/utf8 and squashes the following commits: 4d7b0ee [Daoyuan Wang] remove useless import 606f981 [Daoyuan

spark git commit: [SPARK-5716] [SQL] Support TOK_CHARSETLITERAL in HiveQl

2015-02-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 6cc96cf0c -> c7ad80ae4 [SPARK-5716] [SQL] Support TOK_CHARSETLITERAL in HiveQl Author: Daoyuan Wang Closes #4502 from adrian-wang/utf8 and squashes the following commits: 4d7b0ee [Daoyuan Wang] remove useless import 606f981 [Daoyuan Wang

svn commit: r1658778 - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-02-10 Thread pwendell
Author: pwendell Date: Tue Feb 10 18:51:07 2015 New Revision: 1658778 URL: http://svn.apache.org/r1658778 Log: Fixing latest doc link to point to 1.2.1 Modified: spark/_layouts/global.html spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/

spark git commit: [Spark-5717] [MLlib] add stop and reorganize import

2015-02-10 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 d6f31e0c7 -> b32f5535d [Spark-5717] [MLlib] add stop and reorganize import Trivial. add sc stop and reorganize import https://issues.apache.org/jira/browse/SPARK-5717 Author: JqueryFan Author: Yuhao Yang Closes #4503 from hhbyyh/scs

spark git commit: [Spark-5717] [MLlib] add stop and reorganize import

2015-02-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master 50820f152 -> 6cc96cf0c [Spark-5717] [MLlib] add stop and reorganize import Trivial. add sc stop and reorganize import https://issues.apache.org/jira/browse/SPARK-5717 Author: JqueryFan Author: Yuhao Yang Closes #4503 from hhbyyh/scstop

spark git commit: [SPARK-1805] [EC2] Validate instance types

2015-02-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master ba667935f -> 50820f152 [SPARK-1805] [EC2] Validate instance types Addresses [SPARK-1805](https://issues.apache.org/jira/browse/SPARK-1805), though doesn't resolve it completely. Error out quickly if the user asks for the master and slaves

spark git commit: [SPARK-5700] [SQL] [Build] Bumps jets3t to 0.9.3 for hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread lian
Repository: spark Updated Branches: refs/heads/branch-1.3 4cfc02531 -> d6f31e0c7 [SPARK-5700] [SQL] [Build] Bumps jets3t to 0.9.3 for hadoop-2.3 and hadoop-2.4 profiles This is a follow-up PR for #4454 and #4484. JetS3t 0.9.2 contains a log4j.properties file inside the artifact and breaks ou

spark git commit: [SPARK-5700] [SQL] [Build] Bumps jets3t to 0.9.3 for hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread lian
Repository: spark Updated Branches: refs/heads/master 2d1e91673 -> ba667935f [SPARK-5700] [SQL] [Build] Bumps jets3t to 0.9.3 for hadoop-2.3 and hadoop-2.4 profiles This is a follow-up PR for #4454 and #4484. JetS3t 0.9.2 contains a log4j.properties file inside the artifact and breaks our te

spark git commit: SPARK-5239 [CORE] JdbcRDD throws "java.lang.AbstractMethodError: oracle.jdbc.driver.xxxxxx.isClosed()Z"

2015-02-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master c15134632 -> 2d1e91673 SPARK-5239 [CORE] JdbcRDD throws "java.lang.AbstractMethodError: oracle.jdbc.driver.xx.isClosed()Z" This is a completion of https://github.com/apache/spark/pull/4033 which was withdrawn for some reason. Author:

spark git commit: SPARK-5239 [CORE] JdbcRDD throws "java.lang.AbstractMethodError: oracle.jdbc.driver.xxxxxx.isClosed()Z"

2015-02-10 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 281614d7c -> 4cfc02531 SPARK-5239 [CORE] JdbcRDD throws "java.lang.AbstractMethodError: oracle.jdbc.driver.xx.isClosed()Z" This is a completion of https://github.com/apache/spark/pull/4033 which was withdrawn for some reason. Aut