spark git commit: [SPARK-5666][streaming][MQTT streaming] some trivial fixes

2015-02-25 Thread srowen
Repository: spark Updated Branches: refs/heads/master d641fbb39 - d51ed263e [SPARK-5666][streaming][MQTT streaming] some trivial fixes modified to adhere to accepted coding standards as pointed by tdas in PR #3844 Author: prabs prabsma...@gmail.com Author: Prabeesh K prabsma...@gmail.com

spark git commit: [GraphX] fixing 3 typos in the graphx programming guide

2015-02-25 Thread srowen
Repository: spark Updated Branches: refs/heads/master d51ed263e - 5b8480e03 [GraphX] fixing 3 typos in the graphx programming guide Corrected 3 Typos in the GraphX programming guide. I hope this is the correct way to contribute. Author: Benedikt Linse benedikt.li...@gmail.com Closes #4766

spark git commit: [SPARK-5771] Number of Cores in Completed Applications of Standalone Master Web Page always be 0 if sc.stop() is called

2015-02-25 Thread srowen
Repository: spark Updated Branches: refs/heads/master 5b8480e03 - dd077abf2 [SPARK-5771] Number of Cores in Completed Applications of Standalone Master Web Page always be 0 if sc.stop() is called In Standalone mode, the number of cores in Completed Applications of the Master Web Page will

spark git commit: [SPARK-5996][SQL] Fix specialized outbound conversions

2015-02-25 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 5c421e030 - fada683e7 [SPARK-5996][SQL] Fix specialized outbound conversions Author: Michael Armbrust mich...@databricks.com Closes #4757 from marmbrus/udtConversions and squashes the following commits: 3714aad [Michael Armbrust]

spark git commit: [SPARK-5996][SQL] Fix specialized outbound conversions

2015-02-25 Thread meng
Repository: spark Updated Branches: refs/heads/master dd077abf2 - f84c799ea [SPARK-5996][SQL] Fix specialized outbound conversions Author: Michael Armbrust mich...@databricks.com Closes #4757 from marmbrus/udtConversions and squashes the following commits: 3714aad [Michael Armbrust]

spark git commit: SPARK-5930 [DOCS] Documented default of spark.shuffle.io.retryWait is confusing

2015-02-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master f84c799ea - 7d8e6a2e4 SPARK-5930 [DOCS] Documented default of spark.shuffle.io.retryWait is confusing Clarify default max wait in spark.shuffle.io.retryWait docs CC andrewor14 Author: Sean Owen so...@cloudera.com Closes #4769 from

spark git commit: SPARK-5930 [DOCS] Documented default of spark.shuffle.io.retryWait is confusing

2015-02-25 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.3 fada683e7 - eaffc6edd SPARK-5930 [DOCS] Documented default of spark.shuffle.io.retryWait is confusing Clarify default max wait in spark.shuffle.io.retryWait docs CC andrewor14 Author: Sean Owen so...@cloudera.com Closes #4769 from

spark git commit: [SPARK-1955][GraphX]: VertexRDD can incorrectly assume index sharing

2015-02-25 Thread ankurdave
Repository: spark Updated Branches: refs/heads/branch-1.3 eaffc6edd - 8073767f5 [SPARK-1955][GraphX]: VertexRDD can incorrectly assume index sharing Fixes the issue whereby when VertexRDD's are `diff`ed, `innerJoin`ed, or `leftJoin`ed and have different partition sizes they fail under the

spark git commit: [SPARK-1955][GraphX]: VertexRDD can incorrectly assume index sharing

2015-02-25 Thread ankurdave
Repository: spark Updated Branches: refs/heads/master a777c65da - 9f603fce7 [SPARK-1955][GraphX]: VertexRDD can incorrectly assume index sharing Fixes the issue whereby when VertexRDD's are `diff`ed, `innerJoin`ed, or `leftJoin`ed and have different partition sizes they fail under the

spark git commit: [SPARK-1955][GraphX]: VertexRDD can incorrectly assume index sharing

2015-02-25 Thread ankurdave
Repository: spark Updated Branches: refs/heads/branch-1.2 a9abcaa2c - 00112baf9 [SPARK-1955][GraphX]: VertexRDD can incorrectly assume index sharing Fixes the issue whereby when VertexRDD's are `diff`ed, `innerJoin`ed, or `leftJoin`ed and have different partition sizes they fail under the

spark git commit: [SPARK-5926] [SQL] make DataFrame.explain leverage queryExecution.logical

2015-02-25 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 6fff9b872 - 5bd4b499a [SPARK-5926] [SQL] make DataFrame.explain leverage queryExecution.logical DataFrame.explain return wrong result when the query is DDL command. For example, the following two queries should print out the same

spark git commit: [SPARK-5926] [SQL] make DataFrame.explain leverage queryExecution.logical

2015-02-25 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 12dbf98c5 - 41e2e5acb [SPARK-5926] [SQL] make DataFrame.explain leverage queryExecution.logical DataFrame.explain return wrong result when the query is DDL command. For example, the following two queries should print out the same

spark git commit: [SPARK-1182][Docs] Sort the configuration parameters in configuration.md

2015-02-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master 41e2e5acb - 46a044a36 [SPARK-1182][Docs] Sort the configuration parameters in configuration.md Sorts all configuration options present on the `configuration.md` page to ease readability. Author: Brennon York brennon.y...@capitalone.com

spark git commit: [SPARK-6010] [SQL] Merging compatible Parquet schemas before computing splits

2015-02-25 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master f3f4c87b3 - e0fdd467e [SPARK-6010] [SQL] Merging compatible Parquet schemas before computing splits `ReadContext.init` calls `InitContext.getMergedKeyValueMetadata`, which doesn't know how to merge conflicting user defined key-value

spark git commit: [SPARK-6010] [SQL] Merging compatible Parquet schemas before computing splits

2015-02-25 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 9aca3c688 - 016f1f81c [SPARK-6010] [SQL] Merging compatible Parquet schemas before computing splits `ReadContext.init` calls `InitContext.getMergedKeyValueMetadata`, which doesn't know how to merge conflicting user defined key-value

[2/2] spark git commit: [SPARK-1182][Docs] Sort the configuration parameters in configuration.md

2015-02-25 Thread rxin
[SPARK-1182][Docs] Sort the configuration parameters in configuration.md Sorts all configuration options present on the `configuration.md` page to ease readability. Author: Brennon York brennon.y...@capitalone.com Closes #3863 from brennonyork/SPARK-1182 and squashes the following commits:

spark git commit: [SPARK-5982] Remove incorrect Local Read Time Metric

2015-02-25 Thread kayousterhout
Repository: spark Updated Branches: refs/heads/branch-1.3 8073767f5 - 791df93cd [SPARK-5982] Remove incorrect Local Read Time Metric This metric is incomplete, because the files are memory mapped, so much of the read from disk occurs later as tasks actually read the file's data. This should

spark git commit: [SPARK-5999][SQL] Remove duplicate Literal matching block

2015-02-25 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 016f1f81c - 6fff9b872 [SPARK-5999][SQL] Remove duplicate Literal matching block Author: Liang-Chi Hsieh vii...@gmail.com Closes #4760 from viirya/dup_literal and squashes the following commits: 06e7516 [Liang-Chi Hsieh] Remove

spark git commit: [SPARK-5982] Remove incorrect Local Read Time Metric

2015-02-25 Thread kayousterhout
Repository: spark Updated Branches: refs/heads/master 9f603fce7 - 838a48036 [SPARK-5982] Remove incorrect Local Read Time Metric This metric is incomplete, because the files are memory mapped, so much of the read from disk occurs later as tasks actually read the file's data. This should be

spark git commit: [SPARK-5944] [PySpark] fix version in Python API docs

2015-02-25 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 791df93cd - 9aca3c688 [SPARK-5944] [PySpark] fix version in Python API docs use RELEASE_VERSION when building the Python API docs Author: Davies Liu dav...@databricks.com Closes #4731 from davies/api_version and squashes the

spark git commit: [SPARK-5944] [PySpark] fix version in Python API docs

2015-02-25 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 838a48036 - f3f4c87b3 [SPARK-5944] [PySpark] fix version in Python API docs use RELEASE_VERSION when building the Python API docs Author: Davies Liu dav...@databricks.com Closes #4731 from davies/api_version and squashes the following

spark git commit: [SPARK-5974] [SPARK-5980] [mllib] [python] [docs] Update ML guide with save/load, Python GBT

2015-02-25 Thread meng
Repository: spark Updated Branches: refs/heads/master 46a044a36 - d20559b15 [SPARK-5974] [SPARK-5980] [mllib] [python] [docs] Update ML guide with save/load, Python GBT * Add GradientBoostedTrees Python examples to ML guide * I ran these in the pyspark shell, and they worked. * Add

spark git commit: [SPARK-5974] [SPARK-5980] [mllib] [python] [docs] Update ML guide with save/load, Python GBT

2015-02-25 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 5bd4b499a - a1b4856e5 [SPARK-5974] [SPARK-5980] [mllib] [python] [docs] Update ML guide with save/load, Python GBT * Add GradientBoostedTrees Python examples to ML guide * I ran these in the pyspark shell, and they worked. * Add

[1/2] spark git commit: [SPARK-5724] fix the misconfiguration in AkkaUtils

2015-02-25 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.3 a1b4856e5 - 56fa38ae6 [SPARK-5724] fix the misconfiguration in AkkaUtils https://issues.apache.org/jira/browse/SPARK-5724 In AkkaUtil, we set several failure detector related the parameters as following ``` al akkaConf =

spark git commit: [SPARK-5976][MLLIB] Add partitioner to factors returned by ALS

2015-02-25 Thread meng
Repository: spark Updated Branches: refs/heads/master d20559b15 - e43139f40 [SPARK-5976][MLLIB] Add partitioner to factors returned by ALS The model trained by ALS requires partitioning information to do quick lookup of a user/item factor for making recommendation on individual requests. In

spark git commit: [SPARK-5976][MLLIB] Add partitioner to factors returned by ALS

2015-02-25 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 56fa38ae6 - a51d9dbeb [SPARK-5976][MLLIB] Add partitioner to factors returned by ALS The model trained by ALS requires partitioning information to do quick lookup of a user/item factor for making recommendation on individual requests.