spark git commit: [SPARK-9731] Standalone scheduling incorrect cores if spark.executor.cores is not set

2015-08-08 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master c564b2744 - ef062c159 [SPARK-9731] Standalone scheduling incorrect cores if spark.executor.cores is not set The issue only happens if `spark.executor.cores` is not set and executor memory is set to a high value. For example, if we have a

spark git commit: [SPARK-4176] [SQL] [MINOR] Should use unscaled Long to write decimals for precision = 18 rather than 8

2015-08-08 Thread lian
Repository: spark Updated Branches: refs/heads/branch-1.5 2ad75d99f - 2cd96329f [SPARK-4176] [SQL] [MINOR] Should use unscaled Long to write decimals for precision = 18 rather than 8 This PR fixes a minor bug introduced in #7455: when writing decimals, we should use the unscaled Long for

spark git commit: [SPARK-9738] [SQL] remove FromUnsafe and add its codegen version to GenerateSafe

2015-08-08 Thread davies
Repository: spark Updated Branches: refs/heads/branch-1.5 2cd96329f - 3ed219f62 [SPARK-9738] [SQL] remove FromUnsafe and add its codegen version to GenerateSafe In https://github.com/apache/spark/pull/7752 we added `FromUnsafe` to convert nexted unsafe data like array/map/struct to safe

spark git commit: [SPARK-6902] [SQL] [PYSPARK] Row should be read-only

2015-08-08 Thread davies
Repository: spark Updated Branches: refs/heads/master 74a6541aa - ac507a03c [SPARK-6902] [SQL] [PYSPARK] Row should be read-only Raise an read-only exception when user try to mutable a Row. Author: Davies Liu dav...@databricks.com Closes #8009 from davies/readonly_row and squashes the

spark git commit: [SPARK-6902] [SQL] [PYSPARK] Row should be read-only

2015-08-08 Thread davies
Repository: spark Updated Branches: refs/heads/branch-1.5 aaa475c98 - 3427f5731 [SPARK-6902] [SQL] [PYSPARK] Row should be read-only Raise an read-only exception when user try to mutable a Row. Author: Davies Liu dav...@databricks.com Closes #8009 from davies/readonly_row and squashes the

spark git commit: [SPARK-9486][SQL] Add data source aliasing for external packages

2015-08-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master 23695f1d2 - a3aec918b [SPARK-9486][SQL] Add data source aliasing for external packages Users currently have to provide the full class name for external data sources, like: `sqlContext.read.format(com.databricks.spark.avro).load(path)`

spark git commit: [SPARK-9486][SQL] Add data source aliasing for external packages

2015-08-08 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.5 3c438c789 - 06b623403 [SPARK-9486][SQL] Add data source aliasing for external packages Users currently have to provide the full class name for external data sources, like:

spark git commit: [MINOR] inaccurate comments for showString()

2015-08-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master a3aec918b - 25c363e93 [MINOR] inaccurate comments for showString() Author: CodingCat zhunans...@gmail.com Closes #8050 from CodingCat/minor and squashes the following commits: 5bc4b89 [CodingCat] inaccurate comments Project:

spark git commit: [MINOR] inaccurate comments for showString()

2015-08-08 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.5 06b623403 - 874b9d855 [MINOR] inaccurate comments for showString() Author: CodingCat zhunans...@gmail.com Closes #8050 from CodingCat/minor and squashes the following commits: 5bc4b89 [CodingCat] inaccurate comments (cherry picked

spark git commit: [SPARK-6212] [SQL] The EXPLAIN output of CTAS only shows the analyzed plan

2015-08-08 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.5 874b9d855 - 251d1eef4 [SPARK-6212] [SQL] The EXPLAIN output of CTAS only shows the analyzed plan JIRA: https://issues.apache.org/jira/browse/SPARK-6212 Author: Yijie Shen henry.yijies...@gmail.com Closes #7986 from

spark git commit: [SPARK-6212] [SQL] The EXPLAIN output of CTAS only shows the analyzed plan

2015-08-08 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 25c363e93 - 3ca995b78 [SPARK-6212] [SQL] The EXPLAIN output of CTAS only shows the analyzed plan JIRA: https://issues.apache.org/jira/browse/SPARK-6212 Author: Yijie Shen henry.yijies...@gmail.com Closes #7986 from yjshen/ctas_explain