spark git commit: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-31 Thread srowen
Repository: spark Updated Branches: refs/heads/master 382fefd18 -> beed5e20a [DOCS][MINOR] Scaladoc fixes (aka typo hunting) ## What changes were proposed in this pull request? Minor changes to scaladoc ## How was this patch tested? Local build Author: Jacek Laskowski Closes #18074 from

spark git commit: [SPARK-20790][MLLIB] Correctly handle negative values for implicit feedback in ALS

2017-05-31 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 3cad66e5e -> 3686c2e96 [SPARK-20790][MLLIB] Correctly handle negative values for implicit feedback in ALS ## What changes were proposed in this pull request? Revert the handling of negative values in ALS with implicit feedback, so tha

spark git commit: [SPARK-20790][MLLIB] Correctly handle negative values for implicit feedback in ALS

2017-05-31 Thread srowen
Repository: spark Updated Branches: refs/heads/master beed5e20a -> d52f63622 [SPARK-20790][MLLIB] Correctly handle negative values for implicit feedback in ALS ## What changes were proposed in this pull request? Revert the handling of negative values in ALS with implicit feedback, so that t

spark git commit: [SPARK-20288] Avoid generating the MapStatus by stageId in BasicSchedulerIntegrationSuite

2017-05-31 Thread irashid
Repository: spark Updated Branches: refs/heads/master d52f63622 -> ac7fc3075 [SPARK-20288] Avoid generating the MapStatus by stageId in BasicSchedulerIntegrationSuite ## What changes were proposed in this pull request? ShuffleId is determined before job submitted. But it's hard to predict st

spark git commit: [SPARK-20633][SQL] FileFormatWriter should not wrap FetchFailedException

2017-05-31 Thread irashid
Repository: spark Updated Branches: refs/heads/master ac7fc3075 -> d0f36bcb1 [SPARK-20633][SQL] FileFormatWriter should not wrap FetchFailedException ## What changes were proposed in this pull request? Explicitly handle the FetchFailedException in FileFormatWriter, so it does not get wrapped

spark git commit: [SPARK-19236][SQL][FOLLOW-UP] Added createOrReplaceGlobalTempView method

2017-05-31 Thread wenchen
Repository: spark Updated Branches: refs/heads/master d0f36bcb1 -> de934e671 [SPARK-19236][SQL][FOLLOW-UP] Added createOrReplaceGlobalTempView method ### What changes were proposed in this pull request? This PR does the following tasks: - Added since - Added the Python API - Added test cases

spark git commit: [SPARK-20876][SQL][BACKPORT-2.2] If the input parameter is float type for ceil or floor, the result is not we expected

2017-05-31 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 3686c2e96 -> f59f9a380 [SPARK-20876][SQL][BACKPORT-2.2] If the input parameter is float type for ceil or floor,the result is not we expected ## What changes were proposed in this pull request? This PR is to backport #18103 to Spark 2.

spark git commit: [SPARK-20894][SS] Resolve the checkpoint location in driver and use the resolved path in state store

2017-05-31 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master de934e671 -> 2bc327288 [SPARK-20894][SS] Resolve the checkpoint location in driver and use the resolved path in state store ## What changes were proposed in this pull request? When the user runs a Structured Streaming query in a cluster,

spark git commit: [SPARK-20940][CORE] Replace IllegalAccessError with IllegalStateException

2017-05-31 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.2 f59f9a380 -> a607a26b3 [SPARK-20940][CORE] Replace IllegalAccessError with IllegalStateException ## What changes were proposed in this pull request? `IllegalAccessError` is a fatal error (a subclass of LinkageError) and its meaning is

spark git commit: [SPARK-20940][CORE] Replace IllegalAccessError with IllegalStateException

2017-05-31 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 9846a3c4b -> cd870c0c9 [SPARK-20940][CORE] Replace IllegalAccessError with IllegalStateException ## What changes were proposed in this pull request? `IllegalAccessError` is a fatal error (a subclass of LinkageError) and its meaning is

spark git commit: [SPARK-20940][CORE] Replace IllegalAccessError with IllegalStateException

2017-05-31 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 46400867c -> dade85f7f [SPARK-20940][CORE] Replace IllegalAccessError with IllegalStateException ## What changes were proposed in this pull request? `IllegalAccessError` is a fatal error (a subclass of LinkageError) and its meaning is

spark git commit: [SPARK-20940][CORE] Replace IllegalAccessError with IllegalStateException

2017-05-31 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 2bc327288 -> 24db35826 [SPARK-20940][CORE] Replace IllegalAccessError with IllegalStateException ## What changes were proposed in this pull request? `IllegalAccessError` is a fatal error (a subclass of LinkageError) and its meaning is `Th

spark git commit: [SPARK-20244][CORE] Handle incorrect bytesRead metrics when using PySpark

2017-05-31 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 24db35826 -> 5854f77ce [SPARK-20244][CORE] Handle incorrect bytesRead metrics when using PySpark ## What changes were proposed in this pull request? Hadoop FileSystem's statistics in based on thread local variables, this is ok if the RDD

spark git commit: [SPARK-20244][CORE] Handle incorrect bytesRead metrics when using PySpark

2017-05-31 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 a607a26b3 -> 14fda6f31 [SPARK-20244][CORE] Handle incorrect bytesRead metrics when using PySpark ## What changes were proposed in this pull request? Hadoop FileSystem's statistics in based on thread local variables, this is ok if the

spark git commit: [SPARK-20708][CORE] Make `addExclusionRules` up-to-date

2017-05-31 Thread brkyvz
Repository: spark Updated Branches: refs/heads/master 5854f77ce -> 34661d8a5 [SPARK-20708][CORE] Make `addExclusionRules` up-to-date ## What changes were proposed in this pull request? Since [SPARK-9263](https://issues.apache.org/jira/browse/SPARK-9263), `resolveMavenCoordinates` ignores Spa

spark git commit: [MINOR][SQL] Fix a few function description error.

2017-05-31 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 34661d8a5 -> c8045f8b4 [MINOR][SQL] Fix a few function description error. ## What changes were proposed in this pull request? Fix a few function description error. ## How was this patch tested? manual tests ![descissues](https://cloud.g

spark git commit: [MINOR][SQL] Fix a few function description error.

2017-05-31 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 14fda6f31 -> 4ab7b820b [MINOR][SQL] Fix a few function description error. ## What changes were proposed in this pull request? Fix a few function description error. ## How was this patch tested? manual tests ![descissues](https://clo