spark git commit: [SPARK-21578][CORE] Add JavaSparkContextSuite

Repository: spark Updated Branches: refs/heads/master 4cc704b12 -> 14e75758a [SPARK-21578][CORE] Add JavaSparkContextSuite ## What changes were proposed in this pull request? Due to SI-8479, [SPARK-1093](https://issues.apache.org/jira/browse/SPARK-21578) introduced redundant [SparkContext

spark git commit: [CORE][MINOR] Improve the error message of checkpoint RDD verification

Repository: spark Updated Branches: refs/heads/master 77cc0d67d -> 4cc704b12 [CORE][MINOR] Improve the error message of checkpoint RDD verification ### What changes were proposed in this pull request? The original error message is pretty confusing. It is unable to tell which number is

spark git commit: [SPARK-12717][PYTHON] Adding thread-safe broadcast pickle registry

Repository: spark Updated Branches: refs/heads/master 58da1a245 -> 77cc0d67d [SPARK-12717][PYTHON] Adding thread-safe broadcast pickle registry ## What changes were proposed in this pull request? When using PySpark broadcast variables in a multi-threaded environment,

spark git commit: [SPARK-21339][CORE] spark-shell --packages option does not add jars to classpath on windows

Repository: spark Updated Branches: refs/heads/branch-2.2 79e5805f9 -> 67c60d78e [SPARK-21339][CORE] spark-shell --packages option does not add jars to classpath on windows The --packages option jars are getting added to the classpath with the scheme as "file:///", in Unix it doesn't have

spark git commit: [SPARK-21339][CORE] spark-shell --packages option does not add jars to classpath on windows

Repository: spark Updated Branches: refs/heads/master b1d59e60d -> 58da1a245 [SPARK-21339][CORE] spark-shell --packages option does not add jars to classpath on windows The --packages option jars are getting added to the classpath with the scheme as "file:///", in Unix it doesn't have

spark git commit: [SPARK-21593][DOCS] Fix 2 rendering errors on configuration page

Repository: spark Updated Branches: refs/heads/master 74cda94c5 -> b1d59e60d [SPARK-21593][DOCS] Fix 2 rendering errors on configuration page ## What changes were proposed in this pull request? Fix 2 rendering errors on configuration doc page, due to SPARK-21243 and SPARK-15355. ## How was

spark git commit: [SPARK-21593][DOCS] Fix 2 rendering errors on configuration page

Repository: spark Updated Branches: refs/heads/branch-2.2 174543466 -> 79e5805f9 [SPARK-21593][DOCS] Fix 2 rendering errors on configuration page ## What changes were proposed in this pull request? Fix 2 rendering errors on configuration doc page, due to SPARK-21243 and SPARK-15355. ## How

spark git commit: [SPARK-21592][BUILD] Skip maven-compiler-plugin main and test compilations in Maven build

Repository: spark Updated Branches: refs/heads/master 6735433cd -> 74cda94c5 [SPARK-21592][BUILD] Skip maven-compiler-plugin main and test compilations in Maven build `scala-maven-plugin` in `incremental` mode compiles `Scala` and `Java` classes. There is no need to execute

spark git commit: [SPARK-20079][YARN] Fix client AM not allocating executors after restart.

Repository: spark Updated Branches: refs/heads/master b13350180 -> 6735433cd [SPARK-20079][YARN] Fix client AM not allocating executors after restart. The main goal of this change is to avoid the situation described in the bug, where an AM restart in the middle of a job may cause no new

spark git commit: [SPARK-21522][CORE] Fix flakiness in LauncherServerSuite.

Repository: spark Updated Branches: refs/heads/branch-2.0 f8ae2bdd2 -> c27a01aec [SPARK-21522][CORE] Fix flakiness in LauncherServerSuite. Handle the case where the server closes the socket before the full message has been written by the client. Author: Marcelo Vanzin

spark git commit: [SPARK-21522][CORE] Fix flakiness in LauncherServerSuite.

Repository: spark Updated Branches: refs/heads/branch-2.1 78f7cdfa1 -> b31b30209 [SPARK-21522][CORE] Fix flakiness in LauncherServerSuite. Handle the case where the server closes the socket before the full message has been written by the client. Author: Marcelo Vanzin

spark git commit: [SPARK-21522][CORE] Fix flakiness in LauncherServerSuite.

Repository: spark Updated Branches: refs/heads/master 97ccc63f7 -> b13350180 [SPARK-21522][CORE] Fix flakiness in LauncherServerSuite. Handle the case where the server closes the socket before the full message has been written by the client. Author: Marcelo Vanzin

spark git commit: [SPARK-21585] Application Master marking application status as Failed for Client Mode

Repository: spark Updated Branches: refs/heads/master 253a07e43 -> 97ccc63f7 [SPARK-21585] Application Master marking application status as Failed for Client Mode The fix deployed for SPARK-21541 resulted in the Application Master to set the final status of a spark application as Failed for

spark git commit: [SPARK-21388][ML][PYSPARK] GBTs inherit from HasStepSize & LInearSVC from HasThreshold

Repository: spark Updated Branches: refs/heads/master 5fd0294ff -> 253a07e43 [SPARK-21388][ML][PYSPARK] GBTs inherit from HasStepSize & LInearSVC from HasThreshold ## What changes were proposed in this pull request? GBTs inherit from HasStepSize & LInearSVC/Binarizer from HasThreshold ##

spark git commit: [SPARK-21475][CORE] Use NIO's Files API to replace FileInputStream/FileOutputStream in some critical paths

Repository: spark Updated Branches: refs/heads/master 110695db7 -> 5fd0294ff [SPARK-21475][CORE] Use NIO's Files API to replace FileInputStream/FileOutputStream in some critical paths ## What changes were proposed in this pull request? Java's `FileInputStream` and `FileOutputStream`

spark git commit: [SPARK-21589][SQL][DOC] Add documents about Hive UDF/UDTF/UDAF

Repository: spark Updated Branches: refs/heads/master 9570e81aa -> 110695db7 [SPARK-21589][SQL][DOC] Add documents about Hive UDF/UDTF/UDAF ## What changes were proposed in this pull request? This pr added documents about unsupported functions in Hive UDF/UDTF/UDAF. This pr relates to #18768