spark git commit: [SPARK-8430] ExternalShuffleBlockResolver of shuffle service should support UnsafeShuffleManager

Repository: spark Updated Branches: refs/heads/master 2c59d5c12 - 9baf09301 [SPARK-8430] ExternalShuffleBlockResolver of shuffle service should support UnsafeShuffleManager andrewor14 can you take a look?thanks Author: Lianhui Wang lianhuiwan...@gmail.com Closes #6873 from lianhuiwang

spark git commit: [SPARK-8430] ExternalShuffleBlockResolver of shuffle service should support UnsafeShuffleManager

Repository: spark Updated Branches: refs/heads/branch-1.4 1f2dafb77 - 6f2e41108 [SPARK-8430] ExternalShuffleBlockResolver of shuffle service should support UnsafeShuffleManager andrewor14 can you take a look?thanks Author: Lianhui Wang lianhuiwan...@gmail.com Closes #6873 from lianhuiwang

spark git commit: [HOTFIX] Fix scala style in DFSReadWriteTest that causes tests failed

Repository: spark Updated Branches: refs/heads/master c5876e529 - 4a462c282 [HOTFIX] Fix scala style in DFSReadWriteTest that causes tests failed This scala style problem causes tested failed. Author: Liang-Chi Hsieh vii...@gmail.com Closes #6907 from viirya/hotfix_style and squashes the

spark git commit: [SPARK-8373] [PYSPARK] Add emptyRDD to pyspark and fix the issue when calling sum on an empty RDD

Repository: spark Updated Branches: refs/heads/branch-1.4 f0513733d - 5e7973df0 [SPARK-8373] [PYSPARK] Add emptyRDD to pyspark and fix the issue when calling sum on an empty RDD This PR fixes the sum issue and also adds `emptyRDD` so that it's easy to create a test case. Author: zsxwing

spark git commit: [SPARK-7515] [DOC] Update documentation for PySpark on YARN with cluster mode

Repository: spark Updated Branches: refs/heads/branch-1.4 320c4420b - a7f6979d0 [SPARK-7515] [DOC] Update documentation for PySpark on YARN with cluster mode Now PySpark on YARN with cluster mode is supported so let's update doc. Author: Kousuke Saruta sarutakoss.nttdata.co.jp Closes #6040

spark git commit: [SPARK-8373] [PYSPARK] Add emptyRDD to pyspark and fix the issue when calling sum on an empty RDD

Repository: spark Updated Branches: refs/heads/master 2837e0670 - 0fc4b96f3 [SPARK-8373] [PYSPARK] Add emptyRDD to pyspark and fix the issue when calling sum on an empty RDD This PR fixes the sum issue and also adds `emptyRDD` so that it's easy to create a test case. Author: zsxwing

spark git commit: [SPARK-8095] Resolve dependencies of --packages in local ivy cache

be. cc andrewor14 Author: Burak Yavuz brk...@gmail.com Closes #6788 from brkyvz/local-ivy-fix and squashes the following commits: 2875bf4 [Burak Yavuz] fix temp dir bug 48cc648 [Burak Yavuz] improve deletion a69e3e6 [Burak Yavuz] delete cache before test as well 0037197 [Burak Yavuz] fix merge

spark git commit: [SPARK-8392] RDDOperationGraph: getting cached nodes is slow

Repository: spark Updated Branches: refs/heads/master 22732e1ec - e2cdb0568 [SPARK-8392] RDDOperationGraph: getting cached nodes is slow ```def getAllNodes: Seq[RDDOperationNode] = { _childNodes ++ _childClusters.flatMap(_.childNodes) }``` when the ```_childClusters``` has so many nodes, the

spark git commit: [SPARK-8095] Resolve dependencies of --packages in local ivy cache

andrewor14 Author: Burak Yavuz brk...@gmail.com Closes #6788 from brkyvz/local-ivy-fix and squashes the following commits: 2875bf4 [Burak Yavuz] fix temp dir bug 48cc648 [Burak Yavuz] improve deletion a69e3e6 [Burak Yavuz] delete cache before test as well 0037197 [Burak Yavuz] fix merge

spark git commit: [SPARK-8395] [DOCS] start-slave.sh docs incorrect

Repository: spark Updated Branches: refs/heads/master 0c1b2df04 - f005be027 [SPARK-8395] [DOCS] start-slave.sh docs incorrect start-slave.sh no longer takes a worker # param in 1.4+ Author: Sean Owen so...@cloudera.com Closes #6855 from srowen/SPARK-8395 and squashes the following commits:

spark git commit: [SPARK-7913] [CORE] Increase the maximum capacity of PartitionedPairBuffe, PartitionedSerializedPairBuffer and AppendOnlyMap

Repository: spark Updated Branches: refs/heads/master 0fc4b96f3 - a411a40de [SPARK-7913] [CORE] Increase the maximum capacity of PartitionedPairBuffe, PartitionedSerializedPairBuffer and AppendOnlyMap The previous growing strategy is alway doubling the capacity. This PR adjusts the growing

spark git commit: [SPARK-8161] Set externalBlockStoreInitialized to be true, after ExternalBlockStore is initialized

Repository: spark Updated Branches: refs/heads/master 98ee3512b - 7ad8c5d86 [SPARK-8161] Set externalBlockStoreInitialized to be true, after ExternalBlockStore is initialized externalBlockStoreInitialized is never set to be true, which causes the blocks stored in ExternalBlockStore can not

spark git commit: [SPARK-8161] Set externalBlockStoreInitialized to be true, after ExternalBlockStore is initialized

Repository: spark Updated Branches: refs/heads/branch-1.4 a7f6979d0 - d75c53d88 [SPARK-8161] Set externalBlockStoreInitialized to be true, after ExternalBlockStore is initialized externalBlockStoreInitialized is never set to be true, which causes the blocks stored in ExternalBlockStore can

spark git commit: [SPARK-8392] RDDOperationGraph: getting cached nodes is slow

Repository: spark Updated Branches: refs/heads/branch-1.4 73cf5def0 - 67ad12d79 [SPARK-8392] RDDOperationGraph: getting cached nodes is slow ```def getAllNodes: Seq[RDDOperationNode] = { _childNodes ++ _childClusters.flatMap(_.childNodes) }``` when the ```_childClusters``` has so many nodes,

spark git commit: [SPARK-8330] DAG visualization: trim whitespace from input

Repository: spark Updated Branches: refs/heads/master 19834fa91 - 886040515 [SPARK-8330] DAG visualization: trim whitespace from input Safeguard against DOM rewriting. Author: Andrew Or and...@databricks.com Closes #6787 from andrewor14/dag-viz-trim and squashes the following commits

spark git commit: [SPARK-8330] DAG visualization: trim whitespace from input

Repository: spark Updated Branches: refs/heads/branch-1.4 141eab71e - 760837341 [SPARK-8330] DAG visualization: trim whitespace from input Safeguard against DOM rewriting. Author: Andrew Or and...@databricks.com Closes #6787 from andrewor14/dag-viz-trim and squashes the following commits

spark git commit: [SPARK-8282] [SPARKR] Make number of threads used in RBackend configurable

Repository: spark Updated Branches: refs/heads/branch-1.4 7b88e6a1e - 28e8a6ea6 [SPARK-8282] [SPARKR] Make number of threads used in RBackend configurable Read number of threads for RBackend from configuration. [SPARK-8282] #comment Linking with JIRA Author: Hossein hoss...@databricks.com

spark git commit: [SPARK-8282] [SPARKR] Make number of threads used in RBackend configurable

Repository: spark Updated Branches: refs/heads/master 38112905b - 30ebf1a23 [SPARK-8282] [SPARKR] Make number of threads used in RBackend configurable Read number of threads for RBackend from configuration. [SPARK-8282] #comment Linking with JIRA Author: Hossein hoss...@databricks.com

spark git commit: [SPARK-7756] CORE RDDOperationScope fix for IBM Java

Repository: spark Updated Branches: refs/heads/master 30ebf1a23 - 19e30b48f [SPARK-7756] CORE RDDOperationScope fix for IBM Java IBM Java has an extra method when we do getStackTrace(): this is getStackTraceImpl, a native method. This causes two tests to fail within DStreamScopeSuite when

spark git commit: [SPARK-7756] CORE RDDOperationScope fix for IBM Java

Repository: spark Updated Branches: refs/heads/branch-1.4 28e8a6ea6 - 568d1d51d [SPARK-7756] CORE RDDOperationScope fix for IBM Java IBM Java has an extra method when we do getStackTrace(): this is getStackTraceImpl, a native method. This causes two tests to fail within DStreamScopeSuite

spark git commit: [SPARK-7261] [CORE] Change default log level to WARN in the REPL

Repository: spark Updated Branches: refs/heads/master e90c9d92d - 80043e9e7 [SPARK-7261] [CORE] Change default log level to WARN in the REPL 1. Add `log4j-defaults-repl.properties` that has log level WARN. 2. When logging is initialized, check whether inside the REPL. If so, use

spark git commit: [SPARK-8273] Driver hangs up when yarn shutdown in client mode

Repository: spark Updated Branches: refs/heads/master cb871c44c - 5014d0ed7 [SPARK-8273] Driver hangs up when yarn shutdown in client mode In client mode, if yarn was shut down with spark application running, the application will hang up after several retries(default: 30) because the

spark git commit: [SPARK-8290] spark class command builder need read SPARK_JAVA_OPTS and SPARK_DRIVER_MEMORY properly

Repository: spark Updated Branches: refs/heads/master 80043e9e7 - cb871c44c [SPARK-8290] spark class command builder need read SPARK_JAVA_OPTS and SPARK_DRIVER_MEMORY properly SPARK_JAVA_OPTS was missed in reconstructing the launcher part, we should add it back so process launched by

spark git commit: [SPARK-8273] Driver hangs up when yarn shutdown in client mode

Repository: spark Updated Branches: refs/heads/branch-1.4 568d1d51d - 2846a357f [SPARK-8273] Driver hangs up when yarn shutdown in client mode In client mode, if yarn was shut down with spark application running, the application will hang up after several retries(default: 30) because the

spark git commit: [SPARK-5479] [YARN] Handle --py-files correctly in YARN.

Repository: spark Updated Branches: refs/heads/master 8f7308f9c - 38112905b [SPARK-5479] [YARN] Handle --py-files correctly in YARN. The bug description is a little misleading: the actual issue is that .py files are not handled correctly when distributed by YARN. They're added to

spark git commit: [SPARK-7527] [CORE] Fix createNullValue to return the correct null values and REPL mode detection

Repository: spark Updated Branches: refs/heads/master 19e30b48f - e90c9d92d [SPARK-7527] [CORE] Fix createNullValue to return the correct null values and REPL mode detection The root cause of SPARK-7527 is `createNullValue` returns an incompatible value `Byte(0)` for `char` and `boolean`.

spark git commit: [MINOR] [UI] DAG visualization: trim whitespace from input

Repository: spark Updated Branches: refs/heads/master 490d5a72e - 0d5892dc7 [MINOR] [UI] DAG visualization: trim whitespace from input Just as a safeguard against DOM rewriting. Author: Andrew Or and...@databricks.com Closes #6732 from andrewor14/dag-viz-trim and squashes the following

spark git commit: [MINOR] [UI] DAG visualization: trim whitespace from input

Repository: spark Updated Branches: refs/heads/branch-1.4 a7b7a194a - 1175cfe08 [MINOR] [UI] DAG visualization: trim whitespace from input Just as a safeguard against DOM rewriting. Author: Andrew Or and...@databricks.com Closes #6732 from andrewor14/dag-viz-trim and squashes the following

spark git commit: [SPARK-8162] [HOTFIX] Fix NPE in spark-shell

find a way to fix that separately. Author: Andrew Or and...@databricks.com Closes #6711 from andrewor14/fix-spark-shell and squashes the following commits: bf62ecc [Andrew Or] Prevent NPE in spark-shell Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip

spark git commit: [SPARK-8162] [HOTFIX] Fix NPE in spark-shell

should find a way to fix that separately. Author: Andrew Or and...@databricks.com Closes #6711 from andrewor14/fix-spark-shell and squashes the following commits: bf62ecc [Andrew Or] Prevent NPE in spark-shell Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip

spark git commit: [SPARK-8145] [WEBUI] Trigger a double click on the span to show full job description.

Repository: spark Updated Branches: refs/heads/master 901a552c5 - 081db9479 [SPARK-8145] [WEBUI] Trigger a double click on the span to show full job description. When using the Spark SQL, Jobs tab and Stages tab display only part of SQL. I change it to display full SQL by double-click on

spark git commit: [SPARK-8145] [WEBUI] Trigger a double click on the span to show full job description.

Repository: spark Updated Branches: refs/heads/branch-1.4 b6fdc6cf1 - 9d1f4d66b [SPARK-8145] [WEBUI] Trigger a double click on the span to show full job description. When using the Spark SQL, Jobs tab and Stages tab display only part of SQL. I change it to display full SQL by double-click

spark git commit: [SPARK-7955] [CORE] Ensure executors with cached RDD blocks are not re…

Repository: spark Updated Branches: refs/heads/branch-1.4 d8a53fb80 - 6faaf15ba [SPARK-7955] [CORE] Ensure executors with cached RDD blocks are not re… …moved if dynamic allocation is enabled. This is a work in progress. This patch ensures that an executor that has cached RDD blocks are

spark git commit: [SPARK-8136] [YARN] Fix flakiness in YarnClusterSuite.

Repository: spark Updated Branches: refs/heads/master 18c4fcebb - ed2cc3ee8 [SPARK-8136] [YARN] Fix flakiness in YarnClusterSuite. Instead of actually downloading the logs, just verify that the logs link is actually a URL and is in the expected format. Author: Hari Shreedharan

spark git commit: [SPARK-7169] [CORE] Allow metrics system to be configured through SparkConf.

Repository: spark Updated Branches: refs/heads/master 5aa804f3c - 18c4fcebb [SPARK-7169] [CORE] Allow metrics system to be configured through SparkConf. Author: Marcelo Vanzin van...@cloudera.com Author: Jacek Lewandowski lewandowski.ja...@gmail.com Closes #6560 from vanzin/SPARK-7169 and

spark git commit: Revert [MINOR] [BUILD] Use custom temp directory during build.

Repository: spark Updated Branches: refs/heads/master 12f5eaeee - 4036d05ce Revert [MINOR] [BUILD] Use custom temp directory during build. This reverts commit b16b5434ff44c42e4b3a337f9af147669ba44896. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: Revert [MINOR] [BUILD] Use custom temp directory during build.

Repository: spark Updated Branches: refs/heads/branch-1.4 3e3151e75 - 429c65851 Revert [MINOR] [BUILD] Use custom temp directory during build. This reverts commit 9b3e4c187123baa22666b8e119ddd55dafecbf89. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [HOTFIX] [BUILD] Fix Maven build; add core test jar

Repository: spark Updated Branches: refs/heads/branch-1.3 ce137b8ed - 3e8b0406a [HOTFIX] [BUILD] Fix Maven build; add core test jar This was added later in ee11be258251adf900680927ba200bf46512cc04 in branch-1.4 but not branch-1.3. This patch adds a step in the maven jar plugin to make a jar

spark git commit: [SPARK-7205] [SPARK-7224] [SPARK-7306] Backport packages fixes

Repository: spark Updated Branches: refs/heads/branch-1.3 5e77d69c7 - 5b96b6933 [SPARK-7205] [SPARK-7224] [SPARK-7306] Backport packages fixes Main motivation is to fix the flaky `SparkSubmitUtilsSuite` in branch-1.3. brkyvz Author: Burak Yavuz brk...@gmail.com Closes #6657 from andrewor14

spark git commit: [MINOR] [UI] Improve confusing message on log page

Repository: spark Updated Branches: refs/heads/branch-1.4 bfab61f39 - 31e0ae9e1 [MINOR] [UI] Improve confusing message on log page It's good practice to check if the input path is in the directory we expect to avoid potentially confusing error messages. Project:

spark git commit: [MINOR] [UI] Improve confusing message on log page

Repository: spark Updated Branches: refs/heads/branch-1.3 e5747ee3a - 744599609 [MINOR] [UI] Improve confusing message on log page It's good practice to check if the input path is in the directory we expect to avoid potentially confusing error messages. Project:

spark git commit: [SPARK-8001] [CORE] Make AsynchronousListenerBus.waitUntilEmpty throw TimeoutException if timeout

Repository: spark Updated Branches: refs/heads/master aa40c4420 - 1d8669f15 [SPARK-8001] [CORE] Make AsynchronousListenerBus.waitUntilEmpty throw TimeoutException if timeout Some places forget to call `assert` to check the return value of `AsynchronousListenerBus.waitUntilEmpty`. Instead of

spark git commit: [HOTFIX] [TYPO] Fix typo in #6546

Repository: spark Updated Branches: refs/heads/master d8662cd90 - bfbdab12d [HOTFIX] [TYPO] Fix typo in #6546 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/bfbdab12 Tree:

spark git commit: [SPARK-8088] don't attempt to lower number of executors by 0

Repository: spark Updated Branches: refs/heads/master 566cb5947 - 51898b515 [SPARK-8088] don't attempt to lower number of executors by 0 Author: Ryan Williams ryan.blake.willi...@gmail.com Closes #6624 from ryan-williams/execs and squashes the following commits: b6f71d4 [Ryan Williams]

spark git commit: [SPARK-8059] [YARN] Wake up allocation thread when new requests arrive.

Repository: spark Updated Branches: refs/heads/master bfbf12b34 - aa40c4420 [SPARK-8059] [YARN] Wake up allocation thread when new requests arrive. This should help reduce latency for new executor allocations. Author: Marcelo Vanzin van...@cloudera.com Closes #6600 from vanzin/SPARK-8059

spark git commit: [HOTFIX] Fix Hadoop-1 build caused by #5792.

Repository: spark Updated Branches: refs/heads/master f27134782 - a8f1f1543 [HOTFIX] Fix Hadoop-1 build caused by #5792. Replaced `fs.listFiles` with Hadoop-1 friendly `fs.listStatus` method. Author: Hari Shreedharan hshreedha...@apache.org Closes #6619 from

spark git commit: [MINOR] [UI] Improve confusing message on log page

Repository: spark Updated Branches: refs/heads/master 20a26b595 - c6a6dd0d0 [MINOR] [UI] Improve confusing message on log page It's good practice to check if the input path is in the directory we expect to avoid potentially confusing error messages. Project:

spark git commit: [SPARK-8083] [MESOS] Use the correct base path in mesos driver page.

Repository: spark Updated Branches: refs/heads/master c6a6dd0d0 - bfbf12b34 [SPARK-8083] [MESOS] Use the correct base path in mesos driver page. Author: Timothy Chen tnac...@gmail.com Closes #6615 from tnachen/mesos_driver_path and squashes the following commits: 4f47b7c [Timothy Chen] Use

spark git commit: [HOTFIX] Unbreak build from backporting #6546

Repository: spark Updated Branches: refs/heads/branch-1.4 b2a22a651 - d0be9508f [HOTFIX] Unbreak build from backporting #6546 This is caused by 7e46ea0228f142f6b384331d62cec8f86e61c9d1. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [BUILD] Increase Jenkins test timeout

Repository: spark Updated Branches: refs/heads/master 0576c3c4f - e35cd36e0 [BUILD] Increase Jenkins test timeout Currently hive tests alone take 40m. The right thing to do is to reduce the test time. However, that is a bigger project and we currently have PRs blocking on tests not timing

spark git commit: [BUILD] Increase Jenkins test timeout

Repository: spark Updated Branches: refs/heads/branch-1.4 c2c129073 - 96f71b105 [BUILD] Increase Jenkins test timeout Currently hive tests alone take 40m. The right thing to do is to reduce the test time. However, that is a bigger project and we currently have PRs blocking on tests not timing

spark git commit: [SPARK-7989] [CORE] [TESTS] Fix flaky tests in ExternalShuffleServiceSuite and SparkListenerWithClusterSuite

Repository: spark Updated Branches: refs/heads/master 1d8669f15 - f27134782 [SPARK-7989] [CORE] [TESTS] Fix flaky tests in ExternalShuffleServiceSuite and SparkListenerWithClusterSuite The flaky tests in ExternalShuffleServiceSuite and SparkListenerWithClusterSuite will fail if there are

spark git commit: [SPARK-3674] [EC2] Clear SPARK_WORKER_INSTANCES when using YARN

Repository: spark Updated Branches: refs/heads/branch-1.4 7e46ea022 - ca21fff7d [SPARK-3674] [EC2] Clear SPARK_WORKER_INSTANCES when using YARN cc andrewor14 Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6424 from shivaram/spark-worker-instances-yarn-ec2 and squashes

spark git commit: [SPARK-8088] don't attempt to lower number of executors by 0

Repository: spark Updated Branches: refs/heads/branch-1.4 0bc9a3ec4 - 16748694b [SPARK-8088] don't attempt to lower number of executors by 0 Author: Ryan Williams ryan.blake.willi...@gmail.com Closes #6624 from ryan-williams/execs and squashes the following commits: b6f71d4 [Ryan Williams]

spark git commit: [HOTFIX] History Server API docs error fix.

Repository: spark Updated Branches: refs/heads/master bfbdab12d - 566cb5947 [HOTFIX] History Server API docs error fix. Minor error in the monitoring docs. Also made indentation changes in `ApiRootResource` Author: Hari Shreedharan hshreedha...@apache.org Closes #6628 from

spark git commit: [BUILD] Use right branch when checking against Hive

against the target branch itself. Author: Andrew Or and...@databricks.com Closes #6629 from andrewor14/build-check-hive and squashes the following commits: 450fbbd [Andrew Or] [BUILD] Use right branch when checking against Hive Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http

spark git commit: [BUILD] Use right branch when checking against Hive (1.4)

to test it out here. Author: Andrew Or and...@databricks.com Closes #6630 from andrewor14/build-check-hive-1.4 and squashes the following commits: 186ec65 [Andrew Or] [BUILD] Use right branch when checking against Hive Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git

[4/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log (1.4)

http://git-wip-us.apache.org/repos/asf/spark/blob/bfe74b34/core/src/test/scala/org/apache/spark/util/collection/AppendOnlyMapSuite.scala -- diff --git

[6/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log (1.4)

[SPARK-7558] Demarcate tests in unit-tests.log (1.4) This includes the following commits: original: 9eb222c hotfix1: 8c99793 hotfix2: a4f2412 scalastyle check: 609c492 --- Original patch #6441 Branch-1.3 patch #6602 Author: Andrew Or and...@databricks.com Closes #6598 from andrewor14

[5/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log (1.4)

http://git-wip-us.apache.org/repos/asf/spark/blob/bfe74b34/core/src/test/scala/org/apache/spark/network/netty/NettyBlockTransferSecuritySuite.scala -- diff --git

spark git commit: [BUILD] Fix Maven build for Kinesis

Repository: spark Updated Branches: refs/heads/branch-1.4 bfe74b34a - 84da65319 [BUILD] Fix Maven build for Kinesis A necessary dependency that is transitively referenced is not provided, causing compilation failures in builds that provide the kinesis-asl profile. Project:

spark git commit: [BUILD] Fix Maven build for Kinesis

Repository: spark Updated Branches: refs/heads/master 9cf740f35 - 984ad6014 [BUILD] Fix Maven build for Kinesis A necessary dependency that is transitively referenced is not provided, causing compilation failures in builds that provide the kinesis-asl profile. Project:

[1/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log (1.4)

Repository: spark Updated Branches: refs/heads/branch-1.4 584a2ba21 - bfe74b34a http://git-wip-us.apache.org/repos/asf/spark/blob/bfe74b34/yarn/src/test/scala/org/apache/spark/deploy/yarn/ClientDistributedCacheManagerSuite.scala

[3/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log (1.4)

http://git-wip-us.apache.org/repos/asf/spark/blob/bfe74b34/mllib/src/test/scala/org/apache/spark/ml/regression/LinearRegressionSuite.scala -- diff --git

[1/5] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log (1.3)

Repository: spark Updated Branches: refs/heads/branch-1.3 bbd377228 - e5747ee3a http://git-wip-us.apache.org/repos/asf/spark/blob/e5747ee3/streaming/src/test/scala/org/apache/spark/streaming/UISeleniumSuite.scala -- diff --git

[3/5] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log (1.3)

http://git-wip-us.apache.org/repos/asf/spark/blob/e5747ee3/external/flume/src/test/scala/org/apache/spark/streaming/flume/FlumeStreamSuite.scala -- diff --git

[4/5] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log (1.3)

http://git-wip-us.apache.org/repos/asf/spark/blob/e5747ee3/core/src/test/scala/org/apache/spark/rdd/DoubleRDDSuite.scala -- diff --git a/core/src/test/scala/org/apache/spark/rdd/DoubleRDDSuite.scala

[2/5] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log (1.3)

http://git-wip-us.apache.org/repos/asf/spark/blob/e5747ee3/mllib/src/test/scala/org/apache/spark/mllib/regression/LassoSuite.scala -- diff --git a/mllib/src/test/scala/org/apache/spark/mllib/regression/LassoSuite.scala

spark git commit: [MINOR] [UI] Improve error message on log page

Repository: spark Updated Branches: refs/heads/branch-1.3 ad5daa3a3 - 476b87d31 [MINOR] [UI] Improve error message on log page Currently if a bad log type if specified, then we get blank. We should provide a more informative error message. Project:

spark git commit: [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior

the testing Thrift server process to ensure proper logging behavior. cc andrewor14 yhuai Author: Cheng Lian l...@databricks.com Closes #6493 from liancheng/override-log4j and squashes the following commits: c489e0e [Cheng Lian] Fixes minor Scala styling issue b46ef0d [Cheng Lian] Uses

spark git commit: [SQL] [TEST] [MINOR] Follow-up of PR #6493, use Guava API to ensure Java 6 friendliness

build. This PR replaces those APIs with equivalent Guava ones to ensure Java 6 friendliness. cc andrewor14 pwendell, this should also be back ported to branch-1.4. Author: Cheng Lian l...@databricks.com Closes #6547 from liancheng/override-log4j and squashes the following commits: c900cfd [Cheng

spark git commit: [SQL] [TEST] [MINOR] Follow-up of PR #6493, use Guava API to ensure Java 6 friendliness

6 build. This PR replaces those APIs with equivalent Guava ones to ensure Java 6 friendliness. cc andrewor14 pwendell, this should also be back ported to branch-1.4. Author: Cheng Lian l...@databricks.com Closes #6547 from liancheng/override-log4j and squashes the following commits: c900cfd

spark git commit: [MINOR] [UI] Improve error message on log page

Repository: spark Updated Branches: refs/heads/branch-1.4 a7c8b00b7 - f5a9833f3 [MINOR] [UI] Improve error message on log page Currently if a bad log type if specified, then we get blank. We should provide a more informative error message. Project:

spark git commit: [MINOR] [UI] Improve error message on log page

Repository: spark Updated Branches: refs/heads/master 2f9c7519d - 15d7c90ae [MINOR] [UI] Improve error message on log page Currently if a bad log type if specified, then we get blank. We should provide a more informative error message. Project:

spark git commit: [MINOR] Add license for dagre-d3 and graphlib-dot

Repository: spark Updated Branches: refs/heads/branch-1.4 01f38f75d - 8a72bc917 [MINOR] Add license for dagre-d3 and graphlib-dot Add license for dagre-d3 and graphlib-dot Author: zsxwing zsxw...@gmail.com Closes #6539 from zsxwing/LICENSE and squashes the following commits: 82b0475

spark git commit: [MINOR] Add license for dagre-d3 and graphlib-dot

Repository: spark Updated Branches: refs/heads/master 4b5f12bac - d1d2def2f [MINOR] Add license for dagre-d3 and graphlib-dot Add license for dagre-d3 and graphlib-dot Author: zsxwing zsxw...@gmail.com Closes #6539 from zsxwing/LICENSE and squashes the following commits: 82b0475 [zsxwing]

spark git commit: [TRIVIAL] Typo fix for last commit

Repository: spark Updated Branches: refs/heads/master 609c4923f - 193dba01c [TRIVIAL] Typo fix for last commit Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/193dba01 Tree:

spark git commit: [SPARK-7962] [MESOS] Fix master url parsing in rest submission client.

Repository: spark Updated Branches: refs/heads/branch-1.4 11a4b30d1 - 8938a7489 [SPARK-7962] [MESOS] Fix master url parsing in rest submission client. Only parse standalone master url when master url starts with spark:// Author: Timothy Chen tnac...@gmail.com Closes #6517 from

spark git commit: [SPARK-7962] [MESOS] Fix master url parsing in rest submission client.

Repository: spark Updated Branches: refs/heads/master da2112aef - 78657d53d [SPARK-7962] [MESOS] Fix master url parsing in rest submission client. Only parse standalone master url when master url starts with spark:// Author: Timothy Chen tnac...@gmail.com Closes #6517 from

spark git commit: [HOT FIX] [BUILD] Fix maven build failures

: Andrew Or and...@databricks.com Closes #6511 from andrewor14/fix-build-mvn and squashes the following commits: 3d53643 [Andrew Or] [HOT FIX #6441] Fix maven build failures Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a4f24123

spark git commit: [HOTFIX] [SQL] Maven test compilation issue

Repository: spark Updated Branches: refs/heads/master dbf8ff38d - 8c9979337 [HOTFIX] [SQL] Maven test compilation issue Tests compile in SBT but not Maven. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8c997933 Tree:

[6/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

: * FINISHED o.a.s.serializer.KryoSerializerSuite: 'kryo with parallelize for primitive arrays' * ... ``` Author: Andrew Or and...@databricks.com Closes #6441 from andrewor14/demarcate-tests and squashes the following commits: 879b060 [Andrew Or] Fix compile after rebase d622af7 [Andrew Or] Merge

[4/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/core/src/test/scala/org/apache/spark/util/collection/AppendOnlyMapSuite.scala -- diff --git

[1/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

Repository: spark Updated Branches: refs/heads/master 94f62a497 - 9eb222c13 http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnAllocatorSuite.scala -- diff --git

[2/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala -- diff --git a/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala

[5/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/core/src/test/scala/org/apache/spark/network/netty/NettyBlockTransferSecuritySuite.scala -- diff --git

[3/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/mllib/src/test/scala/org/apache/spark/ml/regression/RandomForestRegressorSuite.scala -- diff --git

spark git commit: [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior

the testing Thrift server process to ensure proper logging behavior. cc andrewor14 yhuai Author: Cheng Lian l...@databricks.com Closes #6493 from liancheng/override-log4j and squashes the following commits: c489e0e [Cheng Lian] Fixes minor Scala styling issue b46ef0d [Cheng Lian] Uses

spark git commit: [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior

the testing Thrift server process to ensure proper logging behavior. cc andrewor14 yhuai Author: Cheng Lian l...@databricks.com Closes #6493 from liancheng/override-log4j and squashes the following commits: c489e0e [Cheng Lian] Fixes minor Scala styling issue b46ef0d [Cheng Lian] Uses a temporary

spark git commit: [MINOR] Fix the a minor bug in PageRank Example.

Repository: spark Updated Branches: refs/heads/branch-1.2 d5763c3b9 - c0a0eaacc [MINOR] Fix the a minor bug in PageRank Example. Fix the bug that entering only 1 arg will cause array out of bounds exception in PageRank example. Author: Li Yao hnkfli...@gmail.com Closes #6455 from

spark git commit: [MINOR] Fix the a minor bug in PageRank Example.

Repository: spark Updated Branches: refs/heads/branch-1.3 33e1539b3 - 7a3feb552 [MINOR] Fix the a minor bug in PageRank Example. Fix the bug that entering only 1 arg will cause array out of bounds exception in PageRank example. Author: Li Yao hnkfli...@gmail.com Closes #6455 from

spark git commit: [MINOR] Fix the a minor bug in PageRank Example.

Repository: spark Updated Branches: refs/heads/branch-1.4 7b5dffb80 - 448528398 [MINOR] Fix the a minor bug in PageRank Example. Fix the bug that entering only 1 arg will cause array out of bounds exception in PageRank example. Author: Li Yao hnkfli...@gmail.com Closes #6455 from

spark git commit: [MINOR] Fix the a minor bug in PageRank Example.

Repository: spark Updated Branches: refs/heads/master 530efe3e8 - c771589c9 [MINOR] Fix the a minor bug in PageRank Example. Fix the bug that entering only 1 arg will cause array out of bounds exception in PageRank example. Author: Li Yao hnkfli...@gmail.com Closes #6455 from

spark git commit: [SPARK-7864] [UI] Fix the logic grabbing the link from table in AllJobPage

Repository: spark Updated Branches: refs/heads/branch-1.4 a25ce91f9 - 13044b046 [SPARK-7864] [UI] Fix the logic grabbing the link from table in AllJobPage This issue is related to #6419 . Now AllJobPage doesn't have a kill link but I think fix the issue mentioned in #6419 just in case to

spark git commit: [SPARK-7864] [UI] Fix the logic grabbing the link from table in AllJobPage

Repository: spark Updated Branches: refs/heads/master 15459db4f - 0db76c90a [SPARK-7864] [UI] Fix the logic grabbing the link from table in AllJobPage This issue is related to #6419 . Now AllJobPage doesn't have a kill link but I think fix the issue mentioned in #6419 just in case to avoid

spark git commit: [SPARK-6602] [CORE] Remove some places in core that calling SparkEnv.actorSystem

Repository: spark Updated Branches: refs/heads/master 2e9a5f229 - 9f742241c [SPARK-6602] [CORE] Remove some places in core that calling SparkEnv.actorSystem Author: zsxwing zsxw...@gmail.com Closes #6333 from zsxwing/remove-actor-system-usage and squashes the following commits: f125aa6

spark git commit: [SPARK-7864] [UI] Do not kill innocent stages from visualization

. Thanks carsonwang for catching this. Author: Andrew Or and...@databricks.com Closes #6419 from andrewor14/fix-ui-viz-kill and squashes the following commits: 25203bd [Andrew Or] Do not kill innocent stages (cherry picked from commit 8f2082426828c15704426ebca1d015bf956c6841) Signed-off-by: Andrew

spark git commit: [SPARK-7864] [UI] Do not kill innocent stages from visualization

carsonwang for catching this. Author: Andrew Or and...@databricks.com Closes #6419 from andrewor14/fix-ui-viz-kill and squashes the following commits: 25203bd [Andrew Or] Do not kill innocent stages Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org

spark git commit: [SPARK-3674] YARN support in Spark EC2

andrewor14 Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6376 from shivaram/spark-ec2-yarn and squashes the following commits: 961504a [Shivaram Venkataraman] Merge branch 'master' of https://github.com/apache/spark into spark-ec2-yarn 152c94c [Shivaram Venkataraman] Open 8088

spark git commit: [HOTFIX] Add tests for SparkListenerApplicationStart with Driver Logs.

Repository: spark Updated Branches: refs/heads/master baa89838c - 368b8c2b5 [HOTFIX] Add tests for SparkListenerApplicationStart with Driver Logs. #6166 added the driver logs to `SparkListenerApplicationStart`. This adds tests in `JsonProtocolSuite` to ensure we don't regress. Author: Hari

<    3   4   5   6   7   8   9   10   11   12   >