spark git commit: [SPARK-5227] [SPARK-5679] Disable FileSystem cache in WholeTextFileRecordReaderSuite

2015-02-13 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.2 c2b4633f0 -> 26410a2d3 [SPARK-5227] [SPARK-5679] Disable FileSystem cache in WholeTextFileRecordReaderSuite This patch fixes two difficult-to-reproduce Jenkins test failures in InputOutputMetricsSuite (SPARK-5227 and SPARK-5679). The

spark git commit: [SPARK-5227] [SPARK-5679] Disable FileSystem cache in WholeTextFileRecordReaderSuite

2015-02-13 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 4f4c6d5a5 -> d06d5ee9b [SPARK-5227] [SPARK-5679] Disable FileSystem cache in WholeTextFileRecordReaderSuite This patch fixes two difficult-to-reproduce Jenkins test failures in InputOutputMetricsSuite (SPARK-5227 and SPARK-5679). The pro

spark git commit: [SPARK-5227] [SPARK-5679] Disable FileSystem cache in WholeTextFileRecordReaderSuite

2015-02-13 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 fccd38d2e -> 152147f5f [SPARK-5227] [SPARK-5679] Disable FileSystem cache in WholeTextFileRecordReaderSuite This patch fixes two difficult-to-reproduce Jenkins test failures in InputOutputMetricsSuite (SPARK-5227 and SPARK-5679). The

spark git commit: [SPARK-5730][ML] add doc groups to spark.ml components

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/master d50a91d52 -> 4f4c6d5a5 [SPARK-5730][ML] add doc groups to spark.ml components This PR adds three groups to the ScalaDoc: `param`, `setParam`, and `getParam`. Params will show up in the generated Scala API doc as the top group. Setters/get

spark git commit: [SPARK-5730][ML] add doc groups to spark.ml components

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 356b798b3 -> fccd38d2e [SPARK-5730][ML] add doc groups to spark.ml components This PR adds three groups to the ScalaDoc: `param`, `setParam`, and `getParam`. Params will show up in the generated Scala API doc as the top group. Setters

spark git commit: [SPARK-5803][MLLIB] use ArrayBuilder to build primitive arrays

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 965876328 -> 356b798b3 [SPARK-5803][MLLIB] use ArrayBuilder to build primitive arrays because ArrayBuffer is not specialized. Author: Xiangrui Meng Closes #4594 from mengxr/SPARK-5803 and squashes the following commits: 1261bd5 [Xia

spark git commit: [SPARK-5803][MLLIB] use ArrayBuilder to build primitive arrays

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/master cc56c8729 -> d50a91d52 [SPARK-5803][MLLIB] use ArrayBuilder to build primitive arrays because ArrayBuffer is not specialized. Author: Xiangrui Meng Closes #4594 from mengxr/SPARK-5803 and squashes the following commits: 1261bd5 [Xiangru

spark git commit: [SPARK-5806] re-organize sections in mllib-clustering.md

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 d9d0250fc -> 965876328 [SPARK-5806] re-organize sections in mllib-clustering.md Put example code close to the algorithm description. Author: Xiangrui Meng Closes #4598 from mengxr/SPARK-5806 and squashes the following commits: a1378

spark git commit: [SPARK-5806] re-organize sections in mllib-clustering.md

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/master 2e0c08452 -> cc56c8729 [SPARK-5806] re-organize sections in mllib-clustering.md Put example code close to the algorithm description. Author: Xiangrui Meng Closes #4598 from mengxr/SPARK-5806 and squashes the following commits: a137872 [

spark git commit: [SPARK-5789][SQL]Throw a better error message if JsonRDD.parseJson encounters unrecoverable parsing errors.

2015-02-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 efffc2e42 -> d9d0250fc [SPARK-5789][SQL]Throw a better error message if JsonRDD.parseJson encounters unrecoverable parsing errors. Author: Yin Huai Closes #4582 from yhuai/jsonErrorMessage and squashes the following commits: 152dbd4

spark git commit: [SPARK-5789][SQL]Throw a better error message if JsonRDD.parseJson encounters unrecoverable parsing errors.

2015-02-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 2cbb3e433 -> 2e0c08452 [SPARK-5789][SQL]Throw a better error message if JsonRDD.parseJson encounters unrecoverable parsing errors. Author: Yin Huai Closes #4582 from yhuai/jsonErrorMessage and squashes the following commits: 152dbd4 [Yi

spark git commit: [SPARK-5642] [SQL] Apply column pruning on unused aggregation fields

2015-02-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 41603717a -> efffc2e42 [SPARK-5642] [SQL] Apply column pruning on unused aggregation fields select k from (select key k, max(value) v from src group by k) t Author: Daoyuan Wang Author: Michael Armbrust Closes #4415 from adrian-wang

spark git commit: [SPARK-5642] [SQL] Apply column pruning on unused aggregation fields

2015-02-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 5d3cc6b3d -> 2cbb3e433 [SPARK-5642] [SQL] Apply column pruning on unused aggregation fields select k from (select key k, max(value) v from src group by k) t Author: Daoyuan Wang Author: Michael Armbrust Closes #4415 from adrian-wang/gro

spark git commit: [HOTFIX] Fix build break in MesosSchedulerBackendSuite

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 ad731897b -> 41603717a [HOTFIX] Fix build break in MesosSchedulerBackendSuite Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/41603717 Tree: http://git-wip-us.apach

spark git commit: [HOTFIX] Fix build break in MesosSchedulerBackendSuite

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 378c7eb0d -> 5d3cc6b3d [HOTFIX] Fix build break in MesosSchedulerBackendSuite Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5d3cc6b3 Tree: http://git-wip-us.apache.or

spark git commit: [HOTFIX] Ignore DirectKafkaStreamSuite.

2015-02-13 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9f31db061 -> 378c7eb0d [HOTFIX] Ignore DirectKafkaStreamSuite. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/378c7eb0 Tree: http://git-wip-us.apache.org/repos/asf/spa

spark git commit: SPARK-5805 Fixed the type error in documentation.

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/master 077eec2d9 -> 9f31db061 SPARK-5805 Fixed the type error in documentation. Fixes SPARK-5805 : Fix the type error in the final example given in MLlib - Clustering documentation. Author: Emre Sevinç Closes #4596 from emres/SPARK-5805 and s

spark git commit: SPARK-5805 Fixed the type error in documentation.

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 cc9eec1a0 -> ad731897b SPARK-5805 Fixed the type error in documentation. Fixes SPARK-5805 : Fix the type error in the final example given in MLlib - Clustering documentation. Author: Emre Sevinç Closes #4596 from emres/SPARK-5805 a

spark git commit: [SPARK-5735] Replace uses of EasyMock with Mockito

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master fc6d3e796 -> 077eec2d9 [SPARK-5735] Replace uses of EasyMock with Mockito This patch replaces all uses of EasyMock with Mockito. There are two motivations for this: 1. We should use a single mocking framework in our tests in order to kee

spark git commit: [SPARK-5735] Replace uses of EasyMock with Mockito

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 e5690a502 -> cc9eec1a0 [SPARK-5735] Replace uses of EasyMock with Mockito This patch replaces all uses of EasyMock with Mockito. There are two motivations for this: 1. We should use a single mocking framework in our tests in order to

spark git commit: [SPARK-5783] Better eventlog-parsing error messages

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 5e6394222 -> e5690a502 [SPARK-5783] Better eventlog-parsing error messages Author: Ryan Williams Closes #4573 from ryan-williams/history and squashes the following commits: a8647ec [Ryan Williams] fix test calls to .replay() 98aa3fe

spark git commit: [SPARK-5783] Better eventlog-parsing error messages

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master e1a1ff810 -> fc6d3e796 [SPARK-5783] Better eventlog-parsing error messages Author: Ryan Williams Closes #4573 from ryan-williams/history and squashes the following commits: a8647ec [Ryan Williams] fix test calls to .replay() 98aa3fe [Rya

spark git commit: [SPARK-5503][MLLIB] Example code for Power Iteration Clustering

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 5c883df09 -> 5e6394222 [SPARK-5503][MLLIB] Example code for Power Iteration Clustering Author: sboeschhuawei Closes #4495 from javadba/picexamples and squashes the following commits: 3c84b14 [sboeschhuawei] PIC Examples updates from

spark git commit: [SPARK-5503][MLLIB] Example code for Power Iteration Clustering

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/master c0ccd2564 -> e1a1ff810 [SPARK-5503][MLLIB] Example code for Power Iteration Clustering Author: sboeschhuawei Closes #4495 from javadba/picexamples and squashes the following commits: 3c84b14 [sboeschhuawei] PIC Examples updates from Xian

spark git commit: [SPARK-5732][CORE]:Add an option to print the spark version in spark script.

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 1255e83f8 -> 5c883df09 [SPARK-5732][CORE]:Add an option to print the spark version in spark script. Naturally, we may need to add an option to print the spark version in spark script. It is pretty common in script tool. ![9](https://cl

spark git commit: [SPARK-5732][CORE]:Add an option to print the spark version in spark script.

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 1768bd514 -> c0ccd2564 [SPARK-5732][CORE]:Add an option to print the spark version in spark script. Naturally, we may need to add an option to print the spark version in spark script. It is pretty common in script tool. ![9](https://cloud.

spark git commit: SPARK-4267 [YARN] Backport: Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

2015-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.2 222ce9ffd -> c2b4633f0 SPARK-4267 [YARN] Backport: Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later Backport of SPARK-4267 (https://github.com/apache/spark/commit/de7806048ac49a8bfdf44d8f87bc11cea1dfb242) for branch

spark git commit: SPARK-5728 [STREAMING] MQTTStreamSuite leaves behind ActiveMQ database files

2015-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.2 a5d72fd50 -> 222ce9ffd SPARK-5728 [STREAMING] MQTTStreamSuite leaves behind ActiveMQ database files Use temp dir for ActiveMQ database Author: Sean Owen Closes #4517 from srowen/SPARK-5728 and squashes the following commits: 1d3aeb8

spark git commit: [SPARK-4631][streaming][FIX] Wait for a receiver to start before publishing test data.

2015-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.2 2b9dbddd3 -> a5d72fd50 [SPARK-4631][streaming][FIX] Wait for a receiver to start before publishing test data. This fixes two sources of non-deterministic failures in this test: - wait for a receiver to be up before pushing data throug

spark git commit: [SPARK-4832][Deploy]some other processes might take the daemon pid

2015-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.2 0ba065f0a -> 2b9dbddd3 [SPARK-4832][Deploy]some other processes might take the daemon pid Some other processes might use the pid saved in pid file. In that case we should ignore it and launch daemons. JIRA is down for maintenance. I w

spark git commit: [SPARK-4832][Deploy]some other processes might take the daemon pid

2015-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 1c8633f3f -> 1768bd514 [SPARK-4832][Deploy]some other processes might take the daemon pid Some other processes might use the pid saved in pid file. In that case we should ignore it and launch daemons. JIRA is down for maintenance. I will

spark git commit: [SPARK-4832][Deploy]some other processes might take the daemon pid

2015-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 a8f560c4e -> 1255e83f8 [SPARK-4832][Deploy]some other processes might take the daemon pid Some other processes might use the pid saved in pid file. In that case we should ignore it and launch daemons. JIRA is down for maintenance. I w