spark git commit: [SPARK-4832][Deploy]some other processes might take the daemon pid

2015-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.2 0ba065f0a - 2b9dbddd3 [SPARK-4832][Deploy]some other processes might take the daemon pid Some other processes might use the pid saved in pid file. In that case we should ignore it and launch daemons. JIRA is down for maintenance. I

spark git commit: SPARK-5728 [STREAMING] MQTTStreamSuite leaves behind ActiveMQ database files

2015-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.2 a5d72fd50 - 222ce9ffd SPARK-5728 [STREAMING] MQTTStreamSuite leaves behind ActiveMQ database files Use temp dir for ActiveMQ database Author: Sean Owen so...@cloudera.com Closes #4517 from srowen/SPARK-5728 and squashes the following

spark git commit: [SPARK-4832][Deploy]some other processes might take the daemon pid

2015-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 1c8633f3f - 1768bd514 [SPARK-4832][Deploy]some other processes might take the daemon pid Some other processes might use the pid saved in pid file. In that case we should ignore it and launch daemons. JIRA is down for maintenance. I will

spark git commit: [SPARK-4832][Deploy]some other processes might take the daemon pid

2015-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 a8f560c4e - 1255e83f8 [SPARK-4832][Deploy]some other processes might take the daemon pid Some other processes might use the pid saved in pid file. In that case we should ignore it and launch daemons. JIRA is down for maintenance. I

spark git commit: SPARK-4267 [YARN] Backport: Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

2015-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.2 222ce9ffd - c2b4633f0 SPARK-4267 [YARN] Backport: Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later Backport of SPARK-4267 (https://github.com/apache/spark/commit/de7806048ac49a8bfdf44d8f87bc11cea1dfb242) for

spark git commit: [SPARK-5735] Replace uses of EasyMock with Mockito

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 e5690a502 - cc9eec1a0 [SPARK-5735] Replace uses of EasyMock with Mockito This patch replaces all uses of EasyMock with Mockito. There are two motivations for this: 1. We should use a single mocking framework in our tests in order to

spark git commit: [SPARK-5783] Better eventlog-parsing error messages

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 5e6394222 - e5690a502 [SPARK-5783] Better eventlog-parsing error messages Author: Ryan Williams ryan.blake.willi...@gmail.com Closes #4573 from ryan-williams/history and squashes the following commits: a8647ec [Ryan Williams] fix

spark git commit: [SPARK-5732][CORE]:Add an option to print the spark version in spark script.

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 1768bd514 - c0ccd2564 [SPARK-5732][CORE]:Add an option to print the spark version in spark script. Naturally, we may need to add an option to print the spark version in spark script. It is pretty common in script tool.

spark git commit: [SPARK-5732][CORE]:Add an option to print the spark version in spark script.

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 1255e83f8 - 5c883df09 [SPARK-5732][CORE]:Add an option to print the spark version in spark script. Naturally, we may need to add an option to print the spark version in spark script. It is pretty common in script tool.

spark git commit: [SPARK-5503][MLLIB] Example code for Power Iteration Clustering

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/master c0ccd2564 - e1a1ff810 [SPARK-5503][MLLIB] Example code for Power Iteration Clustering Author: sboeschhuawei stephen.boe...@huawei.com Closes #4495 from javadba/picexamples and squashes the following commits: 3c84b14 [sboeschhuawei] PIC

spark git commit: [SPARK-5503][MLLIB] Example code for Power Iteration Clustering

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 5c883df09 - 5e6394222 [SPARK-5503][MLLIB] Example code for Power Iteration Clustering Author: sboeschhuawei stephen.boe...@huawei.com Closes #4495 from javadba/picexamples and squashes the following commits: 3c84b14 [sboeschhuawei]

spark git commit: SPARK-5805 Fixed the type error in documentation.

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 cc9eec1a0 - ad731897b SPARK-5805 Fixed the type error in documentation. Fixes SPARK-5805 : Fix the type error in the final example given in MLlib - Clustering documentation. Author: Emre Sevinç emre.sev...@gmail.com Closes #4596

spark git commit: SPARK-5805 Fixed the type error in documentation.

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/master 077eec2d9 - 9f31db061 SPARK-5805 Fixed the type error in documentation. Fixes SPARK-5805 : Fix the type error in the final example given in MLlib - Clustering documentation. Author: Emre Sevinç emre.sev...@gmail.com Closes #4596 from

spark git commit: [HOTFIX] Ignore DirectKafkaStreamSuite.

2015-02-13 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9f31db061 - 378c7eb0d [HOTFIX] Ignore DirectKafkaStreamSuite. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/378c7eb0 Tree:

spark git commit: [SPARK-5806] re-organize sections in mllib-clustering.md

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/master 2e0c08452 - cc56c8729 [SPARK-5806] re-organize sections in mllib-clustering.md Put example code close to the algorithm description. Author: Xiangrui Meng m...@databricks.com Closes #4598 from mengxr/SPARK-5806 and squashes the following

spark git commit: [SPARK-5806] re-organize sections in mllib-clustering.md

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 d9d0250fc - 965876328 [SPARK-5806] re-organize sections in mllib-clustering.md Put example code close to the algorithm description. Author: Xiangrui Meng m...@databricks.com Closes #4598 from mengxr/SPARK-5806 and squashes the

spark git commit: [SPARK-5642] [SQL] Apply column pruning on unused aggregation fields

2015-02-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 41603717a - efffc2e42 [SPARK-5642] [SQL] Apply column pruning on unused aggregation fields select k from (select key k, max(value) v from src group by k) t Author: Daoyuan Wang daoyuan.w...@intel.com Author: Michael Armbrust

spark git commit: [SPARK-5789][SQL]Throw a better error message if JsonRDD.parseJson encounters unrecoverable parsing errors.

2015-02-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 efffc2e42 - d9d0250fc [SPARK-5789][SQL]Throw a better error message if JsonRDD.parseJson encounters unrecoverable parsing errors. Author: Yin Huai yh...@databricks.com Closes #4582 from yhuai/jsonErrorMessage and squashes the

spark git commit: [HOTFIX] Fix build break in MesosSchedulerBackendSuite

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 378c7eb0d - 5d3cc6b3d [HOTFIX] Fix build break in MesosSchedulerBackendSuite Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5d3cc6b3 Tree:

spark git commit: [HOTFIX] Fix build break in MesosSchedulerBackendSuite

2015-02-13 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 ad731897b - 41603717a [HOTFIX] Fix build break in MesosSchedulerBackendSuite Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/41603717 Tree:

spark git commit: [SPARK-5789][SQL]Throw a better error message if JsonRDD.parseJson encounters unrecoverable parsing errors.

2015-02-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 2cbb3e433 - 2e0c08452 [SPARK-5789][SQL]Throw a better error message if JsonRDD.parseJson encounters unrecoverable parsing errors. Author: Yin Huai yh...@databricks.com Closes #4582 from yhuai/jsonErrorMessage and squashes the following

spark git commit: [SPARK-5730][ML] add doc groups to spark.ml components

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/master d50a91d52 - 4f4c6d5a5 [SPARK-5730][ML] add doc groups to spark.ml components This PR adds three groups to the ScalaDoc: `param`, `setParam`, and `getParam`. Params will show up in the generated Scala API doc as the top group.

spark git commit: [SPARK-5803][MLLIB] use ArrayBuilder to build primitive arrays

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 965876328 - 356b798b3 [SPARK-5803][MLLIB] use ArrayBuilder to build primitive arrays because ArrayBuffer is not specialized. Author: Xiangrui Meng m...@databricks.com Closes #4594 from mengxr/SPARK-5803 and squashes the following

spark git commit: [SPARK-5803][MLLIB] use ArrayBuilder to build primitive arrays

2015-02-13 Thread meng
Repository: spark Updated Branches: refs/heads/master cc56c8729 - d50a91d52 [SPARK-5803][MLLIB] use ArrayBuilder to build primitive arrays because ArrayBuffer is not specialized. Author: Xiangrui Meng m...@databricks.com Closes #4594 from mengxr/SPARK-5803 and squashes the following

spark git commit: [SPARK-5227] [SPARK-5679] Disable FileSystem cache in WholeTextFileRecordReaderSuite

2015-02-13 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.2 c2b4633f0 - 26410a2d3 [SPARK-5227] [SPARK-5679] Disable FileSystem cache in WholeTextFileRecordReaderSuite This patch fixes two difficult-to-reproduce Jenkins test failures in InputOutputMetricsSuite (SPARK-5227 and SPARK-5679). The

spark git commit: [SPARK-5227] [SPARK-5679] Disable FileSystem cache in WholeTextFileRecordReaderSuite

2015-02-13 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 4f4c6d5a5 - d06d5ee9b [SPARK-5227] [SPARK-5679] Disable FileSystem cache in WholeTextFileRecordReaderSuite This patch fixes two difficult-to-reproduce Jenkins test failures in InputOutputMetricsSuite (SPARK-5227 and SPARK-5679). The

spark git commit: [SPARK-5227] [SPARK-5679] Disable FileSystem cache in WholeTextFileRecordReaderSuite

2015-02-13 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 fccd38d2e - 152147f5f [SPARK-5227] [SPARK-5679] Disable FileSystem cache in WholeTextFileRecordReaderSuite This patch fixes two difficult-to-reproduce Jenkins test failures in InputOutputMetricsSuite (SPARK-5227 and SPARK-5679). The