spark git commit: [SPARK-8401] [BUILD] Scala version switching build enhancements

Repository: spark Updated Branches: refs/heads/master 6364735bc - f5b6dc5e3 [SPARK-8401] [BUILD] Scala version switching build enhancements These commits address a few minor issues in the Scala cross-version support in the build: 1. Correct two missing `${scala.binary.version}` pom file

spark git commit: [SPARK-9758] [TEST] [SQL] Compilation issue for hive test / wrong package?

a `test.org.apache.spark` package is legitimate but didn't seem to be the intent here. Author: Sean Owen so...@cloudera.com Closes #8307 from srowen/SPARK-9758. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cb2d2e15 Tree: http

spark git commit: [SPARK-9758] [TEST] [SQL] Compilation issue for hive test / wrong package?

a `test.org.apache.spark` package is legitimate but didn't seem to be the intent here. Author: Sean Owen so...@cloudera.com Closes #8307 from srowen/SPARK-9758. (cherry picked from commit cb2d2e15844d7ae34b5dd7028b55e11586ed93fa) Signed-off-by: Sean Owen so...@cloudera.com Project: http://git

spark git commit: [SPARK-11264] bin/spark-class can't find assembly jars with certain GREP_OPTIONS set

Repository: spark Updated Branches: refs/heads/branch-1.5 56f0bb6ed -> 1cd2d9ced [SPARK-11264] bin/spark-class can't find assembly jars with certain GREP_OPTIONS set Temporarily remove GREP_OPTIONS if set in bin/spark-class. Some GREP_OPTIONS will modify the output of the grep commands that

spark git commit: [SPARK-11264] bin/spark-class can't find assembly jars with certain GREP_OPTIONS set

Repository: spark Updated Branches: refs/heads/master e5bc8c275 -> 28132ceb1 [SPARK-11264] bin/spark-class can't find assembly jars with certain GREP_OPTIONS set Temporarily remove GREP_OPTIONS if set in bin/spark-class. Some GREP_OPTIONS will modify the output of the grep commands that are

spark git commit: [SPARK-11245] update twitter4j to 4.0.4 version

Repository: spark Updated Branches: refs/heads/master ffed00493 -> e5bc8c275 [SPARK-11245] update twitter4j to 4.0.4 version update twitter4j to 4.0.4 version https://issues.apache.org/jira/browse/SPARK-11245 Author: dima Closes #9221 from pronix/twitter4j_update.

spark git commit: Fix typos

Repository: spark Updated Branches: refs/heads/master 28132ceb1 -> 146da0d81 Fix typos Two typos squashed. BTW Let me know how to proceed with other typos if I ran across any. I don't feel well to leave them aside as much as sending pull requests with such tiny changes. Guide me. Author:

spark git commit: Fix typos

Repository: spark Updated Branches: refs/heads/branch-1.5 1cd2d9ced -> 5200a6e29 Fix typos Two typos squashed. BTW Let me know how to proceed with other typos if I ran across any. I don't feel well to leave them aside as much as sending pull requests with such tiny changes. Guide me.

spark git commit: [SPARK-11121][CORE] Correct the TaskLocation type

Repository: spark Updated Branches: refs/heads/master 1d9733271 -> c03b6d115 [SPARK-11121][CORE] Correct the TaskLocation type Correct the logic to return `HDFSCacheTaskLocation` instance when the input `str` is a in memory location. Author: zhichao.li Closes #9096

spark git commit: [SPARK-11242][SQL] In conf/spark-env.sh.template SPARK_DRIVER_MEMORY is documented incorrectly

Repository: spark Updated Branches: refs/heads/master d4950e6be -> 188ea348f [SPARK-11242][SQL] In conf/spark-env.sh.template SPARK_DRIVER_MEMORY is documented incorrectly Minor fix on the comment Author: guoxi Closes #9201 from xguo27/SPARK-11242. Project:

spark git commit: [SPARK-5966][WIP] Spark-submit deploy-mode cluster is not compatible with master local>

Repository: spark Updated Branches: refs/heads/master 05c4bdb57 -> 616be29c7 [SPARK-5966][WIP] Spark-submit deploy-mode cluster is not compatible with master local> … master local> Author: Kevin Yu Closes #9220 from kevinyu98/working_on_spark-5966. Project:

spark git commit: [SPARK-5966][WIP] Spark-submit deploy-mode cluster is not compatible with master local>

Repository: spark Updated Branches: refs/heads/branch-1.5 74921c219 -> a355d0d0d [SPARK-5966][WIP] Spark-submit deploy-mode cluster is not compatible with master local> … master local> Author: Kevin Yu Closes #9220 from kevinyu98/working_on_spark-5966. (cherry picked

spark git commit: [SPARK-11276][CORE] SizeEstimator prevents class unloading

Repository: spark Updated Branches: refs/heads/master d77d198fc -> feb8d6a44 [SPARK-11276][CORE] SizeEstimator prevents class unloading The SizeEstimator keeps a cache of ClassInfos but this cache uses Class objects as keys. Which results in strong references to the Class objects. If these

spark git commit: [SPARK-11318] Include hive profile in make-distribution.sh command

Repository: spark Updated Branches: refs/heads/master f79ebf2a9 -> f304f9c9a [SPARK-11318] Include hive profile in make-distribution.sh command Author: tedyu Closes #9281 from tedyu/master. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-11287] Fixed class name to properly start TestExecutor from deploy.client.TestClient

Repository: spark Updated Branches: refs/heads/master 92b9c5edd -> 80279ac18 [SPARK-11287] Fixed class name to properly start TestExecutor from deploy.client.TestClient Executing deploy.client.TestClient fails due to bad class name for TestExecutor in ApplicationDescription. Author: Bryan

spark git commit: [SPARK-11287] Fixed class name to properly start TestExecutor from deploy.client.TestClient

Repository: spark Updated Branches: refs/heads/branch-1.5 36fddb07a -> 74921c219 [SPARK-11287] Fixed class name to properly start TestExecutor from deploy.client.TestClient Executing deploy.client.TestClient fails due to bad class name for TestExecutor in ApplicationDescription. Author:

spark git commit: [DOC][MINOR][SQL] Fix internal link

Repository: spark Updated Branches: refs/heads/master 9e48cdfbd -> b541b3163 [DOC][MINOR][SQL] Fix internal link It doesn't show up as a hyperlink currently. It will show up as a hyperlink after this change. Author: Rohit Agarwal Closes #9544 from mindprince/patch-2.

spark git commit: [DOC][MINOR][SQL] Fix internal link

Repository: spark Updated Branches: refs/heads/branch-1.6 f53c9fb18 -> 0f03bd13e [DOC][MINOR][SQL] Fix internal link It doesn't show up as a hyperlink currently. It will show up as a hyperlink after this change. Author: Rohit Agarwal Closes #9544 from

spark git commit: [SPARK-11218][CORE] show help messages for start-slave and start-master

Repository: spark Updated Branches: refs/heads/branch-1.6 7eaf48eeb -> f53c9fb18 [SPARK-11218][CORE] show help messages for start-slave and start-master Addressing https://issues.apache.org/jira/browse/SPARK-11218, mostly copied start-thriftserver.sh. ``` charlesyeh-mbp:spark charlesyeh$

spark git commit: [SPARK-11476][DOCS] Incorrect function referred to in MLib Random data generation documentation

Repository: spark Updated Branches: refs/heads/master 4b69a42ed -> d98190210 [SPARK-11476][DOCS] Incorrect function referred to in MLib Random data generation documentation Fix Python example to use normalRDD as advertised Author: Sean Owen <so...@cloudera.com> Closes #9529 fr

spark git commit: [SPARK-11476][DOCS] Incorrect function referred to in MLib Random data generation documentation

Repository: spark Updated Branches: refs/heads/branch-1.6 696d4a52d -> 0bc813b45 [SPARK-11476][DOCS] Incorrect function referred to in MLib Random data generation documentation Fix Python example to use normalRDD as advertised Author: Sean Owen <so...@cloudera.com> Closes #9529 fr

spark git commit: [DOC][SQL] Remove redundant out-of-place python snippet

Repository: spark Updated Branches: refs/heads/branch-1.6 0bc813b45 -> 7b3736098 [DOC][SQL] Remove redundant out-of-place python snippet This snippet seems to be mistakenly introduced at two places in #5348. Author: Rohit Agarwal Closes #9540 from mindprince/patch-1.

spark git commit: [DOC][SQL] Remove redundant out-of-place python snippet

Repository: spark Updated Branches: refs/heads/master d98190210 -> 5c4e6d7ec [DOC][SQL] Remove redundant out-of-place python snippet This snippet seems to be mistakenly introduced at two places in #5348. Author: Rohit Agarwal Closes #9540 from mindprince/patch-1.

spark git commit: [DOC][SQL] Remove redundant out-of-place python snippet

Repository: spark Updated Branches: refs/heads/branch-1.5 3917f6153 -> ea786a196 [DOC][SQL] Remove redundant out-of-place python snippet This snippet seems to be mistakenly introduced at two places in #5348. Author: Rohit Agarwal Closes #9540 from mindprince/patch-1.

spark git commit: [SPARK-11476][DOCS] Incorrect function referred to in MLib Random data generation documentation

Repository: spark Updated Branches: refs/heads/branch-1.5 8fb6696cd -> 3917f6153 [SPARK-11476][DOCS] Incorrect function referred to in MLib Random data generation documentation Fix Python example to use normalRDD as advertised Author: Sean Owen <so...@cloudera.com> Closes #9529 fr

spark git commit: [DOCS] Fix typo for Python section on unifying Kafka streams

Repository: spark Updated Branches: refs/heads/branch-1.6 7b4d7abfc -> 006d73a74 [DOCS] Fix typo for Python section on unifying Kafka streams 1) kafkaStreams is a list. The list should be unpacked when passing it into the streaming context union method, which accepts a variable number of

spark git commit: [DOCS] Fix typo for Python section on unifying Kafka streams

Repository: spark Updated Branches: refs/heads/master cd174882a -> 874cd66d4 [DOCS] Fix typo for Python section on unifying Kafka streams 1) kafkaStreams is a list. The list should be unpacked when passing it into the streaming context union method, which accepts a variable number of

spark git commit: [DOCS] Fix typo for Python section on unifying Kafka streams

Repository: spark Updated Branches: refs/heads/branch-1.5 6b314fe9e -> a33fd737c [DOCS] Fix typo for Python section on unifying Kafka streams 1) kafkaStreams is a list. The list should be unpacked when passing it into the streaming context union method, which accepts a variable number of

spark git commit: [SPARK-11573] Correct 'reflective access of structural type member meth…

Repository: spark Updated Branches: refs/heads/master 9a73b33a9 -> 9461f5ee8 [SPARK-11573] Correct 'reflective access of structural type member meth… …od should be enabled' Scala warnings Author: Gábor Lipták Closes #9550 from gliptak/SPARK-11573. Project:

spark git commit: [SPARK-11573] Correct 'reflective access of structural type member meth…

Repository: spark Updated Branches: refs/heads/branch-1.6 5153356d5 -> d5a7ff11c [SPARK-11573] Correct 'reflective access of structural type member meth… …od should be enabled' Scala warnings Author: Gábor Lipták Closes #9550 from gliptak/SPARK-11573. (cherry

spark git commit: [MINOR][DOCS] typo in docs/configuration.md

Repository: spark Updated Branches: refs/heads/branch-1.6 47a918661 -> 5153356d5 [MINOR][DOCS] typo in docs/configuration.md `<\code>` end tag missing backslash in docs/configuration.md{L308-L339} ref #8795 Author: Kai Jiang Closes #9715 from vectorijk/minor-typo-docs.

spark git commit: [MINOR][DOCS] typo in docs/configuration.md

Repository: spark Updated Branches: refs/heads/master 139c15b62 -> 9a73b33a9 [MINOR][DOCS] typo in docs/configuration.md `<\code>` end tag missing backslash in docs/configuration.md{L308-L339} ref #8795 Author: Kai Jiang Closes #9715 from vectorijk/minor-typo-docs.

spark git commit: Typo in comment: use 2 seconds instead of 1

Repository: spark Updated Branches: refs/heads/branch-1.6 d5a7ff11c -> 927acb19b Typo in comment: use 2 seconds instead of 1 Use 2 seconds batch size as duration specified in JavaStreamingContext constructor is 2000 ms Author: Rohan Bhanderi Closes #9714 from

spark git commit: Typo in comment: use 2 seconds instead of 1

Repository: spark Updated Branches: refs/heads/master 9461f5ee8 -> 22e96b87f Typo in comment: use 2 seconds instead of 1 Use 2 seconds batch size as duration specified in JavaStreamingContext constructor is 2000 ms Author: Rohan Bhanderi Closes #9714 from

spark git commit: [BUILD][MINOR] Remove non-exist yarnStable module in Sbt project

Repository: spark Updated Branches: refs/heads/master 30e743364 -> 08660a0bc [BUILD][MINOR] Remove non-exist yarnStable module in Sbt project Remove some old yarn related building codes, please review, thanks a lot. Author: jerryshao Closes #9625 from

spark git commit: [BUILD][MINOR] Remove non-exist yarnStable module in Sbt project

Repository: spark Updated Branches: refs/heads/branch-1.6 ed048763b -> c3a0c7728 [BUILD][MINOR] Remove non-exist yarnStable module in Sbt project Remove some old yarn related building codes, please review, thanks a lot. Author: jerryshao Closes #9625 from

spark git commit: [SPARK-11751] Doc describe error in the "Spark Streaming Programming Guide" page

Repository: spark Updated Branches: refs/heads/master fa13301ae -> 7276fa9aa [SPARK-11751] Doc describe error in the "Spark Streaming Programming Guide" page In the **[Task Launching Overheads](http://spark.apache.org/docs/latest/streaming-programming-guide.html#task-launching-overheads)**

spark git commit: [SPARK-11779][DOCS] Fix reference to deprecated MESOS_NATIVE_LIBRARY

Repository: spark Updated Branches: refs/heads/master 7276fa9aa -> 15cc36b77 [SPARK-11779][DOCS] Fix reference to deprecated MESOS_NATIVE_LIBRARY MESOS_NATIVE_LIBRARY was renamed in favor of MESOS_NATIVE_JAVA_LIBRARY. This commit fixes the reference in the documentation. Author: Philipp

spark git commit: [SPARK-11779][DOCS] Fix reference to deprecated MESOS_NATIVE_LIBRARY

Repository: spark Updated Branches: refs/heads/branch-1.6 b1a2abb23 -> 29f18b730 [SPARK-11779][DOCS] Fix reference to deprecated MESOS_NATIVE_LIBRARY MESOS_NATIVE_LIBRARY was renamed in favor of MESOS_NATIVE_JAVA_LIBRARY. This commit fixes the reference in the documentation. Author: Philipp

spark git commit: [SPARK-11751] Doc describe error in the "Spark Streaming Programming Guide" page

Repository: spark Updated Branches: refs/heads/branch-1.6 2ae1fa074 -> b1a2abb23 [SPARK-11751] Doc describe error in the "Spark Streaming Programming Guide" page In the **[Task Launching

spark git commit: Fix typo in driver page

Repository: spark Updated Branches: refs/heads/branch-1.5 0512960fc -> 6e823b4d7 Fix typo in driver page "Comamnd property" => "Command property" Author: Paul Chandler Closes #9578 from pestilence669/fix_spelling. (cherry picked from commit

spark git commit: Fix typo in driver page

Repository: spark Updated Branches: refs/heads/branch-1.6 b426d24db -> 39c1ebcd3 Fix typo in driver page "Comamnd property" => "Command property" Author: Paul Chandler Closes #9578 from pestilence669/fix_spelling. (cherry picked from commit

spark git commit: Fix typo in driver page

Repository: spark Updated Branches: refs/heads/master 521b3cae1 -> 5507a9d09 Fix typo in driver page "Comamnd property" => "Command property" Author: Paul Chandler Closes #9578 from pestilence669/fix_spelling. Project:

spark git commit: [SPARK-11305][DOCS] Remove Third-Party Hadoop Distributions Doc Page

<so...@cloudera.com> Closes #9298 from srowen/SPARK-11305. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/643c49c7 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/643c49c7 Diff: http://git-wip-us.apache.org/repos/asf/s

spark git commit: [SPARK-11344] Made ApplicationDescription and DriverDescription case classes

Repository: spark Updated Branches: refs/heads/master b86f2cab6 -> 233e534ac [SPARK-11344] Made ApplicationDescription and DriverDescription case classes DriverDescription refactored to case class because it included no mutable fields. ApplicationDescription had one mutable field, which was

spark git commit: [SPARK-11378][STREAMING] make StreamingContext.awaitTerminationOrTimeout return properly

Repository: spark Updated Branches: refs/heads/master 6f81eae24 -> 859dff56e [SPARK-11378][STREAMING] make StreamingContext.awaitTerminationOrTimeout return properly This adds a failing test checking that `awaitTerminationOrTimeout` returns the expected value, and then fixes that failing

spark git commit: [SPARK-11378][STREAMING] make StreamingContext.awaitTerminationOrTimeout return properly

Repository: spark Updated Branches: refs/heads/branch-1.5 d31b312fc -> 9522dd23d [SPARK-11378][STREAMING] make StreamingContext.awaitTerminationOrTimeout return properly This adds a failing test checking that `awaitTerminationOrTimeout` returns the expected value, and then fixes that

spark git commit: [SPARK-11449][CORE] PortableDataStream should be a factory

oth the ```PortableDataStream``` and the ```InputStream``` it produces). This PR removes all state from ```PortableDataStream``` and effectively turns it into an ```InputStream```/```Array[Byte]``` factory. This makes the user responsible for managing the ```InputStream``` it returns. cc srowen Author: Herman

spark git commit: [SPARK-11506][MLLIB] Removed redundant operation in Online LDA implementation

Repository: spark Updated Branches: refs/heads/master 7bdc92197 -> a94671a02 [SPARK-11506][MLLIB] Removed redundant operation in Online LDA implementation In file LDAOptimizer.scala: line 441: since "idx" was never used, replaced unrequired zipWithIndex.foreach with foreach. -

spark git commit: [SPARK-11271][SPARK-11016][CORE] Use Spark BitSet instead of RoaringBitmap to reduce memory usage

Repository: spark Updated Branches: refs/heads/master e963070c1 -> e209fa271 [SPARK-11271][SPARK-11016][CORE] Use Spark BitSet instead of RoaringBitmap to reduce memory usage JIRA: https://issues.apache.org/jira/browse/SPARK-11271 As reported in the JIRA ticket, when there are too many

spark git commit: [SPARK-11413][BUILD] Bump joda-time version to 2.9 for java 8 and s3

Repository: spark Updated Branches: refs/heads/master e209fa271 -> ea4a3e7d0 [SPARK-11413][BUILD] Bump joda-time version to 2.9 for java 8 and s3 It's a known issue that joda-time before 2.8.1 is incompatible with java 1.8u60 or later, which causes s3 request to fail. This affects Spark when

spark git commit: Typo fixes + code readability improvements

Repository: spark Updated Branches: refs/heads/master 8211aab07 -> 62bb29077 Typo fixes + code readability improvements Author: Jacek Laskowski Closes #9501 from jaceklaskowski/typos-with-style. Project: http://git-wip-us.apache.org/repos/asf/spark/repo

spark git commit: [SPARK-10116][CORE] XORShiftRandom.hashSeed is random in high bits

Repository: spark Updated Branches: refs/heads/branch-1.6 e86499954 -> 7755b50b4 [SPARK-10116][CORE] XORShiftRandom.hashSeed is random in high bits https://issues.apache.org/jira/browse/SPARK-10116 This is really trivial, just happened to notice it -- if `XORShiftRandom.hashSeed` is really

spark git commit: [SPARK-10116][CORE] XORShiftRandom.hashSeed is random in high bits

Repository: spark Updated Branches: refs/heads/master 62bb29077 -> 49f1a8203 [SPARK-10116][CORE] XORShiftRandom.hashSeed is random in high bits https://issues.apache.org/jira/browse/SPARK-10116 This is really trivial, just happened to notice it -- if `XORShiftRandom.hashSeed` is really

spark git commit: [SPARK-10986][MESOS] Set the context class loader in the Mesos executor backend.

Repository: spark Updated Branches: refs/heads/master 14d08b990 -> 0451b0014 [SPARK-10986][MESOS] Set the context class loader in the Mesos executor backend. See [SPARK-10986](https://issues.apache.org/jira/browse/SPARK-10986) for details. This fixes the `ClassNotFoundException` for Spark

spark git commit: [SPARK-11342][TESTS] Allow to set hadoop profile when running dev/ru…

Repository: spark Updated Branches: refs/heads/master 40c77fb23 -> 729f983e6 [SPARK-11342][TESTS] Allow to set hadoop profile when running dev/ru… …n_tests Author: Jeff Zhang Closes #9295 from zjffdu/SPARK-11342. Project:

spark git commit: [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen)

Repository: spark Updated Branches: refs/heads/master 2692bdb7d -> 8aff36e91 [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) This PR is based on the work of roji to support running Spark scripts from symlinks. Thanks for the great work roji . Would you mind taking a look

spark git commit: [SPARK-11442] Reduce numSlices for local metrics test of SparkListenerSuite

Repository: spark Updated Branches: refs/heads/master 8aff36e91 -> c09e51398 [SPARK-11442] Reduce numSlices for local metrics test of SparkListenerSuite In the thread, http://search-hadoop.com/m/q3RTtcQiFSlTxeP/test+failed+due+to+OOME=test+failed+due+to+OOME, it was discussed that memory

spark git commit: [SPARK-10921][YARN] Completely remove the use of SparkContext.prefer…

Repository: spark Updated Branches: refs/heads/master beb8bc1ea -> bd64c2d55 [SPARK-10921][YARN] Completely remove the use of SparkContext.prefer… …redNodeLocationData Author: Jacek Laskowski Closes #8976 from jaceklaskowski/SPARK-10921. Project:

spark git commit: [SPARK-10883] Add a note about how to build Spark sub-modules (reactor)

Repository: spark Updated Branches: refs/heads/master cd28139c9 -> 60150cf00 [SPARK-10883] Add a note about how to build Spark sub-modules (reactor) Author: Jean-Baptiste Onofré Closes #8993 from jbonofre/SPARK-10883-2. Project:

spark git commit: [SPARK-11060] [STREAMING] Fix some potential NPE in DStream transformation

Repository: spark Updated Branches: refs/heads/master eb0b4d6e2 -> 43f5d1f32 [SPARK-11060] [STREAMING] Fix some potential NPE in DStream transformation This patch fixes: 1. Guard out against NPEs in `TransformedDStream` when parent DStream returns None instead of empty RDD. 2. Verify some

spark git commit: [SPARK-11092] [DOCS] Add source links to scaladoc generation

Repository: spark Updated Branches: refs/heads/master 43f5d1f32 -> ed775042c [SPARK-11092] [DOCS] Add source links to scaladoc generation Modify the SBT build script to include GitHub source links for generated Scaladocs, on releases only (no snapshots). Author: Jakob Odersky

spark git commit: [SPARK-11066] Update DAGScheduler's "misbehaved ResultHandler"

Repository: spark Updated Branches: refs/heads/branch-1.5 c27e19042 -> 63ca9f921 [SPARK-11066] Update DAGScheduler's "misbehaved ResultHandler" Restrict tasks (of job) to only 1 to ensure that the causing Exception asserted for job failure is the deliberately thrown

spark git commit: [SPARK-11066] Update DAGScheduler's "misbehaved ResultHandler"

Repository: spark Updated Branches: refs/heads/master aec4400be -> 523adc24a [SPARK-11066] Update DAGScheduler's "misbehaved ResultHandler" Restrict tasks (of job) to only 1 to ensure that the causing Exception asserted for job failure is the deliberately thrown

spark git commit: [SPARK-11094] Strip extra strings from Java version in test runner

Repository: spark Updated Branches: refs/heads/master ed775042c -> 08698ee1d [SPARK-11094] Strip extra strings from Java version in test runner Removes any extra strings from the Java version, fixing subsequent integer parsing. This is required since some OpenJDK versions (specifically in

spark git commit: [SPARK-11094] Strip extra strings from Java version in test runner

Repository: spark Updated Branches: refs/heads/branch-1.5 7aaf485f3 -> 9903e0509 [SPARK-11094] Strip extra strings from Java version in test runner Removes any extra strings from the Java version, fixing subsequent integer parsing. This is required since some OpenJDK versions (specifically

spark git commit: [SPARK-11110][BUILD] Remove transient annotation for parameters.

Repository: spark Updated Branches: refs/heads/master 8f74aa639 -> 60851bc7b [SPARK-0][BUILD] Remove transient annotation for parameters. `transient` annotations on class parameters (not case class parameters or vals) causes compilation errors during compilation with Scala 2.11. I

spark git commit: [SPARK-11122] [BUILD] [WARN] Add tag to fatal warnings

Repository: spark Updated Branches: refs/heads/master 08698ee1d -> 4ee2cea2a [SPARK-11122] [BUILD] [WARN] Add tag to fatal warnings Shows that an error is actually due to a fatal warning. Author: Jakob Odersky Closes #9128 from jodersky/fatalwarnings. Project:

spark git commit: [SPARK-11174] [DOCS] Fix typo in the GraphX programming guide

Repository: spark Updated Branches: refs/heads/master 3895b2113 -> a112d69fd [SPARK-11174] [DOCS] Fix typo in the GraphX programming guide This patch fixes a small typo in the GraphX programming guide Author: Lukasz Piepiora Closes #9160 from

spark git commit: [SPARK-10669] [DOCS] Link to each language's API in codetabs in ML docs: spark.mllib

Repository: spark Updated Branches: refs/heads/master ffe6831e4 -> 27cdde2ff [SPARK-10669] [DOCS] Link to each language's API in codetabs in ML docs: spark.mllib In the Markdown docs for the spark.mllib Programming Guide, we have code examples with codetabs for each language. We should link

svn commit: r1708495 - in /spark: js/downloads.js site/js/downloads.js

Author: srowen Date: Tue Oct 13 19:42:05 2015 New Revision: 1708495 URL: http://svn.apache.org/viewvc?rev=1708495=rev Log: SPARK-11070 Point to archive.apache.org for older Spark releases Modified: spark/js/downloads.js spark/site/js/downloads.js Modified: spark/js/downloads.js URL

spark git commit: [SPARK-11052] Spaces in the build dir causes failures in the build/mv…

Repository: spark Updated Branches: refs/heads/master b3ffac517 -> 0d1b73b78 [SPARK-11052] Spaces in the build dir causes failures in the build/mv… …n script Author: trystanleftwich Closes #9065 from trystanleftwich/SPARK-11052. Project:

spark git commit: [SPARK-7050] [BUILD] Fix Python Kafka test assembly jar not found issue under Maven build

Repository: spark Updated Branches: refs/heads/master 351a36d0c - 8a9d9cc15 [SPARK-7050] [BUILD] Fix Python Kafka test assembly jar not found issue under Maven build To fix Spark Streaming unit test with maven build. Previously the name and path of maven generated jar is different from

spark git commit: [SPARK-8657] [YARN] [HOTFIX] Fail to upload resource to viewfs

Repository: spark Updated Branches: refs/heads/branch-1.4 e91d87e66 - e4313db38 [SPARK-8657] [YARN] [HOTFIX] Fail to upload resource to viewfs Fail to upload resource to viewfs in spark-1.4 JIRA Link: https://issues.apache.org/jira/browse/SPARK-8657 Author: Tao Li li...@sogou-inc.com Closes

spark git commit: [SPARK-8657] [YARN] Fail to upload resource to viewfs

Repository: spark Updated Branches: refs/heads/master f61c989b4 - 26d9b6b8c [SPARK-8657] [YARN] Fail to upload resource to viewfs Fail to upload resource to viewfs in spark-1.4 JIRA Link: https://issues.apache.org/jira/browse/SPARK-8657 Author: Tao Li li...@sogou-inc.com Closes #7125 from

[3/3] spark git commit: [SPARK-7977] [BUILD] Disallowing println

[SPARK-7977] [BUILD] Disallowing println Author: Jonathan Alter jonal...@users.noreply.github.com Closes #7093 from jonalter/SPARK-7977 and squashes the following commits: ccd44cc [Jonathan Alter] Changed println to log in ThreadingSuite 7fcac3e [Jonathan Alter] Reverting to println in

[1/3] spark git commit: [SPARK-7977] [BUILD] Disallowing println

Repository: spark Updated Branches: refs/heads/master d538919cc - e14b545d2 http://git-wip-us.apache.org/repos/asf/spark/blob/e14b545d/sql/core/src/main/scala/org/apache/spark/sql/Column.scala -- diff --git

[2/3] spark git commit: [SPARK-7977] [BUILD] Disallowing println

http://git-wip-us.apache.org/repos/asf/spark/blob/e14b545d/examples/src/main/scala/org/apache/spark/examples/SparkALS.scala -- diff --git a/examples/src/main/scala/org/apache/spark/examples/SparkALS.scala

spark git commit: [SPARK-8927] [DOCS] Format wrong for some config descriptions

Repository: spark Updated Branches: refs/heads/branch-1.4 5bc19a1a9 - 2fb2ef0ee [SPARK-8927] [DOCS] Format wrong for some config descriptions A couple descriptions were not inside `td/td` and were being displayed immediately under the section title instead of in their row. Author: Jonathan

spark git commit: [SPARK-8927] [DOCS] Format wrong for some config descriptions

Repository: spark Updated Branches: refs/heads/master 74d8d3d92 - 28fa01e2b [SPARK-8927] [DOCS] Format wrong for some config descriptions A couple descriptions were not inside `td/td` and were being displayed immediately under the section title instead of in their row. Author: Jonathan

[3/3] spark git commit: [SPARK-7944] [SPARK-8013] Remove most of the Spark REPL fork for Scala 2.11

[SPARK-7944] [SPARK-8013] Remove most of the Spark REPL fork for Scala 2.11 This PR removes most of the code in the Spark REPL for Scala 2.11 and leaves just a couple of overridden methods in `SparkILoop` in order to: - change welcome message - restrict available commands (like `:power`) -

[2/3] spark git commit: [SPARK-7944] [SPARK-8013] Remove most of the Spark REPL fork for Scala 2.11

http://git-wip-us.apache.org/repos/asf/spark/blob/11e22b74/repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkIMain.scala -- diff --git a/repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkIMain.scala

[1/3] spark git commit: [SPARK-7944] [SPARK-8013] Remove most of the Spark REPL fork for Scala 2.11

Repository: spark Updated Branches: refs/heads/master e14b545d2 - 11e22b74a http://git-wip-us.apache.org/repos/asf/spark/blob/11e22b74/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala -- diff --git

spark git commit: [SPARK-11732] Removes some MiMa false positives

Repository: spark Updated Branches: refs/heads/branch-1.6 5047e675e -> b468f8171 [SPARK-11732] Removes some MiMa false positives This adds an extra filter for private or protected classes. We only filter for package private right now. Author: Timothy Hunter

spark git commit: [SPARK-11732] Removes some MiMa false positives

Repository: spark Updated Branches: refs/heads/master 5aca6ad00 -> fa603e08d [SPARK-11732] Removes some MiMa false positives This adds an extra filter for private or protected classes. We only filter for package private right now. Author: Timothy Hunter Closes

spark git commit: [SPARK-10182] [MLLIB] GeneralizedLinearModel doesn't unpersist cached data

Repository: spark Updated Branches: refs/heads/master e1f4de4a7 - fdd466bed [SPARK-10182] [MLLIB] GeneralizedLinearModel doesn't unpersist cached data `GeneralizedLinearModel` creates a cached RDD when building a model. It's inconvenient, since these RDDs flood the memory when building

spark git commit: [SPARK-10257] [MLLIB] Removes Guava from all spark.mllib Java tests

Repository: spark Updated Branches: refs/heads/master b02e81872 - e1f4de4a7 [SPARK-10257] [MLLIB] Removes Guava from all spark.mllib Java tests * Replaces instances of `Lists.newArrayList` with `Arrays.asList` * Replaces `commons.lang.StringUtils` over `com.google.collections.Strings` *

spark git commit: [SPARK-10315] remove document on spark.akka.failure-detector.threshold

Repository: spark Updated Branches: refs/heads/branch-1.5 965b3bb0e - db1971501 [SPARK-10315] remove document on spark.akka.failure-detector.threshold https://issues.apache.org/jira/browse/SPARK-10315 this parameter is not used any longer and there is some mistake in the current document ,

spark git commit: [SPARK-10315] remove document on spark.akka.failure-detector.threshold

Repository: spark Updated Branches: refs/heads/master dc86a227e - 84baa5e9b [SPARK-10315] remove document on spark.akka.failure-detector.threshold https://issues.apache.org/jira/browse/SPARK-10315 this parameter is not used any longer and there is some mistake in the current document ,

spark git commit: typo in comment

Repository: spark Updated Branches: refs/heads/master 18294cd87 - 71a077f6c typo in comment Author: Dharmesh Kakadia dharmeshkaka...@users.noreply.github.com Closes #8497 from dharmeshkakadia/patch-2. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: typo in comment

Repository: spark Updated Branches: refs/heads/branch-1.5 e23ffd675 - 3ccd2e647 typo in comment Author: Dharmesh Kakadia dharmeshkaka...@users.noreply.github.com Closes #8497 from dharmeshkakadia/patch-2. (cherry picked from commit 71a077f6c16c8816eae13341f645ba50d997f63d) Signed-off-by:

spark git commit: [SPARK-10295] [CORE] Dynamic allocation in Mesos does not release when RDDs are cached

/jira/browse/SPARK-10295 Author: Sean Owen so...@cloudera.com Closes #8489 from srowen/SPARK-10295. (cherry picked from commit cc39803062119c1d14611dc227b9ed0ed1284d38) Signed-off-by: Sean Owen so...@cloudera.com Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip

spark git commit: [SPARK-10295] [CORE] Dynamic allocation in Mesos does not release when RDDs are cached

/browse/SPARK-10295 Author: Sean Owen so...@cloudera.com Closes #8489 from srowen/SPARK-10295. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cc398030 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/cc398030 Diff: http

spark git commit: Fix DynamodDB/DynamoDB typo in Kinesis Integration doc

Repository: spark Updated Branches: refs/heads/branch-1.5 8eff0696c - e23ffd675 Fix DynamodDB/DynamoDB typo in Kinesis Integration doc Fix DynamodDB/DynamoDB typo in Kinesis Integration doc Author: Keiji Yoshida yoshida.keiji...@gmail.com Closes #8501 from yosssi/patch-1. (cherry picked

spark git commit: Fix DynamodDB/DynamoDB typo in Kinesis Integration doc

Repository: spark Updated Branches: refs/heads/master cc3980306 - 18294cd87 Fix DynamodDB/DynamoDB typo in Kinesis Integration doc Fix DynamodDB/DynamoDB typo in Kinesis Integration doc Author: Keiji Yoshida yoshida.keiji...@gmail.com Closes #8501 from yosssi/patch-1. Project:

svn commit: r1698445 - /spark/doap.rdf

Author: srowen Date: Sat Aug 29 08:47:31 2015 New Revision: 1698445 URL: http://svn.apache.org/r1698445 Log: SPARK-10175 fix links in Spark DOAP file Modified: spark/doap.rdf Modified: spark/doap.rdf URL: http://svn.apache.org/viewvc/spark/doap.rdf?rev=1698445r1=1698444r2=1698445view=diff

spark git commit: [DOC] add missing parameters in SparkContext.scala for scala doc

Repository: spark Updated Branches: refs/heads/master 0e6368ffa - 5c1489015 [DOC] add missing parameters in SparkContext.scala for scala doc Author: Zhang, Liye liye.zh...@intel.com Closes #8412 from liyezhang556520/minorDoc. Project: http://git-wip-us.apache.org/repos/asf/spark/repo

spark git commit: [SPARK-10254] [ML] Removes Guava dependencies in spark.ml.feature JavaTests

Repository: spark Updated Branches: refs/heads/master 9625d13d5 - 1650f6f56 [SPARK-10254] [ML] Removes Guava dependencies in spark.ml.feature JavaTests * Replaces `com.google.common` dependencies with `java.util.Arrays` * Small clean up in `JavaNormalizerSuite` Author: Feynman Liang

spark git commit: [SPARK-10255] [ML] Removes Guava dependencies from spark.ml.param JavaTests

Repository: spark Updated Branches: refs/heads/master 1650f6f56 - 75d623079 [SPARK-10255] [ML] Removes Guava dependencies from spark.ml.param JavaTests Author: Feynman Liang fli...@databricks.com Closes #8446 from feynmanliang/SPARK-10255. Project:

spark git commit: [SPARK-10256] [ML] Removes guava dependency from spark.ml.classification JavaTests

Repository: spark Updated Branches: refs/heads/master 75d623079 - 1a446f75b [SPARK-10256] [ML] Removes guava dependency from spark.ml.classification JavaTests Author: Feynman Liang fli...@databricks.com Closes #8447 from feynmanliang/SPARK-10256. Project:

<    1   2   3   4   5   6   7   8   9   10   >