spark git commit: [SPARK-9613] [HOTFIX] Fix usage of JavaConverters removed in Scala 2.11

Repository: spark Updated Branches: refs/heads/master 1a446f75b - b02e81872 [SPARK-9613] [HOTFIX] Fix usage of JavaConverters removed in Scala 2.11 Fix for [JavaConverters.asJavaListConverter](http://www.scala-lang.org/api/2.10.5/index.html#scala.collection.JavaConverters$) being removed in

spark git commit: [DOCS] [STREAMING] [KAFKA] Fix typo in exactly once semantics

Repository: spark Updated Branches: refs/heads/master de0278286 - 9625d13d5 [DOCS] [STREAMING] [KAFKA] Fix typo in exactly once semantics Fix Typo in exactly once semantics [Semantics of output operations] link Author: Moussa Taifi mouta...@gmail.com Closes #8468 from moutai/patch-3.

spark git commit: [DOCS] [STREAMING] [KAFKA] Fix typo in exactly once semantics

Repository: spark Updated Branches: refs/heads/branch-1.5 165be9ad1 - 30f0f7e4e [DOCS] [STREAMING] [KAFKA] Fix typo in exactly once semantics Fix Typo in exactly once semantics [Semantics of output operations] link Author: Moussa Taifi mouta...@gmail.com Closes #8468 from moutai/patch-3.

spark git commit: [SPARK-10398] [DOCS] Migrate Spark download page to use new lua mirroring scripts

I'm implementing the changes to the Apache site separately. Author: Sean Owen <so...@cloudera.com> Closes #8557 from srowen/SPARK-10398. (cherry picked from commit 3f63bd6023edcc9af268933a235f34e10bc3d2ba) Signed-off-by: Sean Owen <so...@cloudera.com> Project: http://git-wip-us.apach

spark git commit: [SPARK-10398] [DOCS] Migrate Spark download page to use new lua mirroring scripts

I'm implementing the changes to the Apache site separately. Author: Sean Owen <so...@cloudera.com> Closes #8557 from srowen/SPARK-10398. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/3f63bd60 Tree: http://git-wip-us.apache.

svn commit: r1700445 [1/2] - in /spark: ./ news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Author: srowen Date: Tue Sep 1 09:34:05 2015 New Revision: 1700445 URL: http://svn.apache.org/r1700445 Log: SPARK-10391 fix URL of "Spark 1.4.1 released" news and regen site Added: spark/news/_posts/2015-07-15-spark-1-4-1-released.md - copied unchanged from r1700436,

svn commit: r1700445 [2/2] - in /spark: ./ news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Modified: spark/site/news/submit-talks-to-spark-summit-2014.html URL: http://svn.apache.org/viewvc/spark/site/news/submit-talks-to-spark-summit-2014.html?rev=1700445=1700444=1700445=diff == ---

spark git commit: Docs small fixes

Repository: spark Updated Branches: refs/heads/branch-1.5 37c5edf1c -> 88a07d89e Docs small fixes Author: Jacek Laskowski Closes #8629 from jaceklaskowski/docs-fixes. (cherry picked from commit 6ceed852ab716d8acc46ce90cba9cfcff6d3616f) Signed-off-by: Sean Owen

svn commit: r1700606 - in /spark/site/docs: 0.6.0/ 0.6.1/ 0.6.2/ 0.7.0/ 0.7.2/ 0.7.3/ 0.8.0/ 0.8.1/ 0.9.0/ 0.9.1/ 0.9.2/ 1.0.0/ 1.0.1/ 1.0.2/ 1.1.0/ 1.1.1/ 1.2.0/ 1.2.1/ 1.2.2/ 1.3.0/ 1.3.1/ 1.4.0/ 1.

Author: srowen Date: Tue Sep 1 16:18:23 2015 New Revision: 1700606 URL: http://svn.apache.org/r1700606 Log: SPARK-10398 also replace closer.cgi with closer.lua in historical docs' link to Mesos Modified: spark/site/docs/0.6.0/running-on-mesos.html spark/site/docs/0.6.1/running

svn commit: r1700551 - in /spark: js/downloads.js site/js/downloads.js

Author: srowen Date: Tue Sep 1 14:00:45 2015 New Revision: 1700551 URL: http://svn.apache.org/r1700551 Log: SPARK-10398 replace closer.cgi with closer.lua Modified: spark/js/downloads.js spark/site/js/downloads.js Modified: spark/js/downloads.js URL: http://svn.apache.org/viewvc/spark

[1/5] spark git commit: [SPARK-9613] [CORE] Ban use of JavaConversions and migrate all existing uses to JavaConverters

Repository: spark Updated Branches: refs/heads/master 7f1e507bf - 69c9c1771 http://git-wip-us.apache.org/repos/asf/spark/blob/69c9c177/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala -- diff --git

[5/5] spark git commit: [SPARK-9613] [CORE] Ban use of JavaConversions and migrate all existing uses to JavaConverters

. Author: Sean Owen so...@cloudera.com Closes #8033 from srowen/SPARK-9613. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/69c9c177 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/69c9c177 Diff: http://git-wip-us.apache.org

[3/5] spark git commit: [SPARK-9613] [CORE] Ban use of JavaConversions and migrate all existing uses to JavaConverters

http://git-wip-us.apache.org/repos/asf/spark/blob/69c9c177/external/flume/src/main/scala/org/apache/spark/streaming/flume/PollingFlumeTestUtils.scala -- diff --git

[4/5] spark git commit: [SPARK-9613] [CORE] Ban use of JavaConversions and migrate all existing uses to JavaConverters

http://git-wip-us.apache.org/repos/asf/spark/blob/69c9c177/core/src/main/scala/org/apache/spark/network/netty/NettyBlockRpcServer.scala -- diff --git a/core/src/main/scala/org/apache/spark/network/netty/NettyBlockRpcServer.scala

spark git commit: [SPARK-10227] fatal warnings with sbt on Scala 2.11

Repository: spark Updated Branches: refs/heads/master 91a577d27 -> c1bc4f439 [SPARK-10227] fatal warnings with sbt on Scala 2.11 The bulk of the changes are on `transient` annotation on class parameter. Often the compiler doesn't generate a field for this parameters, so the the transient

spark git commit: [SPARK-10497] [BUILD] [TRIVIAL] Handle both locations for JIRAError with python-jira

Repository: spark Updated Branches: refs/heads/master 1dc7548c5 -> 48817cc11 [SPARK-10497] [BUILD] [TRIVIAL] Handle both locations for JIRAError with python-jira Location of JIRAError has moved between old and new versions of python-jira package. Longer term it probably makes sense to pin

spark git commit: [SPARK-10222] [GRAPHX] [DOCS] More thoroughly deprecate Bagel in favor of GraphX

Repository: spark Updated Branches: refs/heads/master b3a7480ab -> 1dc614b87 [SPARK-10222] [GRAPHX] [DOCS] More thoroughly deprecate Bagel in favor of GraphX Finish deprecating Bagel; remove reference to nonexistent example Author: Sean Owen <so...@cloudera.com> Closes #8731 fr

spark git commit: [SPARK-10511] [BUILD] Reset git repository before packaging source distro

Repository: spark Updated Branches: refs/heads/branch-1.5 2bbcbc659 -> 4c4a9ba28 [SPARK-10511] [BUILD] Reset git repository before packaging source distro The calculation of Spark version is downloading Scala and Zinc in the build directory which is inflating the size of the source

spark git commit: [SPARK-10511] [BUILD] Reset git repository before packaging source distro

Repository: spark Updated Branches: refs/heads/master 95b6a8103 -> 1894653ed [SPARK-10511] [BUILD] Reset git repository before packaging source distro The calculation of Spark version is downloading Scala and Zinc in the build directory which is inflating the size of the source distribution.

spark git commit: [SPARK-10546] Check partitionId's range in ExternalSorter#spill()

Repository: spark Updated Branches: refs/heads/master 5f4644476 -> b231ab893 [SPARK-10546] Check partitionId's range in ExternalSorter#spill() See this thread for background: http://search-hadoop.com/m/q3RTt0rWvIkHAE81 We should check the range of partition Id and provide meaningful message

spark git commit: [PYTHON] Fixed typo in exception message

Repository: spark Updated Branches: refs/heads/master b231ab893 -> c37386677 [PYTHON] Fixed typo in exception message Just fixing a typo in exception message, raised when attempting to pickle SparkContext. Author: Icaro Medeiros Closes #8724 from

spark git commit: [SPARK-10566] [CORE] SnappyCompressionCodec init exception handling masks important error information

Repository: spark Updated Branches: refs/heads/master c34fc1976 -> 6d8367807 [SPARK-10566] [CORE] SnappyCompressionCodec init exception handling masks important error information When throwing an IllegalArgumentException in SnappyCompressionCodec.init, chain the existing exception. This

spark git commit: [SPARK-10556] Remove explicit Scala version for sbt project build files

Repository: spark Updated Branches: refs/heads/branch-1.5 89d351b5a -> 4af925664 [SPARK-10556] Remove explicit Scala version for sbt project build files Previously, project/plugins.sbt explicitly set scalaVersion to 2.10.4. This can cause issues when using a version of sbt that is compiled

spark git commit: [SPARK-10556] Remove explicit Scala version for sbt project build files

Repository: spark Updated Branches: refs/heads/master e1d7f6429 -> 9bbe33f31 [SPARK-10556] Remove explicit Scala version for sbt project build files Previously, project/plugins.sbt explicitly set scalaVersion to 2.10.4. This can cause issues when using a version of sbt that is compiled

spark git commit: [SPARK-10556] Remove explicit Scala version for sbt project build files

Repository: spark Updated Branches: refs/heads/branch-1.4 53f119cc5 -> af69c4c90 [SPARK-10556] Remove explicit Scala version for sbt project build files Previously, project/plugins.sbt explicitly set scalaVersion to 2.10.4. This can cause issues when using a version of sbt that is compiled

spark git commit: [SPARK-10556] Remove explicit Scala version for sbt project build files

Repository: spark Updated Branches: refs/heads/branch-1.3 d0d7ada9f -> 8c8d7ab20 [SPARK-10556] Remove explicit Scala version for sbt project build files Previously, project/plugins.sbt explicitly set scalaVersion to 2.10.4. This can cause issues when using a version of sbt that is compiled

spark git commit: [SPARK-10554] [CORE] Fix NPE with ShutdownHook

Repository: spark Updated Branches: refs/heads/master 6d8367807 -> 8285e3b0d [SPARK-10554] [CORE] Fix NPE with ShutdownHook https://issues.apache.org/jira/browse/SPARK-10554 Fixes NPE when ShutdownHook tries to cleanup temporary folders Author: Nithin Asokan

spark git commit: [SPARK-10554] [CORE] Fix NPE with ShutdownHook

Repository: spark Updated Branches: refs/heads/branch-1.5 5bf403c53 -> f8909a6c6 [SPARK-10554] [CORE] Fix NPE with ShutdownHook https://issues.apache.org/jira/browse/SPARK-10554 Fixes NPE when ShutdownHook tries to cleanup temporary folders Author: Nithin Asokan

[1/2] spark git commit: [SPARK-10547] [TEST] Streamline / improve style of Java API tests

Repository: spark Updated Branches: refs/heads/master 8285e3b0d -> 22730ad54 http://git-wip-us.apache.org/repos/asf/spark/blob/22730ad5/streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java -- diff --git

spark git commit: [DOCS] Small fixes to Spark on Yarn doc

Repository: spark Updated Branches: refs/heads/master 0d9ab0167 -> 416003b26 [DOCS] Small fixes to Spark on Yarn doc * a follow-up to 16b6d18613e150c7038c613992d80a7828413e66 as `--num-executors` flag is not suppported. * links + formatting Author: Jacek Laskowski

spark git commit: [SPARK-10589] [WEBUI] Add defense against external site framing

Repository: spark Updated Branches: refs/heads/master d9b7f3e4d -> 5dbaf3d39 [SPARK-10589] [WEBUI] Add defense against external site framing Set `X-Frame-Options: SAMEORIGIN` to protect against frame-related vulnerability Author: Sean Owen <so...@cloudera.com> Closes #8745 from sro

spark git commit: [SPARK-10778] [MLLIB] Implement toString for AssociationRules.Rule

Repository: spark Updated Branches: refs/heads/master 6f94d56a9 -> 299b43992 [SPARK-10778] [MLLIB] Implement toString for AssociationRules.Rule I implemented toString for AssociationRules.Rule, format like `[x, y] => {z}: 1.0` Author: y-shimizu Closes #8904 from

spark git commit: [SPARK-10782] [PYTHON] Update dropDuplicates documentation

Repository: spark Updated Branches: refs/heads/master 7d399c9da -> c1ad373f2 [SPARK-10782] [PYTHON] Update dropDuplicates documentation Documentation for dropDuplicates() and drop_duplicates() is one and the same. Resolved the error in the example for drop_duplicates using the same approach

spark git commit: FIX: rememberDuration reassignment error message

Repository: spark Updated Branches: refs/heads/master 107320c9b -> be0dcd6eb FIX: rememberDuration reassignment error message I was reading throught the scheduler and found this small mistake. Author: Guillaume Poulin Closes #8966 from gpoulin/remember_duration_typo.

spark git commit: [SPARK-10889] [STREAMING] Bump KCL to add MillisBehindLatest metric

Repository: spark Updated Branches: refs/heads/master 82bbc2a5f -> 883bd8fcc [SPARK-10889] [STREAMING] Bump KCL to add MillisBehindLatest metric I don't believe the API changed at all. Author: Avrohom Katz Closes #8957 from akatz/kcl-upgrade. Project:

spark git commit: [SPARK-10889] [STREAMING] Bump KCL to add MillisBehindLatest metric

Repository: spark Updated Branches: refs/heads/branch-1.5 8836ac3d1 -> d323e5ede [SPARK-10889] [STREAMING] Bump KCL to add MillisBehindLatest metric I don't believe the API changed at all. Author: Avrohom Katz Closes #8957 from akatz/kcl-upgrade. (cherry picked

spark git commit: [SPARK-9570] [DOCS] Consistent recommendation for submitting spark apps to YARN, -master yarn --deploy-mode x vs -master yarn-x'.

low-on to https://github.com/apache/spark/pull/8385 CC nssalian Author: Sean Owen <so...@cloudera.com> Closes #8968 from srowen/SPARK-9570. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/82bbc2a5 Tree: http:

spark git commit: [SPARK-10720] [SQL] [JAVA] Add a java wrapper to create a dataframe from a local list of java beans

Repository: spark Updated Branches: refs/heads/master 418e5e4cb -> 8ecba3e86 [SPARK-10720] [SQL] [JAVA] Add a java wrapper to create a dataframe from a local list of java beans Similar to SPARK-10630 it would be nice if Java users didn't have to parallelize there data explicitly (as Scala

spark git commit: add doc for spark.streaming.stopGracefullyOnShutdown

Repository: spark Updated Branches: refs/heads/master 8ecba3e86 -> fb4c7be74 add doc for spark.streaming.stopGracefullyOnShutdown Author: Bin Wang Closes #8898 from wb14123/doc. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: Fix two mistakes in programming-guide page

Repository: spark Updated Branches: refs/heads/master fb4c7be74 -> b58249930 Fix two mistakes in programming-guide page seperate -> separate sees -> see Author: David Martin Closes #8928 from dmartinpro/patch-1. Project:

[2/2] spark git commit: [SPARK-10833] [BUILD] Inline, organize BSD/MIT licenses in LICENSE

SE file can continue to provide a helpful list of BSD/MIT licensed projects and a pointer to their sites. This would be over and above including license text in the distro, which is the essential thing. Author: Sean Owen <so...@cloudera.com> Closes #8919 from srowen/SPARK-10833.

[2/2] spark git commit: [SPARK-10833] [BUILD] Inline, organize BSD/MIT licenses in LICENSE

SE file can continue to provide a helpful list of BSD/MIT licensed projects and a pointer to their sites. This would be over and above including license text in the distro, which is the essential thing. Author: Sean Owen <so...@cloudera.com> Closes #8919 from srowen/SPARK-10833.

[1/2] spark git commit: [SPARK-10833] [BUILD] Inline, organize BSD/MIT licenses in LICENSE

Repository: spark Updated Branches: refs/heads/branch-1.5 a36784083 -> 9b3014bc4 http://git-wip-us.apache.org/repos/asf/spark/blob/9b3014bc/licenses/LICENSE-jpmml-model.txt -- diff --git a/licenses/LICENSE-jpmml-model.txt

[1/2] spark git commit: [SPARK-10833] [BUILD] Inline, organize BSD/MIT licenses in LICENSE

Repository: spark Updated Branches: refs/heads/master ea02e5513 -> bf4199e26 http://git-wip-us.apache.org/repos/asf/spark/blob/bf4199e2/licenses/LICENSE-jquery.txt -- diff --git a/licenses/LICENSE-jquery.txt

spark git commit: [SPARK-10721] Log warning when file deletion fails

Repository: spark Updated Branches: refs/heads/master 50e463423 -> 27bfa9ab3 [SPARK-10721] Log warning when file deletion fails Author: tedyu Closes #8843 from tedyu/master. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-10706] [MLLIB] Add java wrapper for random vector rdd

Repository: spark Updated Branches: refs/heads/master 7278f792a -> 870b8a2ed [SPARK-10706] [MLLIB] Add java wrapper for random vector rdd Add java wrapper for random vector rdd holdenk srowen Author: Meihua Wu <meihu...@umich.edu> Closes #8841 from rotationsymmetry/SPARK-10706.

spark git commit: [SPARK-10718] [BUILD] Update License on conf files and corresponding excludes file update

Repository: spark Updated Branches: refs/heads/master 0bd0e5bed -> 7278f792a [SPARK-10718] [BUILD] Update License on conf files and corresponding excludes file update Update License on conf files and corresponding excludes file update Author: Rekha Joshi Author: Joshi

spark git commit: Fixed links to the API

Repository: spark Updated Branches: refs/heads/branch-1.5 aaae67df9 -> 9b74fecb3 Fixed links to the API Submitting this change on the master branch as requested in https://github.com/apache/spark/pull/8819#issuecomment-141505941 Author: Alexis Seigneurin

spark git commit: Fixed links to the API

Repository: spark Updated Branches: refs/heads/master d507f9c0b -> d83b6aae8 Fixed links to the API Submitting this change on the master branch as requested in https://github.com/apache/spark/pull/8819#issuecomment-141505941 Author: Alexis Seigneurin Closes

spark git commit: [SPARK-10626] [MLLIB] create java friendly method for random rdd

Repository: spark Updated Branches: refs/heads/master 014403951 -> 20a61dbd9 [SPARK-10626] [MLLIB] create java friendly method for random rdd SPARK-3136 added a large number of functions for creating Java RandomRDDs, but for people that want to use custom RandomDataGenerators we should make

spark git commit: [SPARK-10662] [DOCS] Code snippets are not properly formatted in tables

Repository: spark Updated Branches: refs/heads/master ebbf85f07 -> ca9fe540f [SPARK-10662] [DOCS] Code snippets are not properly formatted in tables * Backticks are processed properly in Spark Properties table * Removed unnecessary spaces * See

spark git commit: [SPARK-12166][TEST] Unset hadoop related environment in testing

Repository: spark Updated Branches: refs/heads/branch-1.6 c9e5274ae -> 870f43562 [SPARK-12166][TEST] Unset hadoop related environment in testing Author: Jeff Zhang Closes #10172 from zjffdu/SPARK-12166. (cherry picked from commit 708129187a460aca30790281e9221c0cd5e271df)

spark git commit: [SPARK-12103][STREAMING][KAFKA][DOC] document that K means Key and V …

Repository: spark Updated Branches: refs/heads/branch-1.6 5c8216920 -> c9e5274ae [SPARK-12103][STREAMING][KAFKA][DOC] document that K means Key and V … …means Value Author: cody koeninger Closes #10132 from koeninger/SPARK-12103. (cherry picked from commit

spark git commit: [SPARK-12103][STREAMING][KAFKA][DOC] document that K means Key and V …

Repository: spark Updated Branches: refs/heads/master 4a39b5a1b -> 48a9804b2 [SPARK-12103][STREAMING][KAFKA][DOC] document that K means Key and V … …means Value Author: cody koeninger Closes #10132 from koeninger/SPARK-12103. Project:

spark git commit: [SPARK-11652][CORE] Remote code execution with InvokerTransformer

hor: Sean Owen <so...@cloudera.com> Closes #10198 from srowen/SPARK-11652.2. (cherry picked from commit e3735ce1602826f0a8e0ca9e08730923843449ee) Signed-off-by: Sean Owen <so...@cloudera.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apach

spark git commit: [SPARK-11652][CORE] Remote code execution with InvokerTransformer

hor: Sean Owen <so...@cloudera.com> Closes #10198 from srowen/SPARK-11652.2. (cherry picked from commit e3735ce1602826f0a8e0ca9e08730923843449ee) Signed-off-by: Sean Owen <so...@cloudera.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apach

spark git commit: [SPARK-11652][CORE] Remote code execution with InvokerTransformer

ean Owen <so...@cloudera.com> Closes #10198 from srowen/SPARK-11652.2. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e3735ce1 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e3735ce1 Diff: http://git-wip-us.a

spark git commit: [SPARK-11652][CORE] Remote code execution with InvokerTransformer

hor: Sean Owen <so...@cloudera.com> Closes #10198 from srowen/SPARK-11652.2. (cherry picked from commit e3735ce1602826f0a8e0ca9e08730923843449ee) Signed-off-by: Sean Owen <so...@cloudera.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apach

spark git commit: [SPARK-12088][SQL] check connection.isClosed before calling connection…

Repository: spark Updated Branches: refs/heads/branch-1.6 6674fd8aa -> 5826096ac [SPARK-12088][SQL] check connection.isClosed before calling connection… In Java Spec java.sql.Connection, it has boolean getAutoCommit() throws SQLException Throws: SQLException - if a database access error

spark git commit: [SPARK-12088][SQL] check connection.isClosed before calling connection…

Repository: spark Updated Branches: refs/heads/master ec2b6c26c -> 5349851f3 [SPARK-12088][SQL] check connection.isClosed before calling connection… In Java Spec java.sql.Connection, it has boolean getAutoCommit() throws SQLException Throws: SQLException - if a database access error occurs

spark git commit: Add links howto to setup IDEs for developing spark

Repository: spark Updated Branches: refs/heads/master 4106d80fb -> 17e4e021a Add links howto to setup IDEs for developing spark These links make it easier for new developers to work with Spark in their IDE. Author: kaklakariada Closes #10104 from

spark git commit: [SPARK-12048][SQL] Prevent to close JDBC resources twice

Repository: spark Updated Branches: refs/heads/branch-1.5 ed7264ba2 -> 8bbb3cdd1 [SPARK-12048][SQL] Prevent to close JDBC resources twice Author: gcc Closes #10101 from rh99/master. (cherry picked from commit 04b6799932707f0a4aa4da0f2fc838bdb29794ce)

spark git commit: [SPARK-12048][SQL] Prevent to close JDBC resources twice

Repository: spark Updated Branches: refs/heads/branch-1.6 2feac49fb -> c8747a9db [SPARK-12048][SQL] Prevent to close JDBC resources twice Author: gcc Closes #10101 from rh99/master. (cherry picked from commit 04b6799932707f0a4aa4da0f2fc838bdb29794ce)

spark git commit: [SPARK-12096][MLLIB] remove the old constraint in word2vec

ize < Ine.max / 8 should be removed. new constraint is vocabSize.toLong * vectorSize < max array length (usually a little less than Int.MaxValue) I tested with vocabsize over 18M and vectorsize = 100. srowen jkbradley Sorry to miss this in last PR. I was reminded today. Author: Yuhao

spark git commit: [SPARK-12031][CORE][BUG] Integer overflow when do sampling

Repository: spark Updated Branches: refs/heads/branch-1.6 0be792aad -> b5a76b4a4 [SPARK-12031][CORE][BUG] Integer overflow when do sampling Author: uncleGen Closes #10023 from uncleGen/1.6-bugfix. (cherry picked from commit a113216865fd45ea39ae8f104e784af2cf667dcf)

spark git commit: [SPARK-10299][ML] word2vec should allow users to specify the window size

Repository: spark Updated Branches: refs/heads/branch-1.6 b5a76b4a4 -> acd462420 [SPARK-10299][ML] word2vec should allow users to specify the window size Currently word2vec has the window hard coded at 5, some users may want different sizes (for example if using on n-gram input or similar).

spark git commit: [SPARK-10299][ML] word2vec should allow users to specify the window size

Repository: spark Updated Branches: refs/heads/master 6e1c55eac -> 22b9a8740 [SPARK-10299][ML] word2vec should allow users to specify the window size Currently word2vec has the window hard coded at 5, some users may want different sizes (for example if using on n-gram input or similar). User

spark git commit: [SPARK-11988][ML][MLLIB] Update JPMML to 1.2.7

Repository: spark Updated Branches: refs/heads/master e9c9ae22b -> 7da674851 [SPARK-11988][ML][MLLIB] Update JPMML to 1.2.7 Update JPMML pmml-model to 1.2.7 Author: Sean Owen <so...@cloudera.com> Closes #9972 from srowen/SPARK-11988. Project: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-11994][MLLIB] Word2VecModel load and save cause SparkException when model is bigger than spark.kryoserializer.buffer.max

Repository: spark Updated Branches: refs/heads/master ee94b70ce -> e9c9ae22b [SPARK-11994][MLLIB] Word2VecModel load and save cause SparkException when model is bigger than spark.kryoserializer.buffer.max Author: Antonio Murgia Closes #9989 from

spark git commit: [DOCUMENTATION][KAFKA] fix typo in kafka/OffsetRange.scala

Repository: spark Updated Branches: refs/heads/branch-1.6 93b69ec45 -> 84cbed17e [DOCUMENTATION][KAFKA] fix typo in kafka/OffsetRange.scala this is to fix some typo in external/kafka/src/main/scala/org/apache/spark/streaming/kafka/OffsetRange.scala Author: microwishing

spark git commit: [DOCUMENTATION][KAFKA] fix typo in kafka/OffsetRange.scala

Repository: spark Updated Branches: refs/heads/master 7470d9edb -> 95b3cf125 [DOCUMENTATION][KAFKA] fix typo in kafka/OffsetRange.scala this is to fix some typo in external/kafka/src/main/scala/org/apache/spark/streaming/kafka/OffsetRange.scala Author: microwishing

spark git commit: [DOCUMENTATION][MLLIB] typo in mllib doc

Repository: spark Updated Branches: refs/heads/branch-1.6 5826096ac -> 93b69ec45 [DOCUMENTATION][MLLIB] typo in mllib doc \cc mengxr Author: Jeff Zhang Closes #10093 from zjffdu/mllib_typo. (cherry picked from commit 7470d9edbb0a45e714c96b5d55eff30724c0653a)

spark git commit: [DOCUMENTATION][MLLIB] typo in mllib doc

Repository: spark Updated Branches: refs/heads/master 5349851f3 -> 7470d9edb [DOCUMENTATION][MLLIB] typo in mllib doc \cc mengxr Author: Jeff Zhang Closes #10093 from zjffdu/mllib_typo. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-3580][CORE] Add Consistent Method To Get Number of RDD Partitions Across Different Languages

Repository: spark Updated Branches: refs/heads/master 4375eb3f4 -> 128c29035 [SPARK-3580][CORE] Add Consistent Method To Get Number of RDD Partitions Across Different Languages I have tried to address all the comments in pull request https://github.com/apache/spark/pull/2447. Note that the

spark git commit: [SPARK-3580][CORE] Add Consistent Method To Get Number of RDD Partitions Across Different Languages

Repository: spark Updated Branches: refs/heads/branch-1.6 c47a7373a -> d79dd971d [SPARK-3580][CORE] Add Consistent Method To Get Number of RDD Partitions Across Different Languages I have tried to address all the comments in pull request https://github.com/apache/spark/pull/2447. Note that

spark git commit: [MINOR][DOC] Fix broken word2vec link

Repository: spark Updated Branches: refs/heads/master ed87f6d3b -> e25f1fe42 [MINOR][DOC] Fix broken word2vec link Follow-up of [SPARK-12199](https://issues.apache.org/jira/browse/SPARK-12199) and #10193 where a broken link has been left as is. Author: BenFradet

spark git commit: [MINOR][DOC] Fix broken word2vec link

Repository: spark Updated Branches: refs/heads/branch-1.6 94ce5025f -> c0f0f6cb0 [MINOR][DOC] Fix broken word2vec link Follow-up of [SPARK-12199](https://issues.apache.org/jira/browse/SPARK-12199) and #10193 where a broken link has been left as is. Author: BenFradet

spark git commit: [SPARK-12332][TRIVIAL][TEST] Fix minor typo in ResetSystemProperties

Repository: spark Updated Branches: refs/heads/master 606f99b94 -> c59df8c51 [SPARK-12332][TRIVIAL][TEST] Fix minor typo in ResetSystemProperties Fix a minor typo (unbalanced bracket) in ResetSystemProperties. Author: Holden Karau Closes #10303 from

spark git commit: [SPARK-11193] Use Java ConcurrentHashMap instead of SynchronizedMap trait in order to avoid ClassCastException due to KryoSerializer in KinesisReceiver

Repository: spark Updated Branches: refs/heads/branch-1.6 47461fea7 -> 2679fce71 [SPARK-11193] Use Java ConcurrentHashMap instead of SynchronizedMap trait in order to avoid ClassCastException due to KryoSerializer in KinesisReceiver Author: Jean-Baptiste Onofré Closes

spark git commit: [SPARK-11193] Use Java ConcurrentHashMap instead of SynchronizedMap trait in order to avoid ClassCastException due to KryoSerializer in KinesisReceiver

Repository: spark Updated Branches: refs/heads/master 1e3526c2d -> 03138b67d [SPARK-11193] Use Java ConcurrentHashMap instead of SynchronizedMap trait in order to avoid ClassCastException due to KryoSerializer in KinesisReceiver Author: Jean-Baptiste Onofré Closes

spark git commit: [SPARK-12136][STREAMING] rddToFileName does not properly handle prefix and suffix parameters

Repository: spark Updated Branches: refs/heads/branch-1.6 f6d866173 -> b5e5812f9 [SPARK-12136][STREAMING] rddToFileName does not properly handle prefix and suffix parameters The original code does not properly handle the cases where the prefix is null, but suffix is not null - the suffix

spark git commit: [SPARK-12136][STREAMING] rddToFileName does not properly handle prefix and suffix parameters

Repository: spark Updated Branches: refs/heads/master d8ec081c9 -> e29704f90 [SPARK-12136][STREAMING] rddToFileName does not properly handle prefix and suffix parameters The original code does not properly handle the cases where the prefix is null, but suffix is not null - the suffix should

spark git commit: [SPARK-11530][MLLIB] Return eigenvalues with PCA model

9736 from srowen/SPARK-11530. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/21b3d2a7 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/21b3d2a7 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/21b3d2a7 Branch: r

spark git commit: [SPARK-11824][WEBUI] WebUI does not render descriptions with 'bad' HTML, throws console error

C tdas as author of this bit of code Author: Sean Owen <so...@cloudera.com> Closes #10159 from srowen/SPARK-11824. (cherry picked from commit 1eb7c22ce72a1b82ed194a51bbcf0da9c771605a) Signed-off-by: Sean Owen <so...@cloudera.com> Project: http://git-wip-us.apache.org/repos/asf/spark

spark git commit: [SPARK-12513][STREAMING] SocketReceiver hang in Netcat example

Repository: spark Updated Branches: refs/heads/master 9fd7a2f02 -> 962aac4db [SPARK-12513][STREAMING] SocketReceiver hang in Netcat example Explicitly close client side socket connection before restart socket receiver. Author: guoxu1231 Author: Shawn Guo

[2/2] spark git commit: [SPARK-12481][CORE][STREAMING][SQL] Remove usage of Hadoop deprecated APIs and reflection that supported 1.x

[SPARK-12481][CORE][STREAMING][SQL] Remove usage of Hadoop deprecated APIs and reflection that supported 1.x Remove use of deprecated Hadoop APIs now that 2.2+ is required Author: Sean Owen <so...@cloudera.com> Closes #10446 from srowen/SPARK-12481. Project: http://git-wip-us.apac

[1/2] spark git commit: [SPARK-12481][CORE][STREAMING][SQL] Remove usage of Hadoop deprecated APIs and reflection that supported 1.x

Repository: spark Updated Branches: refs/heads/master 94f7a12b3 -> 15bd73627 http://git-wip-us.apache.org/repos/asf/spark/blob/15bd7362/sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveWriterContainers.scala -- diff --git

spark git commit: [SPARK-12618][CORE][STREAMING][SQL] Clean up build warnings: 2.0.0 edition

ove the deprecated APIs. Author: Sean Owen <so...@cloudera.com> Closes #10570 from srowen/SPARK-12618. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b9c83533 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree

spark git commit: fixed numVertices in transitive closure example

Repository: spark Updated Branches: refs/heads/master 00d926172 -> 8c70cb4c6 fixed numVertices in transitive closure example Author: Udo Klein Closes #10642 from udoklein/patch-2. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: fixed numVertices in transitive closure example

Repository: spark Updated Branches: refs/heads/branch-1.6 fe2cf342e -> e4227cb3e fixed numVertices in transitive closure example Author: Udo Klein Closes #10642 from udoklein/patch-2. (cherry picked from commit 8c70cb4c62a353bea99f37965dfc829c4accc391) Signed-off-by:

spark git commit: [SPARK-12331][ML] R^2 for regression through the origin.

Repository: spark Updated Branches: refs/heads/master 8eb2dc713 -> 1cdc42d2b [SPARK-12331][ML] R^2 for regression through the origin. Modified the definition of R^2 for regression through origin. Added modified test for regression metrics. Author: Imran Younus Author:

spark git commit: [SPARK-12453][STREAMING] Remove explicit dependency on aws-java-sdk

Repository: spark Updated Branches: refs/heads/master 78015a8b7 -> ff8997554 [SPARK-12453][STREAMING] Remove explicit dependency on aws-java-sdk Successfully ran kinesis demo on a live, aws hosted kinesis stream against master and 1.6 branches. For reasons I don't entirely understand it

spark git commit: [SPARK-12453][STREAMING] Remove explicit dependency on aws-java-sdk

Repository: spark Updated Branches: refs/heads/branch-1.6 0afad6678 -> bf3dca2df [SPARK-12453][STREAMING] Remove explicit dependency on aws-java-sdk Successfully ran kinesis demo on a live, aws hosted kinesis stream against master and 1.6 branches. For reasons I don't entirely understand it

spark git commit: [SPARK-12453][STREAMING] Remove explicit dependency on aws-java-sdk

Repository: spark Updated Branches: refs/heads/branch-1.5 4c176d95d -> 7a49b6048 [SPARK-12453][STREAMING] Remove explicit dependency on aws-java-sdk Successfully ran kinesis demo on a live, aws hosted kinesis stream against master and 1.6 branches. For reasons I don't entirely understand it

spark git commit: [SPARK-12598][CORE] bug in setMinPartitions

Repository: spark Updated Branches: refs/heads/master 1b2c2162a -> 834651835 [SPARK-12598][CORE] bug in setMinPartitions There is a bug in the calculation of ```maxSplitSize```. The ```totalLen``` should be divided by ```minPartitions``` and not by ```files.size```. Author: Darek Blasiak

spark git commit: [SPARK-12598][CORE] bug in setMinPartitions

Repository: spark Updated Branches: refs/heads/branch-1.6 017b73e69 -> 6ef823544 [SPARK-12598][CORE] bug in setMinPartitions There is a bug in the calculation of ```maxSplitSize```. The ```totalLen``` should be divided by ```minPartitions``` and not by ```files.size```. Author: Darek

spark git commit: [STREAMING][MINOR] More contextual information in logs + minor code i…

Repository: spark Updated Branches: refs/heads/master 07b314a57 -> 1b2c2162a [STREAMING][MINOR] More contextual information in logs + minor code i… …mprovements Please review and merge at your convenience. Thanks! Author: Jacek Laskowski Closes #10595 from

spark git commit: [SPARK-10158][PYSPARK][MLLIB] ALS better error message when using Long IDs

Repository: spark Updated Branches: refs/heads/master 284e29a87 -> ce1798b3a [SPARK-10158][PYSPARK][MLLIB] ALS better error message when using Long IDs Added catch for casting Long to Int exception when PySpark ALS Ratings are serialized. It is easy to accidentally use Long IDs for

spark git commit: [SPARK-12353][STREAMING][PYSPARK] Fix countByValue inconsistent output in Python API

Repository: spark Updated Branches: refs/heads/master 5aa2710c1 -> 8d4940092 [SPARK-12353][STREAMING][PYSPARK] Fix countByValue inconsistent output in Python API The semantics of Python countByValue is different from Scala API, it is more like countDistinctValue, so here change to make it

spark git commit: [SPARK-12515][SQL][DOC] minor doc update for read.jdbc

Repository: spark Updated Branches: refs/heads/master 9ab296ecd -> 5aa2710c1 [SPARK-12515][SQL][DOC] minor doc update for read.jdbc Author: felixcheung Closes #10465 from felixcheung/dfreaderjdbcdoc. Project: http://git-wip-us.apache.org/repos/asf/spark/repo

<    2   3   4   5   6   7   8   9   10   11   >