spark git commit: [SPARK-10238] [MLLIB] update since versions in mllib.linalg

Repository: spark Updated Branches: refs/heads/master 8668ead2e - ab431f8a9 [SPARK-10238] [MLLIB] update since versions in mllib.linalg Same as #8421 but for `mllib.linalg`. cc dbtsai Author: Xiangrui Meng m...@databricks.com Closes #8440 from mengxr/SPARK-10238 and squashes the following

spark git commit: [SPARK-10238] [MLLIB] update since versions in mllib.linalg

Repository: spark Updated Branches: refs/heads/branch-1.5 af98e51f2 - 46750b912 [SPARK-10238] [MLLIB] update since versions in mllib.linalg Same as #8421 but for `mllib.linalg`. cc dbtsai Author: Xiangrui Meng m...@databricks.com Closes #8440 from mengxr/SPARK-10238 and squashes the

spark git commit: [SPARK-10234] [MLLIB] update since version in mllib.clustering

Repository: spark Updated Branches: refs/heads/master c3a54843c - d703372f8 [SPARK-10234] [MLLIB] update since version in mllib.clustering Same as #8421 but for `mllib.clustering`. cc feynmanliang yu-iskw Author: Xiangrui Meng m...@databricks.com Closes #8435 from mengxr/SPARK-10234.

spark git commit: [SPARK-10235] [MLLIB] update since versions in mllib.regression

Repository: spark Updated Branches: refs/heads/master fb7e12fe2 - 4657fa1f3 [SPARK-10235] [MLLIB] update since versions in mllib.regression Same as #8421 but for `mllib.regression`. cc freeman-lab dbtsai Author: Xiangrui Meng m...@databricks.com Closes #8426 from mengxr/SPARK-10235 and

spark git commit: [SPARK-10235] [MLLIB] update since versions in mllib.regression

Repository: spark Updated Branches: refs/heads/branch-1.5 6d8ebc801 - 08d390f45 [SPARK-10235] [MLLIB] update since versions in mllib.regression Same as #8421 but for `mllib.regression`. cc freeman-lab dbtsai Author: Xiangrui Meng m...@databricks.com Closes #8426 from mengxr/SPARK-10235 and

spark git commit: [SPARK-10240] [SPARK-10242] [MLLIB] update since versions in mlilb.random and mllib.stat

Repository: spark Updated Branches: refs/heads/master ab431f8a9 - c3a54843c [SPARK-10240] [SPARK-10242] [MLLIB] update since versions in mlilb.random and mllib.stat The same as #8241 but for `mllib.stat` and `mllib.random`. cc feynmanliang Author: Xiangrui Meng m...@databricks.com Closes

spark git commit: [SPARK-10243] [MLLIB] update since versions in mllib.tree

Repository: spark Updated Branches: refs/heads/master d703372f8 - fb7e12fe2 [SPARK-10243] [MLLIB] update since versions in mllib.tree Same as #8421 but for `mllib.tree`. cc jkbradley Author: Xiangrui Meng m...@databricks.com Closes #8442 from mengxr/SPARK-10236. Project:

spark git commit: [SPARK-10243] [MLLIB] update since versions in mllib.tree

Repository: spark Updated Branches: refs/heads/branch-1.5 be0c9915c - 6d8ebc801 [SPARK-10243] [MLLIB] update since versions in mllib.tree Same as #8421 but for `mllib.tree`. cc jkbradley Author: Xiangrui Meng m...@databricks.com Closes #8442 from mengxr/SPARK-10236. (cherry picked from

spark git commit: [SPARK-10178] [SQL] HiveComparisionTest should print out dependent tables

Repository: spark Updated Branches: refs/heads/branch-1.5 c99f4160b - 2239a2036 [SPARK-10178] [SQL] HiveComparisionTest should print out dependent tables In `HiveComparisionTest`s it is possible to fail a query of the form `SELECT * FROM dest1`, where `dest1` is the query that is actually

spark git commit: [SPARK-10178] [SQL] HiveComparisionTest should print out dependent tables

Repository: spark Updated Branches: refs/heads/master a0c0aae1d - 5175ca0c8 [SPARK-10178] [SQL] HiveComparisionTest should print out dependent tables In `HiveComparisionTest`s it is possible to fail a query of the form `SELECT * FROM dest1`, where `dest1` is the query that is actually

spark git commit: [SPARK-9786] [STREAMING] [KAFKA] fix backpressure so it works with defa…

Repository: spark Updated Branches: refs/heads/branch-1.5 2239a2036 - 88991dc4f [SPARK-9786] [STREAMING] [KAFKA] fix backpressure so it works with defa… …ult maxRatePerPartition setting of 0 Author: cody koeninger c...@koeninger.org Closes #8413 from

spark git commit: [SPARK-10196] [SQL] Correctly saving decimals in internal rows to JSON.

Repository: spark Updated Branches: refs/heads/branch-1.5 bb1357f36 - 0b425ed3d [SPARK-10196] [SQL] Correctly saving decimals in internal rows to JSON. https://issues.apache.org/jira/browse/SPARK-10196 Author: Yin Huai yh...@databricks.com Closes #8408 from yhuai/DecimalJsonSPARK-10196.

spark git commit: [SPARK-10137] [STREAMING] Avoid to restart receivers if scheduleReceivers returns balanced results

Repository: spark Updated Branches: refs/heads/branch-1.5 88991dc4f - bb1357f36 [SPARK-10137] [STREAMING] Avoid to restart receivers if scheduleReceivers returns balanced results This PR fixes the following cases for `ReceiverSchedulingPolicy`. 1) Assume there are 4 executors: host1, host2,

spark git commit: [SPARK-9786] [STREAMING] [KAFKA] fix backpressure so it works with defa…

Repository: spark Updated Branches: refs/heads/master 5175ca0c8 - d9c25dec8 [SPARK-9786] [STREAMING] [KAFKA] fix backpressure so it works with defa… …ult maxRatePerPartition setting of 0 Author: cody koeninger c...@koeninger.org Closes #8413 from koeninger/backpressure-testing-master.

spark git commit: [SPARK-10137] [STREAMING] Avoid to restart receivers if scheduleReceivers returns balanced results

Repository: spark Updated Branches: refs/heads/master d9c25dec8 - f023aa2fc [SPARK-10137] [STREAMING] Avoid to restart receivers if scheduleReceivers returns balanced results This PR fixes the following cases for `ReceiverSchedulingPolicy`. 1) Assume there are 4 executors: host1, host2,

spark git commit: [SPARK-10230] [MLLIB] Rename optimizeAlpha to optimizeDocConcentration

Repository: spark Updated Branches: refs/heads/branch-1.5 742c82ed9 - c740f5dd2 [SPARK-10230] [MLLIB] Rename optimizeAlpha to optimizeDocConcentration See [discussion](https://github.com/apache/spark/pull/8254#discussion_r37837770) CC jkbradley Author: Feynman Liang fli...@databricks.com

spark git commit: [SPARK-10230] [MLLIB] Rename optimizeAlpha to optimizeDocConcentration

Repository: spark Updated Branches: refs/heads/master b37f0cc1b - 881208a8e [SPARK-10230] [MLLIB] Rename optimizeAlpha to optimizeDocConcentration See [discussion](https://github.com/apache/spark/pull/8254#discussion_r37837770) CC jkbradley Author: Feynman Liang fli...@databricks.com

spark git commit: [SPARK-10231] [MLLIB] update @Since annotation for mllib.classification

Repository: spark Updated Branches: refs/heads/master 881208a8e - 16a2be1a8 [SPARK-10231] [MLLIB] update @Since annotation for mllib.classification Update `Since` annotation in `mllib.classification`: 1. add version to classes, objects, constructors, and public variables declared in

spark git commit: [DOC] add missing parameters in SparkContext.scala for scala doc

Repository: spark Updated Branches: refs/heads/master 0e6368ffa - 5c1489015 [DOC] add missing parameters in SparkContext.scala for scala doc Author: Zhang, Liye liye.zh...@intel.com Closes #8412 from liyezhang556520/minorDoc. Project: http://git-wip-us.apache.org/repos/asf/spark/repo

spark git commit: [SPARK-10245] [SQL] Fix decimal literals with precision scale

Repository: spark Updated Branches: refs/heads/master 00ae4be97 - ec89bd840 [SPARK-10245] [SQL] Fix decimal literals with precision scale In BigDecimal or java.math.BigDecimal, the precision could be smaller than scale, for example, BigDecimal(0.001) has precision = 1 and scale = 3. But

spark git commit: [SPARK-10245] [SQL] Fix decimal literals with precision scale

Repository: spark Updated Branches: refs/heads/branch-1.5 6f05b7aeb - 8925896b1 [SPARK-10245] [SQL] Fix decimal literals with precision scale In BigDecimal or java.math.BigDecimal, the precision could be smaller than scale, for example, BigDecimal(0.001) has precision = 1 and scale = 3. But

spark git commit: [SPARK-10215] [SQL] Fix precision of division (follow the rule in Hive)

Repository: spark Updated Branches: refs/heads/master ec89bd840 - 7467b52ed [SPARK-10215] [SQL] Fix precision of division (follow the rule in Hive) Follow the rule in Hive for decimal division. see

spark git commit: [SPARK-10215] [SQL] Fix precision of division (follow the rule in Hive)

Repository: spark Updated Branches: refs/heads/branch-1.5 8925896b1 - ab7d46d1d [SPARK-10215] [SQL] Fix precision of division (follow the rule in Hive) Follow the rule in Hive for decimal division. see

spark git commit: [SPARK-10048] [SPARKR] Support arbitrary nested Java array in serde.

Repository: spark Updated Branches: refs/heads/master 16a2be1a8 - 71a138cd0 [SPARK-10048] [SPARKR] Support arbitrary nested Java array in serde. This PR: 1. supports transferring arbitrary nested array from JVM to R side in SerDe; 2. based on 1, collect() implemenation is improved. Now it can

spark git commit: [SPARK-9800] Adds docs for GradientDescent$.runMiniBatchSGD alias

Repository: spark Updated Branches: refs/heads/branch-1.5 5a32ed75c - 95e44b4df [SPARK-9800] Adds docs for GradientDescent$.runMiniBatchSGD alias * Adds doc for alias of runMIniBatchSGD documenting default value for convergeTol * Cleans up a note in code Author: Feynman Liang

spark git commit: [SPARK-9800] Adds docs for GradientDescent$.runMiniBatchSGD alias

Repository: spark Updated Branches: refs/heads/master 71a138cd0 - c0e9ff158 [SPARK-9800] Adds docs for GradientDescent$.runMiniBatchSGD alias * Adds doc for alias of runMIniBatchSGD documenting default value for convergeTol * Cleans up a note in code Author: Feynman Liang

spark git commit: [SPARK-10237] [MLLIB] update since versions in mllib.fpm

Repository: spark Updated Branches: refs/heads/branch-1.5 95e44b4df - 186326df2 [SPARK-10237] [MLLIB] update since versions in mllib.fpm Same as #8421 but for `mllib.fpm`. cc feynmanliang Author: Xiangrui Meng m...@databricks.com Closes #8429 from mengxr/SPARK-10237. (cherry picked from

spark git commit: [SPARK-10237] [MLLIB] update since versions in mllib.fpm

Repository: spark Updated Branches: refs/heads/master c0e9ff158 - c619c7552 [SPARK-10237] [MLLIB] update since versions in mllib.fpm Same as #8421 but for `mllib.fpm`. cc feynmanliang Author: Xiangrui Meng m...@databricks.com Closes #8429 from mengxr/SPARK-10237. Project:

[1/5] spark git commit: [SPARK-9613] [CORE] Ban use of JavaConversions and migrate all existing uses to JavaConverters

Repository: spark Updated Branches: refs/heads/master 7f1e507bf - 69c9c1771 http://git-wip-us.apache.org/repos/asf/spark/blob/69c9c177/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala -- diff --git

[5/5] spark git commit: [SPARK-9613] [CORE] Ban use of JavaConversions and migrate all existing uses to JavaConverters

[SPARK-9613] [CORE] Ban use of JavaConversions and migrate all existing uses to JavaConverters Replace `JavaConversions` implicits with `JavaConverters` Most occurrences I've seen so far are necessary conversions; a few have been avoidable. None are in critical code as far as I see, yet.

[3/5] spark git commit: [SPARK-9613] [CORE] Ban use of JavaConversions and migrate all existing uses to JavaConverters

http://git-wip-us.apache.org/repos/asf/spark/blob/69c9c177/external/flume/src/main/scala/org/apache/spark/streaming/flume/PollingFlumeTestUtils.scala -- diff --git

[4/5] spark git commit: [SPARK-9613] [CORE] Ban use of JavaConversions and migrate all existing uses to JavaConverters

http://git-wip-us.apache.org/repos/asf/spark/blob/69c9c177/core/src/main/scala/org/apache/spark/network/netty/NettyBlockRpcServer.scala -- diff --git a/core/src/main/scala/org/apache/spark/network/netty/NettyBlockRpcServer.scala

spark git commit: [SPARK-9797] [MLLIB] [DOC] StreamingLinearRegressionWithSGD.setConvergenceTol default value

Repository: spark Updated Branches: refs/heads/master c619c7552 - 920590787 [SPARK-9797] [MLLIB] [DOC] StreamingLinearRegressionWithSGD.setConvergenceTol default value Adds default convergence tolerance (0.001, set in `GradientDescent.convergenceTol`) to `setConvergenceTol`'s scaladoc

spark git commit: [SPARK-9797] [MLLIB] [DOC] StreamingLinearRegressionWithSGD.setConvergenceTol default value

Repository: spark Updated Branches: refs/heads/branch-1.5 186326df2 - 055387c08 [SPARK-9797] [MLLIB] [DOC] StreamingLinearRegressionWithSGD.setConvergenceTol default value Adds default convergence tolerance (0.001, set in `GradientDescent.convergenceTol`) to `setConvergenceTol`'s scaladoc

spark git commit: [SPARK-9888] [MLLIB] User guide for new LDA features

Repository: spark Updated Branches: refs/heads/master 7467b52ed - 125205cdb [SPARK-9888] [MLLIB] User guide for new LDA features * Adds two new sections to LDA's user guide; one for each optimizer/model * Documents new features added to LDA (e.g. topXXXperXXX, asymmetric priors, hyperpam

spark git commit: [SPARK-9888] [MLLIB] User guide for new LDA features

Repository: spark Updated Branches: refs/heads/branch-1.5 4c03cb4da - 5cf266fde [SPARK-9888] [MLLIB] User guide for new LDA features * Adds two new sections to LDA's user guide; one for each optimizer/model * Documents new features added to LDA (e.g. topXXXperXXX, asymmetric priors,

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.1-rc3 [deleted] 3e8ae3894 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.1-rc1 [deleted] 60e08e507 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.1-rc4 [deleted] dbaa5c294 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.1-rc2 [deleted] 07b95c7ad - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-10196] [SQL] Correctly saving decimals in internal rows to JSON.

Repository: spark Updated Branches: refs/heads/master f023aa2fc - df7041d02 [SPARK-10196] [SQL] Correctly saving decimals in internal rows to JSON. https://issues.apache.org/jira/browse/SPARK-10196 Author: Yin Huai yh...@databricks.com Closes #8408 from yhuai/DecimalJsonSPARK-10196.

[1/2] spark git commit: Preparing Spark release v1.5.0-rc2

Repository: spark Updated Branches: refs/heads/branch-1.5 ab7d46d1d - 4c03cb4da Preparing Spark release v1.5.0-rc2 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/72777135 Tree:

[2/2] spark git commit: Preparing development version 1.5.1-SNAPSHOT

Preparing development version 1.5.1-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4c03cb4d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/4c03cb4d Diff:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.5.0-rc2 [created] 727771352 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-10239] [SPARK-10244] [MLLIB] update since versions in mllib.pmml and mllib.util

Repository: spark Updated Branches: refs/heads/branch-1.5 055387c08 - 6f05b7aeb [SPARK-10239] [SPARK-10244] [MLLIB] update since versions in mllib.pmml and mllib.util Same as #8421 but for `mllib.pmml` and `mllib.util`. cc dbtsai Author: Xiangrui Meng m...@databricks.com Closes #8430 from

spark git commit: [SPARK-10239] [SPARK-10244] [MLLIB] update since versions in mllib.pmml and mllib.util

Repository: spark Updated Branches: refs/heads/master 920590787 - 00ae4be97 [SPARK-10239] [SPARK-10244] [MLLIB] update since versions in mllib.pmml and mllib.util Same as #8421 but for `mllib.pmml` and `mllib.util`. cc dbtsai Author: Xiangrui Meng m...@databricks.com Closes #8430 from

spark git commit: [SPARK-10233] [MLLIB] update since version in mllib.evaluation

Repository: spark Updated Branches: refs/heads/branch-1.5 5cf266fde - af98e51f2 [SPARK-10233] [MLLIB] update since version in mllib.evaluation Same as #8421 but for `mllib.evaluation`. cc avulanov Author: Xiangrui Meng m...@databricks.com Closes #8423 from mengxr/SPARK-10233. (cherry

spark git commit: [SPARK-10233] [MLLIB] update since version in mllib.evaluation

Repository: spark Updated Branches: refs/heads/master 125205cdb - 8668ead2e [SPARK-10233] [MLLIB] update since version in mllib.evaluation Same as #8421 but for `mllib.evaluation`. cc avulanov Author: Xiangrui Meng m...@databricks.com Closes #8423 from mengxr/SPARK-10233. Project: