spark git commit: [SPARK-5563] [MLLIB] LDA with online variational inference

2015-05-04 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 9646018bb - 3539cb7d2 [SPARK-5563] [MLLIB] LDA with online variational inference JIRA: https://issues.apache.org/jira/browse/SPARK-5563 The PR contains the implementation for [Online LDA]

spark git commit: [SPARK-5100] [SQL] add webui for thriftserver

2015-05-04 Thread lian
Repository: spark Updated Branches: refs/heads/master 3539cb7d2 - 343d3bfaf [SPARK-5100] [SQL] add webui for thriftserver This PR is a rebased version of #3946 , and mainly focused on creating an independent tab for the thrift server in spark web UI. Features: 1. Session related statistics

Git Push Summary

2015-05-04 Thread pwendell
Repository: spark Updated Tags: refs/tags/branch-1.4 [created] 343d3bfaf - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-05-04 Thread pwendell
Repository: spark Updated Tags: refs/tags/branch-1.4 [deleted] 343d3bfaf - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-05-04 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.2.2-rc1 [deleted] 7531b50e4 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-05-04 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 [created] 343d3bfaf - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-05-04 Thread pwendell
Repository: spark Updated Tags: refs/tags/branch-1.4 [created] 343d3bfaf - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-05-04 Thread pwendell
Repository: spark Updated Tags: refs/tags/branch-1.4 [deleted] 343d3bfaf - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [MINOR] Fix python test typo?

2015-05-04 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 343d3bfaf - 5a1a1075a [MINOR] Fix python test typo? I suspect haven't been using anaconda in tests in a while. I wonder if this change actually does anything but this line as it stands looks strictly less correct. Author: Andrew Or

[3/3] spark git commit: [SPARK-5956] [MLLIB] Pipeline components should be copyable.

2015-05-04 Thread meng
[SPARK-5956] [MLLIB] Pipeline components should be copyable. This PR added `copy(extra: ParamMap): Params` to `Params`, which makes a copy of the current instance with a randomly generated uid and some extra param values. With this change, we only need to implement `fit` and `transform`

[2/3] spark git commit: [SPARK-5956] [MLLIB] Pipeline components should be copyable.

2015-05-04 Thread meng
http://git-wip-us.apache.org/repos/asf/spark/blob/893b3103/mllib/src/main/scala/org/apache/spark/ml/feature/StringIndexer.scala -- diff --git a/mllib/src/main/scala/org/apache/spark/ml/feature/StringIndexer.scala

[3/3] spark git commit: [SPARK-5956] [MLLIB] Pipeline components should be copyable.

2015-05-04 Thread meng
[SPARK-5956] [MLLIB] Pipeline components should be copyable. This PR added `copy(extra: ParamMap): Params` to `Params`, which makes a copy of the current instance with a randomly generated uid and some extra param values. With this change, we only need to implement `fit` and `transform`

[2/3] spark git commit: [SPARK-5956] [MLLIB] Pipeline components should be copyable.

2015-05-04 Thread meng
http://git-wip-us.apache.org/repos/asf/spark/blob/e0833c59/mllib/src/main/scala/org/apache/spark/ml/feature/StringIndexer.scala -- diff --git a/mllib/src/main/scala/org/apache/spark/ml/feature/StringIndexer.scala

[1/3] spark git commit: [SPARK-5956] [MLLIB] Pipeline components should be copyable.

2015-05-04 Thread meng
Repository: spark Updated Branches: refs/heads/master 5a1a1075a - e0833c595 http://git-wip-us.apache.org/repos/asf/spark/blob/e0833c59/mllib/src/test/java/org/apache/spark/ml/regression/JavaLinearRegressionSuite.java -- diff

[1/3] spark git commit: [SPARK-5956] [MLLIB] Pipeline components should be copyable.

2015-05-04 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 343d3bfaf - 893b3103f http://git-wip-us.apache.org/repos/asf/spark/blob/893b3103/mllib/src/test/java/org/apache/spark/ml/regression/JavaLinearRegressionSuite.java --

spark git commit: [SPARK-7319][SQL] Improve the output from DataFrame.show()

2015-05-04 Thread rxin
Repository: spark Updated Branches: refs/heads/master e0833c595 - f32e69ecc [SPARK-7319][SQL] Improve the output from DataFrame.show() Author: 云峤 chensong...@alibaba-inc.com Closes #5865 from kaka1992/df.show and squashes the following commits: c79204b [云峤] Update a1338f6 [云峤]

spark git commit: [SPARK-7266] Add ExpectsInputTypes to expressions when possible.

2015-05-04 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 ecf0d8a9f - 1388a469b [SPARK-7266] Add ExpectsInputTypes to expressions when possible. This should gives us better analysis time error messages (rather than runtime) and automatic type casting. Author: Reynold Xin r...@databricks.com

spark git commit: [SPARK-7266] Add ExpectsInputTypes to expressions when possible.

2015-05-04 Thread rxin
Repository: spark Updated Branches: refs/heads/master 805541117 - 678c4da0f [SPARK-7266] Add ExpectsInputTypes to expressions when possible. This should gives us better analysis time error messages (rather than runtime) and automatic type casting. Author: Reynold Xin r...@databricks.com

spark git commit: [SPARK-7236] [CORE] Fix to prevent AkkaUtils askWithReply from sleeping on final attempt

2015-05-04 Thread rxin
Repository: spark Updated Branches: refs/heads/master 678c4da0f - 8aa5aea7f [SPARK-7236] [CORE] Fix to prevent AkkaUtils askWithReply from sleeping on final attempt Added a check so that if `AkkaUtils.askWithReply` is on the final attempt, it will not sleep for the `retryInterval`. This

spark git commit: [SPARK-7236] [CORE] Fix to prevent AkkaUtils askWithReply from sleeping on final attempt

2015-05-04 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 1388a469b - 48655d10e [SPARK-7236] [CORE] Fix to prevent AkkaUtils askWithReply from sleeping on final attempt Added a check so that if `AkkaUtils.askWithReply` is on the final attempt, it will not sleep for the `retryInterval`.

[6/7] spark git commit: [SPARK-6943] [SPARK-6944] DAG visualization on SparkUI

2015-05-04 Thread andrewor14
http://git-wip-us.apache.org/repos/asf/spark/blob/fc8b5819/core/src/main/resources/org/apache/spark/ui/static/d3.min.js -- diff --git a/core/src/main/resources/org/apache/spark/ui/static/d3.min.js

[5/7] spark git commit: [SPARK-6943] [SPARK-6944] DAG visualization on SparkUI

2015-05-04 Thread andrewor14
http://git-wip-us.apache.org/repos/asf/spark/blob/fc8b5819/core/src/main/resources/org/apache/spark/ui/static/dagre-d3.min.js -- diff --git a/core/src/main/resources/org/apache/spark/ui/static/dagre-d3.min.js

[1/7] spark git commit: [SPARK-6943] [SPARK-6944] DAG visualization on SparkUI

2015-05-04 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master f32e69ecc - fc8b58195 http://git-wip-us.apache.org/repos/asf/spark/blob/fc8b5819/core/src/main/scala/org/apache/spark/util/JsonProtocol.scala -- diff --git

[4/7] spark git commit: [SPARK-6943] [SPARK-6944] DAG visualization on SparkUI

2015-05-04 Thread andrewor14
http://git-wip-us.apache.org/repos/asf/spark/blob/863ec0cb/core/src/main/resources/org/apache/spark/ui/static/graphlib-dot.min.js -- diff --git a/core/src/main/resources/org/apache/spark/ui/static/graphlib-dot.min.js

[5/7] spark git commit: [SPARK-6943] [SPARK-6944] DAG visualization on SparkUI

2015-05-04 Thread andrewor14
http://git-wip-us.apache.org/repos/asf/spark/blob/863ec0cb/core/src/main/resources/org/apache/spark/ui/static/dagre-d3.min.js -- diff --git a/core/src/main/resources/org/apache/spark/ui/static/dagre-d3.min.js

[7/7] spark git commit: [SPARK-6943] [SPARK-6944] DAG visualization on SparkUI

2015-05-04 Thread andrewor14
[SPARK-6943] [SPARK-6944] DAG visualization on SparkUI This patch adds the functionality to display the RDD DAG on the SparkUI. This DAG describes the relationships between - an RDD and its dependencies, - an RDD and its operation scopes, and - an RDD's operation scopes and the stage / job

[3/7] spark git commit: [SPARK-6943] [SPARK-6944] DAG visualization on SparkUI

2015-05-04 Thread andrewor14
http://git-wip-us.apache.org/repos/asf/spark/blob/863ec0cb/core/src/main/resources/org/apache/spark/ui/static/spark-dag-viz.js -- diff --git a/core/src/main/resources/org/apache/spark/ui/static/spark-dag-viz.js

[1/7] spark git commit: [SPARK-6943] [SPARK-6944] DAG visualization on SparkUI

2015-05-04 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.4 34edaa8ac - 863ec0cb4 http://git-wip-us.apache.org/repos/asf/spark/blob/863ec0cb/core/src/main/scala/org/apache/spark/util/JsonProtocol.scala -- diff --git

[6/7] spark git commit: [SPARK-6943] [SPARK-6944] DAG visualization on SparkUI

2015-05-04 Thread andrewor14
http://git-wip-us.apache.org/repos/asf/spark/blob/863ec0cb/core/src/main/resources/org/apache/spark/ui/static/d3.min.js -- diff --git a/core/src/main/resources/org/apache/spark/ui/static/d3.min.js

[7/7] spark git commit: [SPARK-6943] [SPARK-6944] DAG visualization on SparkUI

2015-05-04 Thread andrewor14
[SPARK-6943] [SPARK-6944] DAG visualization on SparkUI This patch adds the functionality to display the RDD DAG on the SparkUI. This DAG describes the relationships between - an RDD and its dependencies, - an RDD and its operation scopes, and - an RDD's operation scopes and the stage / job

[2/7] spark git commit: [SPARK-6943] [SPARK-6944] DAG visualization on SparkUI

2015-05-04 Thread andrewor14
http://git-wip-us.apache.org/repos/asf/spark/blob/fc8b5819/core/src/main/scala/org/apache/spark/rdd/RDD.scala -- diff --git a/core/src/main/scala/org/apache/spark/rdd/RDD.scala b/core/src/main/scala/org/apache/spark/rdd/RDD.scala

[4/7] spark git commit: [SPARK-6943] [SPARK-6944] DAG visualization on SparkUI

2015-05-04 Thread andrewor14
http://git-wip-us.apache.org/repos/asf/spark/blob/fc8b5819/core/src/main/resources/org/apache/spark/ui/static/graphlib-dot.min.js -- diff --git a/core/src/main/resources/org/apache/spark/ui/static/graphlib-dot.min.js

spark git commit: [SPARK-7243][SQL] Contingency Tables for DataFrames

2015-05-04 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 863ec0cb4 - ecf0d8a9f [SPARK-7243][SQL] Contingency Tables for DataFrames Computes a pair-wise frequency table of the given columns. Also known as cross-tabulation. cc mengxr rxin Author: Burak Yavuz brk...@gmail.com Closes #5842

spark git commit: [SPARK-7243][SQL] Contingency Tables for DataFrames

2015-05-04 Thread rxin
Repository: spark Updated Branches: refs/heads/master fc8b58195 - 805541117 [SPARK-7243][SQL] Contingency Tables for DataFrames Computes a pair-wise frequency table of the given columns. Also known as cross-tabulation. cc mengxr rxin Author: Burak Yavuz brk...@gmail.com Closes #5842 from

spark git commit: [SPARK-7319][SQL] Improve the output from DataFrame.show()

2015-05-04 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 893b3103f - 34edaa8ac [SPARK-7319][SQL] Improve the output from DataFrame.show() Author: 云峤 chensong...@alibaba-inc.com Closes #5865 from kaka1992/df.show and squashes the following commits: c79204b [云峤] Update a1338f6