spark git commit: [SPARK-6940] [MLLIB] Add CrossValidator to Python ML pipeline API

Repository: spark Updated Branches: refs/heads/master 9f019c722 - 32cdc815c [SPARK-6940] [MLLIB] Add CrossValidator to Python ML pipeline API Since CrossValidator is a meta algorithm, we copy the implementation in Python. jkbradley Author: Xiangrui Meng m...@databricks.com Closes #5926

spark git commit: [SPARK-6940] [MLLIB] Add CrossValidator to Python ML pipeline API

Repository: spark Updated Branches: refs/heads/branch-1.4 20f923771 - 3e27a5437 [SPARK-6940] [MLLIB] Add CrossValidator to Python ML pipeline API Since CrossValidator is a meta algorithm, we copy the implementation in Python. jkbradley Author: Xiangrui Meng m...@databricks.com Closes #5926

svn commit: r1677934 - /spark/site/sql/index.html

Author: srowen Date: Wed May 6 06:45:28 2015 New Revision: 1677934 URL: http://svn.apache.org/r1677934 Log: Fix 'seemlessly' typo Modified: spark/site/sql/index.html Modified: spark/site/sql/index.html URL:

spark git commit: [SPARK-7384][Core][Tests] Fix flaky tests for distributed mode in BroadcastSuite

Repository: spark Updated Branches: refs/heads/branch-1.4 384ac3c11 - 20f923771 [SPARK-7384][Core][Tests] Fix flaky tests for distributed mode in BroadcastSuite Fixed the following failure:

spark git commit: [SPARK-7384][Core][Tests] Fix flaky tests for distributed mode in BroadcastSuite

Repository: spark Updated Branches: refs/heads/master 7b1457839 - 9f019c722 [SPARK-7384][Core][Tests] Fix flaky tests for distributed mode in BroadcastSuite Fixed the following failure:

svn commit: r1677933 - /spark/site/faq.html

Author: srowen Date: Wed May 6 06:42:44 2015 New Revision: 1677933 URL: http://svn.apache.org/r1677933 Log: SPARK-6889 point to new contribution guidelines Modified: spark/site/faq.html Modified: spark/site/faq.html URL:

[04/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

http://git-wip-us.apache.org/repos/asf/spark/blob/b521a3b0/sql/hive/src/test/resources/golden/windowing_windowspec.q (deterministic)-1-6378faf36ffd3f61e61cee6c0cb70e6 -- diff --git

[11/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

http://git-wip-us.apache.org/repos/asf/spark/blob/b521a3b0/sql/hive/src/test/resources/golden/windowing.q -- 43. testUnboundedFollowingForRange-0-3cd04e5f2398853c4850f4f86142bb39 -- diff --git

[09/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

http://git-wip-us.apache.org/repos/asf/spark/blob/b521a3b0/sql/hive/src/test/resources/golden/windowing_ntile.q (deterministic)-1-a3d352560ac835993001665db6954965 -- diff --git

[02/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

http://git-wip-us.apache.org/repos/asf/spark/blob/b521a3b0/sql/hive/src/test/resources/golden/windowing_windowspec.q (deterministic)-5-ee44c5cdc80e1c832b702f9fb76d8145 -- diff --git

[10/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

http://git-wip-us.apache.org/repos/asf/spark/blob/b521a3b0/sql/hive/src/test/resources/golden/windowing_navfn.q (deterministic)-1-9ee79e711248dd6e0a6ce27e439e55f4 -- diff --git

[05/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

http://git-wip-us.apache.org/repos/asf/spark/blob/b521a3b0/sql/hive/src/test/resources/golden/windowing_udaf.q (deterministic)-4-f2e4d659b65a833e9281b6786d3d55c1 -- diff --git a/sql/hive/src/test/resources/golden/windowing_udaf.q

[12/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

http://git-wip-us.apache.org/repos/asf/spark/blob/b521a3b0/sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUdfs.scala -- diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUdfs.scala

[01/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

Repository: spark Updated Branches: refs/heads/branch-1.4 7212897dc - b521a3b03 http://git-wip-us.apache.org/repos/asf/spark/blob/b521a3b0/sql/hive/src/test/resources/golden/windowing_windowspec.q (deterministic)-8-45a1d7c2aba45d761e19ff4dfdf5463e

[07/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

http://git-wip-us.apache.org/repos/asf/spark/blob/b521a3b0/sql/hive/src/test/resources/golden/windowing_rank.q (deterministic) 2-0-81bb7f49a55385878637c8aac4d08e5 -- diff --git

[03/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

http://git-wip-us.apache.org/repos/asf/spark/blob/b521a3b0/sql/hive/src/test/resources/golden/windowing_windowspec.q (deterministic)-3-6f104992e0050576085064815de43194 -- diff --git

[2/2] spark git commit: [SPARK-5995] [ML] Make Prediction dev API public

[SPARK-5995] [ML] Make Prediction dev API public Changes: * Update protected prediction methods, following design doc. **--most interesting change** * Changed abstract classes for Estimator and Model to be public. Added DeveloperApi tag. (I kept the traits for Estimator/Model Params private.)

[1/2] spark git commit: [SPARK-5995] [ML] Make Prediction dev API public

Repository: spark Updated Branches: refs/heads/branch-1.4 14bcb84e8 - b681b9312 http://git-wip-us.apache.org/repos/asf/spark/blob/b681b931/mllib/src/main/scala/org/apache/spark/mllib/linalg/Vectors.scala -- diff --git

spark git commit: [HOT FIX] [SPARK-7418] Ignore flaky SparkSubmitUtilsSuite test

Repository: spark Updated Branches: refs/heads/master 1ad04dae0 - fbf1f342a [HOT FIX] [SPARK-7418] Ignore flaky SparkSubmitUtilsSuite test Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fbf1f342 Tree:

[2/2] spark git commit: [SPARK-5995] [ML] Make Prediction dev API public

[SPARK-5995] [ML] Make Prediction dev API public Changes: * Update protected prediction methods, following design doc. **--most interesting change** * Changed abstract classes for Estimator and Model to be public. Added DeveloperApi tag. (I kept the traits for Estimator/Model Params private.)

[1/2] spark git commit: [SPARK-5995] [ML] Make Prediction dev API public

Repository: spark Updated Branches: refs/heads/master 774099670 - 1ad04dae0 http://git-wip-us.apache.org/repos/asf/spark/blob/1ad04dae/mllib/src/main/scala/org/apache/spark/mllib/linalg/Vectors.scala -- diff --git

spark git commit: [HOT-FIX] Move HiveWindowFunctionQuerySuite.scala to hive compatibility dir.

Repository: spark Updated Branches: refs/heads/master 845d1d4d0 - 774099670 [HOT-FIX] Move HiveWindowFunctionQuerySuite.scala to hive compatibility dir. Author: Yin Huai yh...@databricks.com Closes #5951 from yhuai/fixBuildMaven and squashes the following commits: fdde183 [Yin Huai] Move

spark git commit: [HOT-FIX] Move HiveWindowFunctionQuerySuite.scala to hive compatibility dir.

Repository: spark Updated Branches: refs/heads/branch-1.4 2163367ea - 14bcb84e8 [HOT-FIX] Move HiveWindowFunctionQuerySuite.scala to hive compatibility dir. Author: Yin Huai yh...@databricks.com Closes #5951 from yhuai/fixBuildMaven and squashes the following commits: fdde183 [Yin Huai]

[01/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

Repository: spark Updated Branches: refs/heads/master c3eb441f5 - f2c47082c http://git-wip-us.apache.org/repos/asf/spark/blob/f2c47082/sql/hive/src/test/resources/golden/windowing_windowspec.q (deterministic)-8-45a1d7c2aba45d761e19ff4dfdf5463e

[03/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

http://git-wip-us.apache.org/repos/asf/spark/blob/f2c47082/sql/hive/src/test/resources/golden/windowing_windowspec.q (deterministic)-3-6f104992e0050576085064815de43194 -- diff --git

[13/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

[SPARK-1442] [SQL] Window Function Support for Spark SQL Adding more information about the implementation... This PR is adding the support of window functions to Spark SQL (specifically OVER and WINDOW clause). For every expression having a OVER clause, we use a WindowExpression as the

[09/13] spark git commit: [SPARK-1442] [SQL] Window Function Support for Spark SQL

http://git-wip-us.apache.org/repos/asf/spark/blob/f2c47082/sql/hive/src/test/resources/golden/windowing_ntile.q (deterministic)-1-a3d352560ac835993001665db6954965 -- diff --git

spark git commit: Add `Private` annotation.

Repository: spark Updated Branches: refs/heads/master 002c12384 - 845d1d4d0 Add `Private` annotation. This was originally added as part of #4435, which was reverted. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-6201] [SQL] promote string and do widen types for IN

Repository: spark Updated Branches: refs/heads/master 150f671c2 - c3eb441f5 [SPARK-6201] [SQL] promote string and do widen types for IN huangjs Acutally spark sql will first go through analysis period, in which we do widen types and promote strings, and then optimization, where constant IN

spark git commit: Add `Private` annotation.

Repository: spark Updated Branches: refs/heads/branch-1.4 d651e2838 - 2163367ea Add `Private` annotation. This was originally added as part of #4435, which was reverted. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-5456] [SQL] fix decimal compare for jdbc rdd

Repository: spark Updated Branches: refs/heads/branch-1.4 389b755db - f1a5cafb7 [SPARK-5456] [SQL] fix decimal compare for jdbc rdd Author: Daoyuan Wang daoyuan.w...@intel.com Closes #5803 from adrian-wang/decimalcompare and squashes the following commits: aef0e96 [Daoyuan Wang] add null

spark git commit: [SPARK-5456] [SQL] fix decimal compare for jdbc rdd

Repository: spark Updated Branches: refs/heads/master 322e7e7f6 - 150f671c2 [SPARK-5456] [SQL] fix decimal compare for jdbc rdd Author: Daoyuan Wang daoyuan.w...@intel.com Closes #5803 from adrian-wang/decimalcompare and squashes the following commits: aef0e96 [Daoyuan Wang] add null handle

spark git commit: [SPARK-5456] [SQL] fix decimal compare for jdbc rdd

Repository: spark Updated Branches: refs/heads/branch-1.3 9278b7a6a - cbf232daa [SPARK-5456] [SQL] fix decimal compare for jdbc rdd Author: Daoyuan Wang daoyuan.w...@intel.com Closes #5803 from adrian-wang/decimalcompare and squashes the following commits: aef0e96 [Daoyuan Wang] add null

spark git commit: [SPARK-7311] Introduce internal Serializer API for determining if serializers support object relocation

Repository: spark Updated Branches: refs/heads/master f2c47082c - 002c12384 [SPARK-7311] Introduce internal Serializer API for determining if serializers support object relocation This patch extends the `Serializer` interface with a new `Private` API which allows serializers to indicate

spark git commit: [SPARK-7311] Introduce internal Serializer API for determining if serializers support object relocation

Repository: spark Updated Branches: refs/heads/branch-1.4 b521a3b03 - d651e2838 [SPARK-7311] Introduce internal Serializer API for determining if serializers support object relocation This patch extends the `Serializer` interface with a new `Private` API which allows serializers to indicate

spark git commit: [HOT FIX] [SPARK-7418] Ignore flaky SparkSubmitUtilsSuite test

Repository: spark Updated Branches: refs/heads/branch-1.4 b681b9312 - c0ec20a51 [HOT FIX] [SPARK-7418] Ignore flaky SparkSubmitUtilsSuite test Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c0ec20a5 Tree:

spark git commit: [SPARK-6799] [SPARKR] Remove SparkR RDD examples, add dataframe examples

Repository: spark Updated Branches: refs/heads/branch-1.4 c0ec20a51 - 4b91e18d9 [SPARK-6799] [SPARKR] Remove SparkR RDD examples, add dataframe examples This PR also makes some of the DataFrame to RDD methods private as the RDD class is private in 1.4 cc rxin pwendell Author: Shivaram

spark git commit: [SPARK-6799] [SPARKR] Remove SparkR RDD examples, add dataframe examples

Repository: spark Updated Branches: refs/heads/master fbf1f342a - 4e930420c [SPARK-6799] [SPARKR] Remove SparkR RDD examples, add dataframe examples This PR also makes some of the DataFrame to RDD methods private as the RDD class is private in 1.4 cc rxin pwendell Author: Shivaram

[1/3] spark git commit: [SPARK-7371] [SPARK-7377] [SPARK-7408] DAG visualization addendum (#5729)

Repository: spark Updated Branches: refs/heads/branch-1.4 ba24dfae7 - 76e8344f2 http://git-wip-us.apache.org/repos/asf/spark/blob/76e8344f/core/src/main/resources/org/apache/spark/ui/static/spark-dag-viz.css -- diff --git

[1/3] spark git commit: [SPARK-7371] [SPARK-7377] [SPARK-7408] DAG visualization addendum (#5729)

Repository: spark Updated Branches: refs/heads/master 316a5c042 - 8fa6829f5 http://git-wip-us.apache.org/repos/asf/spark/blob/8fa6829f/core/src/main/resources/org/apache/spark/ui/static/spark-dag-viz.css -- diff --git

[3/3] spark git commit: [SPARK-7371] [SPARK-7377] [SPARK-7408] DAG visualization addendum (#5729)

[SPARK-7371] [SPARK-7377] [SPARK-7408] DAG visualization addendum (#5729) This is a follow-up patch for #5729. **[SPARK-7408]** Move as much style code from JS to CSS as possible **[SPARK-7377]** Fix JS error if a job / stage contains only one RDD **[SPARK-7371]** Decrease emphasis on RDD on

spark git commit: [SPARK-7405] [STREAMING] Fix the bug that ReceiverInputDStream doesn't report InputInfo

Repository: spark Updated Branches: refs/heads/master 71a452b61 - 14502d5e5 [SPARK-7405] [STREAMING] Fix the bug that ReceiverInputDStream doesn't report InputInfo The bug is because SPARK-7139 removed some codes from SPARK-7112 unintentionally here:

spark git commit: [SPARK-7396] [STREAMING] [EXAMPLE] Update KafkaWordCountProducer to use new Producer API

Repository: spark Updated Branches: refs/heads/master 4e930420c - 316a5c042 [SPARK-7396] [STREAMING] [EXAMPLE] Update KafkaWordCountProducer to use new Producer API Otherwise it will throw exception: ``` Exception in thread main kafka.common.FailedToSendMessageException: Failed to send

spark git commit: [SPARK-7396] [STREAMING] [EXAMPLE] Update KafkaWordCountProducer to use new Producer API

Repository: spark Updated Branches: refs/heads/branch-1.4 4b91e18d9 - ba24dfae7 [SPARK-7396] [STREAMING] [EXAMPLE] Update KafkaWordCountProducer to use new Producer API Otherwise it will throw exception: ``` Exception in thread main kafka.common.FailedToSendMessageException: Failed to send

spark git commit: [SPARK-7432] [MLLIB] disable cv doctest

Repository: spark Updated Branches: refs/heads/master 14502d5e5 - 773aa2525 [SPARK-7432] [MLLIB] disable cv doctest Temporarily disable flaky doctest for CrossValidator. jkbradley Author: Xiangrui Meng m...@databricks.com Closes #5962 from mengxr/disable-pyspark-cv-test and squashes the

spark git commit: [SQL] JavaDoc update for various DataFrame functions.

Repository: spark Updated Branches: refs/heads/master 32cdc815c - 322e7e7f6 [SQL] JavaDoc update for various DataFrame functions. Author: Reynold Xin r...@databricks.com Closes #5935 from rxin/df-doc1 and squashes the following commits: aaeaadb [Reynold Xin] [SQL] JavaDoc update for various

spark git commit: [SQL] JavaDoc update for various DataFrame functions.

Repository: spark Updated Branches: refs/heads/branch-1.4 3e27a5437 - 389b755db [SQL] JavaDoc update for various DataFrame functions. Author: Reynold Xin r...@databricks.com Closes #5935 from rxin/df-doc1 and squashes the following commits: aaeaadb [Reynold Xin] [SQL] JavaDoc update for