spark git commit: [SPARK-6317][SQL]Fixed HIVE console startup issue

2015-03-13 Thread lian
Repository: spark Updated Branches: refs/heads/master cdc34ed91 -> e360d5e4a [SPARK-6317][SQL]Fixed HIVE console startup issue Author: vinodkc Author: Vinod K C Closes #5011 from vinodkc/HIVE_console_startupError and squashes the following commits: b43925f [vinodkc] Changed order of impor

spark git commit: [SPARK-6285] [SQL] Removes unused ParquetTestData and duplicated TestGroupWriteSupport

2015-03-13 Thread lian
Repository: spark Updated Branches: refs/heads/master b943f5d90 -> cdc34ed91 [SPARK-6285] [SQL] Removes unused ParquetTestData and duplicated TestGroupWriteSupport All the contents in this file are not referenced anywhere and should have been removed in #4116 when I tried to get rid of the o

svn commit: r1666542 - in /spark: documentation.md site/documentation.html

2015-03-13 Thread pwendell
Author: pwendell Date: Fri Mar 13 18:49:38 2015 New Revision: 1666542 URL: http://svn.apache.org/r1666542 Log: Fixing latest doc link (some how I reverted changes) Modified: spark/documentation.md spark/site/documentation.html Modified: spark/documentation.md URL: http://svn.apache.org/

spark git commit: [SPARK-4600][GraphX]: org.apache.spark.graphx.VertexRDD.diff does not work

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 7f13434a5 -> b943f5d90 [SPARK-4600][GraphX]: org.apache.spark.graphx.VertexRDD.diff does not work Turns out, per the [convo on the JIRA](https://issues.apache.org/jira/browse/SPARK-4600), `diff` is acting exactly as should. It became a la

svn commit: r1666540 - in /spark: news/_posts/2015-03-13-spark-1-3-0-released.md site/documentation.html site/news/index.html site/news/spark-1-3-0-released.html

2015-03-13 Thread pwendell
Author: pwendell Date: Fri Mar 13 18:47:57 2015 New Revision: 1666540 URL: http://svn.apache.org/r1666540 Log: Fixing old link in release news item Modified: spark/news/_posts/2015-03-13-spark-1-3-0-released.md spark/site/documentation.html spark/site/news/index.html spark/site/ne

spark git commit: [SPARK-6275][Documentation]Miss toDF() function in docs/sql-programming-guide.md

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 a08588c7e -> 301278126 [SPARK-6275][Documentation]Miss toDF() function in docs/sql-programming-guide.md Miss `toDF()` function in docs/sql-programming-guide.md Author: zzcclp Closes #4977 from zzcclp/SPARK-6275 and squashes the follo

spark git commit: [SPARK-6133] Make sc.stop() idempotent

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 338bea7b3 -> a08588c7e [SPARK-6133] Make sc.stop() idempotent Before we would get the following (benign) error if we called `sc.stop()` twice. This is because the listener bus would try to post the end event again even after it has al

[1/2] spark git commit: [SPARK-6132] ContextCleaner race condition across SparkContexts

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 9846790f4 -> 338bea7b3 [SPARK-6132] ContextCleaner race condition across SparkContexts The problem is that `ContextCleaner` may clean variables that belong to a different `SparkContext`. This can happen if the `SparkContext` to which t

[2/2] spark git commit: [SPARK-6132][HOTFIX] ContextCleaner InterruptedException should be quiet

2015-03-13 Thread srowen
[SPARK-6132][HOTFIX] ContextCleaner InterruptedException should be quiet If the cleaner is stopped, we shouldn't print a huge stack trace when the cleaner thread is interrupted because we purposefully did this. Author: Andrew Or Closes #4882 from andrewor14/cleaner-interrupt and squashes the f

spark git commit: [SPARK-6087][CORE] Provide actionable exception if Kryo buffer is not large enough

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 f81611dca -> 9846790f4 [SPARK-6087][CORE] Provide actionable exception if Kryo buffer is not large enough A simple try-catch wrapping KryoException to be more informative. Author: Lev Khomich Closes #4947 from levkhomich/master and

spark git commit: [SPARK-6036][CORE] avoid race condition between eventlogListener and akka actor system

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 4aa41327d -> f81611dca [SPARK-6036][CORE] avoid race condition between eventlogListener and akka actor system For detail description, pls refer to [SPARK-6036](https://issues.apache.org/jira/browse/SPARK-6036). Author: Zhang, Liye

spark git commit: SPARK-4044 [CORE] Thriftserver fails to start when JAVA_HOME points to JRE instead of JDK

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 a3493eb77 -> 4aa41327d SPARK-4044 [CORE] Thriftserver fails to start when JAVA_HOME points to JRE instead of JDK Don't use JAR_CMD unless present in archive check. Add datanucleus always if present, to avoid needing a check involving

spark git commit: SPARK-4300 [CORE] Race condition during SparkWorker shutdown

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 170af49bb -> a3493eb77 SPARK-4300 [CORE] Race condition during SparkWorker shutdown Close appender saving stdout/stderr before destroying process to avoid exception on reading closed input stream. (This also removes a redundant `waitFo

spark git commit: SPARK-4704 [CORE] SparkSubmitDriverBootstrap doesn't flush output

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 214f68103 -> dbee7e16c SPARK-4704 [CORE] SparkSubmitDriverBootstrap doesn't flush output Join on output threads to make sure any lingering output from process reaches stdout, stderr before exiting CC andrewor14 since I believe he crea

spark git commit: [SPARK-6194] [SPARK-677] [PySpark] fix memory leak in collect()

2015-03-13 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.3 dbee7e16c -> 170af49bb [SPARK-6194] [SPARK-677] [PySpark] fix memory leak in collect() Because circular reference between JavaObject and JavaMember, an Java object can not be released until Python GC kick in, then it will cause memory

spark git commit: [SPARK-6278][MLLIB] Mention the change of objective in linear regression

2015-03-13 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 dc287f38f -> 214f68103 [SPARK-6278][MLLIB] Mention the change of objective in linear regression As discussed in the RC3 vote thread, we should mention the change of objective in linear regression in the migration guide. srowen Author:

spark git commit: [SPARK-6278][MLLIB] Mention the change of objective in linear regression

2015-03-13 Thread meng
Repository: spark Updated Branches: refs/heads/master dc4abd4dc -> 7f13434a5 [SPARK-6278][MLLIB] Mention the change of objective in linear regression As discussed in the RC3 vote thread, we should mention the change of objective in linear regression in the migration guide. srowen Author: Xia

spark git commit: [SPARK-6252] [mllib] Added getLambda to Scala NaiveBayes

2015-03-13 Thread meng
Repository: spark Updated Branches: refs/heads/master ea3d2eed9 -> dc4abd4dc [SPARK-6252] [mllib] Added getLambda to Scala NaiveBayes Note: not relevant for Python API since it only has a static train method Author: Joseph K. Bradley Author: Joseph K. Bradley Closes #4969 from jkbradley/SP

svn commit: r1666519 - /spark/site/documentation.html

2015-03-13 Thread srowen
Author: srowen Date: Fri Mar 13 17:18:03 2015 New Revision: 1666519 URL: http://svn.apache.org/r1666519 Log: Add 1.3.0 docs link Modified: spark/site/documentation.html Modified: spark/site/documentation.html URL: http://svn.apache.org/viewvc/spark/site/documentation.html?rev=1666519&r1=166

svn commit: r1666516 - in /spark: releases/_posts/2015-03-13-spark-release-1-3-0.md site/releases/spark-release-1-3-0.html

2015-03-13 Thread pwendell
Author: pwendell Date: Fri Mar 13 17:15:41 2015 New Revision: 1666516 URL: http://svn.apache.org/r1666516 Log: Incorrect link in Kafka API in 1.3 release notes Modified: spark/releases/_posts/2015-03-13-spark-release-1-3-0.md spark/site/releases/spark-release-1-3-0.html Modified: spark/r

Git Push Summary

2015-03-13 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.0 [created] 4aaf48d46 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

svn commit: r1666489 - in /spark: releases/_posts/2015-03-13-spark-release-1-3-0.md site/releases/spark-release-1-3-0.html

2015-03-13 Thread pwendell
Author: pwendell Date: Fri Mar 13 15:53:06 2015 New Revision: 1666489 URL: http://svn.apache.org/r1666489 Log: Adding missing files Added: spark/releases/_posts/2015-03-13-spark-release-1-3-0.md spark/site/releases/spark-release-1-3-0.html Added: spark/releases/_posts/2015-03-13-spark-re

svn commit: r1666487 - in /spark: news/_posts/2015-03-13-spark-1-3-0-released.md site/news/spark-1-3-0-released.html

2015-03-13 Thread pwendell
Author: pwendell Date: Fri Mar 13 15:52:37 2015 New Revision: 1666487 URL: http://svn.apache.org/r1666487 Log: Adding missing files Added: spark/news/_posts/2015-03-13-spark-1-3-0-released.md spark/site/news/spark-1-3-0-released.html Added: spark/news/_posts/2015-03-13-spark-1-3-0-releas

svn commit: r1666484 - in /spark: downloads.md js/downloads.js site/community.html site/docs/latest site/downloads.html site/examples.html site/index.html site/js/downloads.js

2015-03-13 Thread pwendell
Author: pwendell Date: Fri Mar 13 15:48:06 2015 New Revision: 1666484 URL: http://svn.apache.org/r1666484 Log: Initial 1.3.0 code Modified: spark/downloads.md spark/js/downloads.js spark/site/community.html spark/site/docs/latest spark/site/downloads.html spark/site/exampl

svn commit: r1666486 [1/2] - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-03-13 Thread pwendell
Author: pwendell Date: Fri Mar 13 15:51:27 2015 New Revision: 1666486 URL: http://svn.apache.org/r1666486 Log: More 1.3 stuff Modified: spark/_layouts/global.html spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/site/examples.html spa

svn commit: r1666486 [2/2] - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-03-13 Thread pwendell
Modified: spark/site/releases/spark-release-0-3.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-3.html?rev=1666486&r1=1666485&r2=1666486&view=diff == --- spark/site/releases/spark-release-0-3.htm

spark git commit: [CORE][minor] remove unnecessary ClassTag in `DAGScheduler`

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 9048e8102 -> ea3d2eed9 [CORE][minor] remove unnecessary ClassTag in `DAGScheduler` This existed at the very beginning, but became unnecessary after [this commit](https://github.com/apache/spark/commit/37d8f37a8ec110416fba0d51d8ba70370ac380

spark git commit: [SPARK-6197][CORE] handle json exception when hisotry file not finished writing

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 69ff8e8cf -> 9048e8102 [SPARK-6197][CORE] handle json exception when hisotry file not finished writing For details, please refer to [SPARK-6197](https://issues.apache.org/jira/browse/SPARK-6197) Author: Zhang, Liye Closes #4927 from liy

spark git commit: [SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide

2015-03-13 Thread lian
Repository: spark Updated Branches: refs/heads/branch-1.3 23069bd02 -> dc287f38f [SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide Also fixed a bunch of minor styling issues. [https://reviewable.io/review_button.png"; height=40 alt="Review on Reviewable"/>](https://revi

spark git commit: [SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide

2015-03-13 Thread lian
Repository: spark Updated Branches: refs/heads/master 0af9ea74a -> 69ff8e8cf [SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide Also fixed a bunch of minor styling issues. [https://reviewable.io/review_button.png"; height=40 alt="Review on Reviewable"/>](https://reviewab

spark git commit: [SPARK-5845][Shuffle] Time to cleanup spilled shuffle files not included in shuffle write time

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 3980ebdf1 -> 0af9ea74a [SPARK-5845][Shuffle] Time to cleanup spilled shuffle files not included in shuffle write time I've added a timer in the right place to fix this inaccuracy. Author: Ilya Ganelin Closes #4965 from ilganeli/SPARK-58