git commit: [SPARK-3045] Make Serializer interface Java friendly

2014-08-16 Thread rxin
Repository: spark Updated Branches: refs/heads/master c9da466ed - a83c7723b [SPARK-3045] Make Serializer interface Java friendly Author: Reynold Xin r...@apache.org Closes #1948 from rxin/kryo and squashes the following commits: a3a80d8 [Reynold Xin] [SPARK-3046] use executor's class loader

git commit: [SPARK-2977] Ensure ShuffleManager is created before ShuffleBlockManager

2014-08-16 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 fcf30cdc5 - 0e0ec2eeb [SPARK-2977] Ensure ShuffleManager is created before ShuffleBlockManager This is intended to fix SPARK-2977. Before, there was an implicit ordering dependency where we needed to know the ShuffleManager

git commit: [SPARK-2977] Ensure ShuffleManager is created before ShuffleBlockManager

2014-08-16 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master a83c7723b - 20fcf3d0b [SPARK-2977] Ensure ShuffleManager is created before ShuffleBlockManager This is intended to fix SPARK-2977. Before, there was an implicit ordering dependency where we needed to know the ShuffleManager

git commit: [SQL] Using safe floating-point numbers in doctest

2014-08-16 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.1 0e0ec2eeb - 8c7957446 [SQL] Using safe floating-point numbers in doctest Test code in `sql.py` tries to compare two floating-point numbers directly, and cased [build

git commit: [SPARK-2677] BasicBlockFetchIterator#next can wait forever

2014-08-16 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 8c7957446 - bd3ce2ffb [SPARK-2677] BasicBlockFetchIterator#next can wait forever Author: Kousuke Saruta saru...@oss.nttdata.co.jp Closes #1632 from sarutak/SPARK-2677 and squashes the following commits: cddbc7b [Kousuke Saruta]

git commit: [SPARK-3081][MLLIB] rename RandomRDDGenerators to RandomRDDs

2014-08-16 Thread meng
Repository: spark Updated Branches: refs/heads/master 7e70708a9 - ac6411c6e [SPARK-3081][MLLIB] rename RandomRDDGenerators to RandomRDDs `RandomRDDGenerators` means factory for `RandomRDDGenerator`. However, its methods return RDDs but not RDDGenerators. So a more proper (and shorter) name

git commit: [SPARK-3081][MLLIB] rename RandomRDDGenerators to RandomRDDs

2014-08-16 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.1 0b354be2f - a12d3ae32 [SPARK-3081][MLLIB] rename RandomRDDGenerators to RandomRDDs `RandomRDDGenerators` means factory for `RandomRDDGenerator`. However, its methods return RDDs but not RDDGenerators. So a more proper (and shorter)

git commit: [SPARK-3035] Wrong example with SparkContext.addFile

2014-08-16 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 a12d3ae32 - 721f2fdc9 [SPARK-3035] Wrong example with SparkContext.addFile https://issues.apache.org/jira/browse/SPARK-3035 fix for wrong document. Author: iAmGhost kdh7...@gmail.com Closes #1942 from iAmGhost/master and squashes

git commit: [SPARK-3035] Wrong example with SparkContext.addFile

2014-08-16 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master ac6411c6e - 379e7585c [SPARK-3035] Wrong example with SparkContext.addFile https://issues.apache.org/jira/browse/SPARK-3035 fix for wrong document. Author: iAmGhost kdh7...@gmail.com Closes #1942 from iAmGhost/master and squashes the

git commit: [SPARK-1065] [PySpark] improve supporting for large broadcast

2014-08-16 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 721f2fdc9 - 5dd571c29 [SPARK-1065] [PySpark] improve supporting for large broadcast Passing large object by py4j is very slow (cost much memory), so pass broadcast objects via files (similar to parallelize()). Add an option to keep

git commit: In the stop method of ConnectionManager to cancel the ackTimeoutMonitor

2014-08-16 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 2fc8aca08 - bc95fe08d In the stop method of ConnectionManager to cancel the ackTimeoutMonitor cc JoshRosen sarutak Author: GuoQiang Li wi...@qq.com Closes #1989 from witgo/cancel_ackTimeoutMonitor and squashes the following commits:

git commit: In the stop method of ConnectionManager to cancel the ackTimeoutMonitor

2014-08-16 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 5dd571c29 - f02e327f0 In the stop method of ConnectionManager to cancel the ackTimeoutMonitor cc JoshRosen sarutak Author: GuoQiang Li wi...@qq.com Closes #1989 from witgo/cancel_ackTimeoutMonitor and squashes the following commits:

git commit: [SPARK-3077][MLLIB] fix some chisq-test

2014-08-16 Thread meng
Repository: spark Updated Branches: refs/heads/master bc95fe08d - fbad72288 [SPARK-3077][MLLIB] fix some chisq-test - promote nullHypothesis field in ChiSqTestResult to TestResult. Every test should have a null hypothesis - correct null hypothesis statement for independence test - p-value:

git commit: [SPARK-3077][MLLIB] fix some chisq-test

2014-08-16 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.1 f02e327f0 - 413a329e1 [SPARK-3077][MLLIB] fix some chisq-test - promote nullHypothesis field in ChiSqTestResult to TestResult. Every test should have a null hypothesis - correct null hypothesis statement for independence test -