[GitHub] spark pull request: [SPARK-2522] set default broadcast factory to ...

2014-07-30 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/1437#issuecomment-50645071 @lianhuiwang I created a JIRA for it: https://issues.apache.org/jira/browse/SPARK-2755 . We can serialize the object to a stream instead of Array[Byte] directly. --- If

[GitHub] spark pull request: [SPARK-2522] set default broadcast factory to ...

2014-07-18 Thread lianhuiwang
Github user lianhuiwang commented on the pull request: https://github.com/apache/spark/pull/1437#issuecomment-49439644 but when broadcoast's size >1G, TorrentBroadcast has a array size exceeds error.in Utils.serialize() will transfer object to Array[Byte]. when broadcoast object's siz

[GitHub] spark pull request: [SPARK-2522] set default broadcast factory to ...

2014-07-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/1437 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-2522] set default broadcast factory to ...

2014-07-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/1437#issuecomment-49206767 Merging in master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-2522] set default broadcast factory to ...

2014-07-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1437#issuecomment-49144587 QA results for PR 1437:- This patch PASSES unit tests.- This patch merges cleanly- This patch adds no public classesFor more information see test ouptut:https://amplab.c