[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-07-05 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/13729 @dbtsai I'll take a look later this week --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-07-05 Thread dbtsai
Github user dbtsai commented on the issue: https://github.com/apache/spark/pull/13729 Hi @jodersky @sethah Could you test in Linear Regression, if `@transient` helps the performance for the same serialization issue?

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-07-05 Thread jodersky
Github user jodersky commented on the issue: https://github.com/apache/spark/pull/13729 Hi @dbtsai, I assisted @sethah with some serialization issues during this PR. I know we considered using transient but can't recall exactly why we ended up not. My knowledge about the bigger

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-07-04 Thread dbtsai
Github user dbtsai commented on the issue: https://github.com/apache/spark/pull/13729 @sethah Late comment. Great improvement for high dimensional problems. I didn't test it out myself, and I wonder whether `@transient` annotation works in the constructor of `LogisticAggregator`.

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13729 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13729 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60712/ Test PASSed. ---

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13729 **[Test build #60712 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60712/consoleFull)** for PR 13729 at commit

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-17 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/13729 Nice catch and LGTM! Merging into master and branch-2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13729 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13729 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60710/ Test PASSed. ---

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13729 **[Test build #60712 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60712/consoleFull)** for PR 13729 at commit

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13729 **[Test build #60710 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60710/consoleFull)** for PR 13729 at commit

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-17 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/13729 @srowen Thanks for the review! I responded to your comments, let me know what you think. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13729 **[Test build #60710 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60710/consoleFull)** for PR 13729 at commit

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13729 I think that makes sense. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13729 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60681/ Test PASSed. ---

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13729 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13729 **[Test build #60681 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60681/consoleFull)** for PR 13729 at commit

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13729 **[Test build #60681 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60681/consoleFull)** for PR 13729 at commit

[GitHub] spark issue #13729: [SPARK-16008][ML] Remove unnecessary serialization in lo...

2016-06-16 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/13729 cc @jkbradley @dbtsai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes