[
https://issues.apache.org/jira/browse/GIRAPH-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16455764#comment-16455764
]
ASF GitHub Bot commented on GIRAPH-1188:
----------------------------------------
Github user yukselakinci commented on the issue:
https://github.com/apache/giraph/pull/70
The custom class resolver allows kryo to always use the integer IDs for
classes that are agreed by all nodes running the job. Default class resolver
always writes the full class name of the first encountered class type to the
stream, and then it assigns an integer for subsequent instances. These changes
make the serialization faster by eliminating the need to write the full name
for the first encountered class instance.
Tests:
1- Unit tests
2- Snapshot tests
3- Ran with two production pipelines
Running time for mutual friends pipeline decreased from 41 to 35
minutes.
> Add kryo custom class resolver for faster serialization.
> --------------------------------------------------------
>
> Key: GIRAPH-1188
> URL: https://issues.apache.org/jira/browse/GIRAPH-1188
> Project: Giraph
> Issue Type: Improvement
> Reporter: Yuksel Akinci
> Priority: Major
>
> The custom class resolver allows kryo to always use the integer IDs for
> classes that are agreed by all nodes running the job. Default class resolver
> always writes the full class name of the first encountered class type to the
> stream, and then it assigns an integer for subsequent instances. These
> changes make the serialization faster by eliminating the need to write the
> full name for the first encountered class instance.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
