[
https://issues.apache.org/jira/browse/NUTCH-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Doğacan Güney updated NUTCH-434:
--------------------------------
Attachment: NUTCH-434_v2.patch
Patch updated for trunk. I also changed Fetcher and Fetcher2 to use
NutchWritable instead of ObjectWritable.
I tested this with a small 2000 url crawl and then used SegmentMerger and
SegmentReader, they all work successfully.
> Replace usage of ObjectWritable with something based on GenericWritable
> -----------------------------------------------------------------------
>
> Key: NUTCH-434
> URL: https://issues.apache.org/jira/browse/NUTCH-434
> Project: Nutch
> Issue Type: Improvement
> Reporter: Sami Siren
> Attachments: NUTCH-434.patch, NUTCH-434_v2.patch
>
>
> We should replace the usage of ObjectWritable and classes extending it with
> class extending GenericWritable. Classes based on GenericWritable have
> smaller footprint on disc and the baseclass also does not contain any classes
> that are Deprecated.
> There is one problem though: the ParseData currently needs Configuration
> object before it can deserialize itself and GenericWritable
> doesn't provide a way to inject configuration in. We could either a) remove
> the need for Configuration, or b) write a class similar to GenericWritable
> that does conf injecting.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
-------------------------------------------------------------------------
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
