[
https://issues.apache.org/jira/browse/NUTCH-444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12494987
]
Doğacan Güney commented on NUTCH-444:
-------------------------------------
Hi Chris,
> Well I must say, with all the discussion that's gone on w.r.t. this issue, I
> am leaning towards your suggestion. Could you please bring this patch up to
> date against the latest trunk? Just to clarify. Does your patch include a new
> feed parser that uses Rome?
Yes, I have a patch that uses ROME.
> If so, I'd like to suggest you and me working closely together on the
> following:
> 1. Bring the existing patch up-to-date against latest trunk
I am working on this. I may not have any time today, but I will definitely
finish this by the end of weekend. I am thinking of changing to name of the
plugin from parse-feed to just feed because I also want to include an
IndexingFilter and a QueryFilter to the plugin. (So that you can do a search
like author:<someone> or date:<sometime>-<sometime>).
> 2. Take nutch newbie's seed list of RSS urls to use as our benchmark
> 3. Run through one or two full tests
> 4. Attach a new patch, call for objects
> 5. Go ahead and commit
> Sound good? If so, let's work on this.
Sure :).
> Possibly use a different library to parse RSS feed for improved performance
> and compatibility
> ---------------------------------------------------------------------------------------------
>
> Key: NUTCH-444
> URL: https://issues.apache.org/jira/browse/NUTCH-444
> Project: Nutch
> Issue Type: Improvement
> Components: fetcher
> Affects Versions: 0.9.0
> Reporter: Renaud Richardet
> Assigned To: Chris A. Mattmann
> Priority: Minor
> Fix For: 1.0.0
>
> Attachments: parse-feed-v2.tar.bz2, parse-feed.tar.bz2
>
>
> As discussed by Nutch Newbie, Gal, and Chris on NUTCH-443, the current
> library (feedparser) has the following issues:
> - OutOfMemory when parsing > 100k feeds, since it has to convert the feed to
> jdom first
> - no support for Atom 1.0
> - there has been no development in the last year
> Alternatives are:
> - Rome
> - Informa
> - custom implementation based on Stax
> - ??
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
-------------------------------------------------------------------------
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
