Thanks you Lewis I already report it last week on JIRA :
https://issues.apache.org/jira/browse/NUTCH-2222 Please let me know if you have any question to give you more details. Best regards, Adnane -----Original Message----- From: Lewis John Mcgibbney [mailto:lewis.mcgibb...@gmail.com] Sent: February 23, 2016 9:18 PM To: user@nutch.apache.org Subject: Re: fetch deletes all metadata except _csh_ and _rs_ Hi Adnane, Yes, we were getting your mail. Just too busy too respond so thank you for your patience. OK so this sounds like a bug IMHO. No Metadata should be deleted, at the most updates should occur, that is all. Can you please log an issue at the Nutch Jira instance describing your Nutch 2.X search stack along with an entire log if possible and any queries which can allow us to better understand the issue at hand? Thanks in advance. lewis On Wed, Feb 17, 2016 at 10:34 AM, <user-digest-h...@nutch.apache.org> wrote: > From: Adnane Benjelloun <adn...@mediaplusplus.com> > To: <user@nutch.apache.org> > Cc: > Date: Tue, 16 Feb 2016 22:03:53 -0500 > Subject: fetch deletes all metadata except _csh_ and _rs_ Hello, > > > > This problem happens at the second time I crawl a page > > > > bin/nutch inject urls/ > > bin/nutch generate -topN 1000 > > bin/nutch fetch -all > > bin/nutch parse -force -all > > bin/nutch updatedb -all > > > > second time : > > > > bin/nutch generate -topN 1000 --> batchid changes for all existing pages > > bin/nutch fetch -all --> *** metadatas are delete for all pages already > crawled ** > > bin/nutch parse -force -all > > bin/nutch updatedb -all > > > > I'm using mongodb > > > > Any Help please ? I'm not sure if it's a nutch bug or it's my > misunderstanding on nutch. > > > > Best regards, > > > Adnane > >
