Re: conditional indexing

2013-01-23 Thread Julien Nioche
d not take a long time now. > > Cheers > > > > -Original message- > > From:Sourajit Basak > > Sent: Thu 24-Jan-2013 05:36 > > To: user@nutch.apache.org > > Subject: Re: conditional indexing > > > > Thanks for the pointer on ordering. &g

RE: conditional indexing

2013-01-23 Thread Markus Jelsma
Hi I'll have to wait until Julien commits his work for pluggable indexing back ends. That should not take a long time now. Cheers -Original message- > From:Sourajit Basak > Sent: Thu 24-Jan-2013 05:36 > To: user@nutch.apache.org > Subject: Re: conditional indexin

Re: conditional indexing

2013-01-23 Thread Sourajit Basak
Thanks for the pointer on ordering. Based upon the presence of certain fields, nutch can decide whether to send a doc to solr. However, I guess its means changes to the main code line instead of driven by plugin. Let me see the source. I am eagerly waiting for the patch from Markus. Best, Souraj

Re: conditional indexing

2013-01-23 Thread feng lu
Hi Sourajit We have an implementation of Indexing filter that runs side-by-side the indexer-basic plugin. How is the order determined ? First, Make sure you indexing filter plugin is set currectly at plugin.includes property in nutch-site.xml configuration file. The indexing filter order

Re: conditional indexing

2013-01-23 Thread Sourajit Basak
Markus - Can you please share your patch ? On Wed, Jan 23, 2013 at 1:52 PM, Tejas Patil wrote: > Hi Sourajit, > See indexingfilter.order in nutch-default.xml > > Thanks, > Tejas Patil > > On Wed, Jan 23, 2013 at 12:16 AM, Sourajit Basak > wrote: > > > We have an implementation of Indexing filter

Re: conditional indexing

2013-01-23 Thread Tejas Patil
Hi Sourajit, See indexingfilter.order in nutch-default.xml Thanks, Tejas Patil On Wed, Jan 23, 2013 at 12:16 AM, Sourajit Basak wrote: > We have an implementation of Indexing filter that runs side-by-side the > indexer-basic plugin. How is the order determined ? > Also, how do I do conditional i

RE: conditional indexing

2013-01-23 Thread Markus Jelsma
Hi - i've not yet committed a fix for: https://issues.apache.org/jira/browse/NUTCH-1449 This will allow you to stop documents from being indexed from within your indexing filter. Order can be configured using the indexing.filter.order or something configuration directive. -Original message