So I'm indexing RSS feeds. I'm running the data import full-import command with a cron job. It runs every 15 minutes and indexes a lot of RSS feeds from many sources.
With cron job, I do a http request using curl, to the address http://localhost:port/solr/core/dataimport/?command=full-import&clean=false When it runs, if the rss source has a feed that is already indexed on solr, it updates the existing source. So if the source has the same information of the destiny, it updates the information on the destiny. I want to prevent that. Is that explicit? I may try to provide some examples. Thanks On Tuesday, September 10, 2013, Chris Hostetter wrote: > > : When i run "dataimport/?command=full-import&clean=false", solr add new > : documents with the information. But if the same information already > : exists with the same uniquekey, it replaces the existing document with a > : new one. > : It does not update the document, it creates a new one. It's that > possible? > > I'm not certain that i'm understanding your question. > > It is possible using Atomic Updates, but you have to be explicit > about what/how you wnat Solr to use the new information (ie: when to > replace, when to add to a multivaluded field, when to increment a numeric > field, etc...) > > https://wiki.apache.org/solr/Atomic_Updates > > I don't think DIH has any straight forward syntax for letting you > configure this easily, but as long as you put a "map" in each > field (ie: via ScriptTransformer perhaps) containing a single "modifier => > value" pair you want applied to that field, it should work. > > : I'm indexing rss feeds. I run the rss example that exists in the solr > : examples, and i does that. > > Can you please be more specific about what you would like to see happen, > we can better understand what your actual goal is? It's really not clear > if using Atomic Updates is the easiest way to achieve what you're after, > or if I'm just completley missunderstanding your question... > > https://wiki.apache.org/solr/UsingMailingLists > > -Hoss > -- Sent from Gmail Mobile
