(...) http://andaluciajunta.es/aj-sea-.html This
search engine will be based on nutch in the next version. The special
character is that this main portal search engine has to search against
the solr BOJA based indexed. Meaning Nutch will have to search the solr
index and not vice versa.
Looks interesting, too bad I don't understand the language :) But I do
get the idea.
<field name="title" type="string" stored="true" ></field>
<field name="content" type="text" indexed="true" stored="true" />
<field name="url" type="string" stored="true" ></field>
This is valuable info to a newbie like me. Thanks a lot! It also makes
me think "why didn't they make Nutch more general" but I guess they
wanted consistence (and it's probably configurable in Nutch, hidden
somewhere, anyway).
Hmm, I think like Hoss on this, why do we want do the same work of
nutch. If you need a crawler why not use the one from nutch and change
some lines? I actually use Forrest as crawler when I generate the new
sites, which will then push the content to the solr server via a plugin
I developed:
http://forrest.apache.org/pluginDocs/plugins_0_80/org.apache.forrest.plugin.output.solr/
Nice one. I didn't know about Forrest, so thanks for the advice. My
"needs" are actually not related to a certain site or application at
all. I am here for pure interest in Lucene/Solr/Nutch/etc, and the
search field in general (enterprise in particular). Think of my needs as
more of R&D, if you'd like.
Ultimately I hope to be able to contribute, but don't know where to
start (and how much time/resources I have).
Not sure. I am using solr because I did not had to develop three
different nutch plugin to make it work. Further I have punctual updates
where I push a certain set of documents to the server, so no need for a
crawler.
My suggestion is independent of how often docs are indexed. Everything
should be possible - manual feed, crawler, filesystem surveillance,
database transaction reports - as long as this is kept separate limit
lies in one's imagination.
Problem is; I haven't worked enough with Solr, Nutch, Lucene etc. to
really know all possibilities and limitations. But I do believe that the
outlined architecture would be flexible and answer many needs.
Not sure.
Well I am thinking about a way to meet the same market as some
commercial vendors. They should not and may not be copied, so don't get
me wrong. But I do know something about this market, or at least I like
to think so.
(...) I must say that interproject
collaboration is very hard to archive.
I take your word for it :) I guess one way is to just code/create the
damn thing, not talk about it like I do now. *dreaming*
Anyway if you need a crawler but want use solr then see the crawling
code of nutch and write a standalone crawler that will update the solr
index.
Will do! Thanks for a full and wise reply.
Eivind
