Re: solr+hadoop = next solr

2007-06-08 Thread Jeff Rodenburg
On 6/7/07, Rafael Rossini [EMAIL PROTECTED] wrote: Hi, Jeff and Mike. Would you mind telling us about the architecture of your solutions a little bit? Mike, you said that you implemented a highly-distributed search engine using Solr as indexing nodes. What does that mean? You guys

Re: solr+hadoop = next solr

2007-06-07 Thread Mike Klaas
On 6-Jun-07, at 7:44 PM, Jeff Rodenburg wrote: I've been exploring distributed search, as of late. I don't know about the next solr but I could certainly see a distributed solr grow out of such an expansion. I've implemented a highly-distributed search engine using Solr (200m docs and

Re: solr+hadoop = next solr

2007-06-07 Thread Jeff Rodenburg
Mike - thanks for the comments. Some responses added below. On 6/7/07, Mike Klaas [EMAIL PROTECTED] wrote: I've implemented a highly-distributed search engine using Solr (200m docs and growing, 60+ servers). It is not a Solr-based solution in the vein of FederatedSearch--it is a

Re: solr+hadoop = next solr

2007-06-07 Thread Rafael Rossini
Hi, Jeff and Mike. Would you mind telling us about the architecture of your solutions a little bit? Mike, you said that you implemented a highly-distributed search engine using Solr as indexing nodes. What does that mean? You guys implemented a master, multi-slave solution for replication? Or

Re: solr+hadoop = next solr

2007-06-06 Thread Yonik Seeley
On 6/6/07, James liu [EMAIL PROTECTED] wrote: anyone agree? No ;-) At least not if you mean using map-reduce for queries. When I started looking at distributed search, I immediately went and read the map-reduce paper (easier concept than it first appeared), and realized it's really more for

Re: solr+hadoop = next solr

2007-06-06 Thread Jeff Rodenburg
I've been exploring distributed search, as of late. I don't know about the next solr but I could certainly see a distributed solr grow out of such an expansion. In terms of the FederatedSearch wiki entry (updated last year), has there been any progress made this year on this topic, at least

Re: solr+hadoop = next solr

2007-06-06 Thread James liu
2007/6/7, Yonik Seeley [EMAIL PROTECTED]: On 6/6/07, James liu [EMAIL PROTECTED] wrote: anyone agree? No ;-) At least not if you mean using map-reduce for queries. When I started looking at distributed search, I immediately went and read the map-reduce paper (easier concept than it first

Re: solr+hadoop = next solr

2007-06-06 Thread Yonik Seeley
On 6/6/07, Jeff Rodenburg [EMAIL PROTECTED] wrote: In terms of the FederatedSearch wiki entry (updated last year), has there been any progress made this year on this topic, at least something worthy of being added or updated to the wiki page? Priorities shifted, and I dropped it for a while. I