On Fri, 2011-02-04 at 05:54 +0100, Ganesh wrote:
> 2. Consider a scenario I am sharding based on the User, I am having single
> search server and It is handling 1000 members. Now as the memory consumption
> is high, I have added one more search server. New users could access the
> second server
nt: Friday, January 21, 2011 12:04 PM
Subject: Re: Scale out design patterns
> Hi Ganesh,
> I'd suggest, if you have a particular dimension/field on which you could
> shard your data such that the query/data breakup gets predictable, that
> would be a good way to scale out e.g. if you h
Hi Ganesh,
I'd suggest, if you have a particular dimension/field on which you could
shard your data such that the query/data breakup gets predictable, that
would be a good way to scale out e.g. if you have users which are equally
active/searched then you may want to split their data on a simple mod
On Mon, Feb 8, 2010 at 9:33 AM, Chris Lu wrote:
> Since you already have RMI interface, maybe you can parallel search on
> several nodes, collect the data, pick top ones, and send back results via
> RMI.
>
One thing to be careful about this, which you might already be aware of:
Query (and subcla
Since you already have RMI interface, maybe you can parallel search on
several nodes, collect the data, pick top ones, and send back results
via RMI.
--
Chris Lu
-
Instant Scalable Full-Text Search On Any Database/Application
site: http://www.dbsight.net
demo: http://sea
> Any thoughts on scaling / clustering? Whether i need to use Hadoop / Carrot
> etc...
>
Carrot2 does search results clustering (by content), while what you probably
need is server/index clustering. See the other responses in this thread for
suggestions.
S.
Solr has more powerful scalability than lucene, maybe you can try that
On Mon, Feb 8, 2010 at 6:14 PM, Ganesh wrote:
> Our indexes is growing and the sorted cache is taking huge amount of RAM.
> We want to add multiple nodes, and scale out the search.
>
> Currently my applaication supports RMI
http://katta.sourceforge.net/ sounds well worth a look.
--
Ian.
On Mon, Feb 8, 2010 at 10:14 AM, Ganesh wrote:
> Our indexes is growing and the sorted cache is taking huge amount of RAM. We
> want to add multiple nodes, and scale out the search.
>
> Currently my applaication supports RMI inte
