Hi Kaan,

It is indeed not easy to reach the 10 GB size for an index, but yet not 
impossible. As you can read here 
<https://cloud.google.com/appengine/docs/quotas#search>, "when an app tries 
to exceed this amount, an insufficient quota error is returned".

Note that if you have purchased one of our Silver, Gold, or Platinum support 
<https://cloud.google.com/support/packages> packages, you'll be able to 
request a quota increase for this limit.

But before that, I would suggest to shard (divide or split) your index into 
multiple indexes. In order to do so, you should:

1. Create an additional index.
2. Store a new document in the second index if needed.
3. When you need to search for a document, search both indexes. For better 
performance, you can make asynchronous search calls.

According to what my colleague David (Google wise man) explained to me, 
this approach will not scale indefinitely. Beyond two or maybe three 
sharded indexes, this technique will become relatively inefficient. The 
Search API is not designed for infinitely large document collections, so if 
you plan to scale a great deal then you would need to consider alternative 
architectures. However this technique will at least allow you to double 
your search capacity.

Hope that info helps!

On Thursday, February 26, 2015 at 9:17:31 PM UTC+1, Kaan Soral wrote:
>
> Thanks for the reply
>
> I don't think 10gb is easy to reach, but growing is probably the aim of 
> most of the appengine apps, and reaching that limit would probably be a 
> nightmare
>
> What exactly happens at that point?
>
> I hope the system automatically purges the low-rank documents on it's own
>
> Is it also a hard-limit, or does an internal bell goes off, and someone 
> warns you that you're first to reach the limit, and starts discussing what 
> to do
>
> I really wish it was unlimited, just for the sake of the mind
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/63d06e8b-c843-4dfb-b38f-31d92ef1db0b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to