Re: [google-appengine] How do I determine the number of instances needed settings?

2013-02-28 Thread Takashi Matsuo
Hi Brett,

You're using Master/Slave datastore, which was already deprecated.
First of all, I recommend you migrate your app to High Replication
Datastore.

On Wed, Feb 27, 2013 at 8:12 AM,  br...@mybizcentral.biz wrote:
 App ID: mybizcentral
 Version: test

 This is for production level code. Can you help me determine what Instances
 settings I should use to avoid deadline exceeded errors? I had the settings
 set to Automatic, but I just changed the minimum idle instance setting to 1.
 I will see if having one Resident instance available helps avoid these
 errors overnight tonight. Every night the application receives thousands of
 emails, with files attached that need to be parsed and stored in the
 datastore. So there is an expected spike in traffic overnight. Can you help
 me with the Instance settings to handle these spikes, but also not sky
 rocket our hosting costs?

If you want to avoid the problem as well as save the cost, I think you
need to optimize your app, instead of (or at least before) just
setting sufficient number of idle instances.


 I'm seeing Deadline Exceeded Errors:

 Uncaught exception from servlet
 com.google.apphosting.runtime.HardDeadlineExceededError:


What part contributes to the DeadlineExceededError?
The performance of the Master/Slave datastore is prone to being
affected by an issue in a single datacenter, so if it was the culprit,
migrating to the HRD is the way to go. If the e-mail parsing takes
time, using taskqueue can help here.


 I'm also occassionally seeing Concurrent Modification errors.

 java.sql.SQLException: Concurrent Modification

How do you access to the datastore? JDO? Low Level API? Anyway, it
seems to me that now your code is trying to write to a single entity
group at too high a rate. I recommend you refine your data models.

-- Takashi


 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To unsubscribe from this group and stop receiving emails from it, send an
 email to google-appengine+unsubscr...@googlegroups.com.
 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine?hl=en.
 For more options, visit https://groups.google.com/groups/opt_out.





--
Takashi Matsuo | Developers Advocate | tmat...@google.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] How do I determine the number of instances needed settings?

2013-02-27 Thread brett
App ID: mybizcentral
Version: test

This is for production level code. Can you help me determine what Instances 
settings I should use to avoid deadline exceeded errors? I had the settings 
set to Automatic, but I just changed the minimum idle instance setting to 
1. I will see if having one Resident instance available helps avoid these 
errors overnight tonight. Every night the application receives thousands of 
emails, with files attached that need to be parsed and stored in the 
datastore. So there is an expected spike in traffic overnight. Can you help 
me with the Instance settings to handle these spikes, but also not sky 
rocket our hosting costs?

I'm seeing Deadline Exceeded Errors:
Uncaught exception from servlet 
com.google.apphosting.runtime.HardDeadlineExceededError:

I'm also occassionally seeing Concurrent Modification errors.
java.sql.SQLException: Concurrent Modification

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.