[appengine-java] Re: Help: Memcache - not hitting at all
The javadocs for MemcacheService suggest a pattern that you would use
if the
backing cache used soft references:
foo = memcache.get(key);
if (foo == null) {
if (memcache.contains(key)) {
// continue, assuming foo had the real value null
} else {
// continue; foo may have had a real null, but has been dropped
now
}
}
On Sep 11, 12:33 pm, realdope rte...@gmail.com wrote:
Here's rest of the code:
public class Memcache {
private static int EXPIRY = 60*60*24*30;
private static final String POSTIDKEY=POSTID_;
private static boolean has(String key) {
return MemcacheServiceFactory.getMemcacheService().contains(key)
get(key).length()0;
}
private static String get(String key) {
try {
return (String)
MemcacheServiceFactory.getMemcacheService().get(key);
} catch (Exception e) { return ; }
}
private static void put(String key, String value, int expiry) {
MemcacheServiceFactory.getMemcacheService().put(key, value,
Expiration.byDeltaSeconds(expiry));
}
private static void delete(String key) {
MemcacheServiceFactory.getMemcacheService().delete(key);
}
public static boolean hasById(Long id) { return has(POSTIDKEY+id); }
public static String getById(Long id) { return get(POSTIDKEY+id); }
public static void putById(Long id, String value) { put(POSTIDKEY+id,
value, EXPIRY); }
public static void flushById(Long id) { delete(POSTIDKEY+id); }
}
public static String byid(HttpServletRequest req) {
Long id=0L;
try { id=Long.parseLong(req.getParameter(id)); } catch (Exception
e) {}
if (id==0) return ;
if (Memcache.hasById(id)) return Memcache.getById(id);
String res = V1Post.getById(id);
Memcache.putById(id, res);
return res;
}
Does anyone know where the error is in my code? And why Memcache.hasById(id)
seems to always return false?
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Delete Lots Of Data
you MUST have a look at http://ikaisays.com/2010/07/09/using-the-java-mapper-framework-for-app-engine/ There's a special section at the end of the post delete all entities of a given kind. You can delete 35M entities in a few minutes using mapreduce. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Can't set URL Fetch Timeout to a value higher than 5 seconds
I was a bad boy and didn't do as I was told in the tutorials ! lol No in all fairness, I only had seen this tutorial http://code.google.com/appengine/docs/java/urlfetch/overview.html And hadn't seen the other one mentioned which showed how to prepare the url call properly, hence my mistake http://code.google.com/appengine/docs/java/urlfetch/usingjavanet.html I followed the second tutorial and it worked like a charm ! :) -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/Ons-Far4PMYJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Strange error after deployment
Please check whether all class files are in /war/WEB-INF/classes directory. You have to change the application id version of your project. For this, edit appengine.web.xml file accordingly and clear the cache ( in Windows C:\Program Files\Windows\temp ) directory and upload the application to google app engine. S. Abraham www.DataStoreGwt.com On Sep 7, 7:20 pm, Shaun Clark shaun.cl...@a-cti.com wrote: On my app id synclio-ivr all of my previous versions work great and if I deploy the current code to a different app id it works, but when I try to deploy my latest version I see a lot of errors that look like this: EXCEPTION java.lang.RuntimeException: java.io.FileNotFoundException: /base/data/ home/apps/s~synclio-ivr/20.353100563800392183/_ah/java_compiled/WEB- INF/classes/org/apache/jsp/pages/financialInfo_jsp.class (No such file or directory) at com.google.appengine.runtime.Request.process-6c587ad80ed61a42(Request.java) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at org.mortbay.util.Loader.loadClass(Loader.java:91) at org.mortbay.util.Loader.loadClass(Loader.java:71) at org.mortbay.jetty.servlet.Holder.doStart(Holder.java:73) at org.mortbay.jetty.servlet.ServletHolder.doStart(ServletHolder.java: 242) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java: 50) at org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java: 685) at org.mortbay.jetty.servlet.Context.startContext(Context.java:140) at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java: 1250) at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java: 517) at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java: 467) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java: 50) at com.google.apphosting.runtime.jetty.AppVersionHandlerMap.createHandler(AppVersionHandlerMap.java: 202) at com.google.apphosting.runtime.jetty.AppVersionHandlerMap.getHandler(AppVersionHandlerMap.java: 171) at com.google.apphosting.runtime.jetty.JettyServletEngineAdapter.serviceRequest(JettyServletEngineAdapter.java: 123) at com.google.apphosting.runtime.JavaRuntime $RequestRunnable.run(JavaRuntime.java:391) at com.google.apphosting.runtime.ThreadGroupPool $PoolEntry.run(ThreadGroupPool.java:160) at java.lang.Thread.run(Thread.java:679) Caused by: java.io.FileNotFoundException: /base/data/home/apps/ s~synclio-ivr/20.353100563800392183/_ah/java_compiled/WEB-INF/classes/ org/apache/jsp/pages/financialInfo_jsp.class (No such file or directory) at java.io.FileInputStream.open(Native Method) at java.io.FileInputStream.init(FileInputStream.java:139) ... 18 more Any ideas what might be up? Thanks! Shaun -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: receiving mail demo
Hi Dom, i have tried your solution, but i am getting a java.lang.OutOfMemoryError: Java heap space error. Did you have that as well? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/4QvY6S9k6l8J. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Error on site (JAVA)
Error: com.caucho.quercus.QuercusModuleException: java.lang.NoClassDefFoundError: java.io.FileOutputStream is a restricted class. Please see the Google App Engine developer's guide for more details. Site: http://greenlieforums.appspot.com Please help me. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: sending pdf
Thanks for the info. I was about to use iText, but without guarantee it works in GAE context. JM On 9 sep, 23:52, Francois Masurel f.masu...@gmail.com wrote: Hi Vik, I'm using PDFJet to generate simple PDFs on GAE/Java. Francois -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] 404 on Ganymede plug-in zip
I am having problems installing the GWT Eclipse plug-in for Eclipse 3.4 (Ganymede). I get site not found when I use http://dl.google.com/eclipse/plugin/3.4 from the Eclipse software update. So I tried to download the zip file from http://dl.google.com/eclipse/plugin/3.4/zips/gpe-e34-latest-updatesite.zip and I get a file not found (404). I can get to the 3.5 zip file without an issue. Has the 3.4 zip file been removed? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Help: Memcache - not hitting at all
How is your memcache configured?
Are you using HTTP or HTTPS?
On Sat, Sep 10, 2011 at 9:21 PM, realdope rte...@gmail.com wrote:
Hi,
I have a Memcache wrapper class with a set of public static methods for
getting and setting application-specific key:value pairs. They use a set of
private static methods defined here:
private static boolean has(String key) {
return MemcacheServiceFactory.getMemcacheService().contains(key)
get(key).length()0;
}
private static String get(String key) {
try {
return (String)
MemcacheServiceFactory.getMemcacheService().get(key);
} catch (Exception e) { return ;}
}
private static void put(String key, String value, int expiry) {
MemcacheServiceFactory.getMemcacheService().put(key, value,
Expiration.byDeltaSeconds(expiry));
}
private static void delete(String key) {
MemcacheServiceFactory.getMemcacheService().delete(key);
}
The problem is there is almost no hit rate on my cache. What's wrong with
the code here?
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine-java/-/KWbuzF6TofYJ.
To post to this group, send email to
google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] input Data in DataStore from External Server ?
I have written a GWT app which uses Datagram Packets in Server Side. So i cannot server side code in Googe App Engine. I want to use GAE for its faster speed than other webhosts (and free). My Code is like this Server-Database- and then Database-Client Now can i copy *Data stored in External Database in external Server to DataStore(or any other thing) to run on GAE.* Will it be feasible / Possible ? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/HOACLLYNYeQJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: input Data in DataStore from External Server ?
Hey Kb, upload another special version of your GAE app. Use that special version to run Java code that imports the data. All versions of an GAE app use the same datastore. Possibly write and run localy a utility application to POST each record to your GAE datastore / or GET each record from an existing server. On Sep 12, 9:04 pm, Kb kb.kb.1...@gmail.com wrote: I have written a GWT app which uses Datagram Packets in Server Side. So i cannot server side code in Googe App Engine. I want to use GAE for its faster speed than other webhosts (and free). My Code is like this Server-Database- and then Database-Client Now can i copy *Data stored in External Database in external Server to DataStore(or any other thing) to run on GAE.* Will it be feasible / Possible ? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: input Data in DataStore from External Server ?
I Have around 100,000 entries in database(MySQL) that updates every 10 minutes. If i use GAE DataStore in Server Application(hosted somewhere) and Again GAE Datastore on Client will it fit the QUOTA Limits? On Sep 13, 12:39 am, gk goran.kar...@googlemail.com wrote: Hey Kb, upload another special version of your GAE app. Use that special version to run Java code that imports the data. All versions of an GAE app use the same datastore. Possibly write and run localy a utility application to POST each record to your GAE datastore / or GET each record from an existing server. On Sep 12, 9:04 pm, Kb kb.kb.1...@gmail.com wrote: I have written a GWT app which uses Datagram Packets in Server Side. So i cannot server side code in Googe App Engine. I want to use GAE for its faster speed than other webhosts (and free). My Code is like this Server-Database- and then Database-Client Now can i copy *Data stored in External Database in external Server to DataStore(or any other thing) to run on GAE.* Will it be feasible / Possible ? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Help Impossible to have some Cached Reqest
Thanks Bruno your solution works well -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/U9IUs43_P9AJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: 404 on Ganymede plug-in zip
I found my answer in another thread (https://groups.google.com/group/ google-plugin-eclipse/browse_thread/thread/ f17485cb3fb8bc87/2e7964a5ceb81fc6) It is no longer supported and has been removed. On Sep 12, 8:33 am, ac cat pcfea...@gmail.com wrote: I am having problems installing the GWT Eclipse plug-in for Eclipse 3.4 (Ganymede). I get site not found when I usehttp://dl.google.com/eclipse/plugin/3.4 from the Eclipse software update. So I tried to download the zip file fromhttp://dl.google.com/eclipse/plugin/3.4/zips/gpe-e34-latest-updatesit... and I get a file not found (404). I can get to the 3.5 zip file without an issue. Has the 3.4 zip file been removed? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] App Engine SDK 1.5.4 released!
Hey everyone, Just wanted to let you all know that App Engine SDK 1.5.4 has been released. The official announcement is here: http://googleappengine.blogspot.com/2011/09/app-engine-154-sdk-release.html The full release notes are below: Java 1.5.4 = - You can now specify the maximum size for a blob in BlobstoreService.createUploadUrl(). - Zigzag merge join queries will now continue scanning up to the 30 second Datastore query deadline. For zigzag queries that used to generate DatastoreNeedIndexException, many will now succeed. A small percentage will now instead timeout. - The SDK datastore viewer in the dev console now displays the number of Write Ops for each entity. Write Ops are the total number of entity and index writes that were required to create the entity. - The Prospective Search API is available in Java for all applications. This API is still experimental, so applications will be limited to a maximum of 1000 subscriptions. - We made a classloading improvement that we expect to help loading request latencies for projects with large numbers of jars. - Added support for the set_default_version flag to Appcfg. - The Java Remote API now recognizes the HTTP_X_APPENGINE_INBOUND_APPID. This means that the Datastore Admin copy functionality will work when using Java's Remote API with the destination app. - Fixed an issue that incorrectly allowed creation of tasks with whitespace in the url. - Fixed the error message for transaction not found to be more descriptive. - Fixed an issue with the dev appserver's local Blobstore implementation trying to modify an immutable collection. http://code.google.com/p/googleappengine/issues/detail?id=3081 - Fixed an SDK issue where CONFIG, FINE, FINER, FINEST logging messages were not displayed. http://code.google.com/p/googleappengine/issues/detail?id=4591 -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] App Engine SDK 1.5.4 released!
Is there an ETA on when this release will be available in Maven? On Mon, Sep 12, 2011 at 10:31 PM, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hey everyone, Just wanted to let you all know that App Engine SDK 1.5.4 has been released. The official announcement is here: http://googleappengine.blogspot.com/2011/09/app-engine-154-sdk-release.html The full release notes are below: Java 1.5.4 = - You can now specify the maximum size for a blob in BlobstoreService.createUploadUrl(). - Zigzag merge join queries will now continue scanning up to the 30 second Datastore query deadline. For zigzag queries that used to generate DatastoreNeedIndexException, many will now succeed. A small percentage will now instead timeout. - The SDK datastore viewer in the dev console now displays the number of Write Ops for each entity. Write Ops are the total number of entity and index writes that were required to create the entity. - The Prospective Search API is available in Java for all applications. This API is still experimental, so applications will be limited to a maximum of 1000 subscriptions. - We made a classloading improvement that we expect to help loading request latencies for projects with large numbers of jars. - Added support for the set_default_version flag to Appcfg. - The Java Remote API now recognizes the HTTP_X_APPENGINE_INBOUND_APPID. This means that the Datastore Admin copy functionality will work when using Java's Remote API with the destination app. - Fixed an issue that incorrectly allowed creation of tasks with whitespace in the url. - Fixed the error message for transaction not found to be more descriptive. - Fixed an issue with the dev appserver's local Blobstore implementation trying to modify an immutable collection. http://code.google.com/p/googleappengine/issues/detail?id=3081 - Fixed an SDK issue where CONFIG, FINE, FINER, FINEST logging messages were not displayed. http://code.google.com/p/googleappengine/issues/detail?id=4591 -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] App Engine SDK 1.5.4 released!
ETA: tomorrow noon PST /dmc On Mon, Sep 12, 2011 at 7:52 PM, Jens Stoltenberg jstolt...@gmail.comwrote: Is there an ETA on when this release will be available in Maven? On Mon, Sep 12, 2011 at 10:31 PM, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hey everyone, Just wanted to let you all know that App Engine SDK 1.5.4 has been released. The official announcement is here: http://googleappengine.blogspot.com/2011/09/app-engine-154-sdk-release.html The full release notes are below: Java 1.5.4 = - You can now specify the maximum size for a blob in BlobstoreService.createUploadUrl(). - Zigzag merge join queries will now continue scanning up to the 30 second Datastore query deadline. For zigzag queries that used to generate DatastoreNeedIndexException, many will now succeed. A small percentage will now instead timeout. - The SDK datastore viewer in the dev console now displays the number of Write Ops for each entity. Write Ops are the total number of entity and index writes that were required to create the entity. - The Prospective Search API is available in Java for all applications. This API is still experimental, so applications will be limited to a maximum of 1000 subscriptions. - We made a classloading improvement that we expect to help loading request latencies for projects with large numbers of jars. - Added support for the set_default_version flag to Appcfg. - The Java Remote API now recognizes the HTTP_X_APPENGINE_INBOUND_APPID. This means that the Datastore Admin copy functionality will work when using Java's Remote API with the destination app. - Fixed an issue that incorrectly allowed creation of tasks with whitespace in the url. - Fixed the error message for transaction not found to be more descriptive. - Fixed an issue with the dev appserver's local Blobstore implementation trying to modify an immutable collection. http://code.google.com/p/googleappengine/issues/detail?id=3081 - Fixed an SDK issue where CONFIG, FINE, FINER, FINEST logging messages were not displayed. http://code.google.com/p/googleappengine/issues/detail?id=4591 -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- David Chandler Developer Programs Engineer, GWT+GAE w: http://code.google.com/ b: http://turbomanage.wordpress.com/ b: http://googlewebtoolkit.blogspot.com/ t: @googledevtools -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] App Engine SDK 1.5.4 released!
Cool. Thanks. Will datanucleus-appengine for Maven also need upgrading? I think it's at 1.0.9 at the moment. dependency groupIdcom.google.appengine.orm/groupId artifactIddatanucleus-appengine/artifactId version1.0.9/version /dependency On Tue, Sep 13, 2011 at 2:05 AM, David Chandler drfibona...@google.comwrote: ETA: tomorrow noon PST /dmc On Mon, Sep 12, 2011 at 7:52 PM, Jens Stoltenberg jstolt...@gmail.comwrote: Is there an ETA on when this release will be available in Maven? On Mon, Sep 12, 2011 at 10:31 PM, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hey everyone, Just wanted to let you all know that App Engine SDK 1.5.4 has been released. The official announcement is here: http://googleappengine.blogspot.com/2011/09/app-engine-154-sdk-release.html The full release notes are below: Java 1.5.4 = - You can now specify the maximum size for a blob in BlobstoreService.createUploadUrl(). - Zigzag merge join queries will now continue scanning up to the 30 second Datastore query deadline. For zigzag queries that used to generate DatastoreNeedIndexException, many will now succeed. A small percentage will now instead timeout. - The SDK datastore viewer in the dev console now displays the number of Write Ops for each entity. Write Ops are the total number of entity and index writes that were required to create the entity. - The Prospective Search API is available in Java for all applications. This API is still experimental, so applications will be limited to a maximum of 1000 subscriptions. - We made a classloading improvement that we expect to help loading request latencies for projects with large numbers of jars. - Added support for the set_default_version flag to Appcfg. - The Java Remote API now recognizes the HTTP_X_APPENGINE_INBOUND_APPID. This means that the Datastore Admin copy functionality will work when using Java's Remote API with the destination app. - Fixed an issue that incorrectly allowed creation of tasks with whitespace in the url. - Fixed the error message for transaction not found to be more descriptive. - Fixed an issue with the dev appserver's local Blobstore implementation trying to modify an immutable collection. http://code.google.com/p/googleappengine/issues/detail?id=3081 - Fixed an SDK issue where CONFIG, FINE, FINER, FINEST logging messages were not displayed. http://code.google.com/p/googleappengine/issues/detail?id=4591 -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- David Chandler Developer Programs Engineer, GWT+GAE w: http://code.google.com/ b: http://turbomanage.wordpress.com/ b: http://googlewebtoolkit.blogspot.com/ t: @googledevtools -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] App Engine SDK 1.5.4 released!
Nope, still 1.0.9 On Mon, Sep 12, 2011 at 9:11 PM, Jens Stoltenberg jstolt...@gmail.comwrote: Cool. Thanks. Will datanucleus-appengine for Maven also need upgrading? I think it's at 1.0.9 at the moment. dependency groupIdcom.google.appengine.orm/groupId artifactIddatanucleus-appengine/artifactId version1.0.9/version /dependency On Tue, Sep 13, 2011 at 2:05 AM, David Chandler drfibona...@google.comwrote: ETA: tomorrow noon PST /dmc On Mon, Sep 12, 2011 at 7:52 PM, Jens Stoltenberg jstolt...@gmail.comwrote: Is there an ETA on when this release will be available in Maven? On Mon, Sep 12, 2011 at 10:31 PM, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hey everyone, Just wanted to let you all know that App Engine SDK 1.5.4 has been released. The official announcement is here: http://googleappengine.blogspot.com/2011/09/app-engine-154-sdk-release.html The full release notes are below: Java 1.5.4 = - You can now specify the maximum size for a blob in BlobstoreService.createUploadUrl(). - Zigzag merge join queries will now continue scanning up to the 30 second Datastore query deadline. For zigzag queries that used to generate DatastoreNeedIndexException, many will now succeed. A small percentage will now instead timeout. - The SDK datastore viewer in the dev console now displays the number of Write Ops for each entity. Write Ops are the total number of entity and index writes that were required to create the entity. - The Prospective Search API is available in Java for all applications. This API is still experimental, so applications will be limited to a maximum of 1000 subscriptions. - We made a classloading improvement that we expect to help loading request latencies for projects with large numbers of jars. - Added support for the set_default_version flag to Appcfg. - The Java Remote API now recognizes the HTTP_X_APPENGINE_INBOUND_APPID. This means that the Datastore Admin copy functionality will work when using Java's Remote API with the destination app. - Fixed an issue that incorrectly allowed creation of tasks with whitespace in the url. - Fixed the error message for transaction not found to be more descriptive. - Fixed an issue with the dev appserver's local Blobstore implementation trying to modify an immutable collection. http://code.google.com/p/googleappengine/issues/detail?id=3081 - Fixed an SDK issue where CONFIG, FINE, FINER, FINEST logging messages were not displayed. http://code.google.com/p/googleappengine/issues/detail?id=4591 -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- David Chandler Developer Programs Engineer, GWT+GAE w: http://code.google.com/ b: http://turbomanage.wordpress.com/ b: http://googlewebtoolkit.blogspot.com/ t: @googledevtools -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- David Chandler Developer Programs Engineer, GWT+GAE w: http://code.google.com/ b: http://turbomanage.wordpress.com/ b: http://googlewebtoolkit.blogspot.com/ t: @googledevtools -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to
Re: [appengine-java] App Engine SDK 1.5.4 released!
Any directions about where to specify HTTP_X_APPENGINE_INBOUND_APPID? Besides, can you give us additional information about a classloading improvement? For instance, shall we still jar our classes trying to reduce timeouts during loading spikes? -- Marcelo On Mon, Sep 12, 2011 at 6:31 PM, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hey everyone, Just wanted to let you all know that App Engine SDK 1.5.4 has been released. The official announcement is here: http://googleappengine.blogspot.com/2011/09/app-engine-154-sdk-release.html The full release notes are below: Java 1.5.4 = - You can now specify the maximum size for a blob in BlobstoreService.createUploadUrl(). - Zigzag merge join queries will now continue scanning up to the 30 second Datastore query deadline. For zigzag queries that used to generate DatastoreNeedIndexException, many will now succeed. A small percentage will now instead timeout. - The SDK datastore viewer in the dev console now displays the number of Write Ops for each entity. Write Ops are the total number of entity and index writes that were required to create the entity. - The Prospective Search API is available in Java for all applications. This API is still experimental, so applications will be limited to a maximum of 1000 subscriptions. - We made a classloading improvement that we expect to help loading request latencies for projects with large numbers of jars. - Added support for the set_default_version flag to Appcfg. - The Java Remote API now recognizes the HTTP_X_APPENGINE_INBOUND_APPID. This means that the Datastore Admin copy functionality will work when using Java's Remote API with the destination app. - Fixed an issue that incorrectly allowed creation of tasks with whitespace in the url. - Fixed the error message for transaction not found to be more descriptive. - Fixed an issue with the dev appserver's local Blobstore implementation trying to modify an immutable collection. http://code.google.com/p/googleappengine/issues/detail?id=3081 - Fixed an SDK issue where CONFIG, FINE, FINER, FINEST logging messages were not displayed. http://code.google.com/p/googleappengine/issues/detail?id=4591 -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [google-appengine] About the mail api again, the surrounding services gae is proud of
makes sense but he needs read receipt more than anything else a bounced back message could indicate non-delivery but not 100% sure though tapir's main concern is did they read it or not On Mon, Sep 12, 2011 at 2:55 AM, Tim Hoffman zutes...@gmail.com wrote: Hi That will only tell you they read it, if they have images enabled by default. I don't for instance in my email. If they don't read it with images enabled you can't tell if it was not delivered or just unread. I wouldn't expect exceptions to be raised from bogus email addresses unless they are malformed, but I would expect a bounce email back to admin email account. Which would be an indication of non-delivery. Rgds Tim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/e0JB0l07k-kJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Milosh Zorica http://www.linkedin.com/in/miloshzorica phone: +44 20 8144 5294 e-mail: miloshzor...@gmail.com skype: milosh.zorica -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Datastore viewer not showing one of the properties for my model
Yeah, I got it. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/etsZAp2tVVYJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] About the mail api again, the surrounding services gae is proud of
HI Milosh Unfortunately there is no guarunteed way to be sure someone has read the mail sent. In fact it would in some cases be considered an invasion of privacy ;-) If's not fundamentally part of email. and read receipt implementations are very much mail server dependent. The most you can say about any sent email (after a number of days) with correctly operating mail servers is that it was delivered to a mail server ;-) And the OP was complaining about not having exceptions raised when non-existent emails where used to send email. Which is definately not something I would expect would happen via the mail api. OP said I found there are not exceptions thrown even the recipient email addresses don't exist at all. I am not sure how the mail api could possibly do this, as you may not get the fact that the email bounced because of a non existing email address for days. Rgds Tim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/mjyFNmD05M4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] About the mail api again, the surrounding services gae is proud of
nicely put, tim probably having more alternative ways to verify users is the way to go On Mon, Sep 12, 2011 at 3:23 AM, Tim Hoffman zutes...@gmail.com wrote: HI Milosh Unfortunately there is no guarunteed way to be sure someone has read the mail sent. In fact it would in some cases be considered an invasion of privacy ;-) If's not fundamentally part of email. and read receipt implementations are very much mail server dependent. The most you can say about any sent email (after a number of days) with correctly operating mail servers is that it was delivered to a mail server ;-) And the OP was complaining about not having exceptions raised when non-existent emails where used to send email. Which is definately not something I would expect would happen via the mail api. OP said I found there are not exceptions thrown even the recipient email addresses don't exist at all. I am not sure how the mail api could possibly do this, as you may not get the fact that the email bounced because of a non existing email address for days. Rgds Tim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/mjyFNmD05M4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Milosh Zorica http://www.linkedin.com/in/miloshzorica phone: +44 20 8144 5294 e-mail: miloshzor...@gmail.com skype: milosh.zorica -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] About the mail api again, the surrounding services gae is proud of
an interesting find though not neccessarily related to the OP's problem http://mixpanel.com/api/docs/guides/email-analytics On Mon, Sep 12, 2011 at 3:26 AM, milosh zorica miloshzor...@gmail.com wrote: nicely put, tim probably having more alternative ways to verify users is the way to go On Mon, Sep 12, 2011 at 3:23 AM, Tim Hoffman zutes...@gmail.com wrote: HI Milosh Unfortunately there is no guarunteed way to be sure someone has read the mail sent. In fact it would in some cases be considered an invasion of privacy ;-) If's not fundamentally part of email. and read receipt implementations are very much mail server dependent. The most you can say about any sent email (after a number of days) with correctly operating mail servers is that it was delivered to a mail server ;-) And the OP was complaining about not having exceptions raised when non-existent emails where used to send email. Which is definately not something I would expect would happen via the mail api. OP said I found there are not exceptions thrown even the recipient email addresses don't exist at all. I am not sure how the mail api could possibly do this, as you may not get the fact that the email bounced because of a non existing email address for days. Rgds Tim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/mjyFNmD05M4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Milosh Zorica http://www.linkedin.com/in/miloshzorica phone: +44 20 8144 5294 e-mail: miloshzor...@gmail.com skype: milosh.zorica -- Milosh Zorica http://www.linkedin.com/in/miloshzorica phone: +44 20 8144 5294 e-mail: miloshzor...@gmail.com skype: milosh.zorica -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Having problem with Text property on Entity Class using JPA
Hello, I have succesfully created an entity bean to store my properties, i can save entity on database easily. But then i need to store long texts so App Engine offered me to use Text property instead of String. I have added Text property inside my entity bean and enhanced class like i had done before. When i save my entity, i got the error says: java.lang.IllegalArgumentException: out of field index: 7 I got 6 properties and + 1 Text property which causes this error. Because when i delete Text property and enhance classes and save again, no errors. Have you ever used Text property in an entity bean using JPA and got this problem? Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Please add MIN idle instances and MAX total instances
Actually that's what Min-Pending-Latency is for: It will limit the number of instances that the scheduler spawns to handle incoming requests, by allowing them to sit up to Min-Pending-Latency in the pending queue waiting for an instance to be available before spawning a new one. Setting Max-Active-Instance to 1 (if this setting existed) would have a similar effect than maxing Min-Pending-Latency to 15s: request would wait in the pending queue for that instance to be available. Hope that helps to understand this performance setting better. On Sun, Sep 11, 2011 at 8:58 PM, Daniel Florey daniel.flo...@gmail.com wrote: After thinking about this for a while I think I would prefer to just have a min and max instances slider. I am running different apps on app engine and for the larger ones I'd like to have a min instances = 10 and max instances = unlimited to be able to scale up fast once heavy traffic occurs. For the smaller apps I'd like to set max instances to a low value to limit scaling. For free apps I'd like to set max instances to 1. I have no clue if this is technically doable but it's at least the easiest to understand for me... -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/gbrqNPQipOAJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Johan Euphrosine (proppy) Developer Programs Engineer Google Developer Relations -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Communication between AppEngine and PhoneGap/JQM
Hi, I've already got a GAE application, and I'm creating a mobile application using Phonegap + JqueryMobile (HTML, CSS, JS). Of course, both applications must communicate (a lot) together. I won't have trouble to create a phoneGap app, but the problem concerns the communication between theses AppEngine and PhoneGap apps. The mobile PhoneGap app will have to read and write data on the bigtable google database (I'm using the Objectify framework (not JDO or JPA) but I guess this changes nothing). I found part of answers here: - Using JSON but with php and mysql: http://samcroft.co.uk/2011/updated-loading-data-in-phonegap-using-jquery-1-5/ - Restlet API for appEngine: http://wiki.restlet.org/docs_2.0/13-restlet/275-restlet/252-restlet.html but I'm still confused (due to a very low experience in this area, I'm not a developper, be kind ^^) Would you know an example/tutorial which show a full solution using AppEngine (or at least Java...) and PhoneGap/Jquery? Otherwise, just some guidance for me ? Where should I take a look ? In my case, performance is important but elegance and simplicity are more. Thanks a lot! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Instance Hours, Python Concurrency, and Regret
What also could reduce the instance hours billed is a slider that sets the instance idle time. The time an instance is kept alive idle is at the moment 10min. My loading request time is about 1.5 sec (webapp). It would be very helpful to have a slider in the Application Settings where I can adjust the idle time in increments of 5 or 10 seconds. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Please add MIN idle instances and MAX total instances
Johan, thanks for your reply. I think I more or less got how the current settings influence the scheduler. But I guess you agree that it would be much much simpler from a developers view to simply have two sliders: - one specifying the min and max instances for the app - another one for specifying how aggressively the app should scale (from slow to fast) The number of questions regarding the scheduler indicates that the current approach is not very intuitive from a users point of view - even though it may reflect the internals of the current scheduler implementation best from your side -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/Sx_5flfi8ycJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Blobstore storage per namespace / tenant
I need to be able to monitor storage per tenant so I can charge accordingly but it looks like namespaces are not supported by the blobstore and this needs to be handled by application code. Has anyone here implemented something like this before? Would appreciate pointers in this regard. Thanks, Krishna -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/eMZJ0QAQ4tUJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Please add MIN idle instances and MAX total instances
Except the latency slider is not really enforced. That's the reason why developers want the opportunity to actually restrict new instances. Requests never reach 15s on my app. Still new ones are spawned. These are _active_ for some time before they are killed. Thus, for that period, we are billed regardless of the min. _idle_ instances settings. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/474B_stqnnEJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Please add MIN idle instances and MAX total instances
IMO Min-Pending-Latency and Max-Instances should be complementary. For example: - let min-pending latency be around 2 second for my app ie spawn instances on-demand if pending-latency is over 2 seconds - but if we are already running 10 instances, then allow max-pending-latency reach up to 15 seconds, before you start rejecting requests. Really, this should help us with the following: - your app suddenly gets very popular, and you don't want to go broke with a ridiculously high bill. The max-daily-budget is a bad solution because it shuts down your app till the end of the day (as opposed to giving you controls so you can throttle your app). -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/FOrFw1EeFcoJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Please add MIN idle instances and MAX total instances
I wrote a blog post about this before http://blog.ugorji.net/2011/09/objective-gripes-with-new-google-app.html In thinking more, it seems like the following knobs should be sufficient to give us control over our budgets, and have graceful degradation of performance when things get high. - max-total-instances - max-idle-instance (which can be set to zero. So any unused instances should be shut down. Folks wanting always-on can set this to a higher value.) - min-pending-latency (this is the default value at which a new instance is started. If num-instances == max-total-instances, then allow the pending-latency to go up to either 15 or 30 seconds before returning a 503 Service Unavailable). This could allow Google the simplicity of a minimum set of knobs to start, while allowing us control our budget and degrade gracefully. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/0gedf-B1-u4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Adding 5GB of Blobstore data to App Engine over 3 three days costs $61 by end of year?
Niklas, I can see from your app2 image that your Blobstore data is not getting double charged as stored data. So Strom's estimate of $20 for the year sounds correct. Thanks for showing your estimated bills (they look quite reasonable by the way). Regards, Jens On Mon, Sep 12, 2011 at 3:25 AM, Niklas Rosencrantz nikla...@gmail.comwrote: I shut down a 10 GB virtual server I used to pay godaddy.com that hosted my Java, python and PHP projects and of course I won't go back to Linux/Apache/Mysql...It's a technical challenge if not for the money I can take a number of measures to adapt to appspot pricing: - Instances (find what forces a new instance and make it with fewer) - Storage (move whats not needed i.e. clean and move data from 2008 ..Only keep last 60 or 90 days in datastore / blobstore or other solution to let object expire while still being accessible from other locations if it must) - Read /writes (cache with 304 not-modified, memcache or instance variables) My billing page says 0 billable for one app and 0.13 for another where usage report says 0.01 billable today. $0.01 to $0.13 is factor 13. A factor 13 change is large but only relative since my alternative is a virtual server which costs about $30 monthly (http://www.godaddy.com/hosting/virtual-dedicated-servers.aspx) I'm happy with appspot and I don't want a virtual server and Amazon seems to have a similar solution like virtual servers with an RDBMS and OS and RAM and harddrive configurations. If my apps get popular I can't expect to host them that cheap anyway. Regards, Niklas On Sun, Sep 11, 2011 at 7:04 PM, Strom xxst...@gmail.com wrote: No it is not correct. Blobstore is not counted as datastore data. Have a quick look at your billing history page for confirmation. On Sep 11, 8:35 pm, Chris Collins xop...@gmail.com wrote: Jens, Your original calculation is correct - $61/year for 15 GB of blobstore data. The reason is, as you pointed out, that the data is counted both as blobstore data and stored data/datastore data. HTH, Chris On Fri, Sep 9, 2011 at 10:37 PM, Niklas Rosencrantz nikla...@gmail.com wrote: In fact the new pricing makes one of my apps even more cost-efficient: It used to cost 1 cent a day and with the new pricing it won't cost anything since it's less than 5 GB and blobstore. So the new pricing doesn't make everything more expensive while on average it might. Cheers, Niklas -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/kx1OPLc8zgkJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Blobstore storage per namespace / tenant
At the moment the best you can do is use a blob type column - which is obviously much more restrictive in terms of size. On Mon, Sep 12, 2011 at 12:46 PM, Krishna shrikrishna.sh...@gmail.comwrote: I need to be able to monitor storage per tenant so I can charge accordingly but it looks like namespaces are not supported by the blobstore and this needs to be handled by application code. Has anyone here implemented something like this before? Would appreciate pointers in this regard. Thanks, Krishna -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/eMZJ0QAQ4tUJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] same app started on 2 different ports do not share same entities?!
hi, if i start the same app at the same time on 2 different ports and create an entity on one of them. why does it not show up on the second? this was working some time ago. my workflow is: - upload a binary to the blobstore. - contact another web service with the necessary data to download the binary and process it - reupload the processed binary to the app to be able to test this locally i need(ed) to start 2 apps on different ports so one uploaded and the other was able to serve the binary while the other one was waiting for the processed data. this does not work any more... why? thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Is the Datastore Admin not namespace-enabled?
I have a Java app with multiple namespaces and no data in the default namespace. But the Datastore Admin shows nothing while Datastore Viewer shows the relevant data broken out by namespace. Does Datastore Admin not display data outside the default namespace? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Can't post to google-appengine-python
Don't know where else to post this. Occasionally over the past year I've tried to post to google-appengine-python, except it just goes straight to the moderator queue and is never approved. I've been a member of the group for well over a year (I have posts dating back to March 2010) but apparently I'm considered a new user as the group's About page says only posts from new users are moderated. I always end up just posting here instead, but that's not usually the best fit for my post if it's python-specific. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/AcvpMUEPIDoJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Sqlite3 for backends
Hi there Is there any plan to support the sqlite3 module in python in GAE? It would be very useful if someone would want to build an SQL like backend. -Andrin -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: About the mail api again, the surrounding services gae is proud of
Tapir, We use the same system. After a week we delete all records without activation enabled. Nothing to do about it. Make it clear in the form that the user has to enter a valid email address. We have a rate of 10% not activated. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/Wt_4faAnEHwJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: About the mail api again, the surrounding services gae is proud of
I like to make people enter their email address twice, like a password. It's amazing how many people misspell their own email. On Sep 12, 9:27 am, de Witte wd.dewi...@gmail.com wrote: Tapir, We use the same system. After a week we delete all records without activation enabled. Nothing to do about it. Make it clear in the form that the user has to enter a valid email address. We have a rate of 10% not activated. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] /_ah/login returns status 500
Hi, I have an android application that authenticates to the app engine with the a google account. I am experiencing a very annoying issue. Once in a while I start getting status 500 when posting /_ah/login?... to my app. I just get the regular server error message : Error: Server Error The server encountered an error and could not complete your request. If the problem persists, please reporthttp://code.google.com/appengine/community.html your problem and mention this error message and the query that caused it. currently I am unable to get non 500 status from app engine. This is not the first time this has happened and it just goes away by itself after more than a few hours. The app engine status page does not show there is any issue. The last time this happened, I did see a few posts in this group and in app engine java group about this issue but there was no response by any Googler. Is anyone using Google authentication on a production environment? Is it flakey as it seems? Any help will be appreciated (before I re write my authentication process). Thanx,Lior -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/EvBFE-BCEYwJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Purging Datastore Content
Last Saturday I decided to cleanup data in my GAE app to avoid getting billed for it in the future, as those $0.02 bills on my cc are really annoying. The app is basically dormant so what could go wrong. So I selected a collection in the datastore admin with about 1.5m records and 500mb and confirmed Delete Entities. Shortly afterwards the app started spinning up instances. Also after a minute or so I reallized that the app was eating up cpu quota like crazy and deleted the tasks from task queue as soon I started to get into the billable zone. Today, two days after, I got back to the dashboard to see the result: nothing changed at all. And those are the numbers from the Datastore Statistics. From the Quota Details page: Total Stored Data [image: 15%] 15% 1.64 of 11.00 GBytes Billing history yesterday: *Stored Data:* $0.005/GByte-day 1.65 1.00 0.65 $0.01 This is exactly as has been before the datastore admin operation. However, when I get to the datastore statistics or datastore admin the numbers *did* change: *Breakdown by Property Type*Property Type Size Integer 151 MBytes Date/Time 62 MBytes Blob 37 MBytes String 12 MBytes NULL 353 KBytes Key 111 KBytes Boolean 92 KBytes Text 23 KBytes Metadata 413 MBytes About* 675 MB *(also matches with the values shown in the datastore admin). So my first question would be is why do I get billed for more data than I store? Next I checked how I would be doing with the new pricing model. I'd expect that this kind of task could propable be done with a single backend instance so I would not have the cpu quota problem. Again I got disappointed. *Old Model:* *CPU Time:* $0.10/CPU hour 8.77 6.50 2.27 $0.23 Thats $0.23 on cpu *New Model:* *Datastore Writes: * $1.00/Million Ops 2.80 0.05 2.75 $2.75*Small Datastore Operations:* $0.10/Million Ops 1.46 0.05 1.41 $0.15 Thats $2.90 total billed on datastore ops. No additional instance costs though. There have been 2.8m writes which makes it expensive. I deleted about 1.4m records so I'm not sure why that number is doubled, probably because of index updates? After doing some math I figure out that it would take 725 days until I'd start saving on stored data costs for compensating the write costs involved deleting my data. Looks like you better purge your data stores before the new pricing model goes live if you have some cpu quota left. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/8fkcWDfTOH8J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Is the Datastore Admin not namespace-enabled?
I've found that the Datastore Admin tool is not namespace-enabled. I tried to delete all entities of a kind (but in multiple namespaces) and only the default namespace was deleted. On Sep 12, 7:11 am, Jens Stoltenberg jstolt...@gmail.com wrote: I have a Java app with multiple namespaces and no data in the default namespace. But the Datastore Admin shows nothing while Datastore Viewer shows the relevant data broken out by namespace. Does Datastore Admin not display data outside the default namespace? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Is the Datastore Admin not namespace-enabled?
Yes I've encountered the same. I guess we have to write a custom mapper to delete entities outside the default namespace. That sucks. On Mon, Sep 12, 2011 at 4:38 PM, Jason Collins jason.a.coll...@gmail.comwrote: I've found that the Datastore Admin tool is not namespace-enabled. I tried to delete all entities of a kind (but in multiple namespaces) and only the default namespace was deleted. On Sep 12, 7:11 am, Jens Stoltenberg jstolt...@gmail.com wrote: I have a Java app with multiple namespaces and no data in the default namespace. But the Datastore Admin shows nothing while Datastore Viewer shows the relevant data broken out by namespace. Does Datastore Admin not display data outside the default namespace? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Sqlite3 for backends
Hi Andrin, The remote system is not writable, in case googlers add the module to python you could read the Sqlite3 files, but you couldn't write new data to them. Ernesto -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/pCKZGIUe5v0J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: The Unofficial Google App Engine Price Change FAQ
Yep, Tim is right. Thanks again Tim for reformulating the logic and making it easy to understand. } Now I don't know what would happen if max-idle-instances was set } to automatic, whether this means 1 (no you wouldn't be } billed), infinity (yes you'd be billed for all 100), Right now it's the latter. If max-idle-instances is set to automatic then it is assumed to be infinity. On Sun, Sep 11, 2011 at 3:13 AM, Tim meer...@gmail.com wrote: On Saturday, 10 September 2011 19:30:13 UTC+1, Jeff Schnitzer wrote: Is this really true, that if you burst to 100 instances you won't get the 15-minute charges? Even if you have it set to automatic? I'd like to hear an official voice on this matter. See Jon McAlister's detailed explanations of billing for particular scenarios in this thread the min instace time is 24 hours? https://groups.google.com/d/topic/google-appengine/W-17IhgwrLI/discussion and my followup based on his answers, which he then confirms as accurate (which you've linked to your FAQ now but I repeat here for others) 15 minutes idle - my new understanding of how it works https://groups.google.com/forum/?pli=1#!topic/google-appengine/zuRXAphGnPk and to quote Jon when someone asked about instances being started quote: href = https://groups.google.com/d/msg/google-appengine/zuRXAphGnPk/U3AgXzltrsoJ In any event [...] this is why max-idle-instances is important. It ensures that you are not held accountable for scheduler behaviors such as these listed. When you set it, the billable-instances-rate is determined by max-idle-instances (a setting you directly control) and active-instances-rate (again, hopefully something you control). The nuances of how the scheduler spins up extra instances to minimize latency and provide spare capacity are not part of the formula, other than their effect on your serving latency and reliability Now I don't know what would happen if max-idle-instances was set to automatic, whether this means 1 (no you wouldn't be billed), infinity (yes you'd be billed for all 100), some kind of dynamic adjustment (you might be billed for some of them depending on how many idle instances have typically been needed to run your app is the previous hours/days/month) or what... but I think automatic is for heavy traffic sites who always have loads of active instances, but that's why my explanations talk about having set max-idle-instances to a distinct number. -- T -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/XJNxgBKeTfEJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: About the mail api again, the surrounding services gae is proud of
I had once read in one of the threads here that email from gae gets marked as spam on yahoo. Apart from that, it was also mentioned by one of the GAE devs not to rely on this for mission critical emails. There are other services that would suffice your need. Having said that, have you tried registering on your site and checking if the email is being sent? How do you know that the reason for them not confirming is because they did not receive the confirmation email? - Users might be just lazy to confirm the subscription - Your email might have landed in their spam folder - They might have provided you with a fake email - They might have misspelled their email - They might think your email is a welcome email and hence just ignore it - see thishttp://bvckup.tumblr.com/post/9101329123/please-confirm-your-email-address Having said that, I'm not implying GAE is indeed sending all the email, just giving you more options to explore :) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/ho1Sa4e0UaAJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Min idle instances setting not working at all?
What's the app-id? On Sun, Sep 11, 2011 at 9:53 AM, Pol-Online i...@pol-online.net wrote: Hi, Because we are about to launch our app very soon, I increased the number of idle instances from 1 to 5 yesterday and things looked correct in the Dashboard. Then this morning, in the Dashboard I see 2 idle instances and this: The spikes correspond to cron tasks running hourly I assume. Anyway, it looks like either the graph is wrong or the setting doesn't work, or the definition of what the setting does is wrong, because clearly it not stable at 5. I just activated Always On to work around the issue, so now it's back to 3+1. -Pol Pol-Online i...@pol-online.net -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. PastedGraphic-11.png
Re: [google-appengine] Re: Long running tasks impact on scheduler ?
Backends are one good way to do this. You can direct tasks at a backend, and then control the number of instances for that backend directly. http://code.google.com/appengine/docs/python/backends/overview.html Once the billing rollout is complete, the treatment of tasks and non-task requests, regardless of their latency, will become pretty much the same. The scheduler will try to find an instance for them. The only difference for tasks is that by default the scheduler will accept a bit more pending latency (proportional to the average request latency for that queue) than it would for non-task requests. The 1s rule (although in reality, it was much more nuanced) will be removed, the app, regardless of request latencies, will be able to get as many instances as it wants (and can pay for). If you want to limit the throughput of a task (to limit the number of instances it turns up), use the queue configuration to do so: http://code.google.com/appengine/docs/python/config/queue.html#Queue_Definitions On Sat, Sep 10, 2011 at 10:41 AM, Robert Kluin robert.kl...@gmail.com wrote: I'd very much like to know how long-running (over 1000ms) requests are treated by the new scheduler as well. Previously I believe they were basically ignored, and hence would not cause new instances to be spun up. And, yes I would very much like to have control over how task queues are treated with regards to the scheduler. We've currently got the fail-fast header (X-AppEngine-FailFast), which helps quite a bit. But, I'd really love to let my queues spin up new instances once the latency hits a certain point while always serving user requests with high priority. Robert On Sat, Sep 10, 2011 at 12:04, stevep prosse...@gmail.com wrote: +1 However please include sub-second tasks Just today I was looking at my logs/appstats. A client new recod write function I have that consists of three separate new kinds being put. It seems to run consistently at 250-300ms per HR put(). These occur serially: first one in my on-line handler, second in a high-rate/ high-token task queue, third in a low-rate/low-token queue. It is fine if the second and third puts occur minutes after the first. Seems much better than a 750 ms on-line handler function. Looking at my logs, nearly every write I do for indexed kinds is in this ballpark for latency. Only one on-line handler task is up around 500 ms because I have to do two puts in it. Everything else is 300 ms or less. So I am very happy with this setup. The recent thread where Brandon/John analyzed high instance rates shows what might happen if average latency viewed by the scheduler is skewed by a few very high latency functions. (Fortunately for my read/query/write client needs, I can avoid big OLH functions, but it is a serious design challenge.) However, the downside right now is that I do not know how the Task Queue scheduler interacts with the Instance Scheduler. My imagined ideal would be for developers to eventually be able to specify separate TQ instances (I believe Robert K. asked for this when he suggested TQ calls could be made to a separate version.) The Scheduler for these separate TQ instances would need to analyze cumulative pending queue tasks (I think the current TQ Scheduler does some of this), and only spawns new instances when the cumulative total exceeded a developer set value -- which would allow minute values rather than seconds. thanks, stevep On Sep 10, 6:03 am, John supp...@weespr.com wrote: I'd like to know what is the impact of tasks on the scheduler. Obviously tasks have very high latency (up to 10 minutes, but not using much cpu - mostly I/O). What is their impact on the scheduler if any ? Would be nice to have some sample use cases on how the scheduler is supposed to react. For example if I have 1 task which takes 1 minute, spawn every 1s, vs every 10s, vs 1 min ? Since the tasks use very low cpu, technically an instance could easily run 60 of them concurrently so 1 qps with 1-min tasks could take only one instance. But I doubt the scheduler would spawn only one instance. App Engine team, any insights ? Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Min idle instances setting not working at all?
Nevermind, I remember, it's everpix-alpha. I see that min-idle-instances was removed on 2011/08/31-19:49:59 and then set to 3 on 2011/09/11-09:47:38. So, it wasn't on when you emailed but is on now. Your instances graph now looks correct. On Mon, Sep 12, 2011 at 10:24 AM, Jon McAlister jon...@google.com wrote: What's the app-id? On Sun, Sep 11, 2011 at 9:53 AM, Pol-Online i...@pol-online.net wrote: Hi, Because we are about to launch our app very soon, I increased the number of idle instances from 1 to 5 yesterday and things looked correct in the Dashboard. Then this morning, in the Dashboard I see 2 idle instances and this: The spikes correspond to cron tasks running hourly I assume. Anyway, it looks like either the graph is wrong or the setting doesn't work, or the definition of what the setting does is wrong, because clearly it not stable at 5. I just activated Always On to work around the issue, so now it's back to 3+1. -Pol Pol-Online i...@pol-online.net -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. PastedGraphic-11.png
Re: [google-appengine] Instance Hours, Python Concurrency, and Regret
That's disappointing. We'd be better off without any kind of pre-emption, only switching on I/O. Jeff On Sun, Sep 11, 2011 at 9:44 PM, Steve unetright.thebas...@xoxy.net wrote: The old 2.5/2.7 GIL hurts performance any time there is more than one thread that is doing python work. Maybe you'd like to read up on how the old GIL burns cpu time in excess signalling and failed lock acquisition: http://www.dabeaz.com/python/NewGIL.pdf -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/KKh6yIezaVoJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Re-entrancy / deadlock bug with scheduler?
I just made a change to your app's configuration. Could you retry your repro? Did this help? Alternatively, is there anything I could do to trigger the repro? On Sat, Sep 10, 2011 at 11:02 PM, Pol i...@pol-online.net wrote: Still happening right now. I can repro pretty easily: schedule ~10 image processing tasks in a queue, and 1 to 3 often fail due to that re-entrancy bug. Then after they retry automatically and after a few times usually go through. 5 instances idle / running, no load on the app: only 1 user currently. It really looks as if the scheduler when getting the callback from the EC2 box is trying to serve it from the same instance from which urlfetch() is running: there must be a bug where the scheduler thinks the instance is not busy or something. If you look at the distribution of requests, something's clearly wrong as 1 instance gets the majority of the traffic. QPS* Latency* Requests Errors Age Memory Availability 0.000 0.0 ms 7 0 0:03:30 17.7 MBytes Dynamic 0.000 0.0 ms 152 1 0:26:56 68.6 MBytes Dynamic 0.000 0.0 ms 6 0 0:32:22 23.9 MBytes Dynamic 0.000 0.0 ms 4 0 0:32:12 24.6 MBytes Dynamic 0.000 0.0 ms 3 0 0:32:09 14.5 MBytes Dynamic On Sep 9, 1:43 pm, Jon McAlister jon...@google.com wrote: Ok, let me know if it recurs. On Wed, Sep 7, 2011 at 3:07 PM, Pol i...@pol-online.net wrote: Hi Jon, Great! everpix-alpha I still see what appears to be the bug now and then, but I don't have a reproducible case just waiting in a task queue anymore. On Sep 7, 1:19 pm, Jon McAlister jon...@google.com wrote: Hi Pol, I think I have a change that will fix this, which should be available once 1.5.4 is pushed out. What is the app-id here? On Mon, Sep 5, 2011 at 10:41 AM, Pol i...@pol-online.net wrote: Hi, Our app settings are as follow: - Python +HRD - Max Idle Instances: ( 2 ) - Min Pending Latency: ( 100ms ) As of right now, there are 3 instances alive. Without going too much into details, we have GAE integrated with EC2 on which we run remote image processing tools. The tools are called directly using HTTP GETs from GAE and they returned their results as JSON (with gzip content encoding). There are currently 3 tasks in the processing queue on GAE continuously failing: the urlfetch() calls to the EC2 tool reach the 10 seconds timeout and bail. What doesn't make sense is that calling the EC2 tool directly using curl from random machines succeeds in less than 1 second. But here's the trick: under certain circumstances, the EC2 tool will call back to GAE (HEAD request that does a single db.get()) to check if the image has already been processed and this happens for these 3 stuck tasks. If calling the EC2 tool from the command line and curl, we have the normal behavior: - EC2 tool retrieves image from arbitrary URL and computes a hash - EC2 tool does a HEAD call to GAE passing this hash to see if image has been already processed - If yes, return empty JSON - If no, process image and return full JSON This takes about 1 second. The exact same call done from GAE produces this behavior: - EC2 tool retrieves image from arbitrary URL and computes a hash - EC2 tool does a HEAD call to GAE passing this hash to see if image has been already processed - HEAD call hangs --- RE-ENTRANCY /DEADLOCKBUG in GAE - urlfetch() from GAE to EC2 reaches 10 seconds deadline and aborts -- BREAKSDEADLOCK - HEAD call finally returns - EC2 tool completes normally GAE logs confirm the bug: HEAD call from EC2 / curl origina 2011-09-05 10:19:52.502 /api/has_backing? bid=90e794f348ac76520076f5d02bc67c87c8a9185b8d36affe8377e73fe4820703 200 368ms 48cpu_ms 8api_cpu_ms 0kb Everpix-Processor HEAD call from EC2 / GAE origin 2011-09-05 10:20:44.670 /api/has_backing? bid=90e794f348ac76520076f5d02bc67c87c8a9185b8d36affe8377e73fe4820703 200 9712ms 48cpu_ms 8api_cpu_ms 0kb Everpix-Processor 2011-09-05 10:20:44.547 /task/import_photo 500 10348ms 28cpu_ms 8api_cpu_ms 0kb AppEngine-Google; (+http://code.google.com/appengine) (see how the HEAD /api/has_backing call hangs for almost 10 seconds and only returns *after* /task/import_photo and its urlfetch() call to EC2 has aborted) And finally, AppStats confirms that it's not the head() Python execution itself that's hanging: (1) 2011-09-05 09:16:06.843 HEAD /api/has_backing? bid=3bc4aeb08e01d3ba4bfab3282d2a198984a4fc1fab2ad9d1e8a39ee3cddd14da 200 real=227ms cpu=24ms api=8ms overhead=0ms (1 RPC) (2) 2011-09-05 09:15:56.422 POST /task/import_photo 500 real=10002ms cpu=33ms api=8ms overhead=0ms (3 RPCs) (3) 2011-09-05 09:15:49.328 HEAD /api/has_backing? bid=90e794f348ac76520076f5d02bc67c87c8a9185b8d36affe8377e73fe4820703 200 real=297ms
[google-appengine] Does read/write an entity with arraylist cost more than an entity w/o arraylist
Hi GAE Datastore experts, I have a question about cost of read/write an entity from/to GAE datastore. Say, I have two type of similar entities, one with arraylist as its field and the other does not. If I need to read the arraylist and make changes and write again to datastore, do they cost the same (datastore operations) or the one with arraylist cost significant more? Please help. Thanks, Bendanpa -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/CaJqOTNP1CQJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Google App engine NO LONGER FOR SMALL DEVELOPERS
I love really americans! There are no world outside USA! Any cup of tee and coffe should have the price 3-5 $. For sure __everybody_ have business and share income with Google. And (OFFKOZ!) ONLY LOOSERS don't speak English, drink no Cola and have no iPhone :))) On 10 Sep., 06:53, Jeff Schnitzer j...@infohazard.org wrote: On Fri, Sep 9, 2011 at 9:52 PM, Jeff Schnitzer j...@infohazard.org wrote: I generally share this opinion - seriously, if $9/mo is a problem, you're not running a business. That's two lates (one in NYC). That would be lattes. Jeff -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Google apps plugin with Eclipse not allowing to use Wifi
Hi, I have a broad band connection which is connected to router. I access internet from my lappy via wifi. If works fine till I open my eclipse. I have recently downloaded the eclipse which also has google app engine plugin downloaded. I want to develop a small application on google apps. But its not possible to work on internet at the same time. Somehow, my wifi connection gets corrupted. I try to repair the same, but it gets disabled. After that I need to restart and enable wifi explicitly. Please provide help, as I am not able to use my internet while developing google app application -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] how to combine multiple images into one on GAE?
Hello, I need to combine multiple images (coming from the datastore as bytes) into 1 large image. I started down this path only to realize Eclipse nicely complain the the ImageIO and BufferedImage classes were not supported by GAE. What's my path forward? Is there a way to apply resize transforms and add more images to a larger composite using GAE's ImageService? Is it going to be fruitless to I search for other java image libraries to assist in this task? Thanks, -A -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Any workaround for 1000 XMPP Stanzas?
I have beeen trying hard for optimizing my free gtalk chat service app. However there is one thing that cannot be optimized: number of sent messages. I don't understand why Google made such a big change, now I can't afford it (It's an open-source project and I wish it could be used for free). Is there any workaround other than sending a protest letter to Google? Thanks. https://lh5.googleusercontent.com/-KwJC4c0NahI/Tm1S1S-eXaI/EUc/skWXnuXAopo/2011-09-12%2B08%2B28%2B01.png -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/u-Tbrr9oGr8J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Erroneous inbound email stuck in a loop?
Hello! It seems to me that inbound mail that failed handling (i.e. the handler threw an exception or otherwise returned the 500 return code) is stuck in a loop and is resent to the handler every so often. Is that a normal behavior? If so, how can I tell GAE to stop handling this mail (as it contained invalid content)? Thanks! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] GAE Security
Hello, I am writing a Masters paper connected with safety of online currencies. I decided to make a web application dealing with one of such currencies and deploy it on GAE. As I'll have to analyse how secure it is, I would like to know how secure GAE is. What precautions to take while developing an app running on it to minimise the risk for the potential users, what are the most common weak chains and so forth. I understand that there are some companies that put sensitive data in the GAE, so it must be safe, but I can't find any details on the matter. Thanks for any answers in advance. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/Vff25BSysagJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] What is the best way to handle twice-a-day updates of many entities?
Hi, I'm currently thinking about how to implement something like: 2 or 3 times a day: For each entity of kind k: update() Is the mapper api still the right way to do this (with the new price model), or can I use some TaskQueue + Backend structure? Thank you :) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/Wwnocu7jrGIJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Recover or delete an app that is registered with deleted email account
A few months ago I had created an google appengine app just to test it out. I made the app using an google apps account that was registered with a domain I owned. Recently the domain name expired, and I choose to delete the google apps account also. Now I see that the app is still available, it was not deleted. Is there a way for me to get the app back. I do not have access tot he admin area of the app, because the email account is already deleted. I also cannot re-create the email account, because the domain name is already expired, I have to access to it anymore. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/GPpwejlvzTgJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] about fetchserver vpn
I feel like a complete idiot. Here's my app.yaml: application:corerproxy version:1 runtime:python api_version:1 handlers: - url: /fetch.py script:fetch.py here is run scripts corerskymatoMacBook-Pro:google_appengine corersky$ /usr/bin/python2.5 appcfg.py update corerproxy/fetchserver Error parsing yaml file: mapping values are not allowed here in corerproxy/fetchserver/app.yaml, line 6, column 9 I don't find what is the error? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] google app engine for extremely demanding multiplayer browser game
Hey guys, I am currently investigating possibilities for writing a sequel to the popular text-based browser game that I released in 2001 called Castle Quest 2 (http://www.castlequest.be). One of the options I am considering is developing the game in GWT, and running it on app engine. But I am not sure whether app engine will be able to scale to the degree needed for my game. CQ2 at its peak generated easily 3 million page views per day (90 million per month!), with bandwidth usage of 2.5GB each month. The database grew to a size of about 1GB. There were at least 250 sql queries each second. And it is expected that CQ3, with the advent of social networks and social gaming, will reach multiples of these numbers. Now I don't really know how big the sites are that are hosted by Google app engine, as information is rather scarce on that part. So my question to the Google team is: do you think (know?) if app engine can handle this kind of pressure from one app? Will the data store hold up, and will it scale well? It is extremely important that I have trustworthy information about this. If I decide to go with app engine and the system doesn't hold up, a massive money and time investment will be lost. Thanks in advance, Kind regards, Karel Crombecq -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/OAB-cvkIXMYJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] using app engine for extremely demanding multiplayer browser game
Hey guys, I am currently evaluating different possibilities for making a sequel to a very popular text-based browser game called Castle Quest 2 (http://www.castlequest.be). The original game was written in php, with MySQL as the backend. I am investigating different hosting options for making a state-of-the-art, html5-based sequel to this game. CQ2 is extremely demanding from a server perspective. About 1500 active users cause on average 3 million page views each day (90 million each month), for a bandwidth usage of 2,5GB per month. About 250 SQL queries are executed each second, and the database is slightly less than 1 GB large, with hundreds of tables. It is expected that, with the advent of social networks and social games, the player base will grow substantially, and the numbers for CQ3 will be multiples of those for CQ2. Is GWT and app engine with the data store a viable platform for a game with these specifications? Will the datastore be able to deal with the pressure? I can't find any data about big apps hosted on app engine, so it is hard for me to get an idea of the scale of some apps that are hosted on app engine. The main alternative (Amazon EC2) has proven to be able to deal with this kind of pressure and much more (Farmville is hosted on it) but google app engine has lots of advantages over Amazon EC2, such as the servlet architecture, easy transparent scaling and integration with GWT, so I'm definitely leaning towards app engine if it can handle it. Any feedback would be greatly appreciated. Thanks in advance, Kind regards, Karel Crombecq -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/QDBUSJ4XRBgJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Problem using Google Apps Viewer to view a blob
Hi,
I have encountered similar problem. In case of opening the .xls (MS
Excel) or .ppt (MS PowerPoint) files which are served from BlobStore
in Google Doc Viewer, Google Doc Viewer can not display them. Error
message from Google Doc Viewer is Sorry, we are unable to generate a
view of the document at this time..
However, .doc (MS Word) and .pdf (PDF) files are worked fine. In
addition, .xls and .ppt files are displayed fine when they are served
as static files (not from BlobStore) like image or CSS files.
The application set application/vnd.ms-powerpoint for Content-Type
of PPT file.
--- Http Header information for PPT file
HTTP/1.1 200 OK
accept-ranges: bytes
Content-Type: application/vnd.ms-powerpoint
Content-Disposition: attachment; filename=abc.ppt
Date: Mon, 12 Sep 2011 18:13:58 GMT
Server: Google Frontend
Content-Length: 102912
Are there anything I can try?
Any information is appreciated.
Thanks,
Hideki
On Sep 9, 1:05 pm, Joshua Smith joshuaesm...@charter.net wrote:
I've never heard anything more on this. Hey Gred D', can you do us a solid
and forward this question over to the google apps people responsible for the
viewer?
On Sep 9, 2011, at 9:20 AM, chrsnv wrote:
I also encoutered the same problem witch .docx files. When open
a .docx file in Google viewer it display nothingIs this a bug of
the Google viewer?
On 26 jul, 17:33, Joshua Smith joshuaesm...@charter.net wrote:
Well all my googling turns up that the mimetype module is giving the best
answer (see attached pic)
and I certainly cannot find any *other* mime type to use for docx files.
Do you suppose you could send a note over to someone on the google apps
team and find out from them what mime type will let me use the google apps
viewer for docx files?
-Joshua
On Jul 25, 2011, at 2:21 AM, Nick Johnson (Google) wrote:
On Thu, Jul 21, 2011 at 2:08 AM, Joshua Smith joshuaesm...@charter.net
wrote:
Excellent question. No, I hadn't.
I just added this:
self.response.headers['Content-Type'] =
str(mimetypes.guess_type(document.title)[0]) or 'application/octet-stream'
and the headers now say:
HTTP/1.1 200 OK
Cache-Control: no-cache
Expires: Fri, 01 Jan 1990 00:00:00 GMT
Content-Type:
application/vnd.openxmlformats-officedocument.wordprocessingml.document
Date: Wed, 20 Jul 2011 16:06:14 GMT
Server: Google Frontend
Content-Length: 10762
But there is no change. .doc files still work, and .docx files do not.
Determine the actual mimetype that docx files should be served as, and
make sure you're serving as that. Don't expect the mimetype module to
know.
-Nick
Any other ideas?
-Joshua
On Jul 19, 2011, at 11:59 PM, Nick Johnson (Google) wrote:
Have you checked what Mime-Type you're serving the documents as, and if
it's valid for docx documents?
-Nick Johnson
On Wed, Jul 20, 2011 at 9:55 AM, Joshua Smith joshuaesm...@charter.net
wrote:
If you look at this URL:
http://www.mytowngovernment.org/meeting/1234040
and click the link for one of the .doc files, they work in google's
viewer. But if you click on one of the .docx files, they don't.
When you click on the link to view, it does this:
dlurl=re.sub('viewer','download',self.request.uri)
self.redirect(http://docs.google.com/viewer?url=%s; %
urllib.quote(dlurl))
and the download handler is simply:
documentKey = self.request.get(document)
document = DocumentModel.get(documentKey)
self.send_blob(document.blob.key())
Everything I've read says that google's docs viewer should be able to
view .docx files, so I'm guessing the problem is in the way the blob is
served from GAE to Google Apps.
Any ideas?
-Joshua
--
You received this message because you are subscribed to the Google
Groups Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group
athttp://groups.google.com/group/google-appengine?hl=en.
--
Nick Johnson, Developer Programs Engineer, App Engine
--
You received this message because you are subscribed to the Google
Groups Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group
athttp://groups.google.com/group/google-appengine?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this
Re: [google-appengine] Sqlite3 for backends
Oi ! Agree completely, in fact really forgot about it ;] I thought it was on the roadmap, not sure though .. maybe 2.7 supports sqlite as the python module is already builtin ? Hmm just checked the roadmap and only 2.7 support is on it, lets hope they dont exclude import sqlite3 from the deal. Bart programming schizofrenic - http://tinyurl.com/bart-thate On Mon, Sep 12, 2011 at 4:07 PM, Andrin von Rechenberg andri...@gmail.comwrote: Hi there Is there any plan to support the sqlite3 module in python in GAE? It would be very useful if someone would want to build an SQL like backend. -Andrin -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Can't post to google-appengine-python
Just to be safe, I put an override on your account in that group. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai On Mon, Sep 12, 2011 at 6:36 AM, dloomer dloo...@gmail.com wrote: Don't know where else to post this. Occasionally over the past year I've tried to post to google-appengine-python, except it just goes straight to the moderator queue and is never approved. I've been a member of the group for well over a year (I have posts dating back to March 2010) but apparently I'm considered a new user as the group's About page says only posts from new users are moderated. I always end up just posting here instead, but that's not usually the best fit for my post if it's python-specific. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/AcvpMUEPIDoJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Disappearing posts
Rob, if it still doesn't appear, email the message to me directly. I'll smash it through with my trusty Mjolnir. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai On Sun, Sep 11, 2011 at 8:01 AM, Rob Smith robertadamsonsm...@gmail.comwrote: I was referring to the earlier messages, which confirmed that my messages had been there at one point. Thanks for clarifying though. On Sep 11, 12:56 pm, Gary Frederick g...@jsoft.com wrote: On Saturday, September 10, 2011 6:22:05 PM UTC-5, Rob Smith wrote: Thanks for confirming that I wasn't just imagining it! I should have clarified someone in a different forum... -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Disappearing posts
Ikai... I'm noticing a trend. You like big hammers don't you? Guess it makes christmas shopping easy for your wife. ;) On Mon, Sep 12, 2011 at 13:33, Ikai Lan (Google) ika...@google.com wrote: Rob, if it still doesn't appear, email the message to me directly. I'll smash it through with my trusty Mjolnir. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai On Sun, Sep 11, 2011 at 8:01 AM, Rob Smith robertadamsonsm...@gmail.com wrote: I was referring to the earlier messages, which confirmed that my messages had been there at one point. Thanks for clarifying though. On Sep 11, 12:56 pm, Gary Frederick g...@jsoft.com wrote: On Saturday, September 10, 2011 6:22:05 PM UTC-5, Rob Smith wrote: Thanks for confirming that I wasn't just imagining it! I should have clarified someone in a different forum... -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Any workaround for 1000 XMPP Stanzas?
I would also be equally happy if there is some way as one of my apps will be facing exactly same problem 2011/9/12 捏造的信仰 yiding...@gmail.com I have beeen trying hard for optimizing my free gtalk chat service app. However there is one thing that cannot be optimized: number of sent messages. I don't understand why Google made such a big change, now I can't afford it (It's an open-source project and I wish it could be used for free). Is there any workaround other than sending a protest letter to Google? Thanks. https://lh5.googleusercontent.com/-KwJC4c0NahI/Tm1S1S-eXaI/EUc/skWXnuXAopo/2011-09-12%2B08%2B28%2B01.png -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/u-Tbrr9oGr8J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: backend vs frontend instances
Frontend specs are the same as a B1 backend as defined here: http://code.google.com/appengine/docs/python/config/backends.html#Instance_Classes This is 128M memory limit and 600MHz CPU limit Greg On Fri, Sep 2, 2011 at 2:28 PM, GR goot...@gmail.com wrote: Google, where can we get the frontend instance specs? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/fTW-5wf5oTQJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Any workaround for 1000 XMPP Stanzas?
I'm having this exact same issue too. Now, I think the $0.01/1k stanza is a fair price, but the minimum is a serious killer for an application uses hardly any of all the other quotas except for XMPP. For my current application, I'm looking at a daily estimated bill of $0.05-$0.15 for 5 days per week, all from XMPP stanzas. That's an average of $0.50 billing per week, but I will be forced to pay $2.10 per week for that. I hope that the purpose of the minimum charge is to reduce credit card charges overhead, and not to punish small applications that cannot stay under the quota. Seeing as there are others that face the same problem I have, I'd like to propose two possible solutions. 1) Allow us the flexibility to adjust our free quotas to favor certain services over others 2) Allow us to pay (e.g.) $5 credit upfront in-lieu of the minimum charge. Our daily usage is then deducted from the credit. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/eeY1ynEOZbMJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Google App engine NO LONGER FOR SMALL DEVELOPERS
Even for bigger ones !!! My apps was costing 400 USD a month up to now and with the new pricing it is going to cost 1300 USD a month for the same resources !! That is completely nonsense and not very delicate for a provider to multiply by 3 the price of an application. Result : We are redesigning our app to work on Amazon which is way cheaper, even with S3 that has tasks, database and equivallents ot Google services. Too bad, GAE was nice. On 10 sep, 21:59, vasja pupki vasiliij.pup...@googlemail.com wrote: I love really americans! There are no world outside USA! Any cup of tee and coffe should have the price 3-5 $. For sure __everybody_ have business and share income with Google. And (OFFKOZ!) ONLY LOOSERS don't speak English, drink no Cola and have no iPhone :))) On 10 Sep., 06:53, Jeff Schnitzer j...@infohazard.org wrote: On Fri, Sep 9, 2011 at 9:52 PM, Jeff Schnitzer j...@infohazard.org wrote: I generally share this opinion - seriously, if $9/mo is a problem, you're not running a business. That's two lates (one in NYC). That would be lattes. Jeff -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] java.lang.NullPointerException: No API environment is registered for this thread.
Hi, I used datastore in development mode as follows, DatastoreService ds = DatastoreServiceFactory.getDatastoreService(); Entity person = new Entity(Personn); person.setProperty(name, Deepak); person.setProperty(lname, priyanka); ds.put(person); when i run it, i get the following exception java.lang.NullPointerException: No API environment is registered for this thread. at com.google.appengine.api.datastore.DatastoreApiHelper.getCurrentAppId(DatastoreApiHelper.java:108) at com.google.appengine.api.datastore.DatastoreApiHelper.getCurrentAppIdNamespace(DatastoreApiHelper.java:118) at com.google.appengine.api.datastore.Key.init(Key.java:104) at com.google.appengine.api.datastore.Key.init(Key.java:88) at com.google.appengine.api.datastore.Key.init(Key.java:84) at com.google.appengine.api.datastore.Entity.init(Entity.java:122) at com.google.appengine.api.datastore.Entity.init(Entity.java:103) Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Any workaround for 1000 XMPP Stanzas?
+1 for Allow us the flexibility to adjust our free quotas to favor certain services over others -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] GAE pricing is multiplied by 3 for my usage !!!
Hi, I have been using GAE since the beginning. One of my application is very resource consuming and, with the introduction of ficed billing for backends, I optimized it to use the full capacity of the 6 backends I am using. The problem now is the Database : My app is performing a -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] GAE pricing is multiplied by 3 for my usage !!!
Hi all, I have been using GAE since the beginning. One of my application is very resource consuming and, with the introduction of ficed billing for backends, I optimized it to use the full capacity of the 6 backends I am using. The problem now is the Database : My app is performing a lot of writes/ reads that were not charged up to now and now ... Google is charging more for the read/writes than for the 6 backends, including 1 b4 and 1 B2 !! Results : The price of this app will switch to 400 USD to 1300 USD (X3). Not normal. Is there a way to optimize this the same way we optimize the usage of backends? Otherwise I fear we will have to move out of GAE. Thanks and regards. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Google App engine NO LONGER FOR SMALL DEVELOPERS
Have you tried configuring your Max Idle Instances to 1, and see how that affects your estimated bill? If you read around this forum, there have been many others that were shocked by the increase in the estimated bill, but have managed to bring it down to reasonable levels by optimizing their code (especially Datastore usage) and adjusting the Max Idle Instance. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/IZuMwbPmDrYJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Google App engine NO LONGER FOR SMALL DEVELOPERS
On Sat, Sep 10, 2011 at 8:16 PM, Jeff Schnitzer j...@infohazard.org wrote: Unfortunately I don't know the answer. It's simple: stop enforcing a minimum spend of $9/month. Let the guy pre-pay $10 into his account so he can cover his $0.07 costs without being ripped-off 4x for services not delivered. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Remote API: how to find out the app ID of the server??
With the Python version if you don't pass the appid at all when you configure the remote_api, it will set it for you--possibly in the environment variable which app_identity.get_application_id will recognize. though you actually want the full appid (from the APPLICATION_ID environment variable) if you're creating datastore keys. With Java, I'm not sure but it's the same idea. On Sep 11, 12:35 pm, andrew andrew.macken...@bcntouch.com wrote: Hi Fred, This week we planned to look at something very similar, so maybe we can share notes. I notice that if you enable datastore admin, there seems to be an option to export datastore to another appid. To be seen how it handles keys, namespaces, etc. That won't cover export to local though. Andrew -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] logging on backends if more than 2 log messages
I've noticed that log messages are only logged with the request if logging() is not used more than twice. Otherwise I have to select 'Info' in the filter. I've set logservice.AUTOFLUSH_ENABLED to False already. This is a request with 4 log messages and no filter in the logs (dashboard). 2011-09-12 12:01:44.161 / 200 102833ms 42161cpu_ms 28861api_cpu_ms 0kb instance=0 The same request with filter set to 'Info'. 2011-09-12 12:01:44.139 / flush start=2011-09-12,12:00:01.327 instance=0 I 2011-09-12 12:00:35.855 ParameterOutOfRange: 100 I 2011-09-12 12:00:37.555 ParameterOutOfRange: 100 I 2011-09-12 12:01:44.138 200 And a request with only 1 log message, and no filter in the logs. Different backend, same configuration. 2011-09-12 12:01:13.859 / 200 72542ms 22831cpu_ms 11048api_cpu_ms 0kb instance=0 I 2011-09-12 12:01:13.843 100 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Tasks not retried if dynamic backend instance runs out of quota?
I have been recently working with dynamic backend instances that respond to task queue requests. I am doing this to separate my frontend (user) traffic from my background work, so that I can keep Min Pending Latency low for users. I deployed some code to a backend and then kicked off a fan-out job on the backend - all of the backend requests are via push queues. I didn't realize I needed to configure the quota for backends, so my backends quickly ran out of quota. From the logs, I can see that they were both (2 of them) issued an / _ah/stop command. A few of my fan-out job tasks came in, and the log shows that they received a 503 response. This all makes sense. However, the queue from where those tasks came is empty. And now that I've added more $$, I have not seen any subsequent requests to the backends. Are those jobs lost? Should I not see them with regular retry mechanism in my queue? Thanks, j -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: GAE pricing is multiplied by 3 for my usage !!!
Optimizing writes: Indexes are probably what will make most apps pay through the nose. If you have properties that do not need to be searched or sorted, make sure they are unindexed. Optimizing reads: Use memcache as much as possible. Also, keys-only queries are a lot cheaper (7x) than entity-fetch queries, so look for opportunities to use keys-only queries. Look for opportunities to bundle several entities together and storing them serialized into one fat entity (bearing in mind the max entity size of 1MB). For large data that don't change a lot, you could even store them into the blobstore instead. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/yuSHSwxaJdQJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: logging on backends if more than 2 log messages
Slight mistake: the first request only has 3 messages of course, not that it makes a difference. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] logging on backends if more than 2 log messages
http://code.google.com/appengine/docs/python/backends/overview.html#Logging On Mon, Sep 12, 2011 at 12:28 PM, pdknsk pdk...@googlemail.com wrote: I've noticed that log messages are only logged with the request if logging() is not used more than twice. Otherwise I have to select 'Info' in the filter. I've set logservice.AUTOFLUSH_ENABLED to False already. This is a request with 4 log messages and no filter in the logs (dashboard). 2011-09-12 12:01:44.161 / 200 102833ms 42161cpu_ms 28861api_cpu_ms 0kb instance=0 The same request with filter set to 'Info'. 2011-09-12 12:01:44.139 / flush start=2011-09-12,12:00:01.327 instance=0 I 2011-09-12 12:00:35.855 ParameterOutOfRange: 100 I 2011-09-12 12:00:37.555 ParameterOutOfRange: 100 I 2011-09-12 12:01:44.138 200 And a request with only 1 log message, and no filter in the logs. Different backend, same configuration. 2011-09-12 12:01:13.859 / 200 72542ms 22831cpu_ms 11048api_cpu_ms 0kb instance=0 I 2011-09-12 12:01:13.843 100 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: logging on backends if more than 2 log messages
I understand this, but why the difference? I very much prefer to not have to switch the filter with 2 messages. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: logging on backends if more than 2 log messages
Sounds reasonable to me. Perhaps file an issue for this? On Mon, Sep 12, 2011 at 12:39 PM, pdknsk pdk...@googlemail.com wrote: I understand this, but why the difference? I very much prefer to not have to switch the filter with 2 messages. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Tasks not retried if dynamic backend instance runs out of quota?
http://code.google.com/appengine/docs/python/backends/overview.html#Billing_Quotas_and_Limits - Task Queue tasks have a 24-hour deadline when sent to a backend -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: logging on backends if more than 2 log messages
http://code.google.com/p/googleappengine/issues/detail?id=5870 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Tasks not retried if dynamic backend instance runs out of quota?
That's good to know (I was wondering that), but I don't think it has anything to do with what I'm seeing. j On Sep 12, 1:41 pm, pdknsk pdk...@googlemail.com wrote: http://code.google.com/appengine/docs/python/backends/overview.html#B... - Task Queue tasks have a 24-hour deadline when sent to a backend -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Tasks not retried if dynamic backend instance runs out of quota?
This is entirely my fault. That particular task has a task_retry_limit of 10, which is exactly what my logs show. Move along, nothing to see here... j On Sep 12, 2:08 pm, Jason Collins jason.a.coll...@gmail.com wrote: That's good to know (I was wondering that), but I don't think it has anything to do with what I'm seeing. j On Sep 12, 1:41 pm, pdknsk pdk...@googlemail.com wrote: http://code.google.com/appengine/docs/python/backends/overview.html#B... - Task Queue tasks have a 24-hour deadline when sent to a backend -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] GAE documentation can't be downloaded. 404 Error.
The link in this page: http://code.google.com/intl/en/appengine/downloads.html to the new documentation: http://googleappengine.googlecode.com/files/google-appengine-docs-20110912.zip throws a 404 error. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/GmBXhz-dgwMJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] App Engine SDK 1.5.4 released!
Hey everyone, Just wanted to let you all know that App Engine SDK 1.5.4 has been released. The official announcement is here: http://googleappengine.blogspot.com/2011/09/app-engine-154-sdk-release.html The full release notes are below: Java = - You can now specify the maximum size for a blob in BlobstoreService.createUploadUrl(). - Zigzag merge join queries will now continue scanning up to the 30 second Datastore query deadline. For zigzag queries that used to generate DatastoreNeedIndexException, many will now succeed. A small percentage will now instead timeout. - The SDK datastore viewer in the dev console now displays the number of Write Ops for each entity. Write Ops are the total number of entity and index writes that were required to create the entity. - The Prospective Search API is available in Java for all applications. This API is still experimental, so applications will be limited to a maximum of 1000 subscriptions. - We made a classloading improvement that we expect to help loading request latencies for projects with large numbers of jars. - Added support for the set_default_version flag to Appcfg. - The Java Remote API now recognizes the HTTP_X_APPENGINE_INBOUND_APPID. This means that the Datastore Admin copy functionality will work when using Java's Remote API with the destination app. - Fixed an issue that incorrectly allowed creation of tasks with whitespace in the url. - Fixed the error message for transaction not found to be more descriptive. - Fixed an issue with the dev appserver's local Blobstore implementation trying to modify an immutable collection. http://code.google.com/p/googleappengine/issues/detail?id=3081 - Fixed an SDK issue where CONFIG, FINE, FINER, FINEST logging messages were not displayed. http://code.google.com/p/googleappengine/issues/detail?id=4591 Python === - You can now specify the maximum size for a blob in create_upload_url(). - Zigzag merge join queries will now continue scanning up to the 30 second Datastore query deadline. For zigzag queries that used to generate NeedIndex errors, many will now succeed. A small percentage will now instead timeout. - The SDK datastore viewer in the dev console now displays the number of Write Ops for each entity. Write Ops are the total number of entity and index writes that were required to create the entity. - Added API functionality for making calls to the Memcache API asynchronously. - Fixed an issue that incorrectly allowed creation of tasks with whitespace in the url. - Fixed the error message for transaction not found to be more descriptive. - Fixed an issue where blobstore uploads didn't work in the SDK with the -a 0.0.0.0 flag set. - Fixed an issue where --dry_run was broken for upload_data in bulkload.py. - Fixed an issue where db.Model().to_xml() incorrectly updated auto-updating properties. http://code.google.com/p/googleappengine/issues/detail?id=322 - Fixed an issue where the SDK didn't expand the '~' in a file path. http://code.google.com/p/googleappengine/issues/detail?id=522 - Fixed an issue where is_saved() wasn't valid after db.Model.__init__. http://code.google.com/p/googleappengine/issues/detail?id=844 - Fixed an issue where GQL IN queries with an empty list returned all entities. http://code.google.com/p/googleappengine/issues/detail?id=932 - Fixed an issue where the SDK's sqlite stub did not handle cursors on descending queries correctly. http://code.google.com/p/googleappengine/issues/detail?id=3121 - Fixed a typo in the SDK's Datastore Stats generator message. http://code.google.com/p/googleappengine/issues/detail?id=5425 -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Frontend Instances graph not accurate?
I have a feeling that others have brought up this same question, but a search for frontend instances brings back so many results and they're difficult to sift through ... In one of my applications I'm questioning what I see in the Instances graph for my frontend. This app used to do a ton of batch processing in the frontend, and understandably would show 4-8 instances running at either time, both under the Instances link and in the graph. I have since moved almost all of the batch processing to backends, and my Instances link now shows just 1-2 instances, sometimes 3, running at any given time on the frontend (and that is total instances not just active). I check it pretty obsessively, and always see the results I'm hoping for: the backend is taking up the processing with a hard maximum number of instances, while the frontend usage is now very light. So why is it that my instances graph looks like this? It suggests that I have 3-4 frontend instances at any given time, never dipping below 2 (although I have observed 0-1 running for extended periods, and again that is total instances not just active). Also, why is the Active line always showing close to zero? It seems like the Total is overstating and Active is understating my actual usage. https://www.google.com/chart?chxt=x,ychd=e:TFTVTsUCUYUuVEVbVxWHWdWzXKXgX2YMYiY5ZPZlZ7aRaoa-bUbqcAcXctdDdZdweGeceyfIfff1gLghg3hOhkh6iQimi9jTjpj.kVkslClYlumEmbmxnHndnzoKogo2pMpip5qPqlq7rRror-sUsqtAtXttuDuZuvvGvcvywIwew1xLxhx3yNyky6zQzmz80T0p0.1V1r2C2Y2u3E3a3x4H4d4z5J5g7L7h748O8k869Q9n99-O-Z,c1ZReuYoUeUeZLeuYtUeUeUeUeKPjMo9cReuYoUeUeZReuYoUeb8euV-UeUeb1euV-UeUeUeZReub8eueueuV-UeegdpUeUeUeUeUeZYeueubFb8euV-cKssdpUeW0mZlVV3ZYeueueudpUedVeuo2n5eueueueueuZ0UeajeuXQUedOeuUwUeZYeuYoUeUeVpeueueulAo9o9o9x0zMfCf5o9mneuiWgleueut-zMhmeuo2rho9o9,TFTVTsUCUYUuVEVbVxWHWdWzXKXgX2YMYiY5ZPZlZ7aRaoa-bUbqcAcXctdDdZdweGeceyfIfff1gLghg3hOhkh6iQimi9jTjpj.kVkslClYlumEmbmxnHndnzoKogo2pMpip5qPqlq7rRror-sUsqtAtXttuDuZuvvGvcvywIwew1xLxhx3yNyky6zQzmz80T0p0.1V1r2C2Y2u3E3a3x4H4d4z5J5g7L7h748O8k869Q9n99-O-Z,AbANAbAAAUAiAbAZAMAUANAGAiAGAiAfANAUAGAUAbANANAGAbAiANAiAGAgAUANAUAGAbAiANAbANANAbAMAUAGAbANAAAUAAAbAUAUAGAAAGAUAGAoANA9ANAbAbAGAbAoAvAnAvA9AvA9BLANBEAoAvBEAiAvBYAvAoAvAuAvA2BLAbBBA9AoBEBEA8BtAiBYAvBLA9BRBtA2BYA2BYBLAbBLBfAvA4AvBLBRAvBLAiBRBmAbBfchxp=0,97.6,73.2,48.8,24.4,0.0|1,20.0,40.0,60.0,80.0,100.0chxs=chg=0,20.00,1,2chco=0077cc,ff9900chm=R,7f7f7f,0,0.976,0.977|R,7f7f7f,0,0.732,0.733|R,7f7f7f,0,0.488,0.489|R,7f7f7f,0,0.244,0.245|R,7f7f7f,0,0.000,0.001|B,eaf0f4,0,0,0|B,eaf0f4,1,0,0chs=750x185cht=lxychxl=0%3A%7Cnow%7C-6hr%7C-12hr%7C-18hr%7C-1d%7C1%3A%7C1.25%7C2.50%7C3.75%7C5.00%7C6.25chls=2,0,0|2,0,0chdl=Total|Activechdlp=t I just made these tweaks a couple days ago, so I've yet to see my first bill showing how many frontend instances I would have been billed for under the new pricing model, but I'm afraid it's going to show what I see on the graph rather than what I see under the Instances link. I have a couple other apps which do very little on the frontend and which always show at most 2 instances running under the Instances link, and for those apps the graph is consistent with what I see elsewhere. It just seems to be this one app (app name: mn-live). -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/bThkg9XmVGEJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: using app engine for extremely demanding multiplayer browser game
Hello Karel, I host 3 browser games on App Engine. Neptune's Pride, Blight of the Immortals and my new one Jupiter's Folly. My oldest and largest game Neptune's Pride has about 2000 Daily active users, and about 7000 visits a day according to Google Analytics. My games are flash, so they don't heaps of page views, but the flash makes 100-150k requests a day. At times I have been much bigger and the data-store easily handles the load. Even though there has been a lot of hoopla here about the price increases, I would still recommend app engine to a small operation who want to get on with the business of making games rather than managing servers. My bill is going from about 50c a day to about $3 a day. About $1000 a year. Before the price increase my hosting was easily covered by the little bit of advertising I have on the game (which players don't see unless they have been playing 7 days without becoming a paying player). After the price increase my ads will probably only cover 2/3s of my hosting costs. My biggest expense is datastore writes. Because the games are interactive, not simply passive pages to view, the players make a lot of changes to their data which needs to be written to the datastore. Those 2k players of Neptune's Pride generate about 2 Million writes which is $2 of my $3 a day bill. Feel free to shoot me any other questions you might have, just keep in mind I'm no expert! ;) Jay. On Sep 13, 2:32 am, Karel Crombecq karel.cromb...@gmail.com wrote: Hey guys, I am currently evaluating different possibilities for making a sequel to a very popular text-based browser game called Castle Quest 2 (http://www.castlequest.be). The original game was written in php, with MySQL as the backend. I am investigating different hosting options for making a state-of-the-art, html5-based sequel to this game. CQ2 is extremely demanding from a server perspective. About 1500 active users cause on average 3 million page views each day (90 million each month), for a bandwidth usage of 2,5GB per month. About 250 SQL queries are executed each second, and the database is slightly less than 1 GB large, with hundreds of tables. It is expected that, with the advent of social networks and social games, the player base will grow substantially, and the numbers for CQ3 will be multiples of those for CQ2. Is GWT and app engine with the data store a viable platform for a game with these specifications? Will the datastore be able to deal with the pressure? I can't find any data about big apps hosted on app engine, so it is hard for me to get an idea of the scale of some apps that are hosted on app engine. The main alternative (Amazon EC2) has proven to be able to deal with this kind of pressure and much more (Farmville is hosted on it) but google app engine has lots of advantages over Amazon EC2, such as the servlet architecture, easy transparent scaling and integration with GWT, so I'm definitely leaning towards app engine if it can handle it. Any feedback would be greatly appreciated. Thanks in advance, Kind regards, Karel Crombecq -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: google app engine for extremely demanding multiplayer browser game
Hello Karel, Here's some initial responses to your question on using App Engine as a gaming back end.. About 1500 active users cause on average 3 million page views each day (90 million each month), for a bandwidth usage of 2,5GB per month. This should not be a problem.. About 250 SQL queries are executed each second, and the database is slightly less than 1 GB large, with hundreds of tables. Can this be handled by a nonSQL db? Or is a relational DB a definite requirement? The GAE Datastore can definitely scale to 250 qps. There's no effective limit to datastore qps, given that access patterns are sufficiently distributed. We currently have customers doing tens of thousands of qps. Is GWT and app engine with the data store a viable platform for a game with these specifications? It should be, although having GWT in the mix is not a requirement. You could also code your app directly in HTML5, or you could also look into using the new multi-platform game development platform: PlayN (http://code.google.com/p/playn/) What might be helpful is to create a small prototype app on App Engine, and see if this environment will work for you. Once you're more familiar with App Engine, you'd be in a much better position to make the call. You can always post further questions to this group, (or the PlayN group..) Hope this helps! -Chris On Sep 12, 7:00 am, Karel Crombecq karel.cromb...@gmail.com wrote: Hey guys, I am currently investigating possibilities for writing a sequel to the popular text-based browser game that I released in 2001 called Castle Quest 2 (http://www.castlequest.be). One of the options I am considering is developing the game in GWT, and running it on app engine. But I am not sure whether app engine will be able to scale to the degree needed for my game. CQ2 at its peak generated easily 3 million page views per day (90 million per month!), with bandwidth usage of 2.5GB each month. The database grew to a size of about 1GB. There were at least 250 sql queries each second. And it is expected that CQ3, with the advent of social networks and social gaming, will reach multiples of these numbers. Now I don't really know how big the sites are that are hosted by Google app engine, as information is rather scarce on that part. So my question to the Google team is: do you think (know?) if app engine can handle this kind of pressure from one app? Will the data store hold up, and will it scale well? It is extremely important that I have trustworthy information about this. If I decide to go with app engine and the system doesn't hold up, a massive money and time investment will be lost. Thanks in advance, Kind regards, Karel Crombecq -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] SmartGwt treefrog skin
Hi there! I'm using SmartGwt on my application and it looks really good all the stuff they've developed. And would really be great to use the treefrog skin on it, but due to all images it has, the static files jump to over 3500. I read a lot of posts on this matter and the two most common solutions, zip the image files or store them on amazon, just don't fit. The first one is so slow that the images most often don't download, plus with the new billing model, I'm not sure that decompressing the zip file would increase the instance hours. The other option would generate an extra cost with some other provider, which doesn't make any sense. Wouldn't it be better if we could pay for extra files like any other service? Or does anyone know how to trim or compact it in a simpler way? Thanks a lot! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Frontend Instances graph not accurate?
Let's say in one hour I have six different instances spin up and down, never two running at the same time, and some occasional space in between. Will that show on the graph as six or 1 instances? And is that what I will be billed for? Is the Active line computed different from Total, instead measuring the average number of active instances at any moment during that hour, which in my case might in fact be close to zero? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/ZfrVYx-nn4UJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
