[appengine-java] Re: Memory based application, static field, data lost
Indeed. Don't rely on the mem cache to keep your pictures for a long time, since they will eventually be removed from the cache. The datastore is GAE's sole persistent data store (except queued tasks in a non- databasey way), and GAE give us a free amount of storage. On Oct 26, 5:03 pm, nischalshetty nischalshett...@gmail.com wrote: GAE runs multiple instances which means your code would be run on multiple JVMs as well which means the static field will be multiple as well. A lot of as wells here but I hope you get the point. Use statics for constants that do not change. For everything else persist either in memcache or datastore. -N On Oct 26, 4:17 pm, yoyo yoyomo...@gmail.com wrote: Thanks for your answear. So, GOE discard instances in cases of low usage. I didn't know. My app is an image board, like 4chan.org. The blowstore api in only available for billing account. I can't use the blowstore because my app isn't commercial. I write it only for fun and i don't want to pay for it. I'll use the memcache service. It's not important if some of pictures are lost. There is no guarantee, but I hope keep most of pictures into it. Else... well I'll see. I've some refactoring to do. Thanks again for your answear. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Sharing a PersistenceManagerFactory instance between web application instances
Thanks, Ikai. I'll bear the low-level API in mind, but I try to avoid this to make my application as portable as possible. On Oct 26, 8:09 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: No, you can't share a PMF instance between app instances. Constructing this is slow because it has to do classpath scanning. Note that if you use the low-level API, application startup time is greatly reduced: http://code.google.com/appengine/docs/java/javadoc/com/google/appengi... -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Tue, Oct 26, 2010 at 3:32 AM, Ian Marshall ianmarshall...@gmail.comwrote: As we all know, the construction of a PersistenceManagerFactory (PMF) instance that is needed for exchanging data with the datastore is slow. To speed up the showing of my home page (which does not need data from the datastore), my application creates a queued task at launch-time, which constructs its singleton PMF instance asynchronously. This way, the creation of my PMF does not add to spin-up (and other?) delays to app start-up. Can a PMF instance be shared between application instances? If so, I could hasten app initialisation by getting an already- existing PMF instance from the memory cache and only construct one if it is no longer in the memory cache. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Memory based application, static field, data lost
Yoyo, you are aware that you only have to enable your account as billable and that it doesn't actually cost anything as long as you stay within the free quota? See the Quota page for more info (http:// code.google.com/appengine/docs/quotas.html#Blobstore) On Oct 27, 9:12 am, Ian Marshall ianmarshall...@gmail.com wrote: Indeed. Don't rely on the mem cache to keep your pictures for a long time, since they will eventually be removed from the cache. The datastore is GAE's sole persistent data store (except queued tasks in a non- databasey way), and GAE give us a free amount of storage. On Oct 26, 5:03 pm, nischalshetty nischalshett...@gmail.com wrote: GAE runs multiple instances which means your code would be run on multiple JVMs as well which means the static field will be multiple as well. A lot of as wells here but I hope you get the point. Use statics for constants that do not change. For everything else persist either in memcache or datastore. -N On Oct 26, 4:17 pm, yoyo yoyomo...@gmail.com wrote: Thanks for your answear. So, GOE discard instances in cases of low usage. I didn't know. My app is an image board, like 4chan.org. The blowstore api in only available for billing account. I can't use the blowstore because my app isn't commercial. I write it only for fun and i don't want to pay for it. I'll use the memcache service. It's not important if some of pictures are lost. There is no guarantee, but I hope keep most of pictures into it. Else... well I'll see. I've some refactoring to do. Thanks again for your answear. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: JSF 2.0 MyFaces problem with Ajax and Command Button
First of all what version of mojarra you use? In case you using the modified jar that was done by Josh for Google App Engine SDK 1.2.6 you should using the original mojarra jars. I wrote a short tutorial on how one can use the original mojarra jars You can find it here: [url]http://www.neverslair-blog.net/daniels-tips-and-tutorials/[/url] Daniel. On Oct 26, 11:06 am, powell...@gmail.com powell...@gmail.com wrote: I cannot get Ajax to allow navigation to another page when a h:commandButton is clicked. I use the classic command given in texts as shown below but Ajax will always display the current page. In the example below, I want to transition to the page2.xhtml page when I click but I only get the current page redisplayed. I tried giving ajax attributes of execute=@form and even render=@form without success. Is this a known bug. h:form prependId=false ... h:commandButton id=button1 action=page2 f:ajax / /h:commandButton /h:form Dave -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Channel API still not live...
Thanks for the answer Ikai. I have another question which perhaps is a bit off topic but I hope You will answer nevertheless. Will it be possible to use the Channel API on Java clients (like Android) and not only from within browsers? It would be awesome. Thanks again. On Oct 26, 7:26 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Very slim. We want to ship it as soon as possible. In the meantime, there are plenty of services that offer this type of functionality: http://beaconpush.comhttp://pubnub.com ... and so forth Don't let this feature block you if your application needs it. Build it using another tool and port it over when we are ready to release the Channel API for everyone. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Tue, Oct 26, 2010 at 12:41 AM, stole goran.stoj...@gmail.com wrote: Thanks everybody for the info. I just needed to see what are the chances for getting the API activated soon (this week). From Your answers I'd say very slim. On Oct 26, 8:16 am, Heiko Roth r...@egotec.com wrote: No activation yet. I'm waiting, too. Right now, we pull status every 5 minutes, but that's not the best way. Other APIs like Pushlet don't work on appengine. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2B unsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: Memory based application, static field, data lost
Thanks for your advices. I'll use the datastore and the blobstore. When I first write my app, I supposed my static field will probably be drop by GAE, because of the non-use of API like memcache or datastore. I try it, for fun and curiosity. It was interesting to understand WHY it was a bad idea to do this. Thanks again for your answear, and have a nice day. 2010/10/27 Simon qila...@gmail.com Yoyo, you are aware that you only have to enable your account as billable and that it doesn't actually cost anything as long as you stay within the free quota? See the Quota page for more info (http:// code.google.com/appengine/docs/quotas.html#Blobstore) On Oct 27, 9:12 am, Ian Marshall ianmarshall...@gmail.com wrote: Indeed. Don't rely on the mem cache to keep your pictures for a long time, since they will eventually be removed from the cache. The datastore is GAE's sole persistent data store (except queued tasks in a non- databasey way), and GAE give us a free amount of storage. On Oct 26, 5:03 pm, nischalshetty nischalshett...@gmail.com wrote: GAE runs multiple instances which means your code would be run on multiple JVMs as well which means the static field will be multiple as well. A lot of as wells here but I hope you get the point. Use statics for constants that do not change. For everything else persist either in memcache or datastore. -N On Oct 26, 4:17 pm, yoyo yoyomo...@gmail.com wrote: Thanks for your answear. So, GOE discard instances in cases of low usage. I didn't know. My app is an image board, like 4chan.org. The blowstore api in only available for billing account. I can't use the blowstore because my app isn't commercial. I write it only for fun and i don't want to pay for it. I'll use the memcache service. It's not important if some of pictures are lost. There is no guarantee, but I hope keep most of pictures into it. Else... well I'll see. I've some refactoring to do. Thanks again for your answear. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: Java while statement bug on GAE server?
Wow Thank you Don you have a very keen eye. On Wed, Oct 27, 2010 at 12:53 AM, l.denardo lorenzo.dena...@gmail.comwrote: I need a good pair of glasses :-) On Oct 26, 5:42 pm, Don Schwarz schwa...@google.com wrote: Yes, it's a bug in your code: while(tempFlag == true); Note the semicolon. Try removing it. On Tue, Oct 26, 2010 at 10:22 AM, doc123 doc.u...@gmail.com wrote: Sorry to use specific sample code. So I tried more basic following code. try { int i =0; boolean tempFlag = false; while(tempFlag == true); { i++; out.println(tempFlag + i + := + tempFlag); tempFlag = false; } } catch(Exception e) { out.println(Error + e.toString()); } what I got is tempFlag1:=false but out.print is within a while(tempFlag == true) bock. I think this is bug. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] How can I keep the data saved in JDO datastore?
I wanted to keep the data when upgrading my app to a new version. How can I do this? Each time I upgrade it it looks like my data was lost. There is no way in admin area that i can back up my data before upgrade. Thanks. Q -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] blobstore - map returned empty
What does your upload page look like? Can you post the full servlet? -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Tue, Oct 26, 2010 at 4:12 PM, pac parvez.chau...@gmail.com wrote: I am trying to use BlobstoreService locally. But map is returned empty by following line in servlet: MapString, BlobKey blobs = blobstoreService.getUploadedBlobs(req); I was following post from http://ikaisays.com/ (also using gwt as front end) but I guess I might have missed something, any thoughts? Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: recommendation on using maxmind geoip
It's not required to use mapreduce. It's just easier to manage the jobs. You'll hit the 30 second deadline if you don't, and you'll end up building your own task queue management logic anyway. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Tue, Oct 26, 2010 at 10:00 PM, asianCoolz second.co...@gmail.com wrote: hello @Ikai, is it required to use mapreduce . why not get the byte stream from blockstore and create new file(..) ? there is no limit on new file(..) and byte[] array in gae right? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: Channel API still not live...
I'm not sure about that. It's my understanding that the Channel API depends on generated Javascript, so if you can interpret that, why not? I haven't looked much into how comet is being implemented in the Channel API - I know there's a long-polling implementation as a fallback. Using a non-browser client would be an undocumented use case, but I don't see why it couldn't be done. When you have a mobile client or a Java client, can't you use XMPP? -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Wed, Oct 27, 2010 at 3:02 AM, stole goran.stoj...@gmail.com wrote: Thanks for the answer Ikai. I have another question which perhaps is a bit off topic but I hope You will answer nevertheless. Will it be possible to use the Channel API on Java clients (like Android) and not only from within browsers? It would be awesome. Thanks again. On Oct 26, 7:26 pm, Ikai Lan (Google) ikai.l+gro...@google.comikai.l%2bgro...@google.com wrote: Very slim. We want to ship it as soon as possible. In the meantime, there are plenty of services that offer this type of functionality: http://beaconpush.comhttp://pubnub.com ... and so forth Don't let this feature block you if your application needs it. Build it using another tool and port it over when we are ready to release the Channel API for everyone. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Tue, Oct 26, 2010 at 12:41 AM, stole goran.stoj...@gmail.com wrote: Thanks everybody for the info. I just needed to see what are the chances for getting the API activated soon (this week). From Your answers I'd say very slim. On Oct 26, 8:16 am, Heiko Roth r...@egotec.com wrote: No activation yet. I'm waiting, too. Right now, we pull status every 5 minutes, but that's not the best way. Other APIs like Pushlet don't work on appengine. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.comgoogle-appengine-java%2B unsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: blobstore - map returned empty
Hi Ikai, Upload page is a composite, in which I have a decorator panel which contains another composite which has FormPanel (Upload field) As for servlet code: public void doPost(HttpServletRequest req, HttpServletResponse res) throws ServletException, IOException { String userIdStr = req.getParameter(IAppConstants.PARAM_UserId); MapString, BlobKey blobs = blobstoreService.getUploadedBlobs(req); BlobKey blobKey = blobs.get(IAppConstants.PARAM_MyFile); . . . blobs returned is empty and so blobKey is null. IAppConstants.PARAM_MyFile is name of upload field at client side i.e. uploadField.setName(IAppConstants.PARAM_MyFile); In servlet if I do String myFile = req.getParameter(IAppConstants.PARAM_MyFile); then myFile is also null. Upload form at client does have uploadForm.setEncoding(FormPanel.ENCODING_MULTIPART); uploadForm.setMethod(FormPanel.METHOD_POST); Any suggestions? Thanks. On Oct 27, 7:28 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: What does your upload page look like? Can you post the full servlet? -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Tue, Oct 26, 2010 at 4:12 PM, pac parvez.chau...@gmail.com wrote: I am trying to use BlobstoreService locally. But map is returned empty by following line in servlet: MapString, BlobKey blobs = blobstoreService.getUploadedBlobs(req); I was following post from http://ikaisays.com/ (also using gwt as front end) but I guess I might have missed something, any thoughts? Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: blobstore - map returned empty
That looks right to me. Strange ... can you compare your code against this project? It's some sample code I whipped up a while ago. Here's the GWT upload widget: http://github.com/ikai/gwt-gae-image-gallery/blob/master/src/com/ikai/photosharing/client/widgets/UploadPhoto.java Here's the servlet that handles uploads: http://github.com/ikai/gwt-gae-image-gallery/blob/master/src/com/ikai/photosharing/server/UploadServlet.java I've seen this happen before when the name isn't set correctly. Can you look into the generated source using a tool like Firebug to see if the form is being generated correctly? -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Wed, Oct 27, 2010 at 3:51 PM, pac parvez.chau...@gmail.com wrote: Hi Ikai, Upload page is a composite, in which I have a decorator panel which contains another composite which has FormPanel (Upload field) As for servlet code: public void doPost(HttpServletRequest req, HttpServletResponse res) throws ServletException, IOException { String userIdStr = req.getParameter(IAppConstants.PARAM_UserId); MapString, BlobKey blobs = blobstoreService.getUploadedBlobs(req); BlobKey blobKey = blobs.get(IAppConstants.PARAM_MyFile); . . . blobs returned is empty and so blobKey is null. IAppConstants.PARAM_MyFile is name of upload field at client side i.e. uploadField.setName(IAppConstants.PARAM_MyFile); In servlet if I do String myFile = req.getParameter(IAppConstants.PARAM_MyFile); then myFile is also null. Upload form at client does have uploadForm.setEncoding(FormPanel.ENCODING_MULTIPART); uploadForm.setMethod(FormPanel.METHOD_POST); Any suggestions? Thanks. On Oct 27, 7:28 pm, Ikai Lan (Google) ikai.l+gro...@google.comikai.l%2bgro...@google.com wrote: What does your upload page look like? Can you post the full servlet? -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Tue, Oct 26, 2010 at 4:12 PM, pac parvez.chau...@gmail.com wrote: I am trying to use BlobstoreService locally. But map is returned empty by following line in servlet: MapString, BlobKey blobs = blobstoreService.getUploadedBlobs(req); I was following post from http://ikaisays.com/ (also using gwt as front end) but I guess I might have missed something, any thoughts? Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com google-appengine-java%2bunsubscr...@googlegroups.comgoogle-appengine-java%252bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: How can I keep the data saved in JDO datastore?
Is this a non-issue at all? Anyone? Thank you. On Oct 26, 7:37 pm, qiwawa deng...@gmail.com wrote: I wanted to keep the data when upgrading my app to a new version. How can I do this? Each time I upgrade it it looks like my data was lost. There is no way in admin area that i can back up my data before upgrade. Thanks. Q -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Text enclosed with Text: ~~~
I have a com.google.appengine.api.datastore.Text object stored in the datastore, when examined through the datastore viewer, it reads as it should e.g. 'this is a test' I retrieve it with a public Text getData() { return data; } then write it out with getWriter, however I'm getting Text: this is a test instead of just 'this is a test' Sure I'm doing something daft! I'm rather new to java. Thanks in advance. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Eclipse plugin insists on copying DataNucleus jars to war/WEB-INF/lib
Hi Max, Does it copy on startup or build? I am using Eclipse 3.5 , 3.6 and it doesn't copy to lib always. It happens when SDK is changed or maybe on startup. Regardless, I wanted to do the same thing and what I did is write an ANT task that runs every build. The ANT task removed the libs that I don't want, including the JDO classes. Looking at the list of libs, how do you get rid of: geronimo-jpa_3.0_spec-1.1.1.jar geronimo-jta_1.1_spec-1.1.1.jar jsr107cache-1.1.jar I remember when I remove those, something won't work. Maybe I need to try again, but those files are very small anyway. I also remove the MapReduce libs when I don't need to run data migration task. One of those libs are huge. On Oct 26, 9:45 am, Maxim Veksler ma...@vekslers.org wrote: Hello, My project needs only 2 jars from GAE/J: appengine-api-1.0-sdk-1.3.8.jar appengine-api-labs-1.3.8.jar The rest of the jars supplied by the plugin are API's that are not used by our application and thus not required as part of the deployment: appengine-jsr107cache-1.3.8.jar datanucleus-appengine-1.0.7.final.jar datanucleus-core-1.1.5.jar datanucleus-jpa-1.1.5.jar geronimo-jpa_3.0_spec-1.1.1.jar geronimo-jta_1.1_spec-1.1.1.jar jdo2-api-2.3-eb.jar jsr107cache-1.1.jar I've tried to delete these jars and deployed the app to GAE/J -- It works great and the application is running happily ever after. The thing is GAE Eclipse plugin insists on recopying the jars to the project war/WEB-INF/lib folder (* it's unclear the when it decides to do so). I even tried to edit the values of filesCopiedToWebInfLib from the settings file .settings/com.google.appengine.eclipse.core.prefs which also did not help (further more -- The plugin just updated this entry back to it's original state... why put a configuration option if you ignore it?) I want these jars removed for 2 reasons: - 1. It makes the project lighter, removes clutter and is generally better to pull small project over wire. - 2. I remember reading in the mailing list that fewer jars help improve the application cold start times. I'm not talking about projects like spring that have large startup penalty but simply having jar flles in the classpath. Don't know if this is true and I haven't done any benchmarks to verify this. OTOH to be on the safe side -- Why test if I can simply not upload the unwanted jars and be done with it? So, in conclusion - What is the proper method (if any) to instruct GAE Eclipse Plugin to skip checking and copying of jar's that are basic GAE sdk jars into my WEB-LIB/lib folder? Thanks for reading, Maxim. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] datastore viewer's GQL
i have following record in the datastore. datastore ABC === ID/Name title message user === and the user is the object. how to run GQL to filter a particular user's record - user (ag1udW1iZXJzaaD9wejAxcgsLEgRVc2VyGOkHKK User: id=100100) ?? select * from ABC where user = User(100100) (not working). any help? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: uploaded file how to view in browser
Hi.. Thanks for ur reply. Content Type application/octet-stream is working fine but same operation doing for Content Type application/pdf. i want view pdf in browser like image view in browser. If have any idea help me. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[google-appengine] Re: App engine down time or problem with CRON requests
Thanks for the reports, we're looking into it. In general, if there's an app engine issue that causes cron to miss a job, it will be executed once the system recovers, i.e. jobs are not entirely dropped. The exact time the task will execute depends on the frequency and scheduling. If you're seeing an issue where a task was completely dropped and never executed, please provide details about your app id and what you're seeing. Thanks. On Oct 24, 11:53 pm, Chris Prinos chrispri...@gmail.com wrote: Ok thanks for confirming you saw this as well. Looks like the same thing occured today, same time frame as before. Chris On Oct 22, 11:02 pm, sodso sodhisoluti...@gmail.com wrote: Yes, same happened for me as well, looks like CRON jobs arent reliable, so i have decided to implement double-checking logic to check whether the job has run or not by using a datatstore / memcache record On Oct 22, 7:51 pm, Chris Prinos chrispri...@gmail.com wrote: Anyone know if there was scheduled down time 10/22/2010 around 12:30AM PDT? None of my cron-initiated requests were triggered from about 12:33 AM PDT to 1:05 AM PDT, but there were no errors in the logs. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Global counter
Hi Guys, I need something like a global counter. Namely, a have a number of pictures and want to show them one by one. In other words, I need some kind of cursor (points to current picture) that I could move from one picture to another. So I could use synchronized static variable, but as I understand it's going to work only inside single JVM, but it's not true for GAE apparently. Datastore is extremely slow for this. So any other thoughts? Thanks a lot, Maxim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Image Upload
I have understand very well the Stephen solution. I'm just fighting with the serve part of the code... 2010/10/27 ego008 ego...@gmail.com you can do it step by step here http://code.google.com/intl/en/appengine/docs/python/images/usingimages.html http://code.google.com/intl/en/appengine/docs/python/images/usingimages.html GAE Geek http://gaefons.appspot.com/ -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- My email: massimiliano.pietr...@gmail.com My Google Wave: massimiliano.pietr...@googlewave.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Global counter
Use a query cursor and sort your images in whatever order you want. Use memcache to cache the cursor state between requests. Rgds T On Oct 27, 3:21 pm, megaswin maxim.tru...@gmail.com wrote: Hi Guys, I need something like a global counter. Namely, a have a number of pictures and want to show them one by one. In other words, I need some kind of cursor (points to current picture) that I could move from one picture to another. So I could use synchronized static variable, but as I understand it's going to work only inside single JVM, but it's not true for GAE apparently. Datastore is extremely slow for this. So any other thoughts? Thanks a lot, Maxim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: When using an automatically Long id as a key, is it possible the Long value is a zero?
I've never seen an automatically generated ID of zero. But it might be safer to use -1 as an invalid marker, rather than 0. On Oct 27, 4:40 am, Tapir tapir@gmail.com wrote: I want to check whethor or not a reference id is invalid by comparing it with a zero. Works? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Problem with query
Hi Robert, yes, if I have the same keywords, two times, I get results. It It seems, that your theory is right. Any suggestion, how I can realize this on one query? Greets Alex On 14 Okt., 18:33, Robert Kluin robert.kl...@gmail.com wrote: Hey Alex, I am guessing that under the hood App Engine breaks the startsWith into two filters that looks something like: myArray = keyword AND myArray keyword + z So when you add the second startsWith filter, you get: myArray = keyword AND myArray keyword + z AND myArray = otherword AND myArray otherword2 + z That is not going to work. You may be able to validate my theory by making the two keywords the same and seeing if you get results. Robert On Thu, Oct 14, 2010 at 03:17, AlexG alexander.gauss.ax...@googlemail.com wrote: Hi @ all, i have a problem with a query, What I want to do, is to search in a String[] for keywords. I use the String.startsWith(a) function. When I build the qery like this: select from ... where myArray.startsWith(keyword), everything works fine. But the problem is, when I build a query, where I want to search for two keywords, the query doesnt give me results. Example: select from ... where myArray.startsWith(keyword1) myArray.stratsWith(keyword2) I don´t know why this doenst work, maybe somebody can help me?? Thanks. Greets Alex -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] ReqestFactory remove() not wirking for me
Hi @ all, I know, that theres an issue, and that this bug is already known. I always get errors, when I try to remove an Entity. I´m using JDO with the RequestFactory, and I get the following Error: Server Error: No such Object I checked the id and everything, but the Object definitely exists in my database. I don´t understand, why I get this Error? I mean persist() works as intended. The querys also works fine. Does someone know, what I´m doing wrong, or is it a bug? Greets Alex -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Error code 203 - What is meaning of this error
Indeed... it was infinitive loop because of our error in algorithm. With no answer and no support from AppEngine team we have to big doubt in app engine, so that we overlook our mistakes. There wasn't possible to log anything or catch exception when this error happened so we couldn't know if it is somehow related with app engine or if error was within our code. Tnx Colin. On Oct 27, 12:27 am, hawkett hawk...@gmail.com wrote: my mistake - I can see where you define the 'sequence' array - I'm just blind - other observations stand :) On Oct 26, 11:26 pm, hawkett hawk...@gmail.com wrote: Hi Matija, I'm not using java on app engine, but I can offer the following - the ms count on the two variations is hugely different - one is less than a second, and one is over 40s - if commenting out those lines causes such a difference, then I don't think it is inside this function that the problem exists. - I can't see where you define the 'sequence' variable, or guess how you use either the 'sequence' array or the 'ai' array, but my money would be on the processing of those arrays - after the call to the function is complete. e.g. commenting out those lines means those arrays have different content, which affects processing elsewhere. - guessing even more, I would say that 203 is not the correct error code, and that perhaps GAE exited from too much recursion, stack overflow, infinite loop or something like that. That should probably be a 500 range error code, as a 2xx range code indicates success, which does not seem right based on the error message. - My understanding is that to deal with memory leaks, GAE will kill a server that uses too much memory and start a new one if necessary to handle subsequent requests. This also makes me wonder about too much recursion or stack overflow etc. - it is strange that the request took 40s and used no cpu - this also makes me wonder about too much recursion - i.e. GAE never gets the opportunity to measure CPU before your process crashes. Anyway - some log messages in your processing would go a long way to identifying the real problem (assuming you are getting log message output before this crashes). Cheers, Colin On Oct 26, 4:42 pm, Matija matija.jerko...@gmail.com wrote: I have a rather complex code for traveling salesman problem that is trowing this error. I have located lines that produce this error and it is pretty strange. int[] sequence = new int[dimension]; private void reverse(int i, int j, final int ai[]) { int i1 = j - i; if (i1 0) i1 += dimension; i1 = i1 / 2 + 1; int l, k; for (l = 0; l i1; l++) { k = sequence[i]; sequence[i] = sequence[j]; ai[sequence[i]] = i; // sequence[j] = k; // ai[sequence[j]] = j; if (++i = dimension) i -= dimension; if (--j 0) j += dimension; } } If I leave commented this two lines task request finishes with this performance parameters (ms=842 cpu_ms=97 api_cpu_ms=0). If I uncomment this two lines I get: ms=40087 cpu_ms=0 api_cpu_ms=0 exit_code=203 throttle_code=1 A serious problem was encountered with the process that handled this request, causing it to exit. This is likely to cause a new process to be used for the next request to your application. If you see this message frequently, you should contact the App Engine team. (Error code 203) Why ?! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Suddenly getting 404 on my application
We actually saw this on one of our instances yesterday. All urls would 404 and nothing showed in the logs/dashboard. A re-deploy to a new version fixed it for us. -Mike On Oct 26, 4:49 pm, Wes westho...@gmail.com wrote: One of my site's is suddenly giving a 404 on the default version as well as the other older versions. Is anyone aware of any system issues? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Using a manifest file with an application hosted on App Engine without going through the App Marketplace
Hello everyone, I am new to App Engine and have been developing my first application for a few weeks now. My application is hosted on App Engine, and I have installed a beta version to a Google Apps Domain that I manage. I have the application up and running just fine, but now I am trying to place a link to my application in the Universal Navigation More drop down menu. I have read several tutorials that instruct me to build a manifest xml file that will be utilized when I list my application on Google Apps Marketplace. However I have no intention of listing my application on the marketplace, does this mean that I can't integrate my application into to universal nav bar? I am already utilizing SSO through the Google User API, and I suppose I could publish the app on the marketplace, but it seems silly to have to. I am developing in Eclipse with the App Engine SDK. Can I just add a manifest file to my application in eclipse somehow that will update when I deploy the application? Thanks in advance for any help you can offer. -Jeremiah -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Application limits
I don't know whether you are using the Java or Python SDK, but it sounds like what you're after is documented here: Python - http://code.google.com/appengine/docs/python/multitenancy/ Java - http://code.google.com/appengine/docs/java/multitenancy/ Basically it's up to the developer, but it's a fairly simple thing to achieve. On Oct 26, 11:01 pm, Douglas Finley dafin...@gmail.com wrote: How does Google App Engine for Business work? It looks like it's only for intranet, how would a tech company create a product on Google App Engine and deploy instances to multiple clients? Or is Google App Engine designed to be take one application, and it's on the developer to partition the database tables properly to separate each client properly versus giving each client an entire instance. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Problem with owned bidirectional one-to-one relationship in JPO
I have 2 classes: public class Cobro implements Serializable { @Persistent(defaultFetchGroup = true) private Pago pago; } And the other : public class Pago implements Serializable { @Persistent(mappedBy = pago) private Cobro cobro; } It is a bidirectional one-to-one relationship, the same way that says in http://code.google.com/appengine/docs/java/datastore/relationships.html#Owned_One_to_One_Relationships All apears to be fine, but when I get a Pago object from JPO like this: Pago pago = pm.getObjectById(Pago.class,idPago); Cobro cob = pago.getCobro(); Sometimes when it's recently created the variable cob it's null. The funny thing about this is that when I get the Cobro object in another RPC, and try again It's not null anymore. I can't understand why. Regrards -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Latency spikes and aborted requests in the last 24 hours
I wanted to chime in. We're seeing high latency (10s, 0 cpu_ms) on tasks that are put into the queue on an hourly basis. This has been going on for a couple of weeks at least. The end result is that we're churning through our CPU time early in the morning, and then our app is dead for the real work it needs to do the rest of the day. I've temporarily fixed the problem by removing our hourly jobs. This is coming up on a crucial time for our application, so it would be nice to know the status. appid is maxistelemetry. All Python, using task queues heavily to do periodic aggregations of information in the datastore. The task queues uses Django templating to parse expressions in config files. Just the default SDK (upgraded to 1.3.8 a few days ago), no special libraries. Derrick On Oct 19, 11:55 am, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Is the main page doing something that would take a long time to load? Multiple datastore calls, URLFetches? -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Tue, Oct 19, 2010 at 10:54 AM, Stepan stepan.wag...@gmail.com wrote: My app id pixycity, it's unusable for last 4 days, cold starts end regularly in DeadlineExceededError. One week ago the cold starts took long but were successful. Thanks Stepan www.pixycity.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] datastore advice?
Generally speaking: no. Entity groups will guarantee a stronger chance of data locality, but this should not affect index traversal or batch reads. A best practice, however, is to keep entity groups as small as possible. There aren't many compelling reasons to not use root entities if you don't need transactions, as working with root entities is generally simpler. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Tue, Oct 26, 2010 at 3:26 PM, djidjadji djidja...@gmail.com wrote: Parent and child objects are stored in the same Bigtable node. This is done for the transactions. A transaction works on a single entity-group. If you perform a query you use an index to find the objects needed. At this point there is no performance penalty for parent or child objects that match the query. The query results in a number of keys of objects that need to be retrieved. The best query responds time is when the objects to fetch are stored in as many Bigtable nodes as possible (parallel fetch). Why do you need so many child objects? Can you implement it with adding a Parent Reference Property to the child object and thus remove the need to store the entity group all in one Bigtable node? The parent-child objects are needed 1) if you need transactions on them or 2) if you want to extract the parent key given a child key Perform a keys_only query on child objects and from these keys get the set of parent keys of objects that you need to fetch complete. Brett Slatkin uses this technique in a number of Google IO talks, the child object has a ListProperty that is used in the keys_only query. Most other applications can be implemented without the explicit parent object. 2010/10/26 Charles char...@whoischarles.com: Hi all, I'm wondering, since the datastore is hierarchical, does the number of children an entity has affect the performance on querying on the parents themselves? For example, if I have a set of parents, say... Jane Margaret Graham Arthur ...and I have a set of children associated with those parents... Jane -Sam -Robert Margaret -Lisa Graham Arthur -Rowen -Jerry ...will the number of children for each parent affect the performance of querying the parents themselves? For instance, if I wanted to select all of the parents (SELECT * FROM parents), that would be easy with the data above. But, since the datastore is hierarchical, does the performance get hampered if say the parents have many thousands or even millions of children? Say, like... Jane -Sam -Robert ...1 million more Margaret ... If so, I'm just wondering if it would make more sense to make the children root entities too, so as not to affect the performance of querying on the parents. Anyways, hope I've explained my question well enough. Thanks in advance! Charles -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Latency spikes and aborted requests in the last 24 hours
Appengine has been horrible since the last maintenance. Periodic waves of Request was aborted after waiting too long... and DeadlineExceededErrors... Flurries of 25-100 of these in a 2-3 minute period. Occurs on simple pages as well as db-intensive ones. I'm using Django Appengine Patch. It was bad like this in the late spring, and got better in the summer up until the last maintenance. Then it got bad again. I guess a .1-. 5% error rate might be survivable, but I'd hope that the standard we're trying to achieve is a bit higher than this. :) On Oct 26, 11:16 am, derrickschneider derrick.schnei...@gmail.com wrote: I wanted to chime in. We're seeing high latency (10s, 0 cpu_ms) on tasks that are put into the queue on an hourly basis. This has been going on for a couple of weeks at least. The end result is that we're churning through our CPU time early in the morning, and then our app is dead for the real work it needs to do the rest of the day. I've temporarily fixed the problem by removing our hourly jobs. This is coming up on a crucial time for our application, so it would be nice to know the status. appid is maxistelemetry. All Python, using task queues heavily to do periodic aggregations of information in the datastore. The task queues uses Django templating to parse expressions in config files. Just the default SDK (upgraded to 1.3.8 a few days ago), no special libraries. Derrick On Oct 19, 11:55 am, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Is the main page doing something that would take a long time to load? Multiple datastore calls, URLFetches? -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Tue, Oct 19, 2010 at 10:54 AM, Stepan stepan.wag...@gmail.com wrote: My app id pixycity, it's unusable for last 4 days, cold starts end regularly in DeadlineExceededError. One week ago the cold starts took long but were successful. Thanks Stepan www.pixycity.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Application limits
The initial launch of GAE4B will focus on building apps for your domain only. Suppose you had @yourcompany.com Google Apps domain. With GAE4B, all your apps would not have quota restrictions, but login via a @ yourcompany.com domain would be required for all pages. If a company wanted to build GAE4B apps, you would do so and deploy to each company's instance. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Tue, Oct 26, 2010 at 3:01 PM, Douglas Finley dafin...@gmail.com wrote: How does Google App Engine for Business work? It looks like it's only for intranet, how would a tech company create a product on Google App Engine and deploy instances to multiple clients? Or is Google App Engine designed to be take one application, and it's on the developer to partition the database tables properly to separate each client properly versus giving each client an entire instance. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Image Upload
get_serving_url is a URL to the file directly - you use it in the actual image tag. self.response.out.write('img src=%s/'%images.get_serving_url(resource, 32)) On 27 October 2010 19:28, Massimiliano massimiliano.pietr...@gmail.com wrote: I'm trying to serve the images with this code, but it's not working class ServeHandler(webapp.RequestHandler): def get(self, resource): self.response.headers['Content-Type'] = image/png self.response.out.write(images.get_serving_url(resource, 32)) Could you help me? 2010/10/27 Massimiliano massimiliano.pietr...@gmail.com I have understand very well the Stephen solution. I'm just fighting with the serve part of the code... 2010/10/27 ego008 ego...@gmail.com you can do it step by step here http://code.google.com/intl/en/appengine/docs/python/images/usingimages.html GAE Geek http://gaefons.appspot.com/ -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- My email: massimiliano.pietr...@gmail.com My Google Wave: massimiliano.pietr...@googlewave.com -- My email: massimiliano.pietr...@gmail.com My Google Wave: massimiliano.pietr...@googlewave.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Application limits
Simon thanks for the link on the namespaces, I've been through most of the App Engine API's and that was first. Ikai so GAE4B is going to be run initally for intranet companies. I have a tech company on Google Apps @bigbrer.com. So, your saying that I have use my @gmail account to deploy an app for customers until GAE4B gets a billing policy for external facing apps that don't need to integrate with Google Authentication. And this is coming early 2011 right? On Oct 27, 1:49 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: The initial launch of GAE4B will focus on building apps for your domain only. Suppose you had @yourcompany.com Google Apps domain. With GAE4B, all your apps would not have quota restrictions, but login via a @ yourcompany.com domain would be required for all pages. If a company wanted to build GAE4B apps, you would do so and deploy to each company's instance. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Tue, Oct 26, 2010 at 3:01 PM, Douglas Finley dafin...@gmail.com wrote: How does Google App Engine for Business work? It looks like it's only for intranet, how would a tech company create a product on Google App Engine and deploy instances to multiple clients? Or is Google App Engine designed to be take one application, and it's on the developer to partition the database tables properly to separate each client properly versus giving each client an entire instance. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Latency spikes and aborted requests in the last 24 hours
Same here. We are just planning a migration out of GAE :-( On 27 oct, 19:44, johnP j...@thinkwave.com wrote: Appengine has been horrible since the last maintenance. Periodic waves of Request was aborted after waiting too long... and DeadlineExceededErrors... Flurries of 25-100 of these in a 2-3 minute period. Occurs on simple pages as well as db-intensive ones. I'm using Django Appengine Patch. It was bad like this in the late spring, and got better in the summer up until the last maintenance. Then it got bad again. I guess a .1-. 5% error rate might be survivable, but I'd hope that the standard we're trying to achieve is a bit higher than this. :) On Oct 26, 11:16 am, derrickschneider derrick.schnei...@gmail.com wrote: I wanted to chime in. We're seeing high latency (10s, 0 cpu_ms) on tasks that are put into the queue on an hourly basis. This has been going on for a couple of weeks at least. The end result is that we're churning through our CPU time early in the morning, and then our app is dead for the real work it needs to do the rest of the day. I've temporarily fixed the problem by removing our hourly jobs. This is coming up on a crucial time for our application, so it would be nice to know the status. appid is maxistelemetry. All Python, using task queues heavily to do periodic aggregations of information in the datastore. The task queues uses Django templating to parse expressions in config files. Just the default SDK (upgraded to 1.3.8 a few days ago), no special libraries. Derrick On Oct 19, 11:55 am, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Is the main page doing something that would take a long time to load? Multiple datastore calls, URLFetches? -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Tue, Oct 19, 2010 at 10:54 AM, Stepan stepan.wag...@gmail.com wrote: My app id pixycity, it's unusable for last 4 days, cold starts end regularly in DeadlineExceededError. One week ago the cold starts took long but were successful. Thanks Stepan www.pixycity.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Latency spikes and aborted requests in the last 24 hours
Yeah, I'm in the same boat. We're trying to decide which implementation of this app to go with, and having AppEngine be in an unreliable state isn't helping my cause at all. Derrick On Wed, Oct 27, 2010 at 12:25 PM, Carlos Ble ble.jur...@gmail.com wrote: Same here. We are just planning a migration out of GAE :-( On 27 oct, 19:44, johnP j...@thinkwave.com wrote: Appengine has been horrible since the last maintenance. Periodic waves of Request was aborted after waiting too long... and DeadlineExceededErrors... Flurries of 25-100 of these in a 2-3 minute period. Occurs on simple pages as well as db-intensive ones. I'm using Django Appengine Patch. It was bad like this in the late spring, and got better in the summer up until the last maintenance. Then it got bad again. I guess a .1-. 5% error rate might be survivable, but I'd hope that the standard we're trying to achieve is a bit higher than this. :) On Oct 26, 11:16 am, derrickschneider derrick.schnei...@gmail.com wrote: I wanted to chime in. We're seeing high latency (10s, 0 cpu_ms) on tasks that are put into the queue on an hourly basis. This has been going on for a couple of weeks at least. The end result is that we're churning through our CPU time early in the morning, and then our app is dead for the real work it needs to do the rest of the day. I've temporarily fixed the problem by removing our hourly jobs. This is coming up on a crucial time for our application, so it would be nice to know the status. appid is maxistelemetry. All Python, using task queues heavily to do periodic aggregations of information in the datastore. The task queues uses Django templating to parse expressions in config files. Just the default SDK (upgraded to 1.3.8 a few days ago), no special libraries. Derrick On Oct 19, 11:55 am, Ikai Lan (Google) ikai.l+gro...@google.comikai.l%2bgro...@google.com wrote: Is the main page doing something that would take a long time to load? Multiple datastore calls, URLFetches? -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Tue, Oct 19, 2010 at 10:54 AM, Stepan stepan.wag...@gmail.com wrote: My app id pixycity, it's unusable for last 4 days, cold starts end regularly in DeadlineExceededError. One week ago the cold starts took long but were successful. Thanks Stepan www.pixycity.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Writer. Programmer. Puzzle Designer. http://www.obsessionwithfood.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Seeing errors in log with java.lang.NoClassDefFoundError
In the last couple of days we've been seeing java.lang.NoClassDefFoundError exceptions in our log for our GAE Java app. The class in question is one of ours that works and has worked for months. What could this be? Is this caused by problems with a static server behind the scenes? Has anyone else seen this? Thanks, George -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: java.security.AccessControlException while Accessing a Read-Only HSQLDB Datababse with Hibernate
mmm using an xml file? On 26 oct, 17:28, Fork Labs forkl...@gmail.com wrote: Hello Nacho, The values I want to access with Hibernate are pre-calculated outside of the server. Think of them as configuration, or as i18n values. Regards -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Latency spikes and aborted requests in the last 24 hours
Appl id:geognos appl version : 5 language :python live instances at the time: 2 loading request: no A typical normal operation for this request : 10-27 09:47AM 08.920 /api/countries/info/CL.json 200 17ms 19cpu_ms 0kb MSIE 15.0,gzip(gfe) 195.97.105.127 - - [27/Oct/2010:09:47:08 -0700] GET /api/countries/ info/CL.json HTTP/1.1 200 551 - MSIE 8.0,gzip(gfe) 5.latest.geognos.appspot.com ms=18 cpu_ms=19 api_cpu_ms=0 cpm_usd=0.000607 While I was load testing the above app with a steady load of around 2 QPS I got 2 error requests out of 3 (see below). Particular request handler is very light no access to any service except a mcache get no heavy imports. Also some more errors today on an other handler. 10-27 09:04AM 59.320 /api/countries/info/CL.json 500 12599ms 0cpu_ms 0kb MSIE 15.0,gzip(gfe) W 10-27 09:05AM 11.920 Request was aborted after waiting too long to attempt to service your request. This may happen sporadically when the App Engine serving cluster is . 10-27 08:20AM 51.444 /api/countries/info/CL.json 500 17015ms 0cpu_ms 0kb MSIE 15.0,gzip(gfe) W 10-27 08:21AM 08.460 Request was aborted after waiting too long to attempt to service your request. This may happen sporadically when the App Engine serving cluster is On Sep 23, 6:19 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hey guys, We've been tracking latency spikes and intermittent batches of aborted requests over the last 24 hour period. There were at least 3 periods of spikes yesterday: ~1100 Pacific (moderate, brief period of high) ~1300 Pacific (small) ~1530 Pacific (small) Community reports seem to indicate that these are related to loading requests. If you are being affected, can you report your environment, language and if these times correlate with your experiences in this thread? Are there periods that this particular report did not cover? Please provide measurements, times and application IDs. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Bug in Datastore Admin page
Same issue with me while trying from Chrome. Cleared cookies - no lack. Works OK from Firefox. On Oct 18, 2:19 pm, Andrius andriu...@gmail.com wrote: Hi, when I try to open datastore admin page in google app engine admin area I get frame window asking me to provide google account to log in. Not sure why is it asking because I am already logged in. If I try to login within that frame I get error: Error: Server Error The server encountered an error and could not complete your request. If the problem persists, please report your problem and mention this error message and the query that caused it. Tried few times with no luck. Could someone from google have a look please? ID: cloudbidder Regards, Andrius -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Instance maximum number of requests
I was doing some load tests on app engine today when I noticed a new Info message in the logs: After handling this request, the process that handled this request reached the maximum number of requests that may be handled in a single process' lifetime, and exited normally. So what that supposed to mean ? Up to know we new that application instances are automatically terminated after some inactivity time out. If I understand this message well now we know that a process can be terminated after handling so many requests. How many exactly ? is this a new magic number ? Lets hope we will have some answers from the always helpful App Engines team. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: ConcurrentModificationException with no datastore operation and only task to be enqueue
Any explanation about this ConcurrentModificationException, so that we can design gae app accordingly ?! On Oct 25, 12:25 pm, Matija matija.jerko...@gmail.com wrote: This is log when this ConcurrentModificationException happened again. One request starts chain of tasks and sometimes I get this exception. I must repeat that when this exception happened, there was no datastore put operations. I am using datastore transaction only to ensure that two task enqueue together or none. Interesting, but during this chain of tasks I have had only one server instance available. So there was no other concurrent task or web request execution. 10-25 02:54AM 16.992 /_ah/queue/sz 200 61ms 158cpu_ms 120api_cpu_ms 10-25 02:54AM 16.822 /_ah/queue/ru 200 154ms 117cpu_ms 40api_cpu_ms 10-25 02:53AM 58.223 /_ah/queue/sz 200 124ms 278cpu_ms 240api_cpu_ms 10-25 02:53AM 58.128 /_ah/queue/ru 200 148ms 199cpu_ms 180api_cpu_ms 10-25 02:53AM 58.034 /_ah/queue/ru 200 178ms 164cpu_ms 67api_cpu_ms 10-25 02:53AM 58.033 /_ah/queue/ru 200 86ms 69cpu_ms 30api_cpu_ms 10-25 02:53AM 57.755 /_ah/queue/ru 200 281ms 38cpu_ms 10-25 02:53AM 57.491 /_ah/queue/ru 200 266ms 19cpu_ms 10-25 02:53AM 57.460 /_ah/queue/sz 200 263ms 238cpu_ms 180api_cpu_ms 10-25 02:53AM 57.441 /_ah/queue/sz 200 218ms 118cpu_ms 80api_cpu_ms 10-25 02:53AM 57.299 /_ah/queue/sz 200 305ms 238cpu_ms 200api_cpu_ms 10-25 02:53AM 57.154 /_ah/queue/ru 200 337ms 55cpu_ms 16api_cpu_ms 10-25 02:53AM 57.138 /_ah/queue/ru 200 311ms 108cpu_ms 30api_cpu_ms 10-25 02:53AM 57.122 /_ah/queue/ru 200 245ms 89cpu_ms 30api_cpu_ms 10-25 02:53AM 57.088 /_ah/queue/ru 200 203ms 96cpu_ms 58api_cpu_ms 10-25 02:53AM 56.970 /_ah/queue/sz 200 241ms 138cpu_ms 80api_cpu_ms 10-25 02:53AM 56.878 /_ah/queue/sz 200 255ms 139cpu_ms 120api_cpu_ms 10-25 02:53AM 56.691 /_ah/queue/ru 200 382ms 77cpu_ms 10-25 02:53AM 56.678 /_ah/queue/ru 200 266ms 108cpu_ms 30api_cpu_ms 10-25 02:53AM 56.645 /_ah/queue/ru 200 214ms 78cpu_ms 40api_cpu_ms 10-25 02:53AM 56.626 /_ah/queue/ru 500 144ms 175cpu_ms 40api_cpu_ms 4kb 10-25 02:53AM 56.451 /_ah/queue/ru 200 156ms 96cpu_ms 0kb 10-25 02:53AM 56.289 /_ah/queue/ru 200 165ms 155cpu_ms 0kb 10-25 02:53AM 56.159 /_ah/queue/de 200 123ms 190cpu_ms 112api_cpu_ms 10-25 02:53AM 55.571 /_ah/queue/ru 200 653ms 146cpu_ms 50api_cpu_ms 10-25 02:53AM 55.502 /_ah/queue/de 200 637ms 195cpu_ms 117api_cpu_ms 10-25 02:53AM 55.439 /_ah/queue/ru 200 128ms 66cpu_ms 8api_cpu_ms 10-25 02:53AM 55.303 /_ah/queue/de 200 198ms 46cpu_ms 8api_cpu_ms 10-25 02:53AM 55.292 /_ah/queue/ru 200 150ms 300cpu_ms 223api_cpu_ms 10-25 02:53AM 55.284 /_ah/queue/de 200 82ms 848cpu_ms 810api_cpu_ms 10-25 02:53AM 54.867 /_ah/queue/de 200 404ms 195cpu_ms 40api_cpu_ms 10-25 02:53AM 54.861 /_ah/queue/de 200 158ms 2785cpu_ms 2726api_cpu_ms 10-25 02:53AM 54.562 /_ah/queue/de 200 284ms 292cpu_ms 137api_cpu_ms 10-25 02:53AM 54.544 /_ah/queue/de 200 160ms 2724cpu_ms 2646api_cpu_ms 10-25 02:53AM 54.199 /_ah/queue/de 200 334ms 312cpu_ms 137api_cpu_ms 10-25 02:53AM 53.912 /hessian/user/ps 200 303ms 291cpu_ms -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Image Upload
I do understand this, but my html is: img src=/serve/{{ elemento.link }} width=10%/br/a How have I to modify the html? I tried with an Iframe, but doesn't work. class UploadHandler(blobstore_handlers.BlobstoreUploadHandler): def post(self): upload_files = self.get_uploads('File') blob_info = upload_files[0] self.request.get('Nick') frasi = FRASI() frasi.frase = self.request.get('Frase') frasi.gruppo = self.request.get('domain') frasi.link = blob_info.key() frasi.put() self.redirect(/ + self.request.get('domain') + /fanpage) class ServeHandler(webapp.RequestHandler): def get(self, resource): self.response.headers['Content-Type'] = image/png self.response.out.write(images.get_serving_url(resource, 32)) 2010/10/27 Barry Hunter barrybhun...@gmail.com get_serving_url is a URL to the file directly - you use it in the actual image tag. self.response.out.write('img src=%s/'%images.get_serving_url(resource, 32)) On 27 October 2010 19:28, Massimiliano massimiliano.pietr...@gmail.com wrote: I'm trying to serve the images with this code, but it's not working class ServeHandler(webapp.RequestHandler): def get(self, resource): self.response.headers['Content-Type'] = image/png self.response.out.write(images.get_serving_url(resource, 32)) Could you help me? 2010/10/27 Massimiliano massimiliano.pietr...@gmail.com I have understand very well the Stephen solution. I'm just fighting with the serve part of the code... 2010/10/27 ego008 ego...@gmail.com you can do it step by step here http://code.google.com/intl/en/appengine/docs/python/images/usingimages.html GAE Geek http://gaefons.appspot.com/ -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- My email: massimiliano.pietr...@gmail.com My Google Wave: massimiliano.pietr...@googlewave.com -- My email: massimiliano.pietr...@gmail.com My Google Wave: massimiliano.pietr...@googlewave.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- My email: massimiliano.pietr...@gmail.com My Google Wave: massimiliano.pietr...@googlewave.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Max Request
Hi, I saw that now (and don't remember seeing that before) we have a maximum number of daily request (43B here), it's enougth for ~500 req/s, let's say I reach 50% of that, could I request more? (and the same question applies to all quotas in the Details Quota page) -- Rafael Sierra http://blog.rafaelsdm.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] cURL Server
I needed a tool to move videos from Amazon S3 to the GAE Blobstore all controlled from my GAE app. My best solution was to put a command line cURL app on an AWS Micro instance. I needed it to run asynchronously to keep my app from timing out, so I put in a daemon to process queued cURL requests. Then I started hearing on these forums questions about pulling files from FTP sites, fixing mimetypes, concatenating Blobstore files, etc. Most of which can be done with such a cURL service, so I cleaned up the code, added JSON-RPC request protocol, and a web client, and put in more documentation and test cases than this thing deserves. The resulting code and README is here: http://github.com/mjhm/cURLServer. For a limited time I'll leave my current instance running at http://ec2-204-236-157-181.us-west-1.compute.amazonaws.com. (If you don't have an Amazon account and need to see it in action send me a private message, and I'll give you the hashkey.) I feel a little awkward plugging a tool on AWS, but it was aimed at GAE developers, and I would be first in line to use a comparable Google tool. John -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Instances, cold start and pending_ms
Can anybody else explain me this pending_ms information especially for task with cold start and how it is related to average latency ? If it is somewhere explained could you provide me with links to it ?! I remember times (two years ago) where group discussions were much more dynamic and you could find explanation from gae team in day or two. Now I can often see questions never answered (when I am searching for same problems). Has GAE lost its momentum ? I hope not. Besides these problems I still think that GAE way of cloud applications is only way, but you should work on a support for developers. Although, I still this that google wave is brilliant product and I am sill using it, but cloud gods don't agree with me :( I would like to evade problems before they struck me, so anybody ? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Application limits
It's in trusted tester mode right now. I have to check the roadmap to see if we've announced a date. I don't believe we have. There's no roadmap item for GAE4B features (SLA, support) for non-domain applications yet. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Wed, Oct 27, 2010 at 12:07 PM, Doug dafin...@gmail.com wrote: Simon thanks for the link on the namespaces, I've been through most of the App Engine API's and that was first. Ikai so GAE4B is going to be run initally for intranet companies. I have a tech company on Google Apps @bigbrer.com. So, your saying that I have use my @gmail account to deploy an app for customers until GAE4B gets a billing policy for external facing apps that don't need to integrate with Google Authentication. And this is coming early 2011 right? On Oct 27, 1:49 pm, Ikai Lan (Google) ikai.l+gro...@google.comikai.l%2bgro...@google.com wrote: The initial launch of GAE4B will focus on building apps for your domain only. Suppose you had @yourcompany.com Google Apps domain. With GAE4B, all your apps would not have quota restrictions, but login via a @ yourcompany.com domain would be required for all pages. If a company wanted to build GAE4B apps, you would do so and deploy to each company's instance. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Tue, Oct 26, 2010 at 3:01 PM, Douglas Finley dafin...@gmail.com wrote: How does Google App Engine for Business work? It looks like it's only for intranet, how would a tech company create a product on Google App Engine and deploy instances to multiple clients? Or is Google App Engine designed to be take one application, and it's on the developer to partition the database tables properly to separate each client properly versus giving each client an entire instance. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Max Request
Yes. http://code.google.com/support/bin/request.py?contact_type=AppEngineCPURequest In general, we usually grant all requests where we see high QPS and daily budgets to match. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Wed, Oct 27, 2010 at 2:33 PM, Rafael Sierra rafaeljs...@gmail.comwrote: Hi, I saw that now (and don't remember seeing that before) we have a maximum number of daily request (43B here), it's enougth for ~500 req/s, let's say I reach 50% of that, could I request more? (and the same question applies to all quotas in the Details Quota page) -- Rafael Sierra http://blog.rafaelsdm.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Image Upload
You could store the url in the datastore (after updating your model definion to include the field :) frasi.gruppo = self.request.get('domain') frasi.link = blob_info.key() frasi.servinglink = images.get_serving_url(frasi.link, 32) frasi.put() . Then would just in the template img src={{ elemento.servinglink }} width=10%/br/a ... or you could call get_serving_url in the code that renders the template. You don't need a 'Serve' handler at all :) On 27 October 2010 22:22, Massimiliano massimiliano.pietr...@gmail.com wrote: I do understand this, but my html is: img src=/serve/{{ elemento.link }} width=10%/br/a How have I to modify the html? I tried with an Iframe, but doesn't work. class UploadHandler(blobstore_handlers.BlobstoreUploadHandler): def post(self): upload_files = self.get_uploads('File') blob_info = upload_files[0] self.request.get('Nick') frasi = FRASI() frasi.frase = self.request.get('Frase') frasi.gruppo = self.request.get('domain') frasi.link = blob_info.key() frasi.put() self.redirect(/ + self.request.get('domain') + /fanpage) class ServeHandler(webapp.RequestHandler): def get(self, resource): self.response.headers['Content-Type'] = image/png self.response.out.write(images.get_serving_url(resource, 32)) 2010/10/27 Barry Hunter barrybhun...@gmail.com get_serving_url is a URL to the file directly - you use it in the actual image tag. self.response.out.write('img src=%s/'%images.get_serving_url(resource, 32)) On 27 October 2010 19:28, Massimiliano massimiliano.pietr...@gmail.com wrote: I'm trying to serve the images with this code, but it's not working class ServeHandler(webapp.RequestHandler): def get(self, resource): self.response.headers['Content-Type'] = image/png self.response.out.write(images.get_serving_url(resource, 32)) Could you help me? 2010/10/27 Massimiliano massimiliano.pietr...@gmail.com I have understand very well the Stephen solution. I'm just fighting with the serve part of the code... 2010/10/27 ego008 ego...@gmail.com you can do it step by step here http://code.google.com/intl/en/appengine/docs/python/images/usingimages.html GAE Geek http://gaefons.appspot.com/ -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- My email: massimiliano.pietr...@gmail.com My Google Wave: massimiliano.pietr...@googlewave.com -- My email: massimiliano.pietr...@gmail.com My Google Wave: massimiliano.pietr...@googlewave.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- My email: massimiliano.pietr...@gmail.com My Google Wave: massimiliano.pietr...@googlewave.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] ETags on static files :(
Hi, I noticed that App Engine is setting ETags on static files. Is there a way to turn them off? ETags override the cache-control header and cause the browser to issue additional HTTP requests to check for modified files. This is bad for performance and completely unnecessary if you use an asset manager that adds a version hash to the generated file names. How can I get rid of those ETags and only have a cache-control header? Thanks! Bye, Waldemar Kornewald -- Django on App Engine, MongoDB, ...? Browser-side Python? It's open-source: http://www.allbuttonspressed.com/blog/django -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Instance maximum number of requests
Yes. Application instances are meant to be relatively short lived. Once each instance has served a certain amount of requests, we will gracefully terminate it and spin up a new instance to take its place. The number of requests to trigger this limit is subject to change for performance tuning reasons, but it should be in the ballpark of tens of thousands of requests. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Wed, Oct 27, 2010 at 1:50 PM, nickmilon nickmi...@gmail.com wrote: I was doing some load tests on app engine today when I noticed a new Info message in the logs: After handling this request, the process that handled this request reached the maximum number of requests that may be handled in a single process' lifetime, and exited normally. So what that supposed to mean ? Up to know we new that application instances are automatically terminated after some inactivity time out. If I understand this message well now we know that a process can be terminated after handling so many requests. How many exactly ? is this a new magic number ? Lets hope we will have some answers from the always helpful App Engines team. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: ConcurrentModificationException with no datastore operation and only task to be enqueue
If you are not saving any entities why are you using a transaction to put the task into the queue. The idea of a queuing a task transactionally is that the task doesn't get fired if the transaction fails (ie you save of entities fails). Seems completely redundant Rgds T On Oct 21, 11:18 pm, Matija matija.jerko...@gmail.com wrote: Hi, I am usinghttp://code.google.com/appengine/docs/java/taskqueue/overview.html#Ta... way to enqueue two tasks in transaction. But I am not saving any datastore entities. I am using objectify. I got this message: java.util.ConcurrentModificationException: too much contention on these datastore entities. please try again. at com.google.appengine.api.datastore.DatastoreApiHelper.translateError(Datast oreApiHelper.java: 39) at com.google.appengine.api.datastore.DatastoreApiHelper.makeSyncCall(Datastor eApiHelper.java: 75) at com.google.appengine.api.datastore.TransactionImpl.makeSyncCall(Transaction Impl.java: 44) at com.google.appengine.api.datastore.TransactionImpl.makeSyncCall(Transaction Impl.java: 52) at com.google.appengine.api.datastore.TransactionImpl.commit(TransactionImpl.j ava: 64) When this happened only one task needed to be added to queue, so why this error ? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Run program server
Hi Try reading http://code.google.com/appengine/docs/python/gettingstarted/ as a staring point, then start experimenting. You need to understand what appengine is good/bad for, before you go to far in your endeacours. I am not sure I understand exactly what you are asking. So I would suggest a bit more research and you present a more detailed explanation of what you want to do. A few new people here have spent months on some project only to realize after much effort that appengine didn't really suit their problem, then complained that appengine is no good. Some detailed reading about appengine upfront would have told them that what they wanted to do wasn't a good fit and saved them a lot of grief. I can't stress strongly enough the need to read in detail the basics of appengine for new people, it will save a world of trouble. (Example even basic things like which version of python to use are important) Rgds Tim On Oct 27, 3:08 am, SombraX sombr...@gmail.com wrote: Hi, sorry for my english. I want a program installed on the host server appengine hear requests one by one at a time or sequentially ( as singleton), and the server program to run a process or stop it on the server side according to the value received from the request, all in internet environment and python . How is it done? Greetings -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Question about cron and versions
Does cron run for every version? Let's say I have versions 1-0 1-1 and 1-2, all of them with the same cronjobs, it will run 3 times? -- Rafael Sierra http://blog.rafaelsdm.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Instance maximum number of requests
Just curious, do you guys retire instances after around 10k requests to avoid memory leaks? -- superco...@gmail.com On Wed, Oct 27, 2010 at 6:50 PM, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Yes. Application instances are meant to be relatively short lived. Once each instance has served a certain amount of requests, we will gracefully terminate it and spin up a new instance to take its place. The number of requests to trigger this limit is subject to change for performance tuning reasons, but it should be in the ballpark of tens of thousands of requests. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Wed, Oct 27, 2010 at 1:50 PM, nickmilon nickmi...@gmail.com wrote: I was doing some load tests on app engine today when I noticed a new Info message in the logs: After handling this request, the process that handled this request reached the maximum number of requests that may be handled in a single process' lifetime, and exited normally. So what that supposed to mean ? Up to know we new that application instances are automatically terminated after some inactivity time out. If I understand this message well now we know that a process can be terminated after handling so many requests. How many exactly ? is this a new magic number ? Lets hope we will have some answers from the always helpful App Engines team. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] The server encountered an error ?
For a while earlier this evening, every page of my app was producing 500 errors with this message: Error: Server Error The server encountered an error and could not complete your request. If the problem persists, please report your problem and mention this error message and the query that caused it. I can't figure out why this would have suddenly happened and then suddenly stopped. Also, I see no record of these errors in my App Engine logs. Can anyone explain or guess what happened? =Tim Jones= -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: datastore advice?
Hi Ikan Lan, I have seen this on so many discussions here in the forums - A best practice, however, is to keep entity groups as small as possible As far as I understand it, one Model class should not have too many records i.e. one table should not have many records Isn't this strange ? When we talk of GAE, we talk of scalability but if the best practice says to limit ther records to only a few in a Model class, what use is the scalability for ? If we store millions fo records (for eg- customer records) in one db.Model table, are you saying it would really impact the performance. Please correct me if I am wrong. I am unclear if my app can survive on GAE if its working with millions of records in one db.Model table ?? Thanks, Sodso On Oct 27, 11:27 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Generally speaking: no. Entity groups will guarantee a stronger chance of data locality, but this should not affect index traversal or batch reads. A best practice, however, is to keep entity groups as small as possible. There aren't many compelling reasons to not use root entities if you don't need transactions, as working with root entities is generally simpler. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Tue, Oct 26, 2010 at 3:26 PM, djidjadji djidja...@gmail.com wrote: Parent and child objects are stored in the same Bigtable node. This is done for the transactions. A transaction works on a single entity-group. If you perform a query you use an index to find the objects needed. At this point there is no performance penalty for parent or child objects that match the query. The query results in a number of keys of objects that need to be retrieved. The best query responds time is when the objects to fetch are stored in as many Bigtable nodes as possible (parallel fetch). Why do you need so many child objects? Can you implement it with adding a Parent Reference Property to the child object and thus remove the need to store the entity group all in one Bigtable node? The parent-child objects are needed 1) if you need transactions on them or 2) if you want to extract the parent key given a child key Perform a keys_only query on child objects and from these keys get the set of parent keys of objects that you need to fetch complete. Brett Slatkin uses this technique in a number of Google IO talks, the child object has a ListProperty that is used in the keys_only query. Most other applications can be implemented without the explicit parent object. 2010/10/26 Charles char...@whoischarles.com: Hi all, I'm wondering, since the datastore is hierarchical, does the number of children an entity has affect the performance on querying on the parents themselves? For example, if I have a set of parents, say... Jane Margaret Graham Arthur ...and I have a set of children associated with those parents... Jane -Sam -Robert Margaret -Lisa Graham Arthur -Rowen -Jerry ...will the number of children for each parent affect the performance of querying the parents themselves? For instance, if I wanted to select all of the parents (SELECT * FROM parents), that would be easy with the data above. But, since the datastore is hierarchical, does the performance get hampered if say the parents have many thousands or even millions of children? Say, like... Jane -Sam -Robert ...1 million more Margaret ... If so, I'm just wondering if it would make more sense to make the children root entities too, so as not to affect the performance of querying on the parents. Anyways, hope I've explained my question well enough. Thanks in advance! Charles -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group,
[google-appengine] Re: The server encountered an error ?
It's not just you, I'm getting the same error as a user to GQueues. It is when trying to authenticate using the Google Apps account. I'm guessing unscheduled maintenance -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: The server encountered an error ?
I have been getting the same error message off and on for 2 days...quite annoying. I just cant figure out why one minute it works and the next it dont. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: The server encountered an error ?
I was getting lots of DeadLineExceeded exceptions. The status page showed Elevated for both the datastore and task queues. On Wed, Oct 27, 2010 at 7:53 PM, Bethany bethanyp...@gmail.com wrote: I have been getting the same error message off and on for 2 days...quite annoying. I just cant figure out why one minute it works and the next it dont. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Rohit -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: The server encountered an error ?
I'm seeing the same for app uploads :( Errors 500 and then 409, because rollback in upload has not finished correctly. On Wed, Oct 27, 2010 at 7:54 PM, Rohit rjenv...@gmail.com wrote: I was getting lots of DeadLineExceeded exceptions. The status page showed Elevated for both the datastore and task queues. On Wed, Oct 27, 2010 at 7:53 PM, Bethany bethanyp...@gmail.com wrote: I have been getting the same error message off and on for 2 days...quite annoying. I just cant figure out why one minute it works and the next it dont. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Rohit -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: The server encountered an error ?
yep me too. system status says there is an Anomaly with the Datastore that is being investigated. :O -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: The server encountered an error ?
Error 500 is the one i get over and over again :( On Wed, Oct 27, 2010 at 10:00 PM, Dmitry Anipko dmitry.ani...@gmail.comwrote: I'm seeing the same for app uploads :( Errors 500 and then 409, because rollback in upload has not finished correctly. On Wed, Oct 27, 2010 at 7:54 PM, Rohit rjenv...@gmail.com wrote: I was getting lots of DeadLineExceeded exceptions. The status page showed Elevated for both the datastore and task queues. On Wed, Oct 27, 2010 at 7:53 PM, Bethany bethanyp...@gmail.com wrote: I have been getting the same error message off and on for 2 days...quite annoying. I just cant figure out why one minute it works and the next it dont. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Rohit -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Bethany Pond -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: The server encountered an error ?
Would a state of elevated for datastor or task queues affect deployments? I'm unable to deploy my app. On Wed, Oct 27, 2010 at 11:02 PM, blackpawn pharmapsycho...@gmail.comwrote: yep me too. system status says there is an Anomaly with the Datastore that is being investigated. :O -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
RE: [google-appengine] Instance maximum number of requests
Does appengine do this in a way which is safe to a heavily-loaded application? i.e. load the new instance while the old instance is still serving requests and then simply re-direct requests to the new instance? Something like this should really be documented. From: google-appengine@googlegroups.com [mailto:google-appeng...@googlegroups.com] On Behalf Of Ikai Lan (Google) Sent: Thursday, October 28, 2010 6:50 AM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] Instance maximum number of requests Yes. Application instances are meant to be relatively short lived. Once each instance has served a certain amount of requests, we will gracefully terminate it and spin up a new instance to take its place. The number of requests to trigger this limit is subject to change for performance tuning reasons, but it should be in the ballpark of tens of thousands of requests. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com http://googleappengine.blogspot.com/ Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Wed, Oct 27, 2010 at 1:50 PM, nickmilon nickmi...@gmail.com wrote: I was doing some load tests on app engine today when I noticed a new Info message in the logs: After handling this request, the process that handled this request reached the maximum number of requests that may be handled in a single process' lifetime, and exited normally. So what that supposed to mean ? Up to know we new that application instances are automatically terminated after some inactivity time out. If I understand this message well now we know that a process can be terminated after handling so many requests. How many exactly ? is this a new magic number ? Lets hope we will have some answers from the always helpful App Engines team. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com mailto:google-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: The server encountered an error ?
We experience lots of timeouts too. I think Google guys are trying to upgrade their infrastructure during the nights and we see some side effects... -- superco...@gmail.com On Wed, Oct 27, 2010 at 10:04 PM, Sundar cyberto...@gmail.com wrote: Would a state of elevated for datastor or task queues affect deployments? I'm unable to deploy my app. On Wed, Oct 27, 2010 at 11:02 PM, blackpawn pharmapsycho...@gmail.com wrote: yep me too. system status says there is an Anomaly with the Datastore that is being investigated. :O -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: The server encountered an error ?
And now it's all ok. It's amazing how well it works when it does, and how I have crazy anxiety when things go wonky on GAE :) On Wed, Oct 27, 2010 at 11:04 PM, Sundar cyberto...@gmail.com wrote: Would a state of elevated for datastor or task queues affect deployments? I'm unable to deploy my app. On Wed, Oct 27, 2010 at 11:02 PM, blackpawn pharmapsycho...@gmail.comwrote: yep me too. system status says there is an Anomaly with the Datastore that is being investigated. :O -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: The server encountered an error ?
Thanks GAE team for the quick action~ On Oct 28, 11:12 am, Sundar cyberto...@gmail.com wrote: And now it's all ok. It's amazing how well it works when it does, and how I have crazy anxiety when things go wonky on GAE :) On Wed, Oct 27, 2010 at 11:04 PM, Sundar cyberto...@gmail.com wrote: Would a state of elevated for datastor or task queues affect deployments? I'm unable to deploy my app. On Wed, Oct 27, 2010 at 11:02 PM, blackpawn pharmapsycho...@gmail.comwrote: yep me too. system status says there is an Anomaly with the Datastore that is being investigated. :O -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: The server encountered an error ?
Awesome. -- superco...@gmail.com On Wed, Oct 27, 2010 at 10:24 PM, Raymond C. windz...@gmail.com wrote: Thanks GAE team for the quick action~ On Oct 28, 11:12 am, Sundar cyberto...@gmail.com wrote: And now it's all ok. It's amazing how well it works when it does, and how I have crazy anxiety when things go wonky on GAE :) On Wed, Oct 27, 2010 at 11:04 PM, Sundar cyberto...@gmail.com wrote: Would a state of elevated for datastor or task queues affect deployments? I'm unable to deploy my app. On Wed, Oct 27, 2010 at 11:02 PM, blackpawn pharmapsycho...@gmail.comwrote: yep me too. system status says there is an Anomaly with the Datastore that is being investigated. :O -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: The server encountered an error ?
+1, it is appreciated. =T= On Oct 27, 2010, at 8:53 PM, supercobra wrote: Awesome. -- superco...@gmail.com On Wed, Oct 27, 2010 at 10:24 PM, Raymond C. windz...@gmail.com wrote: Thanks GAE team for the quick action~ On Oct 28, 11:12 am, Sundar cyberto...@gmail.com wrote: And now it's all ok. It's amazing how well it works when it does, and how I have crazy anxiety when things go wonky on GAE :) On Wed, Oct 27, 2010 at 11:04 PM, Sundar cyberto...@gmail.com wrote: Would a state of elevated for datastor or task queues affect deployments? I'm unable to deploy my app. On Wed, Oct 27, 2010 at 11:02 PM, blackpawn pharmapsycho...@gmail.comwrote: yep me too. system status says there is an Anomaly with the Datastore that is being investigated. :O -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: datastore advice?
There are no tables on App Engine, only Kinds which are arbitrary collections of properties. In fact, all applications' entities are stored in a single bigtable table. Entity groups refers to a logical group of entities that are physically stored together; this allows that group of entities to be updated in a transaction. If you make entity groups with lots and lots of entities in them your data can not be sharded across bigtable tablets. That means if you are try to write 5 entities in that group the writes are done serially. Fetches will also be less efficient for the same reasons. You can read all about these topics: http://code.google.com/appengine/articles/datastore/overview.html Robert On Wed, Oct 27, 2010 at 21:40, sodso sodhisoluti...@gmail.com wrote: Hi Ikan Lan, I have seen this on so many discussions here in the forums - A best practice, however, is to keep entity groups as small as possible As far as I understand it, one Model class should not have too many records i.e. one table should not have many records Isn't this strange ? When we talk of GAE, we talk of scalability but if the best practice says to limit ther records to only a few in a Model class, what use is the scalability for ? If we store millions fo records (for eg- customer records) in one db.Model table, are you saying it would really impact the performance. Please correct me if I am wrong. I am unclear if my app can survive on GAE if its working with millions of records in one db.Model table ?? Thanks, Sodso On Oct 27, 11:27 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Generally speaking: no. Entity groups will guarantee a stronger chance of data locality, but this should not affect index traversal or batch reads. A best practice, however, is to keep entity groups as small as possible. There aren't many compelling reasons to not use root entities if you don't need transactions, as working with root entities is generally simpler. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Tue, Oct 26, 2010 at 3:26 PM, djidjadji djidja...@gmail.com wrote: Parent and child objects are stored in the same Bigtable node. This is done for the transactions. A transaction works on a single entity-group. If you perform a query you use an index to find the objects needed. At this point there is no performance penalty for parent or child objects that match the query. The query results in a number of keys of objects that need to be retrieved. The best query responds time is when the objects to fetch are stored in as many Bigtable nodes as possible (parallel fetch). Why do you need so many child objects? Can you implement it with adding a Parent Reference Property to the child object and thus remove the need to store the entity group all in one Bigtable node? The parent-child objects are needed 1) if you need transactions on them or 2) if you want to extract the parent key given a child key Perform a keys_only query on child objects and from these keys get the set of parent keys of objects that you need to fetch complete. Brett Slatkin uses this technique in a number of Google IO talks, the child object has a ListProperty that is used in the keys_only query. Most other applications can be implemented without the explicit parent object. 2010/10/26 Charles char...@whoischarles.com: Hi all, I'm wondering, since the datastore is hierarchical, does the number of children an entity has affect the performance on querying on the parents themselves? For example, if I have a set of parents, say... Jane Margaret Graham Arthur ...and I have a set of children associated with those parents... Jane -Sam -Robert Margaret -Lisa Graham Arthur -Rowen -Jerry ...will the number of children for each parent affect the performance of querying the parents themselves? For instance, if I wanted to select all of the parents (SELECT * FROM parents), that would be easy with the data above. But, since the datastore is hierarchical, does the performance get hampered if say the parents have many thousands or even millions of children? Say, like... Jane -Sam -Robert ...1 million more Margaret ... If so, I'm just wondering if it would make more sense to make the children root entities too, so as not to affect the performance of querying on the parents. Anyways, hope I've explained my question well enough. Thanks in advance! Charles -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to