[appengine-java] Re: The index for this query is not ready to serve
The problem has be solved. I need to wait for 4 hours. Here is the story There were about 300 test records in the table. We deleted those records and deployed new version. In console pannle it was displaying total 2 indexes. 1 was completed instantly but 1 was in queue. I was getting error because the index was not build instantly. It is strange it takes 4 hours to build. On Jun 5, 8:08 am, John Patterson jdpatter...@gmail.com wrote: This would be one of the most explicit error messages I have ever seen. Are you saying that the admin page said the index is not building? On 5 Jun 2010, at 21:28, Manjoor wrote: Just uploaded an app and got the error Uncaught exception from servlet com.google.appengine.api.datastore.DatastoreNeedIndexException: The index for this query is not ready to serve. See the Datastore Indexes page in the Admin Console.. datastore-index kind=UserMaster ancestor=false source=manual property name=__key__ direction=desc/ /datastore-index any idea? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com . To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com . For more options, visit this group athttp://groups.google.com/group/google-appengine-java?hl=en .- Hide quoted text - - Show quoted text - -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: The index for this query is not ready to serve
The problem has been solved. I need to wait for 4 hours. Here is the story There were about 300 test records in the table. We deleted those records and deployed new version. In console pannle it was displaying total 2 indexes. 1 was completed instantly but 1 was in queue. I was getting error because the index was not build instantly. It is strange it takes 4 hours to build. On Jun 5, 8:08 am, John Patterson jdpatter...@gmail.com wrote: This would be one of the most explicit error messages I have ever seen. Are you saying that the admin page said the index is not building? On 5 Jun 2010, at 21:28, Manjoor wrote: Just uploaded an app and got the error Uncaught exception from servlet com.google.appengine.api.datastore.DatastoreNeedIndexException: The index for this query is not ready to serve. See the Datastore Indexes page in the Admin Console.. datastore-index kind=UserMaster ancestor=false source=manual property name=__key__ direction=desc/ /datastore-index any idea? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com . To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com . For more options, visit this group athttp://groups.google.com/group/google-appengine-java?hl=en .- Hide quoted text - - Show quoted text - -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] application search!
Hi, Is the applications during development is searchable by other users? like, can someone come game1.appspot.com although it isnt advertised yet? Please elighten. regards, Ijaz -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] How to stop development server from command line?
Hi, I am not able to stop development server. I am starting it from command prompt using ANT script. I have created ANT script (build.xml) according to tutorial given by Google itself. My development App server starts successfully and I am able to test my app also. But when I press Ctrl+C, only ANT script stops and development server keeps running in background. I have to stop it manually by killing the process using Windows Task Manager. Does anyone knows how to stop server through ANT script? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Can't use the google's Key class
I have a simple data class with the google's Key as a primary key. When I try to get an object by Key from a persistent manager, I get an exception. However if I wrap the key in ObjectIdentity(ClassName.class, key), everything works fine. Is it intended to be so or did I misconfigure something? Konstantin -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: GAE and Google Apps
Hi, On Jun 7, 1:51 am, i...@ontologycentral.com i...@ontologycentral.com wrote: However, I get a: This webpage is not available. The webpage athttps://appengine.google.com/_ah/login?continue=https://appengine.goo.. when I try to accept the admin invite. ok, hitting reload a couple of times helped. The joys of Google's account magic... Cheers, Andreas. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Performance issue for GAE auto-restart
Hey, The logs show what is being GET for any message. When loading some pages, I noticed that, beyond the initial delay of the page, I saw an 8s delay on one of the javascript files that was referenced in the code. When I checked the GAE logs, I saw a startup request for the initial GET for the HTML and then one immediately following GET for the javascript file. I suppose it is possible that this was a new instance spawning (instead of a restart), but I find that unlikely since I was the only user of my application. Or, if it is the case that GAE needs to spawn multiple JVMs to support one full page request, I think that is a problem :) Anyways, end result is that from a period of inactivity with no instances running, I went to my homepage once and saw two loading requests in the logs right after one another for that single page load. This has happened more than once. Granted, it's now been a couple of weeks since I last tested this behavior, but I haven't heard any feedback on my issue to suggest that it has changed. Jake On Jun 5, 8:45 pm, Thomas mylee...@gmail.com wrote: Hi Jake: I am curious about how do you know there were 2 startup during one request? Did you submit an issue about the phenomenon? On 6月6日, 上午2時34分, Jake jbrooko...@cast.org wrote: Hey Thomas, I get it all the time - to the point where all of my demonstration applications are using the development server hosted on a non-GAE machine :) Anyways, Ikai is (was) aware of the issue from awhile back, but I'm not sure it's taking priority. Jake -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Performance issue for GAE auto-restart
Hey, Here's a concrete example. One page load, 3 loading requests: one for the library page, another for a CSS file for that page, and a third for an image on that page. The end result, after a lot of optimization, is 24 seconds from initial page arrival to full display. And, it's likely that by the time the page has displayed, the JVM instance has shut down and the next user interaction will cause another loading request. 05-27 08:59AM 16.068 /resources/indira/img/buttons/share_o.png 200 4665ms 4160cpu_ms 1kb Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3,gzip(gfe) 05-27 08:59AM 20.707 This request caused a new process to be started for your application, and thus caused your application code to be loaded for the first time. This request may thus take longer and use more CPU than a typical request for your application. 05-27 08:59AM 05.109 /resources/org.apache.wicket.Application/css/ tht.css 200 4014ms 3946cpu_ms 0kb Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3,gzip(gfe) 05-27 08:59AM 09.100 This request caused a new process to be started for your application, and thus caused your application code to be loaded for the first time. This request may thus take longer and use more CPU than a typical request for your application. 05-27 08:58AM 56.380 /library;jsessionid=fU8dpFQMEe1Ec3BqNEY2vQ 200 8394ms 8142cpu_ms 170api_cpu_ms 3kb Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.2.3) Gecko/20100401 Firefox/ 3.6.3,gzip(gfe) 05-27 08:59AM 04.773 This request caused a new process to be started for your application, and thus caused your application code to be loaded for the first time. This request may thus take longer and use more CPU than a typical request for your application. Thanks! Jake On Jun 7, 9:40 am, Jake jbrooko...@cast.org wrote: Hey, The logs show what is being GET for any message. When loading some pages, I noticed that, beyond the initial delay of the page, I saw an 8s delay on one of the javascript files that was referenced in the code. When I checked the GAE logs, I saw a startup request for the initial GET for the HTML and then one immediately following GET for the javascript file. I suppose it is possible that this was a new instance spawning (instead of a restart), but I find that unlikely since I was the only user of my application. Or, if it is the case that GAE needs to spawn multiple JVMs to support one full page request, I think that is a problem :) Anyways, end result is that from a period of inactivity with no instances running, I went to my homepage once and saw two loading requests in the logs right after one another for that single page load. This has happened more than once. Granted, it's now been a couple of weeks since I last tested this behavior, but I haven't heard any feedback on my issue to suggest that it has changed. Jake On Jun 5, 8:45 pm, Thomas mylee...@gmail.com wrote: Hi Jake: I am curious about how do you know there were 2 startup during one request? Did you submit an issue about the phenomenon? On 6月6日, 上午2時34分, Jake jbrooko...@cast.org wrote: Hey Thomas, I get it all the time - to the point where all of my demonstration applications are using the development server hosted on a non-GAE machine :) Anyways, Ikai is (was) aware of the issue from awhile back, but I'm not sure it's taking priority. Jake -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Performance issue for GAE auto-restart
Hi Jake: By default, all css/image files should be treated as static files. It seems that your css/image files were not served as static files. I think you should check your static files setting. Please refer to http://code.google.com/intl/en/appengine/docs/java/config/appconfig.html#Static_Files_and_Resource_Files Hope it helps! -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Performance issue for GAE auto-restart
Hi Jack: I suggest that maybe you can write a ServletContextListener to monitor the web instance reloading issue, for our testing we just put a info logging in the contextInitialized(..) method: public void contextInitialized(ServletContextEvent evt) { log.info(Web context inited.); } And modify the DEFAULT logging level to INFO in the logging.properties file. If the web instance was reloaded, we could trace this in the logging messages. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Performance issue for GAE auto-restart
Hi all, @Thomas: I will look into that, thank you. The way we generate our pages in this framework, however, involves some interesting dynamic generation of image URLs that are mounted within the application itself. It ends up being a bit more complicated than just displaying one string or another for the src attribute. Whether this is a good practice on GAE is certainly up for debate, but I presume this wouldn't help the frequent restart issue, correct? It just means that fewer files would be able to trigger a restart? @Tin: I'm not sure I understand what I will learn from this. From what I understand, contextDestroyed() is never called so all I would see is an additional log statement near GAE's loading request logging line? I've never used a ServletContextListener, so perhaps it has other features that I'm not aware of? Thanks! Jake On Jun 7, 11:41 am, Tin tin.c...@gmail.com wrote: Hi Jack: I suggest that maybe you can write a ServletContextListener to monitor the web instance reloading issue, for our testing we just put a info logging in the contextInitialized(..) method: public void contextInitialized(ServletContextEvent evt) { log.info(Web context inited.); } And modify the DEFAULT logging level to INFO in the logging.properties file. If the web instance was reloaded, we could trace this in the logging messages. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: JSONMarshaller on GAE
Hi François, does the problem occur in unit tests too? Do you custom types? JSONMarshaller has some problems with classloaders and custom types: http://code.google.com/p/jsonmarshaller/issues/detail?id=25 Cheers, Marc. -- Blog: http://mguillem.wordpress.com François wrote: This is happening locally. I'm using eclipse galileo. I tested all the tips i found on this page http://groups.google.com/group/google-appengine-java/browse_thread/thread/67cb7cdaefc8429f but i'm still stuck. Thank you for your time. On 2 juin, 00:42, Ikai L (Google) ika...@google.com wrote: Is this exception happening locally or in production? Are you using an IDE? Which one? On Tue, Jun 1, 2010 at 7:01 AM, François francois.poi...@gmail.com wrote: I'm trying to add the jar of jsonmarshaller to my application but i'm getting the classdefnotfound exception even though my jar is inside the web-inf/lib folder and has been added to the build path. here is the jar i'm adding http://code.google.com/p/jsonmarshaller/downloads/detail?name=json-0 -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- Ikai Lan Developer Programs Engineer, Google App Engine Blog:http://googleappengine.blogspot.com Twitter:http://twitter.com/app_engine Reddit:http://www.reddit.com/r/appengine -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Custom settings aplication
Hi, I'm starting to develop an application in AppEngine with Java. I have a question that has not been resolved by searching the Web. My application needs a table or file to save settings as general for the entire application. Try creating a class Administration which was persistent, but could not, because JDO and JPA is meant to save entities, not tables key-value. What would be the right way to fix this? Sorry for my english, it's very bad, i know and thanks! Maxi -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Class guestbook.Greeting does not seem to have been enhanced
Hello all, I am working on persistence in Google app engine. When I tried doing the same with the simple guestbook app provided I land into this error.. --- Class guestbook.Greeting does not seem to have been enhanced You may want to rerun the enhancer and check for errors in the output. has no table in the database, but the operation requires it. Please check the specification of the MetaData for this class. - I am sure many of you here who had worked on this would have found a way out of this, It will be great if one of you can guide me out of this.. Regrads Naveen -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] java.lang.NoClassDefFoundError: org/apache/tools/ant/ExitException
java.lang.NoClassDefFoundError: org/apache/tools/ant/ExitException can anyone tell why this happen? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Sending XMPP message with HTML anchor tag
Hello. I can send XMPP messages to the Google Talk client using the API provided with GAE. However, I'd like to send a link that people can click on, as well as do some simple formatting. These links contain a lot of request parameters, so they are long and messy- looking. I'd prefer to hide that detail in an HTML anchor tag. How do I use the API to format a message to accomplish this? Does the API support generating messages with embedded XHTML as described in http://xmpp.org/extensions/xep-0071.html ? Does the Google Talk client recognize XHTML? When building the Message, I've tried various combinations of html and body tags in an attempt to make the resulting Message look something like Example 1 in the document above. If I don't build the Message with .asXml(true) , then all the html tag information gets printed in the Google Talk client as text. If I try to use .asXml(true), then that section of the message body is ignored in the Google Talk client. For example, I try generating message text as follows: StringBuilder buffer = new StringBuilder(); // Will hold message text buffer.append(html xmlns=\http://jabber.org/protocol/xhtml-im \); buffer.append(body xmlns=\http://www.w3.org/1999/xhtml\;); // ... some XHTML is generated here, including a/a tags ... buffer.append(/body); buffer.append(/html); The toString() result of this buffer is then fed in as messageText in : Message msg = new MessageBuilder() .withRecipientJids(jid) .withBody(messageText) // .asXml(true) .build(); (The code just follows the examples in the documentation. Note asXml(true) was commented out). The result in the Google Talk client doesn't recognize the XHTML, so it looks too messy. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Custom settings aplication
Hi, I'm starting to develop an application in AppEngine with Java. I have a question that has not been resolved by searching the Web. My application needs a table or file to save settings as general for the entire application. Try creating a class Administration which was persistent, but could not, because JDO and JPA is meant to save entities, not tables key-value. What would be the right way to fix this? Sorry for my english, it's very bad, i know and thanks! Maxi -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Frontend Auth Redirect not working.
I started with the the basic GWT/GAE project in Eclipse. This ends up with just the basic enter your name and then a dialog pop up. Now if I try and put in the front end authentication in the deployment xml file, the performance is this. The page will load but none of the dynamic code will be presented. The title is there and little else but it does not redirect to a login page. If you manually open a login page, login and then refresh the app it works just fine. Here is my web.xml: ?xml version=1.0 encoding=UTF-8? !DOCTYPE web-app PUBLIC -//Sun Microsystems, Inc.//DTD Web Application 2.3//EN http://java.sun.com/dtd/web-app_2_3.dtd; web-app !-- Servlets -- servlet servlet-namegreetServlet/servlet-name servlet-classcom.example.empGwtGae.server.GreetingServiceImpl/ servlet-class /servlet servlet-mapping servlet-namegreetServlet/servlet-name url-pattern/emptygwtgae/greet/url-pattern /servlet-mapping !-- Default page to serve -- welcome-file-list welcome-fileEmptyGwtGae.html/welcome-file /welcome-file-list security-constraint web-resource-collection web-resource-nameHome/web-resource-name url-pattern/emptygwtgae/*/url-pattern /web-resource-collection auth-constraint role-name*/role-name /auth-constraint user-data-constraint transport-guaranteeCONFIDENTIAL/transport-guarantee /user-data-constraint /security-constraint /web-app Likewise if you try and access the page with http instead of https it only shows the html of the page and none of the dynamic members. Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Need help on java.security.AccessControlException: access denied
Can you try placing the file into WEB-INF and setting filename to WEB-INF/ssma_std.txt? On Sat, Jun 5, 2010 at 4:42 PM, Nick lgfr...@gmail.com wrote: Hi, I'm new to GoogleAppEngine, please help me on resolving following erro... 1. I would like to read a ssma_stud.txt file as an input file. This file resides in a path web/ssma_stud.txt 2. As well, updated appengine-web.xml with following... system-properties property name=com.google.gdata.DisableCookieHandler value=true/ /system-properties 3. My objective is to read a text file and generate a HashMap which I can use into my servlet Code: String fileName = /ssma_stud.txt; ArrayList arrayListLineReadData = new ArrayList(); try { BufferedReader inBuffReader = new BufferedReader(new FileReader(fileName)); if (!inBuffReader.ready()) throw new IOException(); 4. on this line BufferedReader inBuffReader = new BufferedReader(new FileReader(fileName)); I get following error..: java.security.AccessControlException: access denied (java.io.FilePermission \ssma_stud.txt read) at java.security.AccessControlContext.checkPermission(AccessControlContext.java: 323) at java.security.AccessController.checkPermission(AccessController.java: 546) at java.lang.SecurityManager.checkPermission(SecurityManager.java: 532) at com.google.appengine.tools.development.DevAppServerFactory $CustomSecurityManager.checkPermission(DevAppServerFactory.java:166) at java.lang.SecurityManager.checkRead(SecurityManager.java:871) at java.io.FileInputStream.init(FileInputStream.java:100) at java.io.FileInputStream.init(FileInputStream.java:66) at java.io.FileReader.init(FileReader.java:41) at com.lgframe.design.C_Stud_Comb_Axial_Bend_Servlet.getArrayListLineReadData(C_Stud_Comb_Axial_Bend_Servlet.java: 411) at com.lgframe.design.C_Stud_Comb_Axial_Bend_Servlet.doPost(C_Stud_Comb_Axial_Bend_Servlet.java: 114) at javax.servlet.http.HttpServlet.service(HttpServlet.java:713) at javax.servlet.http.HttpServlet.service(HttpServlet.java:806) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java: 511) at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1166) at com.google.appengine.api.blobstore.dev.ServeBlobFilter.doFilter(ServeBlobFilter.java: 51) at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1157) at com.google.apphosting.utils.servlet.TransactionCleanupFilter.doFilter(TransactionCleanupFilter.java: 43) at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1157) at com.google.appengine.tools.development.StaticFileFilter.doFilter(StaticFileFilter.java: 122) at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1157) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java: 388) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java: 216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java: 182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java: 765) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java: 418) at com.google.apphosting.utils.jetty.DevAppEngineWebAppContext.handle(DevAppEngineWebAppContext.java: 70) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java: 152) at com.google.appengine.tools.development.JettyContainerService $ApiProxyHandler.handle(JettyContainerService.java:349) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java: 152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java: 542) at org.mortbay.jetty.HttpConnection $RequestHandler.content(HttpConnection.java:938) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:755) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java: 409) at org.mortbay.thread.QueuedThreadPool $PoolThread.run(QueuedThreadPool.java:582) -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to
[appengine-java] App Engine datastore does not support operator max.
Hi, I'm trying to get a max value using jdoql. My query is: Query query = pm.newQuery(select max(timeStamp) from + DBPrettyThing.class.getName()); But I'm getting this trace insted: Service method 'public abstract com.polillaSoft.prettyThingsTracker.client.PrettyThing com.polillaSoft.prettyThingsTracker.client.UserGService.getLastPrettyThing(long)' threw an unexpected exception: org.datanucleus.store.appengine.query.DatastoreQuery $UnsupportedDatastoreOperatorException: Problem with query SELECT max(timeStamp) FROM com.polillaSoft.prettyThingsTracker.server.DBPrettyThing: App Engine datastore does not support operator max. Is the app engine jdo not supporting max aggregate? Thanks, Iván -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Datastore design
I've the following scenario. a) Registered users can post recipes (we anticipate on 5000 different recipes) b) Each recipe is part of 1 or more categories (we anticipate 100 different categories) c) Registered users can vote for recipes d) Registered users must select the country they live in 1) The site will display a list of recipes ordered on popularity. Including paging, so users would be able to browse all recipes 2) The same as 1 but based on a chosen category 3) Popular recipes by users in a specific country What is the most popular recipe in a given country. Including paging, so users would be able to browse all recipes 4) Same a 3 but based on chosen category I wonder how I can design this scnario using the Google datastore. In a relational database I would use some group by functions. Cheers, Marcel -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Datastore design
Thanks, do you know if there is a demo site using thoughtsite? On Jun 7, 9:06 pm, Ikai L (Google) ika...@google.com wrote: Thoughtsite does something similar. Have you taken a look yet? http://google-opensource.blogspot.com/2010/05/open-sourcing-thoughtsi... On Mon, Jun 7, 2010 at 11:48 AM, Marcel Overdijk marceloverd...@gmail.comwrote: I've the following scenario. a) Registered users can post recipes (we anticipate on 5000 different recipes) b) Each recipe is part of 1 or more categories (we anticipate 100 different categories) c) Registered users can vote for recipes d) Registered users must select the country they live in 1) The site will display a list of recipes ordered on popularity. Including paging, so users would be able to browse all recipes 2) The same as 1 but based on a chosen category 3) Popular recipes by users in a specific country What is the most popular recipe in a given country. Including paging, so users would be able to browse all recipes 4) Same a 3 but based on chosen category I wonder how I can design this scnario using the Google datastore. In a relational database I would use some group by functions. Cheers, Marcel -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2B unsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- Ikai Lan Developer Programs Engineer, Google App Engine Blog:http://googleappengine.blogspot.com Twitter:http://twitter.com/app_engine Reddit:http://www.reddit.com/r/appengine -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: many to many relation with additional attribut
Thank you very much Ian! I've implemented your solution but now I struggle with adding a Link to the database: A record of entity 1 and one of entity 2 are stored in the database. How can I get them out of the database to put their keys into a new link? I don't know the keys of both entities because I never use them to identify the objects (I use Long values instead). Regards, Anna -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Need help on java.security.AccessControlException: access denied
I encountered the same problem. I have a configuration file and It contained same information for my app. If the file is located in /war/, everything is OK. However, some other paths , such as /war/config/, are not available for reading. Is there anybody who can explain this issue for me ? I will be appropriate. On Tue, Jun 8, 2010 at 2:38 AM, Ikai L (Google) ika...@google.com wrote: Can you try placing the file into WEB-INF and setting filename to WEB-INF/ssma_std.txt? On Sat, Jun 5, 2010 at 4:42 PM, Nick lgfr...@gmail.com wrote: Hi, I'm new to GoogleAppEngine, please help me on resolving following erro... 1. I would like to read a ssma_stud.txt file as an input file. This file resides in a path web/ssma_stud.txt 2. As well, updated appengine-web.xml with following... system-properties property name=com.google.gdata.DisableCookieHandler value=true/ /system-properties 3. My objective is to read a text file and generate a HashMap which I can use into my servlet Code: String fileName = /ssma_stud.txt; ArrayList arrayListLineReadData = new ArrayList(); try { BufferedReader inBuffReader = new BufferedReader(new FileReader(fileName)); if (!inBuffReader.ready()) throw new IOException(); 4. on this line BufferedReader inBuffReader = new BufferedReader(new FileReader(fileName)); I get following error..: java.security.AccessControlException: access denied (java.io.FilePermission \ssma_stud.txt read) at java.security.AccessControlContext.checkPermission(AccessControlContext.java: 323) at java.security.AccessController.checkPermission(AccessController.java: 546) at java.lang.SecurityManager.checkPermission(SecurityManager.java: 532) at com.google.appengine.tools.development.DevAppServerFactory $CustomSecurityManager.checkPermission(DevAppServerFactory.java:166) at java.lang.SecurityManager.checkRead(SecurityManager.java:871) at java.io.FileInputStream.init(FileInputStream.java:100) at java.io.FileInputStream.init(FileInputStream.java:66) at java.io.FileReader.init(FileReader.java:41) at com.lgframe.design.C_Stud_Comb_Axial_Bend_Servlet.getArrayListLineReadData(C_Stud_Comb_Axial_Bend_Servlet.java: 411) at com.lgframe.design.C_Stud_Comb_Axial_Bend_Servlet.doPost(C_Stud_Comb_Axial_Bend_Servlet.java: 114) at javax.servlet.http.HttpServlet.service(HttpServlet.java:713) at javax.servlet.http.HttpServlet.service(HttpServlet.java:806) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java: 511) at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1166) at com.google.appengine.api.blobstore.dev.ServeBlobFilter.doFilter(ServeBlobFilter.java: 51) at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1157) at com.google.apphosting.utils.servlet.TransactionCleanupFilter.doFilter(TransactionCleanupFilter.java: 43) at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1157) at com.google.appengine.tools.development.StaticFileFilter.doFilter(StaticFileFilter.java: 122) at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1157) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java: 388) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java: 216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java: 182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java: 765) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java: 418) at com.google.apphosting.utils.jetty.DevAppEngineWebAppContext.handle(DevAppEngineWebAppContext.java: 70) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java: 152) at com.google.appengine.tools.development.JettyContainerService $ApiProxyHandler.handle(JettyContainerService.java:349) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java: 152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java: 542) at org.mortbay.jetty.HttpConnection $RequestHandler.content(HttpConnection.java:938) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:755) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at
[appengine-java] Datastore stats
I am querying the __Stat_Kind__ kind. It does not return me entities about kinds that currently exist in the datastore but it includes entities about kinds that I had deleted more than a week ago. I am not so much concerned about it returning me the non-existent kinds - the doc does mention this scenario after all. But I am concerned that it does not return me info about my current kinds. Is this a known issue or am I doing something wrong? --- Also, on the dev server neither __Stat_Kind__ nor __Stat_Total__ return any entities. Which means I need to deploy my app to appspot before I can test this behavior. It would be nice if the dev server did return some basic info. Thanks, Keyur -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Class guestbook.Greeting does not seem to have been enhanced
Annotation problems will definitely do that. Other times, I've found that I need to do a Project - Clean from the Eclipse menu. I think that in some cases, the enhancement process just doesn't work quite right, and clean rebuilds it and the problem is solved. (This seemed to happen more often when accidentally editing and saving while a session was running in the development environment, but I never really investigated it. Not surprisingly, it happens mainly when adding or removing persisted properties, rather than when changing other code.) - Greg On Jun 7, 2:01 pm, Ikai L (Google) ika...@google.com wrote: Are you using Eclipse? Can you post your Greeting class? This type of error is likely a result of not annotating your Greeting class with @PersistenceCapable correctly. On Mon, Jun 7, 2010 at 3:54 AM, naveen shan naveenshang...@gmail.comwrote: Hello all, I am working on persistence in Google app engine. When I tried doing the same with the simple guestbook app provided I land into this error.. --- Class guestbook.Greeting does not seem to have been enhanced You may want to rerun the enhancer and check for errors in the output. has no table in the database, but the operation requires it. Please check the specification of the MetaData for this class. - I am sure many of you here who had worked on this would have found a way out of this, It will be great if one of you can guide me out of this.. Regrads Naveen -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- Ikai Lan Developer Programs Engineer, Google App Engine Blog:http://googleappengine.blogspot.com Twitter:http://twitter.com/app_engine Reddit:http://www.reddit.com/r/appengine- Hide quoted text - - Show quoted text - -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Version not ready error (but it's ready)
I keep on getting this during deployment: Deploying new version. Will check again in 1 seconds Will check again in 2 seconds Will check again in 4 seconds Will check again in 8 seconds Will check again in 16 seconds Will check again in 32 seconds Will check again in 64 seconds Will check again in 128 seconds Rolling back the update. java.lang.RuntimeException: Version not ready. This happens almost every time I deploy. The thing is, the application code deploys just fine, but this error prevents any updates to indexes or queues. In summary, the new version gets deployed to the app engine just fine. I can set it as default version and it works. What breaks is that any queues or indexes are not updated because they never get uploaded due to the above error. Please help. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] SDK 1.3.4 Development Mode showing import error blob/user
Use Eclipse (Version: 3.5.2.R35x_v20100210-0800-9hEiFzmFst- TiEn9hNYgDWg1XN8ulH_JvCNGB), develop within it, have 1.3.4 app engine sdk, using JPA. I have recently upgraded to app engine 1.3.4. Since upgrade, the Validating newly complied units in Development Mode window in Eclipse gives me new errors. That window is reporting errors (normal eclipse view does not show errors). My com.google.appengine.api.datastore.Blob is not found according to the error, and all Blob References fails. Also, I created an EMF like static class, and also the javax.persistence.EntityManagerFactory, and they also can't be found now (this application actually worked a while ago). I have checked the project build path, and libraries in the GWT SDK (using GWT), App Engine and JRE 6 jar are included. I tried to explicitly include the jpa and geronimo jars where these exist, but no luck with that approach. Anybody hit something like this? Perry -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Uploading to blobstore gives OutOfMemoryError
Anyone NOT getting an outOfMemory error? I tried to deploy to appengine, and don't get an outofmemory error, but instead eventually get a methodNotFound. Anyone have a small working example? Jean On Jun 5, 5:22 pm, Luai kassar luai.kas...@gmail.com wrote: I am getting OutOfMemoryError too for any file i try to upload . can someone explain what the problem is please? Thanks Luai. On Jun 3, 12:14 am,JeanHsu jeanhs...@gmail.com wrote: Hi all, I am trying to set up a basic file upload to blobstore, but I get this OutOfMemoryError: WARNING: Error for /_ah/upload/ aghvbWdkcmVzc3IcCxIVX19CbG9iVXBsb2FkU2Vzc2lvbl9fGMACDA java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:2786) at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:71) at javax.mail.internet.MimeMultipart.readTillFirstBoundary(MimeMultipart.java: 316) at javax.mail.internet.MimeMultipart.parse(MimeMultipart.java:186) at javax.mail.internet.MimeMultipart.getCount(MimeMultipart.java:109) at com.google.appengine.api.blobstore.dev.UploadBlobServlet.handleUpload(UploadBlobServlet.java: 135) at com.google.appengine.api.blobstore.dev.UploadBlobServlet.access $000(UploadBlobServlet.java:72) at com.google.appengine.api.blobstore.dev.UploadBlobServlet $1.run(UploadBlobServlet.java:100) at java.security.AccessController.doPrivileged(Native Method) at com.google.appengine.api.blobstore.dev.UploadBlobServlet.doPost(UploadBlobServlet.java: 98) at javax.servlet.http.HttpServlet.service(HttpServlet.java:713) at javax.servlet.http.HttpServlet.service(HttpServlet.java:806) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java: 511); I used the Memory Analyzer on Eclipse and it said that the memory leak suspect is QueuedThreadPool. I found this information about a memory leak bug: http://jira.codehaus.org/browse/JETTY-1188 How can I figure out what release of jetty is running locally? It looks like they fixed this in version 6.1.23: http://jira.codehaus.org/secure/ReleaseNote.jspa?projectId=11160vers... Has anyone else had this issue? Thanks, Jean -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Uploading to blobstore gives OutOfMemoryError
Here's what I get from live http headers when I deploy and try to upload. It tries to do a get on the uploadUrl, for test.nocache.js, and also later for css. I get a 405 Method Not Allowed for these. Any ideas why it's trying to do a get?? POST /_ah/upload/ AMmfu6ZRpZf67ospmbfJKHd0AKnI9LFkWSDeDuGECy_md0wTVCgPaA9nVuqSg3MUlLJM26dP9I421TDZriqztBSoT7vDEq_Eeel0lhoWwoD1JgFj2pA7bSI/ ALBNUaYATA2SyHej3Q3PwRuq5WJuE0QxgQPHYGMk/ HTTP/1.1 ... HTTP/1.1 200 OK Server: Upload Server Built on May 19 2010 13:39:25 (1274301565) Etag: N3jo2g Date: Tue, 08 Jun 2010 00:36:01 GMT Expires: Fri, 01 Jan 1990 00:00:00 GMT Cache-Control: no-cache, no-store, must-revalidate X-AppEngine-Estimated-CPM-US-Dollars: $0.52 X-AppEngine-Resource-Usage: ms=2 cpu_ms=0 api_cpu_ms=0 Content-Type: text/html Pragma: no-cache Content-Length: 2590 -- http://app-name.appspot.com/_ah/upload/AMmfu6ZRpZf67ospmbfJKHd0AKnI9LFkWSDeDuGECy_md0wTVCgPaA9nVuqSg3MUlLJM26dP9I421TDZriqztBSoT7vDEq_Eeel0lhoWwoD1JgFj2pA7bSI/ALBNUaYATA2SyHej3Q3PwRuq5WJuE0QxgQPHYGMk/test/test.nocache.js GET /_ah/upload/ AMmfu6ZRpZf67ospmbfJKHd0AKnI9LFkWSDeDuGECy_md0wTVCgPaA9nVuqSg3MUlLJM26dP9I421TDZriqztBSoT7vDEq_Eeel0lhoWwoD1JgFj2pA7bSI/ ALBNUaYATA2SyHej3Q3PwRuq5WJuE0QxgQPHYGMk/test/test.nocache.js HTTP/ 1.1 Host: app-name.appspot.com User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv: 1.9.2.3) Gecko/20100401 Firefox/3.6.3 Accept: */* Accept-Language: en-us,en;q=0.5 Accept-Encoding: gzip,deflate Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7 Keep-Alive: 115 Connection: keep-alive Referer: http://app-name.appspot.com/_ah/upload/AMmfu6ZRpZf67ospmbfJKHd0AKnI9LFkWSDeDuGECy_md0wTVCgPaA9nVuqSg3MUlLJM26dP9I421TDZriqztBSoT7vDEq_Eeel0lhoWwoD1JgFj2pA7bSI/ALBNUaYATA2SyHej3Q3PwRuq5WJuE0QxgQPHYGMk/ HTTP/1.1 405 Method Not Allowed Server: Upload Server Built on May 19 2010 13:39:25 (1274301565) Allow: POST Date: Tue, 08 Jun 2010 00:36:01 GMT Pragma: no-cache Expires: Fri, 01 Jan 1990 00:00:00 GMT Cache-Control: no-cache, no-store, must-revalidate Content-Length: 0 Content-Type: text/html On Jun 7, 5:10 pm, Jean Hsu jeanhs...@gmail.com wrote: Anyone NOT getting an outOfMemory error? I tried to deploy to appengine, and don't get an outofmemory error, but instead eventually get a methodNotFound. Anyone have a small working example? Jean On Jun 5, 5:22 pm, Luai kassar luai.kas...@gmail.com wrote: I am getting OutOfMemoryError too for any file i try to upload . can someone explain what the problem is please? Thanks Luai. On Jun 3, 12:14 am,JeanHsu jeanhs...@gmail.com wrote: Hi all, I am trying to set up a basic file upload to blobstore, but I get this OutOfMemoryError: WARNING: Error for /_ah/upload/ aghvbWdkcmVzc3IcCxIVX19CbG9iVXBsb2FkU2Vzc2lvbl9fGMACDA java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:2786) at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:71) at javax.mail.internet.MimeMultipart.readTillFirstBoundary(MimeMultipart.java: 316) at javax.mail.internet.MimeMultipart.parse(MimeMultipart.java:186) at javax.mail.internet.MimeMultipart.getCount(MimeMultipart.java:109) at com.google.appengine.api.blobstore.dev.UploadBlobServlet.handleUpload(UploadBlobServlet.java: 135) at com.google.appengine.api.blobstore.dev.UploadBlobServlet.access $000(UploadBlobServlet.java:72) at com.google.appengine.api.blobstore.dev.UploadBlobServlet $1.run(UploadBlobServlet.java:100) at java.security.AccessController.doPrivileged(Native Method) at com.google.appengine.api.blobstore.dev.UploadBlobServlet.doPost(UploadBlobServlet.java: 98) at javax.servlet.http.HttpServlet.service(HttpServlet.java:713) at javax.servlet.http.HttpServlet.service(HttpServlet.java:806) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java: 511); I used the Memory Analyzer on Eclipse and it said that the memory leak suspect is QueuedThreadPool. I found this information about a memory leak bug: http://jira.codehaus.org/browse/JETTY-1188 How can I figure out what release of jetty is running locally? It looks like they fixed this in version 6.1.23: http://jira.codehaus.org/secure/ReleaseNote.jspa?projectId=11160vers... Has anyone else had this issue? Thanks, Jean -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] On cron job - Request was aborted after waiting too long to attempt to service your request
Hi, On a cron job scheduled each minute, I get the following message 20-30 times a day on a very regular basis: Request was aborted after waiting too long to attempt to service your request. This may happen sporadically when the App Engine serving cluster is under unexpectedly high or uneven load. If you see this message frequently, please contact the App Engine team. As it says, contact the App Engine team, it is what I do here. My cron job is not executed in that case N.B: for today, I had it 20+ times around 1 PM (time of server) Is there anything that can be done to make sure that my cron job gets really executed every minute ? regards didier -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: SDK 1.3.4 Development Mode showing import error blob/user
Well, for those like me who hit this, just a few things I have learned: a) Writing an application with GWT and App Engine support is trickier than app engine by itself with some html front end (which I had working). You have to really keep track of the new folders created. b) I was hoping I could mix JPA objects between GWT and App Engine, and put my JPA enabled files into shared folder. This was a key problem took me a bit to understand, refering to the gwt xml file which looks there for dependencies by default. c) When one does this, and does understand that GWT expects things in shared to be consumed by GWT, more care is required. GWT could not resolve the libraries as it appears to use a different build library path than the app engine server code. d) I have (for now) recreated my GWT and App Engine project, and put my JPA related files in the server path (I know, Duh, well, ah well, I was in a hurry, you know the speel...) e) Whew, i'm working again, but with brain dead GWT UI... work on that tomorrow morning. The project now runs the the default GWT support, and my JPA objects are ready to be used in the project. I have to read a few more articles on how to transfer objects between the app engine proper and GWT (so far is seems complicated), and I was hoping to use my JPAs as POJOs even in GWT, but well, that I'm not clear on yet. This should help a searcher who hit my problem, and save several hours scratching their head, looking at web pages, and messing with the eclipse build path settings. Perry On Jun 7, 5:01 pm, Perry Dykes pdy...@gmail.com wrote: Use Eclipse (Version: 3.5.2.R35x_v20100210-0800-9hEiFzmFst- TiEn9hNYgDWg1XN8ulH_JvCNGB), develop within it, have 1.3.4 app engine sdk, using JPA. I have recently upgraded to app engine 1.3.4. Since upgrade, the Validating newly complied units in Development Mode window in Eclipse gives me new errors. That window is reporting errors (normal eclipse view does not show errors). My com.google.appengine.api.datastore.Blob is not found according to the error, and all Blob References fails. Also, I created an EMF like static class, and also the javax.persistence.EntityManagerFactory, and they also can't be found now (this application actually worked a while ago). I have checked the project build path, and libraries in the GWT SDK (using GWT), App Engine and JRE 6 jar are included. I tried to explicitly include the jpa and geronimo jars where these exist, but no luck with that approach. Anybody hit something like this? Perry -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] indexes and Eclipse plugin
I'm getting some very confusing behavior regarding indexes in my app. Maybe someone can help me figure out what's going on. I have a persistent entity, GameDataV1. I'd pushed several versions of my app to appspot with no issues until last week. Then, after a push, all indexes for GameDataV1 were gone. I could still query it based on the index in a dependent object, but all queries on fields in GameDataV1 failed. I tried pushing a new version to no avail. This evening I tried inspecting the datastore-indexes-auto.xml file running locally out of eclipse. I deleted the DB and indexes to start with a clean slate. In general, the first time I execute a query requiring an index, I see that index show up in the XML file. But periodically I'll run a query and the file will collapse to an empty datastore-indexes element. Queries continue to execute without error, but return 0 entries. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[google-appengine] Accesing config-files on the Engine
Hi I'm new with google app engine. I just deployed my Application molwind to the engine. In my web.xml i described a parameter for the ?xml version=1.0 encoding=ISO-8859-1? !DOCTYPE web-app PUBLIC -//Sun Microsystems, Inc.//DTD Web Application 2.3//EN http://java.sun.com/dtd/web-app_2_3.dtd; web-app servlet servlet-name Server /servlet-name servlet-class com.emd.worldwind.servlet.Server /servlet-class init-param param-nameconfigurl/param-name param-valuehttp://localhost:8080/files/config.txt/param-value /init-param /servlet servlet-mapping servlet-name Server /servlet-name url-pattern /MolWind /url-pattern /servlet-mapping /web-app That param-value is the path to the config-file on my Jetty-Server, where i developed the app. The config- file is located like: MyApp ..WEB-INF ..web.xml ..appengine-web.xml ..META-INF .. ..data .config.txt ..frontend Now my question is: Whats the location or url to acces my config-file thanks a lot nice regards -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: app-engine-data-pipelines session video
Also if someone knew what is the purpose of now / 30 in the task name, please: http://www.youtube.com/watch?v=zSDC_TU7rtc#t=41m35 Regards J. Záruba 2010/6/7 Jaroslav Záruba jaroslav.zar...@gmail.com Hello I'm reading through the PDF that Brett Slatkin has published for %subj %. http://tinyurl.com/3523mej In the video (the Fan-in part) Brett says that the work_index has to be a hash, so that 'you distribute the load across the BigTable' http://www.youtube.com/watch?v=zSDC_TU7rtc#t=48m44 And this is how work_index is created: work_index = '%s-%d' % (sum_name, knuth_hash(index)) ...which I guess creates something like 'votesMovieXYZ-54657651321987' My question is why only one half of work_index is hashed? Is it important? Would it be bad to do md5('%s-%d' % (sum_name, index)) so that the hash would be like '6gw8hq6'? Regards J. Záruba -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] can not access appengine.google.com
Hello; From Turkey I can not access my app-engine dashboard. Currently there is ip based restriction for youtube. For a few days, also we can not reach some google services (docs, appengine, chart api), as some ip's shared by youtube are banned also. So is there a way to connect to appengine, else than appengine.google.com domain. There may be another ip address for appengine. As it is ip based restriction, the 8.8.8.8 dns do not solve the problem. Please help, as I can not reach my dashboard for my applications... -- Enes Akar http://www.linkedin.com/pub/enes-akar/7/835/3aa -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Cannot delete blobs from the Google Dashboard
Dear Google, I am not able to delete blobs from your dashboard. I always get a generic error message (see the attached image). Please, could you solve quickly the problem on your servers? Thanks in advance Regards, Michele -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. attachment: dashboard.png
Re: [google-appengine] Re: Using GAE as external storage
I'm afraid, this won't work. My problem is quite exactly as the one described in http://groups.google.com/group/gs-discussion/msg/dd3bae779fecd633?hl=en On 10-06-04 23:05, ctran wrote: Google Storage for Developers or use S3 is much more suitable for your purpose. On Jun 3, 1:18 pm, Maaartin grajc...@seznam.cz wrote: I'm very new to GAE. I'm thinking about using GAE for storing huge quantities of data, sent and retrieved by a client. What I mean looks more like a remote file system then like a web app. Do I have to use https for the communication or is there something better? How can I store it most efficiently? The vast majority of my data belong to a single table looking like CREATE TABLE MyBlobs (id BINARY(32), content BLOB, PRIMARY KEY (id)) where the contents are a couple of kilobytes long, the ids are random- looking unrelated binary strings, and all queries look like INSERT INTO MyBlobs VALUES (id1, content1), (id2, content2), (id3, content3), or DELETE FROM MyBlobs WHERE id IN (id1, id2, id3, ) or SELECT * FROM MyBlobs WHERE id IN (id1, id2, id3, ) There will be no updates and no range searches nor alike. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Using GAE as external storage
is the data textual files? images? why not use blobstore service to store the files using a proprietary api and write a proprietary api to download them? its not supposed to be an issue or am i missing the point? - Cheers, public static function AlonCarmel() { //Contact me var email = 'a...@aloncarmel.me'; var twitter = '@aloncarmel'; var web = 'http://aloncarmel.me'; var phone = '+972-54-4860380'; } * If you received an unsolicited email from by mistake that wasn't of your matter please delete immediately. All E-mail sent from Alon Carmel is copyrighted to Alon Carmel 2008. Any details revealed in e-mails sent by Alon Carmel are owned by the Author only. Any attempt to duplicate or imitate any of the Content is prohibited under copyright law 2008. On Mon, Jun 7, 2010 at 2:32 PM, Maaartin-1 grajc...@seznam.cz wrote: I'm afraid, this won't work. My problem is quite exactly as the one described in http://groups.google.com/group/gs-discussion/msg/dd3bae779fecd633?hl=en On 10-06-04 23:05, ctran wrote: Google Storage for Developers or use S3 is much more suitable for your purpose. On Jun 3, 1:18 pm, Maaartin grajc...@seznam.cz wrote: I'm very new to GAE. I'm thinking about using GAE for storing huge quantities of data, sent and retrieved by a client. What I mean looks more like a remote file system then like a web app. Do I have to use https for the communication or is there something better? How can I store it most efficiently? The vast majority of my data belong to a single table looking like CREATE TABLE MyBlobs (id BINARY(32), content BLOB, PRIMARY KEY (id)) where the contents are a couple of kilobytes long, the ids are random- looking unrelated binary strings, and all queries look like INSERT INTO MyBlobs VALUES (id1, content1), (id2, content2), (id3, content3), or DELETE FROM MyBlobs WHERE id IN (id1, id2, id3, ) or SELECT * FROM MyBlobs WHERE id IN (id1, id2, id3, ) There will be no updates and no range searches nor alike. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Indexes Not Building (again)
These indexes finished building over the weekend. Thanks ;) On Jun 4, 9:24 am, jread jr...@vendasta.com wrote: We added a new index to our app (appid: steprep-demo) 24 hours ago and it has yet to start building. Can someone give it a kickstart? We have also added the index this morning to our production app (appid: steprep) so it might need a kickstart as well. Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Email Service with 10K+ addresses in the cc list
have you experimented with shorter email groups. do we know the maximum recipients that can be safely added? I think maybe the only solution would be to split them into smaller individual tasks. On Jun 3, 3:00 am, Aurelian aurelian.vacar...@googlemail.com wrote: I was trying to send 1200 emails using a task queue, but it doesn't work, giving a error. I think you should split the list of receivers every 5000, and send 2 o 3 emails. Happy coding. On Jun 3, 7:45 am, Sandeep Arneja sandee...@gmail.com wrote: I am trying to send an email with about 10K+ addresses in the cc list. This is not for spam but in case i have maintainence on my application i send an email to all users informing them about the status. How should i design this? I see that google app engine in dev stops responding when i use Transport.send(msg); with 10K+ emails in cc even when the method is supposed to return asynchronously. Should i divide the email into smaller tasks and put on the queue or would the engine not hang in PROD? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Email Service with 10K+ addresses in the cc list
Has anyone experimented with shorter email bcc groups? Whats the maximum number of people I can have in a group without having the task fail? On Jun 3, 3:00 am, Aurelian aurelian.vacar...@googlemail.com wrote: I was trying to send 1200 emails using a task queue, but it doesn't work, giving a error. I think you should split the list of receivers every 5000, and send 2 o 3 emails. Happy coding. On Jun 3, 7:45 am, Sandeep Arneja sandee...@gmail.com wrote: I am trying to send an email with about 10K+ addresses in the cc list. This is not for spam but in case i have maintainence on my application i send an email to all users informing them about the status. How should i design this? I see that google app engine in dev stops responding when i use Transport.send(msg); with 10K+ emails in cc even when the method is supposed to return asynchronously. Should i divide the email into smaller tasks and put on the queue or would the engine not hang in PROD? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Account re-verification
Hello, I have already verified my account, but am being asked to do so again to add another application. I can't re-verify as it won't accept the same phone number twice. Could this be to do with my email changing to @gmail.com as part of the UK change from @googlemail.com? Hope you can help! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Deployment getting stuck
Seeing this as well. Robert On Jun 7, 4:11 am, Kelly A kelly.j.ander...@gmail.com wrote: Every time I try to deploy it just gets stuck. I have let it run for over an hour but the update never completes. Updates were happening fine earlier this morning. Any one have any suggestions on how I might fix this? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] give me a demo that have 'nomoal user signup' and openid user login
a demo or a framework on gae -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: An introduction to the DataStore
yup, good work indeed! it's been very helpful, to people like me, too! coincidentally, from Athens, GA.. =) more power to you! On Jun 5, 9:23 pm, nickmilon nickmi...@gmail.com wrote: Good work and very yy helpfull ! Ciao (from Athens Greece) On Jun 5, 11:33 am, Luca luca.mas...@gmail.com wrote: Hi guys, thank to the work of our GTUG (http://sites.google.com/site/ firenzegtug/) I wrote an introduction to our loved/hated DataStore: http://www.lucamasini.net/Home/gwt/google-app-engine/introduction-to-... I'm aware that is very basic, but was useful to introduce the concepts. Hope can be useful to someone else too. Ciao. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Searching a Google Apps Domain Authenticated Application
I have a blogging application running on GAE that is only accessible to a specific Google Apps Domain. I need my users to be able to search the application. The options I can think of are: (1) The application is indexed by Google's crawler and results are returned with a simple Google search. But how with the application be crawled if it is only accessible by the specific Google Apps Domain? Will the results be returned to only the members of that domain? (2) Implement some sort of full-text indexing on the datastore for the application. Does anyone know how to do this? I would like to avoid queries on multiple fields using the likes of: startsWith, endsWith, matches, etc. Any assistance would be much appreciated. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Shows Datastore Quota Exceeded (100%) when 149 MB of 1GB only used
On the Dashboard we are getting Total Stored Data 100% 1.00 of 1.00 GBytes But on the Datastore Statistics we get 149 MBytes as the Size of all entities We are getting- The API call datastore_v3.Put() required more quota than is available. as an exception when we try to insert values in the database. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Application Code Loaded for the First Time
I keep getting the usual log message of: This request caused a new process to be started for your application, and thus caused your application code to be loaded for the first time. Looking through my app logs i'm seeing this message multiple times within ONE minute. I can understand if the site is idle for more than 5 minutes or so. But this is happening way too often, even when i'm getting a good amount of traffic. Am I doing something wrong here? Is there a way around this? I was going to just write a task queue that pings via RPC every minute or so but read this is a no, no. Understandable. Can we get some sort of workaround or solution to this problem. I would pay extra for my app to just be left on all of the time. Thanks, Brandon www.skatenav.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Application Code Loaded for the First Time
On Mon, Jun 7, 2010 at 7:17 PM, brandoneggar brandoneg...@gmail.com wrote: Looking through my app logs i'm seeing this message multiple times within ONE minute. I can understand if the site is idle for more than 5 minutes or so. I'm envious of you guys, my JVMs seem to fall asleep after 30s. Therefore to get the message two times within single minute is just usual. There's paid always-ready-and-waiting-JVM in the roadmap. Thanks, Brandon www.skatenav.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Application Code Loaded for the First Time
Hey, Several threads on this. I wonder why, after I started having the issue several months ago, it's getting so much attention now :) Anyways, star this issue: http://code.google.com/p/googleappengine/issues/detail?id=2931 :) Jake On Jun 7, 1:36 pm, Jaroslav Záruba jaroslav.zar...@gmail.com wrote: On Mon, Jun 7, 2010 at 7:17 PM, brandoneggar brandoneg...@gmail.com wrote: Looking through my app logs i'm seeing this message multiple times within ONE minute. I can understand if the site is idle for more than 5 minutes or so. I'm envious of you guys, my JVMs seem to fall asleep after 30s. Therefore to get the message two times within single minute is just usual. There's paid always-ready-and-waiting-JVM in the roadmap. Thanks, Brandon www.skatenav.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Deadline?
I was under the impression that the deadline for requests was 30 seconds, but my app is routinely throwing deadline exceptions after 10 seconds or so. Is there a reason for this? -- Patrick H. Twohig. Namazu Studios P.O. Box 34161 San Diego, CA 92163-4161 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Bulk upload - transform to uppercase?
I'm a Java guy, so I'm asking for something that's probably pitifully simple, but I can't find it. I need to write a bulk upload import transformer that takes a particular field from my source data and converts it to uppercase before storing it in the datastore. I can find how to convert a python string to uppercase by calling a method on it, but not how to do it as a one-arg transformer function. Any help is appreciated. -- Craig Berry - http://lapidum.org/home.html Magicians lie to the universe, and the universe believes them. -- Lenore Berry -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Deadline?
The ones that fail right at 10 seconds are usually due to the simultaneous dynamic request limit. Do the logs show this? Request was aborted after waiting too long to attempt to service your request because you have reached your simultaneous dynamic request limit. This is almost always due to excessively high latency in your app. Please see http://code.google.com/appengine/kb/general.html#activerequests for more details. -mike On Jun 7, 2:20 pm, Patrick Twohig patr...@namazustudios.com wrote: I was under the impression that the deadline for requests was 30 seconds, but my app is routinely throwing deadline exceptions after 10 seconds or so. Is there a reason for this? -- Patrick H. Twohig. Namazu Studios P.O. Box 34161 San Diego, CA 92163-4161 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Deadline?
Ah, that would make sense. On Mon, Jun 7, 2010 at 1:17 PM, Mike Wesner mike.wes...@webfilings.comwrote: The ones that fail right at 10 seconds are usually due to the simultaneous dynamic request limit. Do the logs show this? Request was aborted after waiting too long to attempt to service your request because you have reached your simultaneous dynamic request limit. This is almost always due to excessively high latency in your app. Please see http://code.google.com/appengine/kb/general.html#activerequests for more details. -mike On Jun 7, 2:20 pm, Patrick Twohig patr...@namazustudios.com wrote: I was under the impression that the deadline for requests was 30 seconds, but my app is routinely throwing deadline exceptions after 10 seconds or so. Is there a reason for this? -- Patrick H. Twohig. Namazu Studios P.O. Box 34161 San Diego, CA 92163-4161 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Patrick H. Twohig. Namazu Studios P.O. Box 34161 San Diego, CA 92163-4161 Office: 619.862.2890 x100 Cell: 619.453.5075 Twitter: @svm_invictvs IRC: svm_invic...@irc.freenode.net ##java, #android-dev, #iphonedev, #appengine http://www.namazustudios.com/ This communication, and any attachments, shall be considered confidential and proprietary information of Namazu Studios LLC. This message, and attachments, are intended for the listed recipients only. If you are not one of the intended recipients, please destroy all copies of this communication. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Email Service with 10K+ addresses in the cc list
If you send a bulk email like that, does it count as one email towards your quota or does it count as each recipient. I wrote a task that sends a single email to my entire subscriber base. WOuld I be saving money by using the BCC field? On Mon, Jun 7, 2010 at 8:34 AM, Sandeep Arneja sandee...@gmail.com wrote: Has anyone experimented with shorter email bcc groups? Whats the maximum number of people I can have in a group without having the task fail? On Jun 3, 3:00 am, Aurelian aurelian.vacar...@googlemail.com wrote: I was trying to send 1200 emails using a task queue, but it doesn't work, giving a error. I think you should split the list of receivers every 5000, and send 2 o 3 emails. Happy coding. On Jun 3, 7:45 am, Sandeep Arneja sandee...@gmail.com wrote: I am trying to send an email with about 10K+ addresses in the cc list. This is not for spam but in case i have maintainence on my application i send an email to all users informing them about the status. How should i design this? I see that google app engine in dev stops responding when i use Transport.send(msg); with 10K+ emails in cc even when the method is supposed to return asynchronously. Should i divide the email into smaller tasks and put on the queue or would the engine not hang in PROD? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Patrick H. Twohig. Namazu Studios P.O. Box 34161 San Diego, CA 92163-4161 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: give me a demo that have 'nomoal user signup' and openid user login
Dear friend, You can see http://code.google.com/p/super-easy/ as an example. But I can't check out the source code. If you have, plz share for us. Thanks. On Jun 7, 10:38 am, zjm1126 zjm1...@gmail.com wrote: a demo or a framework on gae -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Searching a Google Apps Domain Authenticated Application
Dear Greg, I would like to recommend for you a library which you can use in datastore: http://code.google.com/p/guestbook-example-appengine-full-text-search/ I have used it, it's easy to implement and powerful, but it parses our text into word token and store it as a new column and so it costs a little in your datastore. Enjoy! On Jun 7, 7:32 pm, Greg Atkinson greg.a.atkin...@gmail.com wrote: I have a blogging application running on GAE that is only accessible to a specific Google Apps Domain. I need my users to be able to search the application. The options I can think of are: (1) The application is indexed by Google's crawler and results are returned with a simple Google search. But how with the application be crawled if it is only accessible by the specific Google Apps Domain? Will the results be returned to only the members of that domain? (2) Implement some sort of full-text indexing on the datastore for the application. Does anyone know how to do this? I would like to avoid queries on multiple fields using the likes of: startsWith, endsWith, matches, etc. Any assistance would be much appreciated. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] GAE anti-DOS mechanism
Hello All, Does GAE have an anti-DOS mechanism? For example, if an IP makes over 10 requests/second, it sends you an email or blocks the IP and sends an email? regards, Tim. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Deployment getting stuck
Just adding a similar issue, yesterday around 10PM (GMT) i was cut out of the ability to deploy my application. appconfig.sh prints out everything up to 90% Deploying new version, and then 95% Rolling back the update, followed by these: java.io.IOException: Error posting to URL: https://appengine.google.com/api/appversion/deploy?app_id=ginasiosundergroundversion=1; 400 Bad Request Client Error (400) The request is invalid for an unspecified reason. Unable to update app: Error posting to URL: https://appengine.google.com/api/appversion/deploy?app_id=ginasiosundergroundversion=1; 400 Bad Request Client Error (400) The request is invalid for an unspecified reason. Please see the logs [/var/folders/Rc/Rcz8oxCmGqaOhRlmNBCnXU+++TI/-Tmp-/ appcfg387735674495154235.log] for further information. The mentioned log file itself is pretty useless, just tells me where in the stack trace was the attempt to send something that is yielding the 400 error, at com.google.appengine.tools.admin.AppAdminImpl.update(AppAdminImpl.java: 56). What's happening? I've checked the group for past issues like this, and got different reasons for each one. I've rechecked my web.xml, and looks ok (e.g., no multiline splitting, no non-ascii chars), and I'm sure none of my changes to the previous version is *that* drastic (i.e., no different jars nor classes, just static files updates) I'm sorry in advance if this isn't the right place to post such an issue, but it looked both content and timeframe related :) Thanks, Edgar Gonçalves On Jun 7, 2:31 am, Robert Munteanu robert.munte...@gmail.com wrote: Seeing this as well. Robert On Jun 7, 4:11 am, Kelly A kelly.j.ander...@gmail.com wrote: Every time I try to deploy it just gets stuck. I have let it run for over an hour but the update never completes. Updates were happening fine earlier this morning. Any one have any suggestions on how I might fix this? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Index doesn't seem to work
I know I'm using python below, but this is really a question about indexes. I am trying to sort a query by price (low to high) and the query looks like: q = models.Slot.all() q.filter('geoboxes =', geobox) q.filter('date =', dt) q.order('price') index.yaml looks like this: - kind: Slot properties: - name: geoboxes - name: date - name: price Now this all works just lovely on the SDK, but despite the indexes already being built on production, the wuery just will not sort by price. Should I delete the index and build it again? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Email Service with 10K+ addresses in the cc list
Each recipient in the bcc list counts towards one email credit On Jun 7, 4:24 pm, Patrick Twohig patr...@namazustudios.com wrote: If you send a bulk email like that, does it count as one email towards your quota or does it count as each recipient. I wrote a task that sends a single email to my entire subscriber base. WOuld I be saving money by using the BCC field? On Mon, Jun 7, 2010 at 8:34 AM, Sandeep Arneja sandee...@gmail.com wrote: Has anyone experimented with shorter email bcc groups? Whats the maximum number of people I can have in a group without having the task fail? On Jun 3, 3:00 am, Aurelian aurelian.vacar...@googlemail.com wrote: I was trying to send 1200 emails using a task queue, but it doesn't work, giving a error. I think you should split the list of receivers every 5000, and send 2 o 3 emails. Happy coding. On Jun 3, 7:45 am, Sandeep Arneja sandee...@gmail.com wrote: I am trying to send an email with about 10K+ addresses in the cc list. This is not for spam but in case i have maintainence on my application i send an email to all users informing them about the status. How should i design this? I see that google app engine in dev stops responding when i use Transport.send(msg); with 10K+ emails in cc even when the method is supposed to return asynchronously. Should i divide the email into smaller tasks and put on the queue or would the engine not hang in PROD? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Patrick H. Twohig. Namazu Studios P.O. Box 34161 San Diego, CA 92163-4161 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: app-engine-data-pipelines session video
not a python guy but, the purpose of int (now / 30) will be to come up with the same name for a span of time (30 milliseconds?). notice that int(1/30) = 0 int (3/30) = 0 int (29/30) = 0 and int(32/30) = 1. this is a way to come up with that task name uniquely. although now i'm confused because doesn't he say later on that time is a bad thing to use for synchronization and sequence numbers should be used instead? On Jun 7, 2:40 am, Jaroslav Záruba jaroslav.zar...@gmail.com wrote: Also if someone knew what is the purpose of now / 30 in the task name, please:http://www.youtube.com/watch?v=zSDC_TU7rtc#t=41m35 Regards J. Záruba 2010/6/7 Jaroslav Záruba jaroslav.zar...@gmail.com Hello I'm reading through the PDF that Brett Slatkin has published for %subj %. http://tinyurl.com/3523mej In the video (the Fan-in part) Brett says that the work_index has to be a hash, so that 'you distribute the load across the BigTable' http://www.youtube.com/watch?v=zSDC_TU7rtc#t=48m44 And this is how work_index is created: work_index = '%s-%d' % (sum_name, knuth_hash(index)) ...which I guess creates something like 'votesMovieXYZ-54657651321987' My question is why only one half of work_index is hashed? Is it important? Would it be bad to do md5('%s-%d' % (sum_name, index)) so that the hash would be like '6gw8hq6'? Regards J. Záruba -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: How to perform a task regularly every 1-4 seconds?
sounds like you're a perfect candidate for the fan-in problem. check out this i/o video: http://code.google.com/events/io/2010/sessions/high-throughput-data-pipelines-appengine.html On Jun 7, 12:20 am, Rye Terrell ryeterr...@ryeterrell.net wrote: Thanks, Nick. It looks like the task queue might work for me. I am doing an ajaxy thing; the user input messages are stored to the datastore, where they are processed by my task queue every 1-4 seconds. That task will store the response to each user in the datastore, where the user can retrieve it with an ajax poll. I am not sure how well it's going to scale. Each user message is stored as an individual datastore entry, so the task queue could conceivably be querying many messages. Each response, at the moment, is also an individual datastore entry. I can probably make all the responses into one large response datastore/memcache object. On Sun, Jun 6, 2010 at 10:41 PM, Nickolas Daskalou n...@daskalou.comwrote: You can add tasks to the Task Queue to overcome cron's 1-minute-minimum time interval by eg. creating a task that adds itself back into the Task Queue once it's completed (with an ETA of 1-4 seconds). However, is this some sort of AJAX-ie thing you're doing? Ie., will the processing of user input be a one-off thing to kick-start asynchronous output (and subsequent output every 1-4 seconds), or will there be user/browser input every 1-4 seconds that you need to respond to synchronously? If the latter, then right now your only option is polling. The good news is that Google are planning to release Comet-like features in the not too distant future. You can find out about it by following the links in Nick Johnson's latest blog post: http://blog.notdot.net/2010/06/Google-I-O-playlist-day-3-What-s-hot-i... Nick On 7 June 2010 12:12, Ryan ryeterr...@gmail.com wrote: I'd like to execute a short script that processes user input and creates output every 1-4 seconds. I can't use a cron, because I can at most execute this once every 1 minute. Is there some way to do this without requiring that something polls my app? Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: app-engine-data-pipelines session video
Hey all, The int(time.time()/30) part of the task name is to prevent queue stalls. When memcache gets evicted the work index counter will be reset to zero. That means new fork-join work items may insert tasks that are named the same as tasks that were already inserted. By including a time window of ~30 seconds in the task name, we ensure that this problem can only last for about thirty seconds. This is also why you should raise an exception when you see a TombstonedTaskError exception. Worst-case scenario if the clocks are wonky is that two tasks are run to do the fan-in work instead of just one, which is an acceptable trade-off in many cases and a fundamental possibility when using the task queue API. This can be mitigated using pigeon-hole acknowledgment entities, like I use in my materialized view example. Hope that helps, -Brett On Mon, Jun 7, 2010 at 2:14 PM, Tristan tristan.slomin...@gmail.com wrote: not a python guy but, the purpose of int (now / 30) will be to come up with the same name for a span of time (30 milliseconds?). notice that int(1/30) = 0 int (3/30) = 0 int (29/30) = 0 and int(32/30) = 1. this is a way to come up with that task name uniquely. although now i'm confused because doesn't he say later on that time is a bad thing to use for synchronization and sequence numbers should be used instead? On Jun 7, 2:40 am, Jaroslav Záruba jaroslav.zar...@gmail.com wrote: Also if someone knew what is the purpose of now / 30 in the task name, please:http://www.youtube.com/watch?v=zSDC_TU7rtc#t=41m35 Regards J. Záruba 2010/6/7 Jaroslav Záruba jaroslav.zar...@gmail.com Hello I'm reading through the PDF that Brett Slatkin has published for %subj %. http://tinyurl.com/3523mej In the video (the Fan-in part) Brett says that the work_index has to be a hash, so that 'you distribute the load across the BigTable' http://www.youtube.com/watch?v=zSDC_TU7rtc#t=48m44 And this is how work_index is created: work_index = '%s-%d' % (sum_name, knuth_hash(index)) ...which I guess creates something like 'votesMovieXYZ-54657651321987' My question is why only one half of work_index is hashed? Is it important? Would it be bad to do md5('%s-%d' % (sum_name, index)) so that the hash would be like '6gw8hq6'? Regards J. Záruba -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: app-engine-data-pipelines session video
Thank you, Brett. Would it be wrong to hash whole work_index instead of only hashing its second half? sum_name, knuth_hash(index) By md5-ing only the sequence number I get work_index of 'mySumName' + 32B. If I hashed mySumName together with the seq.number the key would be only 32B. (Still quite huge though.) Given how frequent a vote entity is I would like to have the keys as short as possible. Regards J. Záruba On Mon, Jun 7, 2010 at 11:21 PM, Brett Slatkin brett-appeng...@google.comwrote: Hey all, The int(time.time()/30) part of the task name is to prevent queue stalls. When memcache gets evicted the work index counter will be reset to zero. That means new fork-join work items may insert tasks that are named the same as tasks that were already inserted. By including a time window of ~30 seconds in the task name, we ensure that this problem can only last for about thirty seconds. This is also why you should raise an exception when you see a TombstonedTaskError exception. Worst-case scenario if the clocks are wonky is that two tasks are run to do the fan-in work instead of just one, which is an acceptable trade-off in many cases and a fundamental possibility when using the task queue API. This can be mitigated using pigeon-hole acknowledgment entities, like I use in my materialized view example. Hope that helps, -Brett On Mon, Jun 7, 2010 at 2:14 PM, Tristan tristan.slomin...@gmail.comwrote: not a python guy but, the purpose of int (now / 30) will be to come up with the same name for a span of time (30 milliseconds?). notice that int(1/30) = 0 int (3/30) = 0 int (29/30) = 0 and int(32/30) = 1. this is a way to come up with that task name uniquely. although now i'm confused because doesn't he say later on that time is a bad thing to use for synchronization and sequence numbers should be used instead? On Jun 7, 2:40 am, Jaroslav Záruba jaroslav.zar...@gmail.com wrote: Also if someone knew what is the purpose of now / 30 in the task name, please:http://www.youtube.com/watch?v=zSDC_TU7rtc#t=41m35 Regards J. Záruba 2010/6/7 Jaroslav Záruba jaroslav.zar...@gmail.com Hello I'm reading through the PDF that Brett Slatkin has published for %subj %. http://tinyurl.com/3523mej In the video (the Fan-in part) Brett says that the work_index has to be a hash, so that 'you distribute the load across the BigTable' http://www.youtube.com/watch?v=zSDC_TU7rtc#t=48m44 And this is how work_index is created: work_index = '%s-%d' % (sum_name, knuth_hash(index)) ...which I guess creates something like 'votesMovieXYZ-54657651321987' My question is why only one half of work_index is hashed? Is it important? Would it be bad to do md5('%s-%d' % (sum_name, index)) so that the hash would be like '6gw8hq6'? Regards J. Záruba -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: app-engine-data-pipelines session video
I was using an integer hash to reduce the key size. You don't need to hash the whole thing. Bigtable will split tablets based on a string prefix, so all that matters is the data distribution beyond that prefix. So foo-hash is just as effective as hash of foo + number, or even better since it's shorter. 2010/6/7 Jaroslav Záruba jaroslav.zar...@gmail.com Thank you, Brett. Would it be wrong to hash whole work_index instead of only hashing its second half? sum_name, knuth_hash(index) By md5-ing only the sequence number I get work_index of 'mySumName' + 32B. If I hashed mySumName together with the seq.number the key would be only 32B. (Still quite huge though.) Given how frequent a vote entity is I would like to have the keys as short as possible. Regards J. Záruba On Mon, Jun 7, 2010 at 11:21 PM, Brett Slatkin brett-appeng...@google.com wrote: Hey all, The int(time.time()/30) part of the task name is to prevent queue stalls. When memcache gets evicted the work index counter will be reset to zero. That means new fork-join work items may insert tasks that are named the same as tasks that were already inserted. By including a time window of ~30 seconds in the task name, we ensure that this problem can only last for about thirty seconds. This is also why you should raise an exception when you see a TombstonedTaskError exception. Worst-case scenario if the clocks are wonky is that two tasks are run to do the fan-in work instead of just one, which is an acceptable trade-off in many cases and a fundamental possibility when using the task queue API. This can be mitigated using pigeon-hole acknowledgment entities, like I use in my materialized view example. Hope that helps, -Brett On Mon, Jun 7, 2010 at 2:14 PM, Tristan tristan.slomin...@gmail.comwrote: not a python guy but, the purpose of int (now / 30) will be to come up with the same name for a span of time (30 milliseconds?). notice that int(1/30) = 0 int (3/30) = 0 int (29/30) = 0 and int(32/30) = 1. this is a way to come up with that task name uniquely. although now i'm confused because doesn't he say later on that time is a bad thing to use for synchronization and sequence numbers should be used instead? On Jun 7, 2:40 am, Jaroslav Záruba jaroslav.zar...@gmail.com wrote: Also if someone knew what is the purpose of now / 30 in the task name, please:http://www.youtube.com/watch?v=zSDC_TU7rtc#t=41m35 Regards J. Záruba 2010/6/7 Jaroslav Záruba jaroslav.zar...@gmail.com Hello I'm reading through the PDF that Brett Slatkin has published for %subj %. http://tinyurl.com/3523mej In the video (the Fan-in part) Brett says that the work_index has to be a hash, so that 'you distribute the load across the BigTable' http://www.youtube.com/watch?v=zSDC_TU7rtc#t=48m44 And this is how work_index is created: work_index = '%s-%d' % (sum_name, knuth_hash(index)) ...which I guess creates something like 'votesMovieXYZ-54657651321987' My question is why only one half of work_index is hashed? Is it important? Would it be bad to do md5('%s-%d' % (sum_name, index)) so that the hash would be like '6gw8hq6'? Regards J. Záruba -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: app-engine-data-pipelines session video
Thanks a lot! On Mon, Jun 7, 2010 at 11:44 PM, Brett Slatkin brett-appeng...@google.comwrote: I was using an integer hash to reduce the key size. You don't need to hash the whole thing. Bigtable will split tablets based on a string prefix, so all that matters is the data distribution beyond that prefix. So foo-hash is just as effective as hash of foo + number, or even better since it's shorter. 2010/6/7 Jaroslav Záruba jaroslav.zar...@gmail.com Thank you, Brett. Would it be wrong to hash whole work_index instead of only hashing its second half? sum_name, knuth_hash(index) By md5-ing only the sequence number I get work_index of 'mySumName' + 32B. If I hashed mySumName together with the seq.number the key would be only 32B. (Still quite huge though.) Given how frequent a vote entity is I would like to have the keys as short as possible. Regards J. Záruba On Mon, Jun 7, 2010 at 11:21 PM, Brett Slatkin brett-appeng...@google.com wrote: Hey all, The int(time.time()/30) part of the task name is to prevent queue stalls. When memcache gets evicted the work index counter will be reset to zero. That means new fork-join work items may insert tasks that are named the same as tasks that were already inserted. By including a time window of ~30 seconds in the task name, we ensure that this problem can only last for about thirty seconds. This is also why you should raise an exception when you see a TombstonedTaskError exception. Worst-case scenario if the clocks are wonky is that two tasks are run to do the fan-in work instead of just one, which is an acceptable trade-off in many cases and a fundamental possibility when using the task queue API. This can be mitigated using pigeon-hole acknowledgment entities, like I use in my materialized view example. Hope that helps, -Brett On Mon, Jun 7, 2010 at 2:14 PM, Tristan tristan.slomin...@gmail.comwrote: not a python guy but, the purpose of int (now / 30) will be to come up with the same name for a span of time (30 milliseconds?). notice that int(1/30) = 0 int (3/30) = 0 int (29/30) = 0 and int(32/30) = 1. this is a way to come up with that task name uniquely. although now i'm confused because doesn't he say later on that time is a bad thing to use for synchronization and sequence numbers should be used instead? On Jun 7, 2:40 am, Jaroslav Záruba jaroslav.zar...@gmail.com wrote: Also if someone knew what is the purpose of now / 30 in the task name, please:http://www.youtube.com/watch?v=zSDC_TU7rtc#t=41m35 Regards J. Záruba 2010/6/7 Jaroslav Záruba jaroslav.zar...@gmail.com Hello I'm reading through the PDF that Brett Slatkin has published for %subj %. http://tinyurl.com/3523mej In the video (the Fan-in part) Brett says that the work_index has to be a hash, so that 'you distribute the load across the BigTable' http://www.youtube.com/watch?v=zSDC_TU7rtc#t=48m44 And this is how work_index is created: work_index = '%s-%d' % (sum_name, knuth_hash(index)) ...which I guess creates something like 'votesMovieXYZ-54657651321987' My question is why only one half of work_index is hashed? Is it important? Would it be bad to do md5('%s-%d' % (sum_name, index)) so that the hash would be like '6gw8hq6'? Regards J. Záruba -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at
Re: [google-appengine] Bulk upload - transform to uppercase?
write a lamba function as lambda x: x.upper() 2010/6/7 Craig Berry cdbe...@gmail.com: I'm a Java guy, so I'm asking for something that's probably pitifully simple, but I can't find it. I need to write a bulk upload import transformer that takes a particular field from my source data and converts it to uppercase before storing it in the datastore. I can find how to convert a python string to uppercase by calling a method on it, but not how to do it as a one-arg transformer function. Any help is appreciated. -- Craig Berry - http://lapidum.org/home.html Magicians lie to the universe, and the universe believes them. -- Lenore Berry -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] GAE anti-DOS mechanism
Look at the Dos sections of the configuration files: app.yaml or app.xml You can permanently block IP ranges, or single IPs 2010/6/7 Timothy Makobu makobu.mwambir...@gmail.com: Hello All, Does GAE have an anti-DOS mechanism? For example, if an IP makes over 10 requests/second, it sends you an email or blocks the IP and sends an email? regards, Tim. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] GAE anti-DOS mechanism
Hi Tim, there is no smart anti-dos mechanism, but you can block specific IP's within dos.yaml in python or alternative configuration. Rgds, Andrius -- Sent from my mobile device On 7 Jun 2010 21:26, Timothy Makobu makobu.mwambir...@gmail.com wrote: Hello All, Does GAE have an anti-DOS mechanism? For example, if an IP makes over 10 requests/second, it sends you an email or blocks the IP and sends an email? regards, Tim. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Reserving instances and datastore performance
I read in the App Engine Product Roadmap that Ability to reserve instances to reduce application loading overhead is planned. Really good! If the price for that will not be too high. http://code.google.com/appengine/docs/roadmap.html But will that also affect the performance of for example the datastore? I have noticed that sometimes the datastore takes a long time to make a put() that usually takes much less time. That's a similar problem to the coldstart load time. It's the load time for an entire page or Ajax call that needs to be fast, and have an even response time. The quality is lowered significantly even when slow responses happen only seldom. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: give me a demo that have 'nomoal user signup' and openid user login
http://github.com/sje397/Chess http://your-move.appspot.com On 8 June 2010 04:20, Tam Vo Minh vo.mita...@gmail.com wrote: Dear friend, You can see http://code.google.com/p/super-easy/ as an example. But I can't check out the source code. If you have, plz share for us. Thanks. On Jun 7, 10:38 am, zjm1126 zjm1...@gmail.com wrote: a demo or a framework on gae -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: can not access appengine.google.com
I think you better address this to Mr. Erdogan or whoever is censoring Internet in Turkey.. Or try through a proxy, as the people from China are doing since ages ago. happy coding ;-) On Jun 7, 10:53 am, enes akar enesa...@gmail.com wrote: Hello; From Turkey I can not access my app-engine dashboard. Currently there is ip based restriction for youtube. For a few days, also we can not reach some google services (docs, appengine, chart api), as some ip's shared by youtube are banned also. So is there a way to connect to appengine, else than appengine.google.com domain. There may be another ip address for appengine. As it is ip based restriction, the 8.8.8.8 dns do not solve the problem. Please help, as I can not reach my dashboard for my applications... -- Enes Akarhttp://www.linkedin.com/pub/enes-akar/7/835/3aa -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Applet cannot find com/google/gdata/util/ServiceException
I'm building an applet in Processing (Java graphics extension) which pulls data from a Google Spreadsheet to populate its internal database. I finally have it to the point where I can and want to run tests in applet form, and I get this error: java.lang.NoClassDefFoundError: com/google/gdata/util/ServiceException This does not happen when I run straight from the local compiler, only in the applet. Looking at the files that were created in the applet folder when I hit Export, I noticed my google library files were not included, but copying them over did not work. Searching the internet returned little results, the only one which showed any promise required my end users to download the google packages onto their machine manually, which ruins the point of making it a web applet. Any suggestions? This is rather important for the project, and I could use some help. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] INFO: This request caused a new process to be started for your application
Hi everyone, Whenever i get the: INFO: This request caused a new process to be started for your application, and thus caused your application code to be loaded for the first time. This request may thus take longer and use more CPU than a typical request for your application. the server returns an empty page. I don know what the problem may me anyone got any clues? has this happend to anyone? this is my handler.py file's header, where i run the main method # -*- coding: utf-8 -*- import sys reload(sys); sys.setdefaultencoding('utf-8') for k in [k for k in sys.modules if k.startswith('django')]: del sys.modules[k] from google.appengine.dist import use_library use_library('django', '1.1') import os os.environ['DJANGO_SETTINGS_MODULE'] = 'settings' Maybe theres the problem? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Bulkupload to local dev server -- key generation?
I am attempting to populate a local dev db using bulk upload (the prerelease version, if that matters). This works fine when I do it to the production datastore at appspot, but when I connect to my local instance (http://localhost:/remote_api), I end up with exactly one record, with an ID of 0. My strong suspicion is that keys are not being generated for the records as they arrive, so they all end up rewriting that one record rather than getting stored as new ones. The __key__ definition fragment in my config file is - property: __key__ external_name: key export_transform: transform.key_id_or_name_as_string Again, this works exactly as expected for production datastore uploads. Any ideas how to make it work for local dev datastore uploads as well? -- Craig Berry - http://lapidum.org/home.html Magicians lie to the universe, and the universe believes them. -- Lenore Berry -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: INFO: This request caused a new process to be started for your application
On Jun 7, 8:53 pm, Francisco Ceruti francisco.cer...@gmail.com wrote: Hi everyone, Whenever i get the: INFO: This request caused a new process to be started for your application, and thus caused your application code to be loaded for the first time. This request may thus take longer and use more CPU than a typical request for your application. the server returns an empty page. I don know what the problem may me anyone got any clues? has this happend to anyone? Are you missing the: if __name__ == __main__: main() clause in your handler file? This is a common cause of this problem; when a new instance is started, the .py file is executed. On subsequent requests, main() is just run if it was cached from an earlier request. If you just define main() without running it, you'll get no output. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Shows Datastore Quota Exceeded (100%) when 149 MB of 1GB only used
What's session data? On Jun 7, 3:03 pm, Ikai L (Google) ika...@google.com wrote: Are you using any indexes? If you have many properties with lots of indexes on them, it's possible the space is taken up by indexes. Another possibility is session data. At any rate, to keep your application going, the quick resolution is to enable billing, which will raise the limit. On Mon, Jun 7, 2010 at 6:27 AM, Apostek Apps apostek.a...@gmail.com wrote: On the Dashboard we are getting Total Stored Data 100% 1.00 of 1.00 GBytes But on the Datastore Statistics we get 149 MBytes as the Size of all entities We are getting- The API call datastore_v3.Put() required more quota than is available. as an exception when we try to insert values in the database. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Ikai Lan Developer Programs Engineer, Google App Engine Blog:http://googleappengine.blogspot.com Twitter:http://twitter.com/app_engine Reddit:http://www.reddit.com/r/appengine -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] get_or_insert and Locks
Just want to make sure: When using get_or_insert(), appengine only locks that entity group and not the entire Kind? Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.