Re: [google-appengine] Re: Appengine down (M/S Datastore)
Dear xxstrom GAE team, My app having data around 30-35 GB and huge indexes as well in M/S app. as per you suggested to migrate on HR, That is fine, the thing is migration could happen in an over night period (around 8 hour's) from M/S to H/R, Because it's a live app and customer access is around 16 hours per day. so per your experience how much time migration would take from M/S to H/R? Seeking your help on this. On Fri, Jun 8, 2012 at 9:04 PM, Strom xxst...@gmail.com wrote: If you want to take it seriously, then migrate to HR. M/S is deprecated and known to fail frequently. On Jun 8, 6:26 pm, Nikhil Jain nikhil.jaint...@gmail.com wrote: Dear Doug, Here in India also we'r promising to our customer about 99.9% up-time servers. but this is truly unprofessional-ism from GAE team. Dear GAE team, please take it this on serious basis, we loosing our customer and accuracy in data as well. Seeking your help on urgent basis On Fri, Jun 8, 2012 at 8:51 PM, doright doug.stodd...@gmail.com wrote: yes, I'm experiencing massive latencies and timeouts M/S datastore too. This is at least the third time its happened in the last few months, AT THE SAME TIME ON A FRIDAY. Googlers, WHATEVER you're doing, or NOT DOING, at this time, please stop! Its end of day, end of week for us here in Europe, so very bad time to be down. www.bikeshopmanager.com On Friday, June 8, 2012 5:15:51 PM UTC+2, Nikhil Jain wrote: At your end is it working, please update?? Appengine team, Please resolved it asap. On Fri, Jun 8, 2012 at 8:31 PM, Nikhil Jain nikhil.jaint...@gmail.comwrote: Appengine seems down, Any idea?? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/0TPZHiOc9UEJ. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Deployment
Dear All, as per my experience (in IT) GAE is ever simplest to deployed than any other. Its does takes hardly 20-30 seconds whether its on python or java. Dear Swapnil, Better is to deploy whole project because while deploying on GAE, GAE clones all static and application files then it compiles it. if any change file it finds in the files with older version then it does loaded into the new version. On Sat, Jun 9, 2012 at 9:55 AM, swapnil khamkar swap...@gmail.com wrote: Hello Wilson, Do i need to deploy only the files which i have changed or the complete project each time? On Thu, Jun 7, 2012 at 10:42 PM, swapnil khamkar swap...@gmail.comwrote: I am not making many changes all the time..but the compiling is taking a lot of time.. On Thu, Jun 7, 2012 at 9:43 PM, Wilson MacGyver wmacgy...@gmail.comwrote: the deployment only upload changes. surely you aren't changing that much each time? On Thu, Jun 7, 2012 at 12:05 PM, swapnil khamkar swap...@gmail.com wrote: Thanksis there any other factor which affects it?? On Thu, Jun 7, 2012 at 5:52 AM, Leandro Rezende leandro.reze...@gmail.com wrote: i have noticed that if i change only HTML files, the deployment is faster, but, if i change any line in a .JAVA, the deploy becomes slower 2012/6/6 swapnil khamkar swap...@gmail.com do the jstl like c: or sec: affect the deployment time? do you no which factors have an imp-act on the deployment time?? Thanks... On Wednesday, June 6, 2012 11:49:56 AM UTC+5:30, alex wrote: Sounds like a dialup to me. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/3GkU9vfQZioJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Omnem crede diem tibi diluxisse supremum. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- *Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566* -- *Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566* -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Deployment
Thank Nikhil, But my project is taking around 3 hours to get deployed. The compiling takes much time. My project is around 32Mb in size. What could be the reason any idea? On Sat, Jun 9, 2012 at 12:00 PM, Nikhil Jain nikhil.jaint...@gmail.comwrote: Dear All, as per my experience (in IT) GAE is ever simplest to deployed than any other. Its does takes hardly 20-30 seconds whether its on python or java. Dear Swapnil, Better is to deploy whole project because while deploying on GAE, GAE clones all static and application files then it compiles it. if any change file it finds in the files with older version then it does loaded into the new version. On Sat, Jun 9, 2012 at 9:55 AM, swapnil khamkar swap...@gmail.com wrote: Hello Wilson, Do i need to deploy only the files which i have changed or the complete project each time? On Thu, Jun 7, 2012 at 10:42 PM, swapnil khamkar swap...@gmail.comwrote: I am not making many changes all the time..but the compiling is taking a lot of time.. On Thu, Jun 7, 2012 at 9:43 PM, Wilson MacGyver wmacgy...@gmail.comwrote: the deployment only upload changes. surely you aren't changing that much each time? On Thu, Jun 7, 2012 at 12:05 PM, swapnil khamkar swap...@gmail.com wrote: Thanksis there any other factor which affects it?? On Thu, Jun 7, 2012 at 5:52 AM, Leandro Rezende leandro.reze...@gmail.com wrote: i have noticed that if i change only HTML files, the deployment is faster, but, if i change any line in a .JAVA, the deploy becomes slower 2012/6/6 swapnil khamkar swap...@gmail.com do the jstl like c: or sec: affect the deployment time? do you no which factors have an imp-act on the deployment time?? Thanks... On Wednesday, June 6, 2012 11:49:56 AM UTC+5:30, alex wrote: Sounds like a dialup to me. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/3GkU9vfQZioJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Omnem crede diem tibi diluxisse supremum. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- *Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566* -- *Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566* -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- *Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566* -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Deployment
But my project size is of around 45-50 Mb working for me (In Python). BTW which SDK version are you using? On Sat, Jun 9, 2012 at 12:42 PM, swapnil khamkar swap...@gmail.com wrote: Thank Nikhil, But my project is taking around 3 hours to get deployed. The compiling takes much time. My project is around 32Mb in size. What could be the reason any idea? On Sat, Jun 9, 2012 at 12:00 PM, Nikhil Jain nikhil.jaint...@gmail.comwrote: Dear All, as per my experience (in IT) GAE is ever simplest to deployed than any other. Its does takes hardly 20-30 seconds whether its on python or java. Dear Swapnil, Better is to deploy whole project because while deploying on GAE, GAE clones all static and application files then it compiles it. if any change file it finds in the files with older version then it does loaded into the new version. On Sat, Jun 9, 2012 at 9:55 AM, swapnil khamkar swap...@gmail.comwrote: Hello Wilson, Do i need to deploy only the files which i have changed or the complete project each time? On Thu, Jun 7, 2012 at 10:42 PM, swapnil khamkar swap...@gmail.comwrote: I am not making many changes all the time..but the compiling is taking a lot of time.. On Thu, Jun 7, 2012 at 9:43 PM, Wilson MacGyver wmacgy...@gmail.comwrote: the deployment only upload changes. surely you aren't changing that much each time? On Thu, Jun 7, 2012 at 12:05 PM, swapnil khamkar swap...@gmail.com wrote: Thanksis there any other factor which affects it?? On Thu, Jun 7, 2012 at 5:52 AM, Leandro Rezende leandro.reze...@gmail.com wrote: i have noticed that if i change only HTML files, the deployment is faster, but, if i change any line in a .JAVA, the deploy becomes slower 2012/6/6 swapnil khamkar swap...@gmail.com do the jstl like c: or sec: affect the deployment time? do you no which factors have an imp-act on the deployment time?? Thanks... On Wednesday, June 6, 2012 11:49:56 AM UTC+5:30, alex wrote: Sounds like a dialup to me. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/3GkU9vfQZioJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Omnem crede diem tibi diluxisse supremum. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- *Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566* -- *Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566* -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- *Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566* -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send
Re: [google-appengine] Deployment
i am using 1.6.6 previously i was using 1.5.2. It had the same problem. I am using taglib, is it the thing?or are there any other factors that are affecting it? On Sat, Jun 9, 2012 at 1:04 PM, Nikhil Jain nikhil.jaint...@gmail.comwrote: But my project size is of around 45-50 Mb working for me (In Python). BTW which SDK version are you using? On Sat, Jun 9, 2012 at 12:42 PM, swapnil khamkar swap...@gmail.comwrote: Thank Nikhil, But my project is taking around 3 hours to get deployed. The compiling takes much time. My project is around 32Mb in size. What could be the reason any idea? On Sat, Jun 9, 2012 at 12:00 PM, Nikhil Jain nikhil.jaint...@gmail.comwrote: Dear All, as per my experience (in IT) GAE is ever simplest to deployed than any other. Its does takes hardly 20-30 seconds whether its on python or java. Dear Swapnil, Better is to deploy whole project because while deploying on GAE, GAE clones all static and application files then it compiles it. if any change file it finds in the files with older version then it does loaded into the new version. On Sat, Jun 9, 2012 at 9:55 AM, swapnil khamkar swap...@gmail.comwrote: Hello Wilson, Do i need to deploy only the files which i have changed or the complete project each time? On Thu, Jun 7, 2012 at 10:42 PM, swapnil khamkar swap...@gmail.comwrote: I am not making many changes all the time..but the compiling is taking a lot of time.. On Thu, Jun 7, 2012 at 9:43 PM, Wilson MacGyver wmacgy...@gmail.comwrote: the deployment only upload changes. surely you aren't changing that much each time? On Thu, Jun 7, 2012 at 12:05 PM, swapnil khamkar swap...@gmail.com wrote: Thanksis there any other factor which affects it?? On Thu, Jun 7, 2012 at 5:52 AM, Leandro Rezende leandro.reze...@gmail.com wrote: i have noticed that if i change only HTML files, the deployment is faster, but, if i change any line in a .JAVA, the deploy becomes slower 2012/6/6 swapnil khamkar swap...@gmail.com do the jstl like c: or sec: affect the deployment time? do you no which factors have an imp-act on the deployment time?? Thanks... On Wednesday, June 6, 2012 11:49:56 AM UTC+5:30, alex wrote: Sounds like a dialup to me. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/3GkU9vfQZioJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Omnem crede diem tibi diluxisse supremum. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- *Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566* -- *Earn with less efforts. http://mGinger.com/index.jsp?inviteId=1023566* -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- *Earn with less efforts.
[google-appengine] Re: Error in JDO Persistence Manager
1. Here's the stack trace : Please advise Error for /sync_contacts java.lang.ExceptionInInitializerError at iiitd.mobishare.ContactsSync.doPost(ContactsSync.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:637) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1166) at com.google.apphosting.utils.servlet.ParseBlobUploadFilter.doFilter(ParseBlobUploadFilter.java:102) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157) at com.google.apphosting.runtime.jetty.SaveSessionFilter.doFilter(SaveSessionFilter.java:35) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157) at com.google.apphosting.utils.servlet.TransactionCleanupFilter.doFilter(TransactionCleanupFilter.java:43) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:388) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418) at com.google.apphosting.runtime.jetty.AppVersionHandlerMap.handle(AppVersionHandlerMap.java:249) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:923) at com.google.apphosting.runtime.jetty.RpcRequestParser.parseAvailable(RpcRequestParser.java:76) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at com.google.apphosting.runtime.jetty.JettyServletEngineAdapter.serviceRequest(JettyServletEngineAdapter.java:135) at com.google.apphosting.runtime.JavaRuntime$RequestRunnable.run(JavaRuntime.java:477) at com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449) at com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455) at com.google.tracing.TraceContext.runInContext(TraceContext.java:695) at com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333) at com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325) at com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453) at com.google.apphosting.runtime.ThreadGroupPool$PoolEntry.run(ThreadGroupPool.java:251) at java.lang.Thread.run(Thread.java:679) Caused by: javax.jdo.JDOFatalInternalException: Unexpected exception caught. NestedThrowables: java.lang.reflect.InvocationTargetException at javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1186) at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:803) at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:1086) at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:914) at iiitd.mobishare.PMF.clinit(PMF.java:9) ... 33 more Caused by: java.lang.reflect.InvocationTargetException at com.google.appengine.runtime.Request.process-064281f1396ec8b6(Request.java) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at java.security.AccessController.doPrivileged(AccessController.java:63) at javax.jdo.JDOHelper.invoke(JDOHelper.java:1951) at javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1159) at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:803) at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:1086) at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:914) at iiitd.mobishare.PMF.clinit(PMF.java:9) at iiitd.mobishare.ContactsSync.doPost(ContactsSync.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:637) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at
[google-appengine] Re: Simple cron job in google app engine (python)
cron uses GET, not POST. j On Jun 8, 2:35 am, afroze 08beeabaqap...@seecs.edu.pk wrote: I need help in implementing a simple cron job in GAE (python). According to what I understood from appengine documentation, I made a file cron.yaml in the application root directory with the following content: cron: - description: blah blah url: /crontask schedule: every 1 minute And my app.yaml file has the following content: application: template-123 version: 1 runtime: python27 api_version: 1 threadsafe: true handlers: - url: /.* script: template-123.app I made all my application code (cron and other parts) into a single file template-123.py. In the code I implement cron in the following way: class CronTask(Handler): def post(self): i=25 number = Birthday(day = i) number.put() And I tell the code to use this class for cron by stating: ('/crontask', CronTask). However no new entries are uploaded to the datastore (as I believe they should be). And I know that it isn't a problem with the way I'm accessing the data store because when I try to do the same thing manually (upload entries to the data store in my non-cron part of application) it returns with appropriate results. So I need some guidance as to what might I be doing wrong or missing? Do have to make some more changes to the yaml files or add some other libraries or files (i think i read somewhere about cron.xml file but it wasn't mentioned in the documentation..) etc? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Datastore Backup / Restore by namespace. Is scripting on servers such as Amazon the only solution ?
I encourage you (and everyone) to star this: http://code.google.com/p/googleappengine/issues/detail?id=7428 j On Jun 8, 1:03 pm, hugues2 hugues.flam...@gmail.com wrote: Hi, I am trying to develop a functionality to backup and restore data in the datastore by namespace. Is the following correct ? -- The datastore admin as it stands today only allows to backup / restore the complete datastore i.e. not by namespace -- The only tool available to extract / load data by namespace is bulkloader and this tool cannot be scheduled on the server but has to be called from a client. == If these two statements are correct, I see no other option that deploying a script on an external server such as Amazon which would connect on GAE to extract data by namespace. My questions would be the following -- Is this conclusion correct ? -- Is someone (at Google or external) working on extending the backup / restore by namespace ? Thanks for your help, Hugues -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Datastore Backup / Restore by namespace. Is scripting on servers such as Amazon the only solution ?
backup.yaml sounds nice but what stops you from going 1 step further and implementing it using scheduled tasks service? (cron.yaml) All pieces are already there, you just need to connect them together. -- alex On Saturday, June 9, 2012 7:39:19 PM UTC+2, Jason Collins wrote: I encourage you (and everyone) to star this: http://code.google.com/p/googleappengine/issues/detail?id=7428 j On Jun 8, 1:03 pm, hugues2 hugues.flam...@gmail.com wrote: Hi, I am trying to develop a functionality to backup and restore data in the datastore by namespace. Is the following correct ? -- The datastore admin as it stands today only allows to backup / restore the complete datastore i.e. not by namespace -- The only tool available to extract / load data by namespace is bulkloader and this tool cannot be scheduled on the server but has to be called from a client. == If these two statements are correct, I see no other option that deploying a script on an external server such as Amazon which would connect on GAE to extract data by namespace. My questions would be the following -- Is this conclusion correct ? -- Is someone (at Google or external) working on extending the backup / restore by namespace ? Thanks for your help, Hugues -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/gBn6vFGcIhYJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Log approach for dynamic html page
I am asking this here rather than SO because I am not sure it qualifies as a well-formed question. For a site I am putting up, I am going with quite a few dynamic div elements in the main page (index.html). Small informative site, so each div corresponds to a chunk of info. Rather than code a new page for each chunk, it seems cleaner to me to use style=display/none for different divs that all load at the same time. Problem is that I do want some logging to support analyzing how folks move through the site. The approach I have settled on is to create a unique visitor ID, and ping my GAE handler with a XMLHttpRequest with its payload = visitorID:buttonID (UTC time is part of visitorID). The handler does nothing more than pass the call's payload to a pull task queue (avgs 40ms). An every few minutes cron executes pull task queue which serializes 5,000 payloads into a TextProperty which it puts as a log entity. Each cron will process up to 10 puts, or 50,000 payloads. I later download these recs to MySQL for in-depth analysis at my leisure. This has, I am pretty sure, problems if the site gets any real volume. Honestly, I do not think that will every be an issue, but who knows. Would appreciate input as to alternate approaches. HTML web page implementations + GAE is clearly not an arrow in my quiver. thanks, stevep -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Datastore Backup / Restore by namespace. Is scripting on servers such as Amazon the only solution ?
We are working hard on improving the built-in backup experience, but in the meantime: The datastore admin is open source so you can make the backup MR do what every you want: http://code.google.com/p/googleappengine/source/browse/trunk/python/google/appengine/ext/datastore_admin/backup_handler.py You can already use cron.yaml to schedule backups: https://developers.google.com/appengine/articles/scheduled_backups On Sat, Jun 9, 2012 at 11:04 AM, alex a...@cloudware.it wrote: backup.yaml sounds nice but what stops you from going 1 step further and implementing it using scheduled tasks service? (cron.yaml) All pieces are already there, you just need to connect them together. -- alex On Saturday, June 9, 2012 7:39:19 PM UTC+2, Jason Collins wrote: I encourage you (and everyone) to star this: http://code.google.com/p/**googleappengine/issues/detail?**id=7428http://code.google.com/p/googleappengine/issues/detail?id=7428 j On Jun 8, 1:03 pm, hugues2 hugues.flam...@gmail.com wrote: Hi, I am trying to develop a functionality to backup and restore data in the datastore by namespace. Is the following correct ? -- The datastore admin as it stands today only allows to backup / restore the complete datastore i.e. not by namespace -- The only tool available to extract / load data by namespace is bulkloader and this tool cannot be scheduled on the server but has to be called from a client. == If these two statements are correct, I see no other option that deploying a script on an external server such as Amazon which would connect on GAE to extract data by namespace. My questions would be the following -- Is this conclusion correct ? -- Is someone (at Google or external) working on extending the backup / restore by namespace ? Thanks for your help, Hugues -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/gBn6vFGcIhYJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Log approach for dynamic html page
Have you considered Events in Google Analytics? If that's not powerful enough, perhaps consider Mixpanel? Jeff On Sat, Jun 9, 2012 at 11:14 AM, stevep prosse...@gmail.com wrote: I am asking this here rather than SO because I am not sure it qualifies as a well-formed question. For a site I am putting up, I am going with quite a few dynamic div elements in the main page (index.html). Small informative site, so each div corresponds to a chunk of info. Rather than code a new page for each chunk, it seems cleaner to me to use style=display/none for different divs that all load at the same time. Problem is that I do want some logging to support analyzing how folks move through the site. The approach I have settled on is to create a unique visitor ID, and ping my GAE handler with a XMLHttpRequest with its payload = visitorID:buttonID (UTC time is part of visitorID). The handler does nothing more than pass the call's payload to a pull task queue (avgs 40ms). An every few minutes cron executes pull task queue which serializes 5,000 payloads into a TextProperty which it puts as a log entity. Each cron will process up to 10 puts, or 50,000 payloads. I later download these recs to MySQL for in-depth analysis at my leisure. This has, I am pretty sure, problems if the site gets any real volume. Honestly, I do not think that will every be an issue, but who knows. Would appreciate input as to alternate approaches. HTML web page implementations + GAE is clearly not an arrow in my quiver. thanks, stevep -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Log approach for dynamic html page
Yep, that's the ticket. Thanks. -stevep On Jun 9, 2:43 pm, Jeff Schnitzer j...@infohazard.org wrote: Have you considered Events in Google Analytics? If that's not powerful enough, perhaps consider Mixpanel? Jeff On Sat, Jun 9, 2012 at 11:14 AM, stevep prosse...@gmail.com wrote: I am asking this here rather than SO because I am not sure it qualifies as a well-formed question. For a site I am putting up, I am going with quite a few dynamic div elements in the main page (index.html). Small informative site, so each div corresponds to a chunk of info. Rather than code a new page for each chunk, it seems cleaner to me to use style=display/none for different divs that all load at the same time. Problem is that I do want some logging to support analyzing how folks move through the site. The approach I have settled on is to create a unique visitor ID, and ping my GAE handler with a XMLHttpRequest with its payload = visitorID:buttonID (UTC time is part of visitorID). The handler does nothing more than pass the call's payload to a pull task queue (avgs 40ms). An every few minutes cron executes pull task queue which serializes 5,000 payloads into a TextProperty which it puts as a log entity. Each cron will process up to 10 puts, or 50,000 payloads. I later download these recs to MySQL for in-depth analysis at my leisure. This has, I am pretty sure, problems if the site gets any real volume. Honestly, I do not think that will every be an issue, but who knows. Would appreciate input as to alternate approaches. HTML web page implementations + GAE is clearly not an arrow in my quiver. thanks, stevep -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] GAE Python DB change Broke My App!
Thanks for the reply Alfred. Sorry for the delayed response. I'm only able to work on this on the weekend and I spent all last weekend porting to a different framework to debug the problem. TL;DR - Despite crashing more often than not, I could never identify where the keyless encoded entities were being created. My app was last deployed around Thanksgiving 2010 using whatever was the then current sdk. It was created on top of the Kay framework. When I installed the latest SDK (to get this code breaking change), Kay spit out errors. Even after I upgraded to the latest Kay release the dev appserver still wouldn't run. So I couldn't reproduce the problem in an environment where I could dig in to the entities causing the crash. On the production servers, I could track down that the problems were from decoding memcache'd entities. But since you can't browse the memcache entries (like the datastore) without knowing specific keys, I couldn't dig very deep there either. Finally I gave up and started porting my app off of Kay and on to the latest webob webapp2 releases that still support python 2.5. When I was able to redeploy on that foundation, the problem disappeared. I was pretty aggravated to have my app crashy for so long and then to lose a weekend to porting it, but at least the update has gotten me 75% of the way towards getting the app ported to the 2.7 runtime. Thanks again for the reply with the source link. If the problem rears it's head again I'll be better prepared to know where to look. Regards, Steve On Sunday, June 3, 2012 12:22:39 PM UTC-10, Alfred Fuller wrote: Hi Steve, We try to avoid backwards incompatible changes as much as possible. You will get an expando when the decoded proto does not have a key (as in this case the correct model class cannot be determined, see http://code.google.com/p/googleappengine/source/browse/trunk/python/google/appengine/api/datastore.py#1086). Are you passing in an empty string to the decode function? Anything that produces an expando should have failed to encode and decode before (with an exception). Do you have a byte string (print '%r' % encoded_proto) you can send me for testing? Thanks, Alfred On Sun, Jun 3, 2012 at 2:30 PM, Steve unetright.thebas...@xoxy.netwrote: I'm mistaken. It's not a problem with Nones. I still can't figure out why sometimes I'm getting an Exapndo and my app crashes. My app doesn't use any Expandos. Google, why u make backwards incompatible change?? --Steve On Saturday, June 2, 2012 5:16:21 PM UTC-10, Steve wrote: The problem seems to be that previously I could encode None to a protobuf and get a None back from decoding. Now instead of None, I get the new default_kind Expando. --Steve On Saturday, June 2, 2012 2:33:11 PM UTC-10, barryhunter wrote: Maybe it would help to actually explain how you are using it - what exactly is broken? Just saying 'its broken' doesnt go very far to explain the issue you facing. Let alone being enough for anyone to figure out a solution that could help you. On Sun, Jun 3, 2012 at 12:48 AM, Steve unetright.thebas...@xoxy.net wrote: Revision 262 comitted on May 22 shows a change to /trunk/python/google/**appengine/ext/db/__init__.py which added a default_kind=Expando inside model_from_protobuf. This has broken my application for the last couple weeks. The change is not something I can override through exposed parameters. How am I supposed to fix this without significantly rewriting my app? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/**msg/google-appengine/-/**bVd8KrYiaxwJhttps://groups.google.com/d/msg/google-appengine/-/bVd8KrYiaxwJ. To post to this group, send email to google-appengine@googlegroups.** com google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscribe@**googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/**group/google-appengine?hl=enhttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/CCbrNcjrfvYJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit
[google-appengine] Datastore Statistics Not Updating
*Am I not understanding how this is supposed to work?* https://lh6.googleusercontent.com/-dYLWx8pxPoc/T9QQbEqZuFI/D-4/BJzqe6_NJVM/s1600/statistics..png -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/c4Hx0bKgECIJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Datastore Backup / Restore by namespace. Is scripting on servers such as Amazon the only solution ?
Alfred, Thanks a lot for your feedback. It really helps to know that you are working hard on improving the backup functionalities. Very much appreciated. With regards to extending the backup open source code, unfortunately it is written in python and I am not yet familiar enough with this programming language to do a correct job. I could learn it and extend the backup code but it would distract me too much from other stuff. Didn't say it in the original post but GAE is really a great tool to work with. It has really incredible and exciting features. Once again, thanks for improving the backup / restore functionalities. It will really help the community in concentrating on core added-value functionalities. Alex, Thanks for your suggestion. Will look into it. Jason, I did star the issue. Very good description of the functionalities required for the backup / restore. Hugues Le vendredi 8 juin 2012 21:03:12 UTC+2, hugues2 a écrit : Hi, I am trying to develop a functionality to backup and restore data in the datastore by namespace. Is the following correct ? -- The datastore admin as it stands today only allows to backup / restore the complete datastore i.e. not by namespace -- The only tool available to extract / load data by namespace is bulkloader and this tool cannot be scheduled on the server but has to be called from a client. == If these two statements are correct, I see no other option that deploying a script on an external server such as Amazon which would connect on GAE to extract data by namespace. My questions would be the following -- Is this conclusion correct ? -- Is someone (at Google or external) working on extending the backup / restore by namespace ? Thanks for your help, Hugues -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/_8D4oPkxWvgJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.